Marcel Müller
M.Sc. Marcel Müller
Junior Professorship for »Artificial Intelligence (AI) - Application in Production and Logistics«
Current projects
GenAI4FFD - Einsatz Generativer KI-Modelle zur Unterstützung der Planung von Fabriken zur Steigerung der Versorgungssicherheit in Deutschland
Duration: 01.02.2025 to 31.01.2028
Für Fabrikplanungsprojekte werden eine Fülle an Informationen in unterschiedlichsten Formaten und
Varianz zu den einzelnen Elementen des Planungsgegenstands benötigt. Diese liegen zum einen in
verschiedenen Systemen, Darstellungsformen und Softwareapplikationen vor oder können zum anderen nur über Gespräche in Erfahrung gebracht werden. Das Sortieren und die Bewertung heterogener Datenmengen hinsichtlich der geeigneten Qualität und Vollständigkeit nimmt viel Zeit in Anspruch. Mithilfe von KI-Ansätzen (Clustering und Classification-Verfahren) kann dieser Aufwand im Vergleich zum derzeitigen manuellen oder teilautomatisierten Ansatz erheblich reduziert werden.
Im Rahmen des Projektvorhabens GenAI4FFD wird auf Basis von Generativer Künstlicher Intelligenz
(GenAI) ein Assistenzsystem entwickelt, das in den frühen Phasen des Fabrikplanungsprozesses
unterstützt – vom Beginn der Zielfestlegung bis zum Abschluss der Detailplanung. Dazu wird im ersten Schritt eine fabrikplanungsspezifische GenAI-basierte Lösung entwickelt werden, welche im Rahmen des Projekts prototypisch für drei zentrale Aufgabenfelder der Fabrikplanung zum Einsatz gebracht wird:
- Anforderungsaufnahme und -analyse,
- Generierung von Fabrikdesigns,
- Modellerstellung und Evaluation.
Bestehende europäische GenAI-Modelle werden verglichen, bewertet und auf das Fabrikplanungswissen spezialisiert. Dazu wird Fachliteratur, relevante Normen und Richtlinien und vor allem Daten aus abgeschlossenen Fabrikplanungsprojekten mit Betriebsinformationen zu deren Performance und Rahmenbedingungen verwendet. Dies ist die Basis für die drei Anwendungsfelder, die dann prototypisch zum einen über das Digitale Raumbuch und zum anderen als eigenständige Webinstanz und Aggregator in Planungs- und Simulationssoftware implementiert werden. Parallel wird geprüft wie die Lösung auf weitere Planungsfragestellung, wie die Wohnraumentwicklung übertragen und für KMU leicht verwendet werden kann.
AI Engineering - An interdisciplinary, project-oriented bachelor's degree program with a focus on artificial intelligence and engineering.
Duration: 01.12.2021 to 30.11.2025
AI Engineering (AiEng) encompasses the systematic design, development, integration and operation of solutions based on artificial intelligence (AI) using engineering methods as a model. At the same time, AiEng builds a bridge between basic research on AI methods and the engineering sciences and makes the use of AI systematically accessible and available there. The project focuses on the nationwide development of an "AI Engineering" Bachelor's degree program, which combines the training of AI methods, models and technologies with those of engineering sciences. AiEng is to be designed as a cooperative study program between Otto von Guericke University (OVGU) Magdeburg and the four universities in Saxony-Anhalt: Anhalt University of Applied Sciences, Harz University of Applied Sciences, Magdeburg-Stendal University of Applied Sciences and Merseburg University of Applied Sciences. The interdisciplinary degree program will enable students to develop AI systems and services in the industrial environment and beyond and to provide holistic support for the associated engineering process - from problem analysis to commissioning and maintenance / servicing. The AiEng curriculum provides comprehensive AI training, supplemented by basic engineering training and in-depth training in a selected application domain. In order to achieve a symbiosis of AI and engineering education, a new action-oriented framework is developed and taught, which describes the complete engineering process of AI solutions and methodically supports all phases. AIEng is characterized by a cross-module interlocking of teaching and learning content within a semester as well as by a cross-faculty and cross-university tandem teaching concept and pursues a student-centered didactic concept, which is supported by many practice-oriented (team) projects and a wide range of Open Educational Resources (OERs) with an (e)-tutor program.
Completed projects
Multi-Agent Reinforcement Learning for Deadlock Handling among Autonomous Mobile Robots
Duration: 15.06.2020 to 27.10.2025
This dissertation explores the application of multi-agent reinforcement learning (MARL) for
handling deadlocks in intralogistics systems that rely on autonomous mobile robots (AMRs).
AMRs enhance operational flexibility but also increase the risk of deadlocks, which degrade system
throughput and reliability. Existing approaches often neglect deadlock handling in the planning
phase and rely on rigid control rules that cannot adapt to dynamic operational conditions.
To address these shortcomings, this work develops a structured methodology for integrating
MARL into logistics planning and operational control. It introduces reference model that explicitly
consider deadlock-capable multi-agent pathfinding (MAPF) problems, enabling systematic
evaluation of MARL strategies. Using grid-based environments and an external simulation
softare, the study compares traditional deadlock handling strategies with MARL-based solutions,
focusing on PPO and IMPALA algorithms under different training and execution modes.
Findings reveal that MARL-based strategies, particularly when combined with centralized
training and decentralized execution (CTDE), outperform rule-based methods in complex,
congested environments. In simpler environments or those with ample spatial freedom, rulebased
methods remain competitive due to their lower computational demands. These results
highlight that MARL provides a flexible and scalable solution for deadlock handling in dynamic
intralogistics scenarios, but requires careful tailoring to the operational context.
Geodesign for urban and logistics planning of the tourism sector with VR visualization
Duration: 01.11.2022 to 31.10.2024
Within the R&D project "GEOSTALOVR", the development of a simulation-based geodesign platform for planning logistics and tourism in European cities is planned. By means of VR visualization and interaction possibilities, the planning process is to be digitalized throughout, democratized and made more human-centered. The development is being realized in an international cooperation project with Turkey in collaboration with three SME partners (LS Software & Engineering GmbH, Globetech Cografi Bilgi Teknolojileri Yazilim Planlama Harita Enerji Egitim Mühendislik Danismanlik Limited and Elf Sehir Planlama) and two research partners (Otto von Guericke University Magdeburg and Harran University). The project is designed to run for two years. A prototypical setup and testing of the system is planned based on the city of Sanliurfa in Turkey. The project emerged from the network "NekoS" and is accompanied by the network management (ZPVP GmbH) during the implementation.
Simulation and testing platform for innovative storage concepts
Duration: 01.09.2022 to 28.02.2023
Development, implementation and evaluation of a simulation and test platform for the development and evaluation of algorithms and strategies for innovative warehouse concepts in manufacturing companies.
LogCentre - Logistics Trainings (LogTraining)
Duration: 15.10.2021 to 31.12.2021
The project aims to enable the LogCentre of the German-Kazakh University (DKU) to provide trainings in the areas of
- Transport
- Business games in production and logistics
- Simulation, optimization and AI for decision support in production and logistics
- Urban and sustainable logistics
on the Kazakh market and to be able to carry them out on a self-supporting basis. The target group of the trainings are companies operating in Kazakhstan and Central Asia as well as governmental organizations such as city administrations and universities.
For this purpose, the following work packages are to be processed jointly by OVGU and DKU in the project:
- Project and risk management
- Needs analysis
- Business plan
- Selection and training of DKU LogCentre personnel
- Creation of concept and materials for the training measures
- Pilot trainings with German-Kazakh trainer tandems in the above mentioned areas
- Commercial trainings in the above mentioned areas
- Communication and marketing
Development of a Bologna-based Master Curriculum in Resource Efficient Production Logistics (ProdLog)
Duration: 01.12.2017 to 15.10.2021
ProdLog addresses the issue of a weak industrial sector in Kazakhstan, Kyrgyzstan and Russian Federation and focuses on enabling universities to gain and provide a profound and holistic knowledge on planning and operating sustainable production processes. For that purpose a bologna-based master curriculum with 18 modules in resource efficient production logistics will be developed and implemented in six universities of the partner countries. The academic staff will be trained with innovative teaching methods in the learning factory "Technology centre for production and logistics systems PULS" and equipped with state of the art logistics laboratories. By means of that, the understanding of logistics shall be widened - away from transport logistics to a systemic and interdisciplinary approach of applicant-oriented education, challenges with economical, political and social problems of our society.
Connecting material flow simulation models based on Plant Simulation with a digital twin of production plants and a visualization platform
Duration: 01.03.2020 to 31.07.2020
Development of material flow simulation models based on Plant Simulation and the development of a connection of these with a digital twin of production plants and a visualization platform with the work packages:
- Basic development of a connection of a material flow simulation with a digital twin of a production plant and basic visualization in a 360 degree visualization system
- Development of an extended material flow simulation
LOCsys - Laundry Order Consolidation System
Duration: 01.01.2018 to 29.02.2020
The R&D project "LOCSys" (Laundry Order Consolidation System) aims to develop and test an innovative, automatic system for buffering, consolidating and picking customer-related, small-scale laundry orders in industrial laundries.
The development is being realized in a cooperative project involving three SME partners (EBF Dresden GmbH, FRAIMTEC Automation & Anlagenmontage GmbH and Ematik GmbH) and two research partners (Otto von Guericke University, Fraunhofer IFF). The planned project is designed to run for 2 years. A prototype assembly and testing of the system is planned at the Puschendorf Textilservice GmbH site in Flechtigen or Schönebeck.
The proposed project is an R&D project that emerged from the ZIM network "NekoS" and will be supported in its implementation by the network management facility, ZPVP Zentrum für Produkt-, Verfahrens- und Prozessinnovation GmbH - Experimentelle Fabrik Magdeburg.
The "LOCSys" project is funded as a joint project by the BMWi as part of the Central Innovation Program for SMEs (ZIM).
This text was translated with DeepL
2025
Peer-reviewed journal article
Design of a data integration and exchange service for touristic city and logistics planning in Şanlıurfa, Turkey
Reider, Richard; Mukku, Vasu Dev; Müller, Marcel; Reggelin, Tobias; Ernst, Fred Barış; Lang, Sebastian
In: Procedia computer science - Amsterdam [u.a.] : Elsevier, Bd. 253 (2025), S. 3000-3006
2024
Peer-reviewed journal article
A review on unsupervised learning algorithms and applications in supply chain management
Rolf, Benjamin; Beier, Alexander; Jackson, Ilya; Müller, Marcel; Reggelin, Tobias; Stuckenschmidt, Heiner; Lang, Sebastian
In: International journal of production research - London [u.a.] : Taylor & Francis, Bd. 63 (2025), Heft 5, S. 1933-1983
A review on unsupervised learning algorithms and applications in supply chain management
Rolf, Benjamin; Beier, Alexander; Jackson, Ilya; Müller, Marcel; Reggelin, Tobias; Stuckenschmidt, Heiner; Lang, Sebastian
In: International journal of production research - London [u.a.] : Taylor & Francis . - 2024, insges. 51 S. [Online first]
A modular simulation testbed for logistics and urban planning in tourism
Mukku, Vasu Dev; Reider, Richard; Reggelin, Tobias; Müller, Marcel; Ernst, Fred Baris; Lang, Sebastian
In: Transport and telecommunication journal - Warsaw : Versita, Bd. 25 (2024), Heft 4, S. 370-377
2023
Book chapter
Multi-agent proximal policy optimization for a deadlock capable transport system in a simulation-based learning environment
Müller, Marcel; Reyes-Rubiano, Lorena S.; Reggelin, Tobias; Zadek, Hartmut
In: 2023 Winter Simulation Conference (WSC) - [Piscataway, NJ] : IEEE, insges. 12 S. [Konferenz: Winter Simulation Conference, WSC, San Antonio, TX, USA, 10-13 December 2023]
A framework for applying reinforcement learning to deadlock handling in intralogistics
Müller, Marcel; Reyes-Rubiano, Lorena Silvana; Reggelin, Tobias; Zadek, Hartmut
In: 2023 International Scientific Symposium on Logistics - Bremen : BVL International, Bundesvereinigung Logistik (BVL) e.V. ; Schmidt, Thorsten, S. 107-121 [Symposium: 2023 International Scientific Symposium on Logistics, Dresden, 19 - 20 June 2023]
Integrating home healthcare and patient transportation - a sample average approximation approach to optimize scheduling and routing
Reyes-Rubiano, Lorena S.; Müller, Marcel; Sarmiento, Angelica; Guerrero, William; Voegl, Jana; Hirsch, Patrick
In: 2023 Winter Simulation Conference (WSC) - [Piscataway, NJ] : IEEE, insges. 12 S. [Konferenz: Winter Simulation Conference, WSC, San Antonio, TX, USA, 10-13 December 2023]
Ereignisdiskrete Modellierung autonomer Transportfahrzeuge mittels Open-Source Software - Discrete-event modelling of autonomous transport vehicles using open-source software
Artiushenko, Viktor; Müller, Marcel; Reggelin, Tobias; Lang, Sebastian
In: Simulation in Produktion und Logistik 2023 / ASIM-Fachtagung Simulation in Produktion und Logistik , 2023 - Ilmenau : Universitätsverlag Ilmenau ; Bergmann, Sören *1979-*, S. 271-280 [Tagung: 20. ASIM Fachtagung Simulation in Produktion und Logistik, Ilmenau, 13-15. September 2023]
Towards deadlock handling with machine learning in a simulation-based learning environment
Müller, Marcel; Reggelin, Tobias; Kutsenko, Iegor; Zadek, Hartmut; Reyes-Rubiano, Lorena Silvana
In: 2022 Winter Simulation Conference (WSC) , 2022 - [Piscataway, NJ] : IEEE ; Feng, B. . - 2023 [Konferenz: Winter Simulation Conference, WSC, Singapore, 11-14 December 2022]
2022
Book chapter
Planung logistischer Systeme
Glistau, Elke; Trojahn, Sebastian; Dittrich, Ingo; Müller, Marcel; Rolf, Benjamin; Reggelin, Tobias
In: Grundlagen der Logistik - Theorie und Praxis logistischer Systeme , 5., vollständig aktualisierte und erweiterte Auflage - München : huss ; Trojahn, Sebastian *1982-* . - 2022, S. 109-164 [Kapitel 4; Literaturangaben]
Peer-reviewed journal article
A review on reinforcement learning algorithms and applications in supply chain management
Rolf, Benjamin; Jackson, Ilya; Müller, Marcel; Lang, Sebastian; Reggelin, Tobias; Ivanov, Dmitry
In: International journal of production research - London [u.a.] : Taylor & Francis, Bd. 60 (2022), insges. 30 S. [Published online: 03. Nov. 2022]
Scientific monograph
Abschlussbericht zum Verbundprojekt InKoLa - Infrastrukturkopplung - Platzierung und Betrieb von Ladestationen aus Verkehrs- und Energienetzsicht
Lindemann, Andreas; Wolter, Martin; Rose, Georg; Vick, Ralf; Hauer, Ines; Tayyab, Muhammad; Helm, Sebastian; Heuer, Maik; Brinken, Julius; Müller, Marcel; Schmidtke, Niels; Hildebrand, Nicole; Wagener, Sven; Holzberger, Mathias
In: Magdeburg: Otto-von-Guericke-Universität Magdeburg, 2022, 1 Online-Ressource (156 Seiten, 8,22 MB) - (Res electricae Magdeburgenses; Band 87) [Literaturverzeichnis: Seite 108-110]
2021
Book chapter
Einfluss von Störungen auf den Umgang mit Deadlocks in einem fahrerlosen Transportsystem - Influence of disruptions on deadlock handling in an automated guided vehicle system
Müller, Marcel; Ulrich, Jan Hendrik; Reyes Rubiano, Lorena Silvana; Reggelin, Tobias; Zadek, Hartmut
In: Simulation in Produktion und Logistik 2021 , 1. Auflage - Göttingen : Cuvillier Verlag ; Franke, Jörg *1964-*, S. 187-196 [Tagung: 19. ASIM-Fachtagung Simulation in Produktion und Logistik, Erlangen, 15. - 17. September 2021; Literaturangaben]
Handling of logistic deadlocks with machine learning
Müller, Marcel; Reggelin, Tobias; Zadek, Hartmut
In: 14th International Doctoral Students Workshop on Logistics, June 22, 2021 Magdeburg , 2021 - Magdeburg : Universitätsbibliothek ; Glistau, Elke *1959-*, S. 77-82 [Tagung: 14th International Doctoral Students Workshop on Logistics, June 22, 2021, Magdeburg]
Simulationsmodell mit 3D-Animation zur schnellen Bewertung von Ablaufplänen in der Produktion - Simulation model with 3D animation for quick evaluation of production schedules
Rolf, Benjamin; Reggelin, Tobias; Lang, Sebastian; Müller, Marcel; Prehm, Johann
In: Simulation in Produktion und Logistik 2021 , 1. Auflage - Göttingen : Cuvillier Verlag ; Franke, Jörg *1964-*, S. 207-216 [Tagung: 19. ASIM-Fachtagung Simulation in Produktion und Logistik, Erlangen, 15. - 17. September 2021; Literaturangaben]
Peer-reviewed journal article
An optimization model for urban transport distribution with time windows - a case study of invoice delivery in a law firm
Reyes-Rubiano, Lorena Silvana; Solano-Charris, Elyn L.; Caneva, Yira; Müller, Marcel; Reggelin, Tobias
In: IFAC-PapersOnLine / Internationale Förderung für Automatische Lenkung - Frankfurt : Elsevier, Bd. 54 (2021), Heft 1, S. 236-242 [Part of special issue: 17th IFAC Symposium on Information Control Problems in Manufacturing INCOM 2021: Budapest, Hungary, 7-9 June 2021]
NeuroEvolution of augmenting topologies for solving a two-stage hybrid flow shop scheduling problem - a comparison of different solution strategies
Lang, Sebastian; Reggelin, Tobias; Schmidt, Johann; Müller, Marcel; Nahhas, Abdulrahman
In: Expert systems with applications - Amsterdam [u.a.] : Elsevier Science - Vol. 172 (2021), article 114666, insgesamt 19 Seiten
Real-time combination of material flow simulation, digital twins of manufacturing cells, an AGV and a mixed-reality application
Müller, Marcel; Mielke, Jonas; Pavlovskyi, Yurii; Pape, Andreas; Masik, Steffen; Reggelin, Tobias; Häberer, Sebastian
In: Procedia CIRP / CIRP - The International Academy for Production Engineering - Amsterdam [u.a.] : Elsevier, Bd. 104 (2021), S. 1607-1612
Open-source discrete-event simulation software for applications in production and logistics - an alternative to commercial tools?
Lang, Sebastian; Reggelin, Tobias; Müller, Marcel; Nahhas, Abdulrahman
In: Procedia computer science - Amsterdam [u.a.] : Elsevier, Bd. 180 (2021), S. 978-987 [Part of special issue: Proceedings of the 2nd International Conference on Industry 4.0 and Smart Manufacturing (ISM 2020)]
2020
Book chapter
Integration of deep reinforcement learning and discrete-event simulation for real-time scheduling of a flexible job shop production
Lanzerath, Nico; Lang, Sebastian; Behrendt, Fabian; Reggelin, Tobias; Müller, Marcel
In: IEEE Xplore digital library / Institute of Electrical and Electronics Engineers - New York, NY : IEEE . - 2020, S. 3057-3068 [Konferenz: 2020 Winter Simulation Conference (WSC), first virtual Winter Simulation Conference December 14-18, 2020.]
Comparison of deadlock handling strategies for different warehouse layouts with an AGVS
Müller, Marcel; Ulrich, Jan Hendrik; Reggelin, Tobias; Lang, Sebastian; Reyes-Rubiano, Lorena Silvana
In: IEEE Xplore digital library / Institute of Electrical and Electronics Engineers - New York, NY : IEEE . - 2020, S. 1300-1311 [Konferenz: 2020 Winter Simulation Conference (WSC), first virtual Winter Simulation Conference December 14-18, 2020.]
Scheduling jobs in a two-stage hybrid flow shop with a simulation-based genetic algorithm and standard dispatching rules
Rolf, Benjamin; Reggelin, Tobias; Nahhas, Abdulrahman; Müller, Marcel; Lang, Sebastian
In: IEEE Xplore digital library / Institute of Electrical and Electronics Engineers - New York, NY : IEEE . - 2020, S. 1584-1595 [Konferenz: 2020 Winter Simulation Conference (WSC), first virtual Winter Simulation Conference December 14-18, 2020.]
Deadlock and collision handling for automated rail-based storage and retrieval units
Müller, Marcel; Schmidt, Stephan; Reggelin, Tobias
In: IEEE Xplore digital library / Institute of Electrical and Electronics Engineers - New York, NY : IEEE . - 2019, S. 1591-1601 [Konferenz: 2019 Winter Simulation Conference, WSC, National Harbor, MD, USA, 8-11 December 2019]
Peer-reviewed journal article
Assigning dispatching rules using a genetic algorithm to solve a hybrid flow shop scheduling problem
Rolf, Benjamin; Reggelin, Tobias; Nahhas, Abdulrahman; Lang, Sebastian; Müller, Marcel
In: Procedia manufacturing - Amsterdam [u.a.] : Elsevier, Bd. 42 (2020), S. 442-449 [Konferenz: International conference on Industry 4.0 and Smart Manufacturing (ISM 2019)]
2019
Book chapter
Simulation and dimensioning of an automatic warehouse of industrial laundries
Müller, Marcel; Maure, Lissette Consepcion; Reggelin, Tobias; Schmidt, Stephan; Coello Machado, Norge Isaias
In: COMEC 2019 ; Conferencia Científica Internacional de Ingeniería Mecánica (10.:2019), insges. 17 S. [Konferenz: COMEC2019, June, 23th-30th, Cayos de Villa Clara, Cuba]
Referenzmodelle für die Simulation von Prozessen in Industriewäschereien
Müller, Marcel; Reggelin, Tobias; Licht, Maximilian
In: ASIM 2019 / ASIM-Fachtagung Simulation in Produktion und Logistik , 2019 , 1. Auflage - Auerbach /Vogtl : Wissenschaftliche Scripten, S. 532-540 [Tagung: 18. ASIM-Fachtagung, 18.-20. September 2019, Chemnitz]
Automated dynamic storage allocation in the industrial laundry sector with RFID
Matke, Martin; Müller, Marcel; Ryll, Frank
In: Smart SysTech 2019 - Berlin : VDE VERLAG, insges. 13 S. [Konferenz: Smart SysTech 2019, 4-5 June 2019, Magdeburg, Germany]
Operational simulation-based decision support in intralogistics using short-term forecasts
Müller, Marcel; Reggelin, Tobias; Schmidt, Stephan
In: Reliability and Statistics in Transportation and Communication - Cham : Springer ; Kabashkin, Igor . - 2019, S. 345-352 - (Lecture Notes in Networks and Systems; volume 68) [Konferenz: 18th International Conference on Reliability and Statistics in Transportation and Communication, RelStat18, 17-20 October 2018, Riga, Latvia]
2018
Book chapter
Simulation-based planning and dimensioning of an automatic laundry storage and retrieval unit with dynamic storage location sizes
Müller, Marcel; Reggelin, Tobias; Schmidt, Stephan; Weigert, David
In: WSC'18 / Winter Simulation Conference , 2018 - Piscataway, NJ : IEEE, S. 2977-2988 [Konferenz: Winter Simulation Conference WSC'18, Gothenburg, Sweden, December 9-12, 2018]
Simulation-based planning and optimization of an automated laundry warehouse using a genetic algorithm
Müller, Marcel; Reggelin, Tobias; Schmidt, Stephan
In: The 17th International Conference Modeling and Applied Simulation (MAS 2018) - Rende, Italy, S. 153-158 [Konferenz: MAS 17]
Approach to evaluating and planning industrial laundries by using discrete event simulation and performance measurement system
Weigert, David; Ryll, Frank; Müller, Marcel
In: The 17th International Conference Modeling and Applied Simulation (MAS 2018) - Rende, Italy, S. 159-167 [Konferenz: MAS 17]