Deep reinforcement learning and 3D physical environments applied to crowd evacuation in congested scenarios

References

• Adrian, Juliane, Maik Boltes, Stefan Holl, Anna Sieben, and Armin Seyfried. 2018. “Crowding and Queuing in Entrance Scenarios: Influence of Corridor Width in Front of Bottlenecks.” Paper presented at the 9th International Conference on Pedestrian and Evacuation Dynamics (PED2018), Lund, Sweden.
   Google Scholar
• Berg, Jur van den, Stephen J. Guy, Ming Lin, and Dinesh Manocha. 2011. “Reciprocal n-Body Collision Avoidance.” In Robotics Research: The 14th International Symposium ISRR, edited by Cédric Pradalier, Roland Siegwart and Gerhard Hirzinger, 3–19. Berlin: Springer Berlin Heidelberg.
   Google Scholar
• Bode, Nikolai W. F., Armel U. Kemloh Wagoum, and Edward A. Codling. 2015. “Information Use by Humans During Dynamic Route Choice in Virtual Crowd Evacuations.” Royal Society Open Science 2 (1): 140410. doi:10.1098/rsos.140410.
   PubMed Web of Science ®Google Scholar
• Brscic, D., T. Kanda, T. Ikeda, and T. Miyashita. 2013. “Person Tracking in Large Public Spaces Using 3-D Range Sensors.” IEEE Transactions on Human-Machine Systems 43 (6): 522–534. doi:10.1109/THMS.2013.2283945.
   Web of Science ®Google Scholar
• Fahy, R. F., and G. Proulx. 2005. Analysis of Published Accounts of the World Trade Center Evacuation. Washington, DC: US Department of Commerce, Technology Administration, National Institute of Standards and Technology.
   Google Scholar
• Godoy, Julio, Stephen J. Guy, Maria Gini, and Ioannis Karamouzas. 2020. “C-Nav: Distributed Coordination in Crowded Multi-Agent Navigation.” Robotics and Autonomous Systems 133: 103631. doi:10.1016/j.robot.2020.103631.
   Web of Science ®Google Scholar
• Haghani, Milad, and Majid Sarvi. 2018. “Crowd Behaviour and Motion: Empirical Methods.” Transportation Research Part B: Methodological 107: 253–294. doi:10.1016/j.trb.2017.06.017.
   Web of Science ®Google Scholar
• Heess, Nicolas, Dhruva Tb, Srinivasan Sriram, Jay Lemmon, Josh Merel, Greg Wayne, Yuval Tassa, Tom Erez, Ziyu Wang, and S. M. Eslami. 2017. “Emergence of Locomotion Behaviours in Rich Environments.” arXiv preprint arXiv:1707.02286.
   Google Scholar
• Helbing, D., and P. Molnar. 1995. “Social Force Model for Pedestrian Dynamics.” Physical Review E 51 (5): 4282–4286. doi:10.1103/PhysRevE.51.4282.
   PubMed Web of Science ®Google Scholar
• Henry, Peter, Christian Vollmer, Brian Ferris, and Dieter Fox. 2010. “Learning to Navigate Through Crowded Environments.” Paper presented at the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.
   Google Scholar
• Huang, Lin, Jianhua Gong, and Wenhang Li. 2021. “A Perception Model for Optimizing and Evaluating Evacuation Guidance Systems.” ISPRS International Journal of Geo-Information 10 (2): 54. doi:10.3390/ijgi10020054.
   Web of Science ®Google Scholar
• Juliani, Arthur, Vincent-Pierre Berges, Ervin Teng, Andrew Cohen, Jonathan Harper, Chris Elion, Chris Goy, Yuan Gao, Hunter Henry, and Marwan Mattar. 2018. “Unity: A General Platform for Intelligent Agents.” arXiv preprint arXiv:1809.02627.
   Google Scholar
• Kinateder, Max, Brittany Comunale, and William H. Warren. 2018. “Exit Choice in an Emergency Evacuation Scenario is Influenced by Exit Familiarity and Neighbor Behavior.” Safety Science 106: 170–175. doi:10.1016/j.ssci.2018.03.015.
   Web of Science ®Google Scholar
• Kretz, Tobias, Anna Grünebohm, and Michael Schreckenberg. 2006. “Experimental Study of Pedestrian Flow Through a Bottleneck.” Journal of Statistical Mechanics: Theory and Experiment 2006 (10): P10014. doi:10.1088/1742-5468/2006/10/P10014.
   Web of Science ®Google Scholar
• Li, Xinjin, Hong Liu, Junqing Li, and Yan Li. 2021. “Deep Deterministic Policy Gradient Algorithm for Crowd-Evacuation Path Planning.” Computers & Industrial Engineering 161: 107621. doi:10.1016/j.cie.2021.107621.
   Web of Science ®Google Scholar
• Li, Weilian, Jun Zhu, Lin Fu, Qing Zhu, Yukun Guo, and Yuhang Gong. 2021. “A Rapid 3D Reproduction System of Dam-Break Floods Constrained by Post-Disaster Information.” Environmental Modelling & Software 139: 104994. doi:10.1016/j.envsoft.2021.104994.
   Web of Science ®Google Scholar
• Li, Weilian, Jun Zhu, Lin Fu, Qing Zhu, Yakun Xie, and Ya Hu. 2021. “An Augmented Representation Method of Debris Flow Scenes to Improve Public Perception.” International Journal of Geographical Information Science 35 (8): 1521–1544. doi:10.1080/13658816.2020.1833016.
   Web of Science ®Google Scholar
• Liao, Weichen, Armel U. Kemloh Wagoum, and Nikolai W. F. Bode. 2017. “Route Choice in Pedestrians: Determinants for Initial Choices and Revising Decisions.” Journal of the Royal Society Interface 14 (127): 20160684. doi:10.1098/rsif.2016.0684.
   PubMed Web of Science ®Google Scholar
• Liao, Weichen, Xiaoping Zheng, Lisheng Cheng, Ying Zhao, Yuan Cheng, and Yafei Wang. 2014. “Layout Effects of Multi-Exit Ticket-Inspectors on Pedestrian Evacuation.” Safety Science 70: 1–8. doi:10.1016/j.ssci.2014.04.015.
   Web of Science ®Google Scholar
• Lin, Hui, Min Chen, and Guonian Lu. 2013. “Virtual Geographic Environment: A Workspace for Computer-Aided Geographic Experiments.” Annals of the Association of American Geographers 103 (3): 465–482. doi:10.1080/00045608.2012.689234.
   Web of Science ®Google Scholar
• Lin, Hui, Min Chen, Guonian Lu, Qing Zhu, Jiahua Gong, Xiong You, Yongning Wen, Bingli Xu, and Mingyuan Hu. 2013. “Virtual Geographic Environments (VGEs): A new Generation of Geographic Analysis Tool.” Earth-Science Reviews 126: 74–84. doi:10.1016/j.earscirev.2013.08.001.
   Web of Science ®Google Scholar
• Low, David J. 2000. “Following the Crowd.” Nature 407 (6803): 465–466. doi:10.1038/35035192.
   PubMed Web of Science ®Google Scholar
• Lü, Guonian, Min Chen, Linwang Yuan, Liangchen Zhou, Yongning Wen, Mingguan Wu, Bin Hu, Zhaoyuan Yu, Songshan Yue, and Yehua Sheng. 2018. “Geographic Scenario: A Possible Foundation for Further Development of Virtual Geographic Environments.” International Journal of Digital Earth 11 (4): 356–368. doi:10.1080/17538947.2017.1374477.
   Web of Science ®Google Scholar
• Macchione, Francesco, Pierfranco Costabile, Carmelina Costanzo, and Rosa De Santis. 2019. “Moving to 3-D Flood Hazard Maps for Enhancing Risk Communication.” Environmental Modelling & Software 111: 510–522. doi:10.1016/j.envsoft.2018.11.005
   Web of Science ®Google Scholar
• Martinez-Gil, Francisco, Miguel Lozano, and Fernando Fernández. 2014. “MARL-Ped: A Multi-Agent Reinforcement Learning Based Framework to Simulate Pedestrian Groups.” Simulation Modelling Practice and Theory 47: 259–275. doi:10.1016/j.simpat.2014.06.005.
   Web of Science ®Google Scholar
• Martinez-Gil, Francisco, Miguel Lozano, and Fernando Fernández. 2017. “Emergent Behaviors and Scalability for Multi-Agent Reinforcement Learning-Based Pedestrian Models.” Simulation Modelling Practice and Theory 74: 117–133. doi:10.1016/j.simpat.2017.03.003.
   Web of Science ®Google Scholar
• Muir, Helen C., David M. Bottomley, and Claire Marrison. 1996. “Effects of Motivation and Cabin Configuration on Emergency Aircraft Evacuation Behavior and Rates of Egress.” The International Journal of Aviation Psychology 6 (1): 57–77. doi:10.1207/s15327108ijap0601_4.
   Web of Science ®Google Scholar
• Müller, Klaus. 1981. “Zur Gestaltung und Bemessung von Fluchtwegen für die Evakuierung von Personen aus Bauwerken auf der Grundlage von Modellversuchen.” PhD diss., Technische Hochschule Magdeburg.
   Google Scholar
• Nagai, Ryoichi, Masahiro Fukamachi, and Takashi Nagatani. 2006. “Evacuation of Crawlers and Walkers from Corridor Through an Exit.” Physica A: Statistical Mechanics and its Applications 367: 449–460. doi:10.1016/j.physa.2005.11.031.
   Web of Science ®Google Scholar
• Saloma, C., G. J. Perez, G. Tapang, M. Lim, and C. Palmes-Saloma. 2003. “Self-organized Queuing and Scale-Free Behavior in Real Escape Panic.” Proceedings of the National Academy of Sciences 100 (21): 11947–11952. doi:10.1073/pnas.2031912100.
   PubMed Web of Science ®Google Scholar
• Schulman, John, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel. 2015. “High-Dimensional Continuous Control Using Generalized Advantage Estimation.” arXiv preprint arXiv:1506.02438.
   Google Scholar
• Schulman, John, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. “Proximal Policy Optimization Algorithms.” arXiv preprint arXiv:1707.06347.
   Google Scholar
• Seyfried, Armin, Maik Boltes, Jens Kähler, Wolfram Klingsch, Andrea Portz, Tobias Rupprecht, Andreas Schadschneider, Bernhard Steffen, and Andreas Winkens. 2010. “Enhanced Empirical Data for the Fundamental Diagram and the Flow Through Bottlenecks.” In Pedestrian and Evacuation Dynamics 2008, edited by Wolfram W. F. Klingsch, Christian Rogsch, Andreas Schadschneider and Michael Schreckenberg, 145–156. Berlin: Springer Berlin Heidelberg.
   Google Scholar
• Seyfried, Armin, Bernhard Steffen, Wolfram Klingsch, and Maik Boltes. 2005. “The Fundamental Diagram of Pedestrian Movement Revisited.” Journal of Statistical Mechanics: Theory and Experiment 2005 (10): P10002. doi:10.1088/1742-5468/2005/10/P10002.
   Web of Science ®Google Scholar
• Torrey, L. 2010. “Crowd Simulation Via Multi-Agent Reinforcement Learning.” Paper presented at the Proceedings of the Sixth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Stanford, California, USA.
   Google Scholar
• Varas, A., M. D. Cornejo, D. Mainemer, B. Toledo, J. Rogan, V. MunOz, and J. A. Valdivia. 2007. “Cellular Automaton Model for Evacuation Process with Obstacles.” Physica A: Statistical Mechanics and its Applications 382 (2): 631–642. doi:10.1016/j.physa.2007.04.006.
   Web of Science ®Google Scholar
• Von Krüchten, Cornelia, and Andreas Schadschneider. 2017. “Empirical Study on Social Groups in Pedestrian Evacuation Dynamics.” Physica A: Statistical Mechanics and its Applications 475: 129–141. doi:10.1016/j.physa.2017.02.004.
   Web of Science ®Google Scholar
• Wang, Qingqing, Hong Liu, Kaizhou Gao, and Le Zhang. 2019. “Improved Multi-Agent Reinforcement Learning for Path Planning-Based Crowd Simulation.” IEEE Access 7: 73841–73855. doi:10.1109/ACCESS.2019.2920913.
   Web of Science ®Google Scholar
• Woo, Sanghyun, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. “Cbam: Convolutional Block Attention Module.” Paper presented at the the European Conference on Computer Vision (ECCV), Munich, Germany.
   Google Scholar
• Xie, Wei, Eric Wai Ming Lee, Yanying Cheng, Meng Shi, Ruifeng Cao, and Yuchun Zhang. 2020. “Evacuation Performance of Individuals and Social Groups Under Different Visibility Conditions: Experiments and Surveys.” International Journal of Disaster Risk Reduction 47: 101527. doi:10.1016/j.ijdrr.2020.101527
   Web of Science ®Google Scholar
• Yao, Zhenzhen, Guijuan Zhang, Dianjie Lu, and Hong Liu. 2020. “Learning Crowd Behavior from Real Data: A Residual Network Method for Crowd Simulation.” Neurocomputing 404: 173–185. doi:10.1016/j.neucom.2020.04.141.
   Web of Science ®Google Scholar
• Yin, Lingzhi, Jun Zhu, Yi Li, Chao Zeng, Qing Zhu, Hua Qi, Mingwei Liu, Weilian Li, Zhenyu Cao, and Weijun Yang. 2017. “A Virtual Geographic Environment for Debris Flow Risk Analysis in Residential Areas.” ISPRS International Journal of Geo-Information 6 (11): 377. doi:10.3390/ijgi6110377.
   Web of Science ®Google Scholar
• Yuksel, Mehmet Erkan. 2018. “Agent-based Evacuation Modeling with Multiple Exits Using NeuroEvolution of Augmenting Topologies.” Advanced Engineering Informatics 35: 30–55. doi:10.1016/j.aei.2017.11.003.
   Web of Science ®Google Scholar
• Zhang, Yihao, Zhaojie Chai, and George Lykotrafitis. 2021. “Deep Reinforcement Learning with a Particle Dynamics Environment Applied to Emergency Evacuation of a Room with Obstacles.” Physica A: Statistical Mechanics and its Applications 571: 125845. doi:10.1016/j.physa.2021.125845.
   Web of Science ®Google Scholar
• Zhang, Guoyong, Jianhua Gong, Yi Li, Jun Sun, Bingli Xu, Dong Zhang, Jieping Zhou, Ling Guo, Shen Shen, and Bingxiao Yin. 2020. “An Efficient Flood Dynamic Visualization Approach Based on 3D Printing and Augmented Reality.” International Journal of Digital Earth 13 (11): 1302–1320. doi:10.1080/17538947.2019.1711210.
   Web of Science ®Google Scholar
• Zhang, Dong, Wenhang Li, Jianhua Gong, Lin Huang, Guoyong Zhang, Shen Shen, Jiantao Liu, and Haonan Ma. 2022. “HDRLM3D: A Deep Reinforcement Learning-Based Model with Human-Like Perceptron and Policy for Crowd Evacuation in 3D Environments.” ISPRS International Journal of Geo-Information 11 (4): 255. doi:10.3390/ijgi11040255.
   Web of Science ®Google Scholar
• Zhao, C. M., S. M. Lo, S. P. Zhang, and M. Liu. 2008. “A Post-Fire Survey on the Pre-Evacuation Human Behavior.” Fire Technology 45 (1): 71–95. doi:10.1007/s10694-007-0040-6.
   Web of Science ®Google Scholar
• Zhao, Xuedan, Long Xia, Jun Zhang, and Weiguo Song. 2020. “Artificial Neural Network Based Modeling on Unidirectional and Bidirectional Pedestrian Flow at Straight Corridors.” Physica A: Statistical Mechanics and its Applications 547: 123825. doi:10.1016/j.physa.2019.123825.
   Web of Science ®Google Scholar
• Zheng, Xiaoping, Tingkuan Zhong, and Mengting Liu. 2009. “Modeling Crowd Evacuation of a Building Based on Seven Methodological Approaches.” Building and Environment 44 (3): 437–445. doi:10.1016/j.buildenv.2008.04.002.
   Web of Science ®Google Scholar
• Zuriguel, I., J. Olivares, J. M. Pastor, C. Martín-Gómez, L. M. Ferrer, J. J. Ramos, and A. Garcimartín. 2016. “Effect of Obstacle Position in the Flow of Sheep Through a Narrow Door.” Physical Review E 94 (3): 032302. doi:10.1103/PhysRevE.94.032302.
   PubMed Web of Science ®Google Scholar