Modelling motorized and non-motorized vehicle conflicts using multiagent inverse reinforcement learning approach

References

• Abbeel, Pieter, and Andrew Y. Ng. 2004. “Apprenticeship Learning via Inverse Reinforcement Learning.” In Proceedings of the Twenty-First International Conference on Machine Learning, 1. Banff, Alberta, Canada: Association for Computing Machinery.
   Google Scholar
• Alrukaibi, Fahad, Rushdi Alsaleh, and Tarek Sayed. 2019. “Applying Machine Learning and Statistical Approaches for Travel Time Estimation in Partial Network Coverage.” Sustainability 11 (14): 3822.
   Web of Science ®Google Scholar
• Alsaleh, Rushdi, Mohamed Hussein, and Tarek Sayed. 2020. “Microscopic Behavioural Analysis of Cyclist and Pedestrian Interactions in Shared Spaces.” Canadian Journal of Civil Engineering 47 (1): 50–62. https://doi.org/10.1139/cjce-2018-0777
   Web of Science ®Google Scholar
• Alsaleh, Rushdi, and Tarek Sayed. 2020. “Modeling Pedestrian-Cyclist Interactions in Shared Space Using Inverse Reinforcement Learning.” Transportation Research Part F: Traffic Psychology and Behaviour 70: 37–57. https://doi.org/10.1016/j.trf.2020.02.007.
   Web of Science ®Google Scholar
• Alsaleh, Rushdi, and Tarek Sayed. 2022a. “Do Road Users Play Nash Equilibrium? A Comparison Between Nash and Logistic Stochastic Equilibriums for Multiagent Modeling of Road User Interactions in Shared Spaces.” Expert Systems with Applications 205: 117710. https://doi.org/10.1016/j.eswa.2022.117710 
   Web of Science ®Google Scholar
• Alsaleh, Rushdi, and Tarek Sayed. 2022b. “Microscopic Modeling of Cyclists Interactions with Pedestrians in Shared Spaces: A Gaussian Process Inverse Reinforcement Learning Approach.” Transportmetrica A: Transport Science 18 (3): 828–854. https://doi.org/10.1080/23249935.2021.1898487
   Web of Science ®Google Scholar
• Alsaleh, Rushdi, Tarek Sayed, and Mohamed H Zaki. 2018. “Assessing the Effect of Pedestrians’ Use of Cell Phones on Their Walking Behavior: A Study Based on Automated Video Analysis.” Transportation research record 2672 (35): 46–57.
   Web of Science ®Google Scholar
• Amundsen, F. H., and C. Hyde´ n. 1977. “Traffic Conflicts Technique-Status in Norway.” In First Workshop on Traffic Conflicts. Oslo, Norway.
   Google Scholar
• Chen, Qun, and Yan Wang. 2016. “A Cellular Automata (CA) Model for Motorized Vehicle Flows Influenced by Bicycles Along the Roadside: Model for Motorized Vehicle Flows Influenced by Bicycles.” Journal of Advanced Transportation 50 (6): 949–966. https://doi.org/10.1002/atr.1382
   Web of Science ®Google Scholar
• Fu, Justin, Katie Luo, and Sergey Levine. 2018. “Learning Robust Rewards with Adverserial Inverse Reinforcement Learning.” arXiv preprint arXiv: 1710.11248.
   Google Scholar
• Fu, Chuanyun, and Tarek Sayed. 2022a. “Bayesian Dynamic Extreme Value Modeling for Conflict-Based Real-Time Safety Analysis.” Analytic Methods in Accident Research 34: 100204. https://doi.org/10.1016/j.amar.2021.100204
   Web of Science ®Google Scholar
• Fu, Chuanyun, and Tarek Sayed. 2022b. “A Multivariate Method for Evaluating Safety from Conflict Extremes in Real Time.” Analytic Methods in Accident Research 36: 100244. https://doi.org/10.1016/j.amar.2022.100244
   Web of Science ®Google Scholar
• Fu, Chuanyun, and Tarek Sayed. 2022c. “Random-Parameter Bayesian Hierarchical Extreme Value Modeling Approach with Heterogeneity in Means and Variances for Traffic Conflict–Based Crash Estimation.” Journal of Transportation Engineering, Part A: Systems 148 (9): 04022056. https://doi.org/10.1061/JTEPBS.0000717.
   Web of Science ®Google Scholar
• Fu, Chuanyun, and Tarek Sayed. 2023. “Identification of Adequate Sample Size for Conflict-Based Crash Risk Evaluation: An Investigation Using Bayesian Hierarchical Extreme Value Theory Models.” Analytic Methods in Accident Research 39: 100281. https://doi.org/10.1016/j.amar.2023.100281.
   Web of Science ®Google Scholar
• Fujii, Hideki, Hideaki Uchida, and Shinobu Yoshimura. 2017. “Agent-based Simulation Framework for Mixed Traffic of Cars, Pedestrians and Trams.” Transportation Research Part C: Emerging Technologies 85: 234–248. https://doi.org/10.1016/j.trc.2017.09.018.
   Web of Science ®Google Scholar
• Gavriilidou, A., W. Daamen, Y. Yuan, and S. P. Hoogendoorn. 2019. “Modelling Cyclist Queue Formation Using a two-Layer Framework for Operational Cycling Behaviour.” Transportation Research Part C: Emerging Technologies 105: 468–484. https://doi.org/10.1016/j.trc.2019.06.012.
   Web of Science ®Google Scholar
• General Technical Requirements for Road Bicycles. 2005. General Administration of Quality Supervision, Inspection and Quarantine of the People's Republic of China.
   Google Scholar
• Helbing, Dirk, and Péter Molnár. 1995. “Social Force Model for Pedestrian Dynamics.” Physical Review E 51 (5): 4282–4286. https://doi.org/10.1103/PhysRevE.51.4282
   PubMed Web of Science ®Google Scholar
• Hu, Yuping, Ye Li, Chen Yuan, and Helai Huang. 2022. “Modeling Conflict Risk with Real-Time Traffic Data for Road Safety Assessment: A Copula-Based Joint Approach.” Transportation Safety and Environment 4 (3): tdac017.
   Google Scholar
• Huang, L., J. Wu, F. You, Z. Lv, and H. Song. 2017. “Cyclist Social Force Model at Unsignalized Intersections with Heterogeneous Traffic.” IEEE Transactions on Industrial Informatics 13 (2): 782–792. https://doi.org/10.1109/TII.2016.2597744.
   Web of Science ®Google Scholar
• Hussein, Mohamed, and Tarek Sayed. 2017. “A bi-Directional Agent-Based Pedestrian Microscopic Model.” Transportmetrica A: Transport Science 13 (4): 326–355. https://doi.org/10.1080/23249935.2016.1266531
   Web of Science ®Google Scholar
• Huttenlocher, D. P., G. A. Klanderman, and W. J. Rucklidge. 1993. “Comparing Images Using the Hausdorff Distance.” IEEE Transactions on Pattern Analysis and Machine Intelligence 15 (9): 850–863. https://doi.org/10.1109/34.232073.
   Web of Science ®Google Scholar
• Ismail, Karim, Tarek Sayed, and Nicolas Saunier. 2010. “Automated Analysis of Pedestrian–Vehicle Conflicts: Context for Before-and-After Studies.” Transportation Research Record: Journal of the Transportation Research Board 2198 (1): 52–64. https://doi.org/10.3141/2198-07
   Google Scholar
• Ismail, Karim, Tarek Sayed, and Nicolas Saunier. 2013. “A Methodology for Precise Camera Calibration for Data Collection Applications in Urban Traffic Scenes.” Canadian Journal of Civil Engineering 40 (1): 57–67. https://doi.org/10.1139/cjce-2011-0456
   Web of Science ®Google Scholar
• Jin, Sheng, Xiaobo Qu, Cheng Xu, Dongfang Ma, and Dianhai Wang. 2015. “An Improved Multi-Value Cellular Automata Model for Heterogeneous Bicycle Traffic Flow.” Physics Letters A 379 (39): 2409–2416. https://doi.org/10.1016/j.physleta.2015.07.031
   Web of Science ®Google Scholar
• Lan, Lawrence W., and Chiung-Wen Chang. 2005. “Inhomogeneous Cellular Automata Modeling for Mixed Traffic with Cars and Motorcycles.” Journal of Advanced Transportation 39 (3): 323–349. https://doi.org/10.1002/atr.5670390307
   Web of Science ®Google Scholar
• Lanzaro, Gabriel, Tarek Sayed, and Rushdi Alsaleh. 2022a. “Can Motorcyclist Behavior in Traffic Conflicts be Modeled? A Deep Reinforcement Learning Approach for Motorcycle-Pedestrian Interactions.” Transportmetrica B: Transport Dynamics 10 (1): 396–420. https://doi.org/10.1080/21680566.2021.2004954.
   Web of Science ®Google Scholar
• Lanzaro, Gabriel, Tarek Sayed, and Rushdi Alsaleh. 2022b. “Modeling Motorcyclist-Pedestrian Near Misses: A Multiagent Adversarial Inverse Reinforcement Learning Approach.” Journal of Computing in Civil Engineering 36 (6): 04022038.
   Web of Science ®Google Scholar
• Lee, Tzu-Chang, and K. I. Wong. 2016. “An Agent-Based Model for Queue Formation of Powered two-Wheelers in Heterogeneous Traffic.” Physica A: Statistical Mechanics and its Applications 461: 199–216. https://doi.org/10.1016/j.physa.2016.05.005.
   Web of Science ®Google Scholar
• Levine, Sergey, and Vladlen Koltun. 2012. “Continuous Inverse Optimal Control with Locally Optimal Examples."arXiv preprint arXiv 1206.4617.
   Google Scholar
• Li, Yixin, Ying Ni, and Jian Sun. 2021. “A Modified Social Force Model for High-Density Through Bicycle Flow at Mixed-Traffic Intersections.” Simulation Modelling Practice and Theory 108: 102265. https://doi.org/10.1016/j.simpat.2020.102265
   Web of Science ®Google Scholar
• Li, Yixin, Ying Ni, Jian Sun, and Zian Ma. 2020. “Modeling the Illegal Lane-Changing Behavior of Bicycles on Road Segments: Considering Lane-Changing Categories and Bicycle Heterogeneity.” Physica A: Statistical Mechanics and its Applications 541: 123302. https://doi.org/10.1016/j.physa.2019.123302.
   Web of Science ®Google Scholar
• Li, Maosheng, Feng Shi, and Dafei Chen. 2011. “Analyze Bicycle-Car Mixed Flow by Social Force Model for Collision Risk Evaluation.” Proceedings of 3rd International Conference on Road Safety and Simulation, 1–22.
   Google Scholar
• Liu, Yan, Rushdi Alsaleh, and Tarek Sayed. 2022. “Modeling Lateral Interactions Between Motorized Vehicles and non-Motorized Vehicles in Mixed Traffic Using Accelerated Failure Duration Model.” Transportmetrica A: Transport Science 18 (3): 910–933. https://doi.org/10.1080/23249935.2021.1908443
   Web of Science ®Google Scholar
• Luo, Yongji, Bin Jia, Jun Liu, William Lam, Xingang li, and Ziyou Gao. 2015. “Modeling the Interactions Between car and Bicycle in Heterogeneous Traffic.” Journal of Advanced Transportation 49 (1): 29����47. https://doi.org/10.1002/atr.1257
   Web of Science ®Google Scholar
• Mansoor, Umer, Mohammad Tamim Kashifi, Fazal Rehman Safi, and Syed Masiur Rahman. 2022. “A Review of Factors and Benefits of non-Motorized Transport: A way Forward for Developing Countries.” Environment, Development and Sustainability 24 (2): 1560–1582. https://doi.org/10.1007/s10668-021-01531-9.
   Web of Science ®Google Scholar
• McKelvey, Richard D., and Thomas R. Palfrey. 1995. “Quantal Response Equilibria for Normal Form Games.” Games and Economic Behavior 10 (1): 6–38. https://doi.org/10.1006/game.1995.1023.
   Web of Science ®Google Scholar
• McKelvey, Richard D., and Thomas R. Palfrey. 1998. “Quantal Response Equilibria for Extensive Form Games.” Experimental Economics 1 (1): 9–41. https://doi.org/10.1023/A:1009905800005
   Google Scholar
• Nagel, Kai, and Michael Schreckenberg. 1992. “A Cellular Automaton Model for Freeway Traffic.” Journal de Physique I 2 (12): 2221–2229. https://doi.org/10.1051/jp1:1992277
   Google Scholar
• Nasernejad, Payam, Tarek Sayed, and Rushdi Alsaleh. 2021. “Modeling Pedestrian Behavior in Pedestrian-Vehicle Near Misses: A Continuous Gaussian Process Inverse Reinforcement Learning (GP-IRL) Approach.” Accident Analysis & Prevention 161: 106355. https://doi.org/10.1016/j.aap.2021.106355.
   PubMed Web of Science ®Google Scholar
• Nasernejad, Payam, Tarek Sayed, and Rushdi Alsaleh. 2023. “Multiagent Modeling of Pedestrian-Vehicle Conflicts Using Adversarial Inverse Reinforcement Learning.” Transportmetrica A Transport Science 19 (3): 2061081. https://doi.org/10.1080/23249935.2022.2061081
   Web of Science ®Google Scholar
• Nash, John. 1951. “Non-Cooperative Games.” The Annals of Mathematics 54 (2): 286–295. https://doi.org/10.2307/1969529
   Web of Science ®Google Scholar
• Ng, Andrew Y., and Stuart J. Russell. 2000. “Algorithms for Inverse Reinforcement Learning.” Proceedings of the Seventeenth International Conference on Machine Learning, 663–670.
   Google Scholar
• Nicolai, Wojke, Bewley Alex, and Paulus Dietrich. 2017. “Simple Online and Realtime Tracking With a Deep Association Metric."arXiv:1703.07402.
   Google Scholar
• Papadimitriou, Eleonora, George Yannis, and John Golias. 2009. “A Critical Assessment of Pedestrian Behaviour Models.” Transportation Research Part F: Traffic Psychology and Behaviour 12 (3): 242–255. https://doi.org/10.1016/j.trf.2008.12.004.
   Web of Science ®Google Scholar
• Passant, Reyad, Tarek Sayed, and Mohamed Zaki. 2020. “Improving the Accuracy of Surrogate Safety Measures With Machine Learning Techniques: A Comparative Study Between Feature-Based and Deep-Learning Tracking.” Paper presented at the the 99th Transportation Research Board Annual Meeting, Washington D.C., USA.
   Google Scholar
• Polus, Abishai, Moshe Livneh, and Benyamin Frischer. 2000. “Evaluation of the Passing Process on two-Lane Rural Highways.” Transportation Research Record: Journal of the Transportation Research Board 1701 (1): 53–60. https://doi.org/10.3141/1701-07
   Google Scholar
• Qu, Zhao-wei, Ning-bo Cao, Yong-heng Chen, Li-ying Zhao, Qiao-wen Bai, and Rui-qi Luo. 2017. “Modeling Electric Bike–car Mixed Flow via Social Force Model.” Advances in Mechanical Engineering 9 (9): 1-14.
   Web of Science ®Google Scholar
• Redmon, Joseph, and Farhadi Ali. 2018. “YOLOv3: An Incremental Improvement."arXiv:1804.02767.
   Google Scholar
• Ren, Gang, Hang Jiang, Jingxu Chen, Zhengfeng Huang, and Lili Lu. 2016. “Heterogeneous Cellular Automata Model for Straight-Through Bicycle Traffic at Signalized Intersection.” Physica A: Statistical Mechanics and its Applications 451: 70–83. https://doi.org/10.1016/j.physa.2015.12.159.
   Web of Science ®Google Scholar
• Saunier, Nicolas, and Tarek Sayed. 2006. “A Feature-Based Tracking Algorithm for Vehicles in Intersections.” The 3rd Canadian Conference on Computer and Robot Vision (CRV'06):59-59.
   Google Scholar
• Savitzky, Abraham, and M. J. E. Golay. 1964. “Smoothing and Differentiation of Data by Simplified Least Squares Procedures.” Analytical Chemistry 36 (8): 1627–1639. https://doi.org/10.1021/ac60214a047
   Web of Science ®Google Scholar
• Sayed, Tarek, Mohamed H. Zaki, and Jarvis Autey. 2013. “Automated Safety Diagnosis of Vehicle–Bicycle Interactions Using Computer Vision Analysis.” Safety Science 59: 163–172. https://doi.org/10.1016/j.ssci.2013.05.009
   Web of Science ®Google Scholar
• Sayed, Tarek, and Sany Zein. 1999. “Traffic Conflict Standards for Intersections.” Transportation Planning and Technology 22 (4): 309–323. https://doi.org/10.1080/03081069908717634
   Web of Science ®Google Scholar
• Song, Jiaming, Hongyu Ren, Dorsa Sadigh, and Stefano Ermon. 2018. “Multi-Agent Generative Adversarial Imitation Learning.” Proceedings of the 32nd International Conference on Neural Information Processing Systems, 7472–7483.
   Google Scholar
• Sun, Jian, Han Liu, and Zian Ma. 2019. “Modelling and Simulation of Highly Mixed Traffic Flow on two-Lane two-way Urban Streets.” Simulation Modelling Practice and Theory 95: 16–35. https://doi.org/10.1016/j.simpat.2019.04.005
   Web of Science ®Google Scholar
• Tageldin, Ahmed, and Tarek Sayed. 2019. “Models to Evaluate the Severity of Pedestrian-Vehicle Conflicts in Five Cities.” Transportmetrica A: Transport Science 15 (2): 354–375. https://doi.org/10.1080/23249935.2018.1477853
   Web of Science ®Google Scholar
• Tang, Tie-Qiao, Ying-Xu Rui, Jian Zhang, and Tao Wang. 2018. “Impacts of Group Behavior on Bicycle Flow at a Signalized Intersection.” Physica A: Statistical Mechanics and its Applications 512: 1205–1215. https://doi.org/10.1016/j.physa.2018.08.022.
   Web of Science ®Google Scholar
• Twaddle, Heather, Tobias Schendzielorz, and Oliver Fakler. 2014. “Bicycles in Urban Areas: Review of Existing Methods for Modeling Behavior.” Transportation Research Record: Journal of the Transportation Research Board 2434 (1): 140–146. https://doi.org/10.3141/2434-17
   Google Scholar
• Vasic, Jelena, and Heather J. Ruskin. 2012. “Cellular Automata Simulation of Traffic Including Cars and Bicycles.” Physica A: Statistical Mechanics and its Applications 391 (8): 2720–2729. https://doi.org/10.1016/j.physa.2011.12.018
   Web of Science ®Google Scholar
• Wierbos, M. J., V. L. Knoop, F. S. Hänseler, and S. P. Hoogendoorn. 2021. “A Macroscopic Flow Model for Mixed Bicycle–car Traffic.” Transportmetrica A: Transport Science 17 (3): 340–355. https://doi.org/10.1080/23249935.2019.1708512
   Web of Science ®Google Scholar
• Xie, Dong-Fan, Zi-You Gao, Xiao-Mei Zhao, and Ke-Ping Li. 2009. “Characteristics of Mixed Traffic Flow with non-Motorized Vehicles and Motorized Vehicles at an Unsignalized Intersection.” Physica A: Statistical Mechanics and its Applications 388 (10): 2041–2050. https://doi.org/10.1016/j.physa.2009.01.033.
   Web of Science ®Google Scholar
• Yang, Da, Xiaoxia Zhou, Danhong Wu, and Sijing Liu. 2018. “Study on the Invasion Behavior of E-Bikes with Motor Vehicle Traffic at a Signalized Intersection.” Transportation Research Record: Journal of the Transportation Research Board 2672 (31): 33–40. https://doi.org/10.1177/0361198118757996
   Web of Science ®Google Scholar
• Yu, Lantao, Jiaming Song, and Stefano Ermon. 2019. “Multi-Agent Adversarial Inverse Reinforcement Learning.” Proceedings of the 36th International Conference on Machine Learning 97: 7194–7201.
   Google Scholar
• Yuan, Yufei, Bernat Goñi-Ros, Tim P. van Oijen, Winnie Daamen, and Serge P. Hoogendoorn. 2019. “Social Force Model Describing Pedestrian and Cyclist Behaviour in Shared Spaces”. Paper presented at the Traffic and Granular Flow ‘17, Cham, 2019.
   Google Scholar
• Zhang, Weihua, Chang Zhou, Wenjuan Huang, Hu Tao, Kun Wang, Zhongxiang Feng, and Zhe Hu. 2019. “Investigating Factors Affecting Riders’ Behaviors of Occupying Motorized Vehicle Lanes on Urban Streets.” Accident Analysis & Prevention 122: 127–133. https://doi.org/10.1016/j.aap.2018.09.025
   PubMed Web of Science ®Google Scholar
• Zhao, De, Wei Wang, Chenyang Li, Zhibin Li, Pengming Fu, and Xiaojian Hu. 2013. “Modeling of Passing Events in Mixed Bicycle Traffic with Cellular Automata.” Transportation Research Record: Journal of the Transportation Research Board 2387 (1): 26–34. https://doi.org/10.3141/2387-04
   Google Scholar
• Zhu, Jiasong, Sun Ke, Jia Sen, Li Qingquan, Hou Xianxu, Lin Weidong, Liu Bozhi, and Qiu Guoping. 2018. “Urban Traffic Density Estimation Based on Ultrahigh-Resolution UAV Video and Deep Neural Network.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 11 (12): 4968–4981. https://doi.org/10.1109/JSTARS.2018.2879368.
   Web of Science ®Google Scholar
• Ziebart, Brian, J. Bagnell, and Anind Dey. 2011. “Maximum Causal Entropy Correlated Equilibria for Markov Games”. Workshops at the Twenty-Fourth AAAI Conference on Artificial Intelligence.
   Google Scholar