Leveraging autonomous vehicles in mixed-autonomy traffic networks with reinforcement learning-controlled intersections

References

• Abdoos, M., N. Mozayani, and A. L. Bazzan. 2011. “Traffic Light Control in Non-stationary Environments Based on Multi Agent q-learning.” In 2011 14th International IEEE conference on intelligent transportation systems (ITSC), 1580–1585. Washington, DC, USA: IEEE.
   Google Scholar
• Abuamer, I. M., M. Sadat, M. A. Silgu, and H. B. Celikoglu. 2017. “Analyzing the Effects of Driver Behavior within an Adaptive Ramp Control Scheme: A Case-study with Alinea.” In 2017 IEEE International Conference on Vehicular Electronics and Safety (ICVES)109–114. Vienna, Austria: IEEE.
   Google Scholar
• Agrawal, A., R. Verschueren, S. Diamond, and S. Boyd. 2018. “A Rewriting System for Convex Optimization Problems.” Journal of Control and Decision 5: 42–60. doi:10.1080/23307706.2017.1397554.
   Google Scholar
• Aziz, H. A., F. Zhu, and S. V. Ukkusuri. 2018. “Learning-based Traffic Signal Control Algorithms with Neighborhood Information Sharing: An Application for Sustainable Mobility.” Journal of Intelligent Transportation Systems 22: 40–52. doi:10.1080/15472450.2017.1387546.
   Web of Science ®Google Scholar
• Chavoshi, K., A. Genser, and A. Kouvelas. 2021. “A Pairing Algorithm for Conflict-free Crossings of Automated Vehicles at Lightless Intersections.” Electronics 10: 1702. doi:10.3390/electronics10141702.
   Web of Science ®Google Scholar
• Chollet, F., et al. 2015. “Keras documentation.” keras. io 33.
   Google Scholar
• Chowdhury, M. A., and A. W. Sadek. 2003. Fundamentals of Intelligent Transportation Systems Planning. Norwood, MA, USA: Artech House.
   Google Scholar
• Diamond, S., and S. Boyd. 2016. “CVXPY: A Python-embedded Modeling Language for Convex Optimization.” Journal of Machine Learning Research 17: 1–5.
   Web of Science ®Google Scholar
• El-Tantawy, S., B. Abdulhai, and H. Abdelgawad. 2014. “Design of Reinforcement Learning Parameters for Seamless Application of Adaptive Traffic Signal Control.” Journal of Intelligent Transportation Systems 18: 227–245. doi:10.1080/15472450.2013.810991.
   Web of Science ®Google Scholar
• Genders, W., and S. Razavi. 2016. “Using a Deep Reinforcement Learning Agent for Traffic Signal Control.” arXiv preprint arXiv:1611.01142 .
   Google Scholar
• Ge, H., Y. Song, C. Wu, J. Ren, and G. Tan. 2019. “Cooperative Deep q-learning with q-value Transfer for Multi-intersection Signal Control.” IEEE Access 7: 40797–40809. doi:10.1109/ACCESS.2019.2907618.
   Google Scholar
• He, Q., K. L. Head, and J. Ding. 2011. “Heuristic Algorithm for Priority Traffic Signal Control.” Transportation Research Record 2259: 1–7. doi:10.3141/2259-01.
   Web of Science ®Google Scholar
• Levin, M. W., and S. D. Boyles. 2016. “A Multiclass Cell Transmission Model for Shared Human and Autonomous Vehicle Roads.” Transportation Research Part C: Emerging Technologies 62: 103–116. doi:10.1016/j.trc.2015.10.005.
   Web of Science ®Google Scholar
• Lin, P., J. Liu, P. J. Jin, and B. Ran. 2017. “Autonomous Vehicle-intersection Coordination Method in a Connected Vehicle Environment.” IEEE Intelligent Transportation Systems Magazine 9: 37–47. doi:10.1109/MITS.2017.2743167.
   Web of Science ®Google Scholar
• Li, M., X. Wu, X. He, G. Yu, and Y. Wang. 2018. “An Eco-driving System for Electric Vehicles with Signal Control under v2x Environment.” Transportation Research Part C: Emerging Technologies 93: 335–350. doi:10.1016/j.trc.2018.06.002.
   Web of Science ®Google Scholar
• Li, Z., Q. Wu, H. Yu, C. Chen, G. Zhang, Z. Z. Tian, and P. D. Prevedouros. 2019. “Temporal-spatial Dimension Extension-based Intersection Control Formulation for Connected and Autonomous Vehicle Systems.” Transportation Research Part C: Emerging Technologies 104: 234–248. doi:10.1016/j.trc.2019.05.003.
   Web of Science ®Google Scholar
• Lopez, P. A., M. Behrisch, L. Bieker-Walz, J. Erdmann, Y. P. Flo¨tter¨od, R. Hilbrich, L. Lu¨cken, J. Rummel, P. Wagner, and E. Wießner. 2018. “Microscopic Traffic Simulation Using Sumo.” In The 21st IEEE International Conference on Intelligent Transportation Systems. IEEE. https://elib.dlr.de/124092/
   Google Scholar
• Mannion, P., J. Duggan, and E. Howley. 2016. “An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control.” In Autonomic Road Transport Support Systems, 47–66. Switzerland: Springer.
   Google Scholar
• Mnih, V., K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, et al. 2015. “Human-level Control through Deep Reinforcement Learning”. nature 518: 529–533. doi:10.1038/nature14236.
   PubMed Web of Science ®Google Scholar
• Qu, Z., Z. Pan, Y. Chen, X. Wang, and H. Li. 2020. “A Distributed Control Method for Urban Networks Using Multi-agent Reinforcement Learning Based on Regional Mixed Strategy Nash-equilibrium.” IEEE Access 8: 19750–19766. doi:10.1109/ACCESS.2020.2968937.
   Web of Science ®Google Scholar
• Raffo, G. V., G. K. Gomes, J. E. Normey-Rico, C. R. Kelber, and L. B. Becker. 2009. “A Predictive Controller for Autonomous Vehicle Path Tracking.” IEEE Transactions on Intelligent Transportation Systems 10: 92–102. doi:10.1109/TITS.2008.2011697.
   Web of Science ®Google Scholar
• Rakha, H., and R. K. Kamalanathsharma. 2011. “Eco-driving at Signalized Intersections Using v2i Communication.” In 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), 341–346. Washington, DC, USA: IEEE.
   Google Scholar
• Sadat, M., and H. B. Celikoglu. 2017. “Simulation-based Variable Speed Limit Systems Modelling: An Overview and a Case Study on Istanbul Freeways.” Transportation Research Procedia 22: 607–614. doi:10.1016/j.trpro.2017.03.051.
   Google Scholar
• Steingrover, M., R. Schouten, S. Peelen, E. Nijhuis and B. Bakker. 2005. Reinforcement Learning of Traffic Light Controllers Adapting to Traffic Congestion, 216–223. Brussels, Belgium: BNAIC, Citeseer.
   Google Scholar
• Sutton, R. S., and A. G. Barto. 2018. Reinforcement Learning: An Introduction. Cambridge, MA, USA: MIT press.
   Google Scholar
• Tajalli, M., M. Mehrabipour, and A. Hajbabaie. 2020. “Network-level Coordinated Speed Optimization and Traffic Light Control for Connected and Automated Vehicles 22 (11).
   Google Scholar
• Watkins, C. J., and P. Dayan. 1992. “Q-learning.” Machine Learning 8: 279–292. doi:10.1007/BF00992698.
   Web of Science ®Google Scholar
• Wu, C., A. Kreidieh, K. Parvate, E. Vinitsky, and A. M. Bayen. 2017. “Flow: A Modular Learning Framework for Autonomy in Traffic.” arXiv preprint arXiv:1710.05465 .
   Google Scholar
• Xu, B., X. J. Ban, Y. Bian, J. Wang, and K. Li. 2017. “V2i Based Cooperation between Traffic Signal and Approaching Automated Vehicles.” 2017 IEEE Intelligent Vehicles Symposium (IV), 1658–1664. Redondo Beach, CA, USA: IEEE.
   Google Scholar
• Yang, K., S. I. Guler, and M. Menendez. 2016. “Isolated Intersection Control for Various Levels of Vehicle Technology: Conventional, Connected, and Automated Vehicles.” Transportation Research Part C: Emerging Technologies 72: 109–129. doi:10.1016/j.trc.2016.08.009.
   Web of Science ®Google Scholar
• Yau, K. L. A., J. Qadir, H. L. Khoo, M. H. Ling, and P. Komisarczuk. 2017. “A Survey on Reinforcement Learning Models and Algorithms for Traffic Signal Control.” ACM Computing Surveys (CSUR) 50: 1–38. doi:10.1145/3068287.
   Web of Science ®Google Scholar
• Zhang, R., A. Ishikawa, W. Wang, B. Striner, and O. Tonguz. 2018. “Intelligent Traffic Signal Control: Using Reinforcement Learning with Partial Detection.” arXiv preprint arXiv:1807.01628.
   Google Scholar
• Zhao, W., R. Liu, and D. Ngoduy. 2019. “A Bilevel Programming Model for Autonomous Intersection Control and Trajectory Planning.” Transportmetrica A: Transport Science 1–25.
   Web of Science ®Google Scholar