Multi-agent reinforcement learning for traffic congestion on one-way multi-lane highways

References

• Abar, S., Theodoropoulos, G. K., Lemarinier, P., & O'Hare, G. M. P. (2017). Agent based modelling and simulation tools: A review of the state-of-art software. Computer Science Review, 24, 13–33. https://doi.org/10.1016/j.cosrev.2017.03.001
   Web of Science ®Google Scholar
• Axhausen, K. W., Horni, A., & Nagel, K. (2016). The multi-agent transport simulation MATSim (p. 618). Ubiquity Press.
   Google Scholar
• Bakker, B., Whiteson, S., Kester, L., & Groen, F. C. A. (2010). Interactive Collaborative Information Systems (pp. 475–510). Springer Berlin, Heidelberg.
   Google Scholar
• Bhatnagar, S., Sutton, R. S., Ghavamzadeh, M., & Lee, M. (2009). Natural actor–critic algorithms. Automatica, 45(11), 2471–2482. https://doi.org/10.1016/j.automatica.2009.07.008
   Web of Science ®Google Scholar
• Chen, D., Li, Z., Hajidavalloo, M., Chen, K., Wang, Y., Jiang, L., & Wang, Y. (2022, January 20). Deep multi-agent reinforcement learning for highway on-ramp merging in mixed traffic. arXiv.org. Retrieved July 29, 2022, from https://arxiv.org/abs/2105.05701.
   Google Scholar
• Chu, T., Wang, J., Codecà, L., & Li, Z. (2019). Multi-agent deep reinforcement learning for large-scale traffic signal control. IEEE Transactions on Intelligent Transportation Systems, 21(3), 1086–1095. https://doi.org/10.1109/tits.2019.2901791
   Web of Science ®Google Scholar
• Deng, F., Jin, J., Shen, Y., & Du, Y. (2019). Advanced self-improving ramp metering algorithm based on multi-agent deep reinforcement learning. In 2019 IEEE Intelligent Transportation Systems Conference (ITSC). IEEE. https://doi.org/10.1109/itsc.2019.8916903
   Google Scholar
• Eleurent, E. (n.d.). Highway-Env: A minimalist environment for decision-making in autonomous driving. GitHub. Retrieved July 29, 2022, from https://github.com/eleurent/highway-env.
   Google Scholar
• El-Tantawy, S., & Abdulhai, B. (2012). Multi-agent reinforcement learning for integrated network of adaptive traffic signal controllers (MARLIN-ATSC). In 2012 15th international IEEE conference on intelligent transportation systems (pp. 319–326). IEEE.10.1109/ITSC.2012.6338707
   Google Scholar
• Grigoryev, I. (2016). Anylogic 7 in three days: A quick course in simulation modeling. Ilya Grigoryev.
   Google Scholar
• Head, B. (2017). Python-extension/traffic basic – reinforcement.nlogo at main · NetLogo/Python-Extension. GitHub. Retrieved July 29, 2022, from https://github.com/NetLogo/Python-Extension/blob/master/demos/Traffic%20Basic%20-%20Reinforcement.nlogo.
   Google Scholar
• Hussain, A., Wang, T., & Jiahua, C. (2020, February 23). Optimizing traffic lights with multi-agent deep reinforcement learning and V2X communication. arXiv.org. Retrieved July 29, 2022, from https://arxiv.org/abs/2002.09853.
   Google Scholar
• Le, N.-T.-T. (2018). Tackling the traffic congestion problem at small bidirectional streets in big cities of vietnam. 7th Conference on Information Technology and Its Application (CITA), Da Nang, Vietnam.
   Google Scholar
• Le, N.-T.-T. (2022). Experimenting reinforcement learning algorithms in a multi-agent setting: A case study of traffic model for the one-way multi-lane highways. 11th conference on information technology and its application (CITA), Hue, Vietnam.
   Google Scholar
• Le, N.-T.-T., Nguyen, P.-A.-H.-C., & Hanachi, C. (2021). Agent-based modeling and simulation of citizens sheltering during a tsunami: Application to Da Nang city in Vietnam. Advances in Computational Collective Intelligence, Kallithea, Rhodes, Greecehttps://doi.org/10.1007/978-3-030-88113-9.
   Google Scholar
• Lopez, P. A., Wiessner, E., Behrisch, M., Bieker-Walz, L., Erdmann, J., Flotterod, Y. -P., Hilbrich, R., Lucken, L., Rummel, J., & Wagner, P. (2018). Microscopic traffic simulation using sumo. In 2018 21st international conference on intelligent transportation systems (ITSC). IEEE. https://doi.org/10.1109/itsc.2018.8569938
   Google Scholar
• Ma, J., & Wu, F. (2020). Feudal multi-agent deep reinforcement learning for traffic signal control. 19th International conference on autonomous agents and multiagent systems (AAMAS), Auckland, New Zealand.
   Google Scholar
• Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013, December 19). Playing Atari with deep reinforcement learning. arXiv.org. Retrieved July 29, 2022, from https://arxiv.org/abs/1312.5602.
   Google Scholar
• Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529–533. https://doi.org/10.1038/nature14236
   PubMed Web of Science ®Google Scholar
• Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020). Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications. IEEE Transactions on Cybernetics, 50(9), 3826–3839. https://doi.org/10.1109/tcyb.2020.2977374
   PubMed Web of Science ®Google Scholar
• Prabuchandran, K. J., Hemanth Kumar, A. N, & Bhatnagar, S. (2014). Multi-agent reinforcement learning for traffic signal control. In 2014 17th international IEEE conference on intelligent transportation Systems (ITSC). IEEE. https://doi.org/10.1109/itsc.2014.6958095
   Google Scholar
• Russell, S. J., & Norvig, P. (2021). Artificial intelligence: A modern approach. Pearson.
   Google Scholar
• Suran, A. (2020, August 3). Actor–critic with tensorflow 2.x [part 1 of 2]. Medium. Retrieved July 29, 2022, from https://towardsdatascience.com/actor-critic-with-tensorflow-2-x-part-1-of-2-d1e26a54ce97.
   Google Scholar
• Suran, A. (2020, August 5). Acto-r-critic with tensorflow 2.x [part 2OF 2]. Medium. Retrieved July 29, 2022, from https://towardsdatascience.com/actor-critic-with-tensorflow-2-x-part-2of-2-b8ceb7e059db.
   Google Scholar
• Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. The MIT Press.
   Google Scholar
• Taillandier, P., Gaudou, B., Grignard, A., Huynh, Q.-N., Marilleau, N., Caillou, P., Philippon, D., & Drogoul, A. (2018). Building, composing and experimenting complex spatial models with the gama platform. GeoInformatica, 23(2), 299–322. https://doi.org/10.1007/s10707-018-00339-6
   Web of Science ®Google Scholar
• Watkins, C. J., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3), 279–292. https://doi.org/10.1007/BF00992698
   Web of Science ®Google Scholar
• Wilensky, U., & Payette, N. (n.d.). Traffic 2 lanes. NetLogo Models Library: Traffic 2 Lanes. Retrieved August 2, 2022, from http://ccl.northwestern.edu/netlogo/models/Traffic2Lanes.
   Google Scholar
• Wilensky, U., & Rand, W. (2015). An introduction to agent-based modeling: Modeling natural, social, and engineered complex systems with NetLogo. The MIT Press.
   Google Scholar
• Zhang, H., Feng, S., Liu, C., Ding, Y., Zhu, Y., Zhou, Z., Zhang, W., Yu, Y., Jin, H., & Li, Z. (2019). CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario. The World Wide Web Conference, San Francisco, CA, USA.
   Google Scholar
• Zhou, W., Chen, D., Yan, J., Li, Z., Yin, H., & Ge, W. (2022). Multi-agent reinforcement learning for cooperative lane changing of connected and autonomous vehicles in mixed traffic. Autonomous Intelligent Systems, 2(1), 5. https://doi.org/10.1007/s43684-022-00023-5
   Google Scholar