Towards multi-agent reinforcement learning for integrated network of optimal traffic controllers (MARLIN-OTC)

Abstract

Traffic congestion can be alleviated by infrastructure expansions; however, improving the existing infrastructure using traffic control is more plausible due to the obvious financial resources and physical space constraints. The most promising control tools include ramp metering, variable message signs, and signalized intersections. Synergizing the aforementioned strategies in one platform is an ultimate and challenging goal to alleviate traffic gridlock and optimally utilize the existing system capacity; this is referred to as <i>Integrated Traffic Control (ITC). Reinforcement Learning (RL)</i> techniques have the potential to tackle the optimal traffic control problem. <i>Game Theory (GT)</i> fits well in modelling the distributed control systems as multiplayer games. <i>Multi-Agent Reinforcement Learning (MARL)</i> achieves the potential synergy of <i>RL</i> and <i>GT</i> concepts, providing a promising tool for optimal distributed traffic control. The objective of this paper is to clarify the opportunities of game theory concepts and <i>MARL</i> approaches in creating an adaptive optimal traffic control system that is decentralized but yet integrated through agents' interactions. In this paper, we comparatively review and evaluate the relevant existing approaches. We then envision and introduce a novel framework that combines <i>GT</i> concepts and <i>MARL</i> to achieve a <i>Multi-Agent Reinforcement Learning for Integrated Network of Optimal Traffic Controllers (MARLIN-OTC).</i>

Keywords:

• Traffic Control
• Reinforcement Learning
• Game Theory
• Multi-Agent Reinforcement Learning