A Switching-Based Adaptive Dynamic Programming Method to Optimal Traffic Signaling

Abstract

The work presented in this paper concerns a switching-based control formulation for multi-intersection and multi-phase traffic light systems. A macroscopic traffic flow modelling approach is first presented, which is instrumental to the development of a model-based and switching-based optimization method for traffic signal operation, in the framework of Adaptive Dynamic Programming (ADP). The main advantage of the switching-based formulation is its capability to determine both 'when' to switch and 'which' mode to switch on without the need to use the cycle-based average flow approximation typical of state-of-the-art formulations. In addition, the framework can handle different cycle times across intersections without the need for synchronization constraints and, moreover, minimum dwell-time constraints can be directly enforced to comply with minimum green/red times in each phase. Simulation experiments on a multi-intersection and multi-phase traffic light systems are presented to show the effectiveness of the method.

Multi-Objective Robust Optimization for the Traffic Sensors Location Problem

“…Liu et al [48] presented a model-based and switching-based control formulation for multi-intersection and multiphase traffic signal operation. Based on their model, appropriate adaptive dynamic programming methods were used to seek the optimal traffic light policy.…”

On Distributed Implementation of Switch-Based Adaptive Dynamic Programming

“…Alternative switch-based ADP methods were considered in [13] and [14] for classes of switched systems, and in [15] for classes of piecewise-smooth systems. Applications include optimal switching in power converters [16], traffic networks [17], and networked control [18], [19].…”

Control of a Mixed Autonomy Signalised Urban Intersection: An Action-Delayed Reinforcement Learning Approach

“…Algorithms to control the traffic-light duration at urban intersection based on dynamic programming or by control theory have been proposed, for instance, in [1], [2], [3], [4], [5], [6]. See also [7], [8] for broad reviews.…”