Evolutionary reinforcement learning multi-agents system for intelligent traffic light control: new approach and case of study

Abstract

<span>Due to the rapid growth of urban vehicles, traffic congestion has become more serious. The signalized intersections are used all over the world and still established in the new construction. This paper proposes a self-adapted approach, called evolutionary reinforcement learning multi-agents system (ERL-MA), which combines computational intelligence and machine learning. The concept of this work is to build an intelligent agent capable of developing senior skills to manage the traffic light control system at any type of junction, using two powerful tools: learning from the confronted experience and the assumption using the randomization concept. The ERL-MA is an independent multi-agents system composed of two layers: the modeling and the decision layers. The modeling layer uses the intersection modeling using generalized fuzzy graph technique. The decision layer uses two methods: the novel greedy genetic algorithm (NGGA), and the Q-learning. In the Q-learning method, a multi Q-tables strategy and a new reward formula are proposed. The experiments used in this work relied on a real case of study with a simulation of one-hour scenario at Pasubio area in Italy. The obtained results show that the ERL-MA system succeeds to achieve competitive results comparing to urban traffic optimization by integrated automation (UTOPIA) system using different metrics.</span>

Analisis Tingkat Layanan Kinerja Simpang Bersinyal pada Kawasan Komersial

“…Untuk mengatasi permasalahan ini, pengendalian simpang menjadi suatu kebutuhan, dan salah satu metode yang umum digunakan adalah sistem kendali lampu lalulintas (Banter et al, 2019;Gulo, 2019;Sihotang, 2020). Sistem lampu lalulintas di simpang telah diterapkan secara luas di seluruh dunia pada era modern ini (Basmassi et al, 2022), dimulai dari pengembangan pertama kali pada tahun 1868 di Inggris (Jiang et al, 2021). Meskipun sudah terpasang sistem kendali lampu lalulintas, simpang bersinyal masih sering mengalami masalah, seperti tundaan atau antrian yang panjang, terutama pada jam sibuk.…”

Model of Base Saturation Flow to Improve Indonesia Highway Capacity Manual at Signalized Intersection

“…Traffic management has become a primary focus of many countries due to urbanization [1]. According to [2], signalized intersections are widely used in modern times across the world. The intersection is an essential node of urban roads.…”

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

“…Traffic Signal Control Optimization: Intelligent agents interact with local signal controllers, leveraging graph-based insights to optimize traffic signal timings by analyzing sensor data from key locations and communicating with local signal controllers [78,79]. This dynamic control mechanism helps in avoiding congestion and improving traffic flow.…”