Vehicle re-identification and trajectory reconstruction using multiple moving cameras in the CARLA driving simulator

Abstract

Analyzing vehicle movement trajectories is essential for understanding urban mobility and traffic flow patterns. Obtaining a reliable estimate of vehicle trajectory is challenging as it requires the vehicle to be observed and re-identified at different locations and times. Recently, a scalable citywide traffic flow estimation method has been proposed utilizing moving cameras on vehicle dashboards. As moving cameras constantly interact with their surroundings, they provide valuable information about the urban environment that can be used to estimate vehicle trajectories. This study extends the recently proposed method for traffic flow estimation by using cameras mounted on multiple moving observers to reconstruct the trajectory of detected vehicles. We develop the CARLA ReID dataset, which includes more than 50,000 images taken from 85 cameras for over 700 different vehicle models, and train a re-identification network to identify the same vehicle by multiple observers. Utilizing our proposed methodology, we conduct extensive research to estimate trajectories of vehicles in a driving simulator CARLA and evaluate the accuracy of reconstructed trajectories using Symmetrized Segment-Path Distance (SSPD) and Hausdorff Distance metrics. Our proposed method achieves a mean error of 5.13 meters evaluated using the SSPD metric for ten driving experiments in CARLA. Findings from this study will provide valuable insights for conducting traffic flow research in a simulation environment, which is otherwise challenging and costly in practice.

A Computer Vision-Based Algorithm for Detecting Vehicle Yielding to Pedestrians

“…In the traffic area, Jaiswal et al [18] proposed a method for traffic intersection vehicle movement counts with temporal and visual similarity-based re-identification. Kumar et al [19] proposed a vehicle re-identification and trajectory reconstruction method using multiple moving cameras in the CARLA driving simulator. Wang et al [20], used a video channel decomposition saliency region network for vehicle re-identification, Li et al [21] proposed a discriminative-region attention and orthogonal-view generation model for vehicle re-identification.…”