Mixed Road User Trajectory Extraction From Moving Aerial Videos Based on Convolution Neural Network Detection

Abstract

Vehicle trajectory data under mixed traffic conditions provides critical information for urban traffic flow modeling and analysis. Recently, the application of unmanned aerial vehicles (UAV) creates a potential of reducing traffic video collection cost and enhances flexibility at the spatial-temporal coverage, supporting trajectory extraction in diverse environments. However, accurate vehicle detection is a challenge due to facts such as small vehicle size and inconspicuous object features in UAV videos. In addition, camera motion in UAV videos hardens the trajectory construction procedure. This research aims at proposing a novel framework for accurate vehicle trajectory construction from UAV videos under mixed traffic conditions. Firstly, a Convolution Neural Network (CNN)-based detection algorithm, named You Only Look Once (YOLO) v3, is applied to detect vehicles globally. Then an image registration method based on Shi-Tomasi corner detection is applied for camera motion compensation. Trajectory construction methods are proposed to obtain accurate vehicle trajectories based on data correlation and trajectory compensation. At last, the ensemble empirical mode decomposition (EEMD) is applied for trajectory data denoising. Our framework is tested on three aerial videos taken by an UAV on urban roads with one including intersection. The extracted vehicle trajectories are compared with manual counts. The results show that the proposed framework achieves an average Recall of 91.91% for motor vehicles, 81.98% for non-motorized vehicles and 78.13% for pedestrians in three videos.

Using single and multiple unmanned aerial vehicles for microscopic driver behaviour data collection at freeway interchange ramps

“…The key advantages of manual and semi-automated video processing techniques, though timeconsuming and laborious, are that they are easier to use, can provide highly accurate results, and require less computational power (Khan et al 2017b Recently, the advances in computer vision have allowed researchers to consider automatic approaches to process and analyze UAV video data (Apeltauer et al 2015;Feng et al 2020;Ke et al 2020;Khan et al 2017a;Kim et al 2019). The main advantage is that automatic video analysis systems can provide quick results with minimum human interactions.…”

Robust detection method for improving small traffic sign recognition based on spatial pyramid pooling

“…Initially, CNN was deepened and expanded for better precision, as algorithms have become smaller and more successful in recent years. Recent deep learning algorithms, specifically those incorporating CNN, such as You Look Only Once (Yolo) V3, have shown great power in high precision target detection projects (Feng et al 2020).…”

An Improved FBPN-Based Detection Network for Vehicles in Aerial Images

“…In 2020, Feng et al focus on vehicle trajectory data under mixed traffic conditions [ 27 ]. Through detecting vehicles from UAV videos under mixed traffic conditions, a novel framework for accurate vehicle trajectory construction is designed.…”