Video-Based Abnormal Driving Behavior Detection via Deep Learning Fusions

Abstract

Video-based abnormal driving behavior detection is becoming more and more popular for the time being, as it is highly important in ensuring safeties of drivers and passengers in the vehicle, and it is an essential step in realizing automatic driving at the current stage. Thanks to recent developments in deep learning techniques, this challenging detection task can be largely facilitated via the prominent generalization capability of sophisticated deep learning models as well as large volumes of video clips which are indispensable for thoroughly training these data-driven deep learning models. In this paper, deep learning fusion techniques are emphasized, and three novel deep learning-based fusion models inspired by the recently proposed and popular densely connected convolutional network (DenseNet) are introduced, to fulfill the video-based abnormal driving behavior detection task for the first time. These three new deep learning-based fusion models are named as the wide group densely (WGD) network, the wide group residual densely (WGRD) network, and the alternative wide group residual densely (AWGRD) network, respectively. Technically, WGD takes important issues of deep learning models, i.e., the depth, the width and the cardinality, into consideration when designing its model structure based on DenseNet. For the WGRD and AWGRD, they are more sophisticated as the important idea of residual networks with superpositions of previous layers is incorporated. The extensive experiments are conducted to verify the effectiveness of three new models. Their superiority has been suggested based on rigorous comparisons towards several popular deep learning models in this video-based abnormal driving behavior detection study.INDEX TERMS Artificial intelligence, digital images, vehicle driving, abnormal driving detection, densely connected convolutional networks, deep learning.

Driver Behavior Classification: A Systematic Literature Review

“…The archived model had 81.66% accuracy. Distracted behavior is classified in papers [102], [103] as texting with the right and left hands, talking on the phone using the right and left hands, drinking, reaching, applying makeup, and talking to passengers using CNN based algorithms. The algorithm achieved 99% accuracy.…”

“…Accident Analysis and Prevention [58], [66], [83], [87], [89], [93], [94], [105], [116] Transportation Research Part F: Traffic Psychology and Behavior [40], [46], [104], [109], [111], [113], [115], [122] IEEE Access [61], [91], [97], [100], [101], [103] Journal of Safety Research [112], [114], [118], [119] Type of behavior Papers Abnormal driver behavior [29], [30], [31], [32], [33], [34], [35], [36], [37], [38], [39], [40], [41], [42], [43], [44], [45], [46], [47], [48], [49], [50], [51],…”

Detecting Human Driver Inattentive and Aggressive Driving Behavior Using Deep Learning: Recent Advances, Requirements and Open Challenges

“…W. Huang et al [102] have proposed three video-based behavior detection techniques for abnormal driving using three deep learning-based fusion model. The proposed models WGD (wide group densely network), WGRD (wide group residual densely network) and AWGRD (alternative wide group residual densely network) are motivated by DenseNet which is based on the densely connected convolutional network.…”

Unusual Driver Behavior Detection in Videos Using Deep Learning Models

“…The third category includes distracted driving behaviors influenced by the environment, such as caring for children or paying long-term attention to dramatic situations outside the automobile. Among the above abnormal driving behaviors, mobile phones have emerged as an essential component in modern abnormal driving [ 5 ].…”