Detecting abnormal movement of driver's head based on spatial-temporal features of video using deep neural network DNN

Abstract

<p>The development of tracking and surveillance devices makes extracting useful information efficiently. Head tracking is an efficient method to obtain then analyze trajectory data and make a decision based on the spatiotemporal information of videos. Many applications are based on head tracking such as diseases some diagnosis, the gestures languages, and drowsiness detection and so on. Abnormal head movement detection can be achieved using spatial information based on a single image (one frame) at a time without considering the temporal information over time. In this paper, a new method based on multi-images is proposed to track head in order to detect abnormal head movement depending on spatiotemporal Feature using Deep Neural Network DNN that employed the 3-Dimensional Convolution Neural Networks 3D CNN. The proposed method extracts the spatial information as well as the temporal information available in a video then analysis this information to make the decision based on time series (sequences of frames); these time series provides the tracking to the head overtime to make the decision. The new dataset created and gathered to implement with the proposed system and called Normal Abnormal Head Movement Dataset (NAHM) video dataset. The new dataset provides different subjects with different conditions that give more efficiency in the implementation of the proposed system. The accuracy of the training set that achieves by the proposed system reach to 88% and of validation set reaches to 86%. The values of loss function reach to 0.3 for the training set and 0.4 for the validation set.</p>

User identification based on short text using recurrent deep learning

“…As the neural network is aimed to imitate the human brain then deep learning is also considered as a kind of imitate for human brain. Deep learning has been used in many applications, such as biometric system [24], abusive comment identification [25], skin cancers detection [26], automatic text generation [27], [28], healthcare [29], image recognition [30], and video [31].…”

Driver drowsiness monitoring system based on facial Landmark detection with convolutional neural network for prediction

“…Our work in this paper focuses on the vehicle interior, especially on a driver's facial trait. Yawning and facial expressions are among the most prominent traits that help in driver fatigue detection [6]- [8]. It is commonly known that yawning represents another sign of drowsiness; head drooping indicates fatigue; moreover, anger, fear, surprise, and sadness negatively affect the driver [9], [10].…”