A Driver’s Visual Attention Prediction Using Optical Flow

Abstract

Motion in videos refers to the pattern of the apparent movement of objects, surfaces, and edges over image sequences caused by the relative movement between a camera and a scene. Motion, as well as scene appearance, are essential features to estimate a driver’s visual attention allocation in computer vision. However, the fact that motion can be a crucial factor in a driver’s attention estimation has not been thoroughly studied in the literature, although driver’s attention prediction models focusing on scene appearance have been well studied. Therefore, in this work, we investigate the usefulness of motion information in estimating a driver’s visual attention. To analyze the effectiveness of motion information, we develop a deep neural network framework that provides attention locations and attention levels using optical flow maps, which represent the movements of contents in videos. We validate the performance of the proposed motion-based prediction model by comparing it to the performance of the current state-of-art prediction models using RGB frames. The experimental results for a real-world dataset confirm our hypothesis that motion plays a role in prediction accuracy improvement, and there is a margin for accuracy improvement by using motion features.

Detection of Road Images Containing a Counterlight Using Multilevel Analysis

“…Among these, CCD sensors are the most commonly used as they are inexpensive and can easily record roads in an image form. Most vehicle driving approaches depend on the driver's perception of the driving conditions based on visual information [7,8]. Safe driving support through driving situation recognition based on the driver's visual information is a symmetrical process.…”