Threats Detection during Human-Computer Interaction in Driver Monitoring Systems

Abstract

This paper presents an approach and a case study for threat detection during human–computer interaction, using the example of driver–vehicle interaction. We analyzed a driver monitoring system and identified two types of users: the driver and the operator. The proposed approach detects possible threats for the driver. We present a method for threat detection during human–system interactions that generalizes potential threats, as well as approaches for their detection. The originality of the method is that we frame the problem of threat detection in a holistic way: we build on the driver–ITS system analysis and generalize existing methods for driver state analysis into a threat detection method covering the identified threats. The developed reference model of the operator–computer interaction interface shows how the driver monitoring process is organized, and what information can be processed automatically, and what information related to the driver behavior has to be processed manually. In addition, the interface reference model includes mechanisms for operator behavior monitoring. We present experiments that included 14 drivers, as a case study. The experiments illustrated how the operator monitors and processes the information from the driver monitoring system. Based on the case study, we clarified that when the driver monitoring system detected the threats in the cabin and notified drivers about them, the number of threats was significantly decreased.

In-Cabin Monitoring System for Autonomous Vehicles

“…A wideband antenna array has been used in their experiment for both vehicle safety and comfort in conventional and future intelligent vehicles. Kashevnik et al have introduced threat detection during human-computer interactions in the in-cabin driver monitoring system [41].…”

Optimization of human-machine interface for fatigue driving problem

“…A threat detection method covering identified threats was proposed, and an operator-computer interaction interface reference model was presented showing how the driver monitoring process is organized and what information can be processed automatically and what information related to the driver's behavior has to be processed manually. The experimental results of the study indicated that when the driver monitoring system detects a threat in the compartment and notifies the driver, the number of threats significantly decreased [3]. Many global automotive corporations, including Toyota, Volkswagen, and Nissan, are presently engaged in research focused on driver attention systems.…”