Gesture-Based User Interface for Vehicle On-Board System: A Questionnaire and Research Approach

Abstract

Touchless interaction with electronic devices using gestures is gaining popularity and along with speech-based communication offers their users natural and intuitive control methods. Now, these interaction modes go beyond the entertainment industry and are successfully applied in real-life scenarios such as a car interior. In the paper, we analyse the potential of hand gesture interaction in the vehicle environment by physically challenged drivers. A survey conducted with potential users shows that the knowledge of gesture-based interaction and its practical use by people with disabilities is low. Based on these results we proposed a gesture-based system for vehicle on-board system. It has been developed on the available state-of-the-art solutions and investigated in terms of usability on a group of people with different physical limitations who drive a car on daily basis mostly using steering aid tools. The obtained results are compared with the performance of users without any disabilities.

Processing and Integration of Multimodal Image Data Supporting the Detection of Behaviors Related to Reduced Concentration Level of Motor Vehicle Users

“…Furthermore, automated event detection can surpass human perception and senses in accuracy and efficiency (e.g., [3]). Comfort is further enhanced by advanced infotainment systems utilizing natural human-machine interaction methods like voice commands with intelligent assistants or gesture control interfaces [4]. Finally, driver monitoring systems that detect fatigue and distraction play an increasingly vital role, allowing for intervention and alerting the driver to potential hazards.…”

The Relationship Between Illusory Heaviness Sensation and the Motion Speed of Visual Feedback in Gesture-Based Touchless Inputs

“…1 Based on the detected gesture-based inputs, these systems give sensory feedback to users. Gesture-based touchless operations are becoming more and more practical in many situations, such as digital signage like KIOSK (Georgiou et al, 2019), car systems (Małecki et al, 2020), smart watches (Ogata and Imai, 2015;Xu et al, 2015), and public displays (Muller et al, 2014).…”

Towards a GUI Gesture Control Using the Leap Motion Controller

“…Contactless interfaces are yet another possible mode of interaction with the machine to control a device by eye contact [3], by voice [4] or by gesture [5,6]. Such an interaction would be of particular interest for hygiene or safety reasons, or even for communication through a natural language in the context of home automation or applications for the elderly, people with disabilities and maybe for those not used to computers.…”