Bimodal feedback for in-car mid-air gesture interaction

Abstract

This demonstration showcases novel multimodal feedback designs for in-car mid-air gesture interaction. It explores the potential of multimodal feedback types for mid-air gestures in cars and how these can reduce eyes-off-the-road time thus make driving safer. We will show four different bimodal feedback combinations to provide effective information about interaction with systems in a car. These feedback techniques are visual-auditory, auditory-ambient (peripheral vision), ambient-tactile, and tactile-auditory. Users can interact with the system after a short introduction, creating an exciting opportunity to deploy these displays in cars in the future.

Mid-Air Haptic Rendering of 2D Geometric Shapes With a Dynamic Tactile Pointer

“…Application Opportunities: Two User Scenarios 1) Scenario 1: Haptic Controls in Automotive Systems: Imagine a driver wishes to turn the volume of the radio down, and increase the temperature in the car. It is an important interaction design task of in-car interaction to provide interfaces that do not require the driver to take their eyes off the road [12], [42]. One possibility is to use gesture control interfaces with integrated haptic feedback.…”

Solids on Soli

“…Mid-air gesture interaction has been extensively researched as an alternative to other modes or as a complementary mode of interaction in a variety of settings such as entertainment [6,44,47], automotive industry [19,28,39,46,50], medical applications [10,26,31,43,54], wearable computing [4,14,15,17], smart home control [18,60,64], virtual reality manipulation [23,65], and art installations [36,37]. Such interaction is particularly interesting where other modes are dangerous, hard, or impossible to use.…”