A study of multimodal interaction design based on touch and audition for the visually impaired

Abstract

Background It studies multimodal interaction design based on touch and audition for the visually impaired and related assistive devices. Methods With the consideration of traditional multimodal hypothesis, cognition and multimodal interaction design, this study proposes a multimodal interaction modal based on touch and auditions for the visually impaired, illustrates information flows from tactile and auditory interaction interfaces, and conducts a blind user experiment under multimodal scenario to analyze the ability of user perception and cognition. Results Under the multimodal interaction scenario, the visually impaired users achieved better user experience and higher recognition efficiency. Conclusions Discusses the design principles of blind assistive devices and their interactions by this interaction modal and user experience, guiding the explorations of blind assistive devices design. The visually impaired can enjoy the internet like us.

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

“…Some devices use hardware mechanisms to pinpoint elements in the tactile braille surface, while others use different representations and user interfaces that assist this task. Graille is a 2D braille display with a touch auxiliary guide slider 10 mm above the braille matrix surface [21]. The users insert their finger into the guide slider, and the slider moves on a two-dimensional plane above the pin matrix to the correct element location.…”