Toward haptic mathematics

Abstract

Understanding a mathematical concept, expressed in a written form, requires the exploration of the whole symbolic expression to recognize its component significant patterns as well as its overall structure. This exploration is difficult for visually impaired people whether the symbolic expression is materialized as an oral description or a Braille expression. The paper introduces the notion of Haptic Mathematics as a digital medium of thought and communication of mathematical concepts that adopts the nomenclature and language of Mathematics and makes its expressions perceptible as sets of haptic signals. As a first step toward Haptic Mathematics, the paper presents a system adopting an audio-haptic interaction whose goal is to enable visual impaired or blind people to reason on graph structures and communicate their reasoning with sighted people. The paper describes a first system prototype and some preliminary usability results aimed at evaluating the effectiveness of the proposal.

On the Evaluation of Novel Sonification Techniques for Non-Visual Shape Exploration

“…Proposed solutions can be broadly divided in two groups: tactile or haptic representations ( [Kurze 1996;Xu et al 2011;Bernareggi et al 2008;Monnai et al 2014;Kim and Lim 2011]) and image sonification. The focus of this review is on the latter group, with particular attention to the techniques that can be adopted to recognize shapes on touchscreen devices.…”