No abstract

Given that most cues exchanged during a social interaction are nonverbal (e.g., facial expressions, hand gestures, body language), individuals who are blind are at a social disadvantage compared to their sighted peers. Very little work has explored sensory augmentation in the context of social assistive aids for individuals who are blind. The purpose of this study is to explore the following questions related to visual-to-vibrotactile mapping of facial action units (the building blocks of facial expressions): (1) How well can individuals who are blind recognize tactile facial action units compared to those who are sighted? (2) How well can individuals who are blind recognize emotions from tactile facial action units compared to those who are sighted? These questions are explored in a preliminary pilot test using absolute identification tasks in which participants learn and recognize vibrotactile stimulations presented through the Haptic Chair, a custom vibrotactile display embedded on the back of a chair. Study results show that individuals who are blind are able to recognize tactile facial action units as well as those who are sighted. These results hint at the potential for tactile facial action units to augment and expand access to social interactions for individuals who are blind.

Emotional response to haptic stimuli is a widely researched topic, but the combination of vibrotactile and thermal stimuli requires more attention. The purpose of this study is to investigate emotional response to vibrothermal stimulation by combining spatiotemporal vibrotactile stimulus with dynamic thermal stimulus (hot or cold). The vibrotactile and thermal stimuli were produced using the Haptic Chair and the Embr wave thermal bracelet, respectively. The results show that spatiotemporal vibrotactile patterns and their duration, and dynamic thermal stimulation, have an independent effect on the emotional response. Increasing duration generally increases the valence and arousal of emotional response. Shifting the dynamic temperature from cold to hot generally decreases the valence of emotional response but has no significant effect on arousal. Nevertheless, certain spatiotemporal patterns do exhibit unique responses to changes in dynamic temperature, although no interaction effects were found. The results show the potential of designing affective haptic interfaces using multimodal vibrothermal feedback.