Improving Perception Accuracy with Multi-sensory Haptic Cue Delivery

Dunkelberger, Nathan; Bradley, Joshua; Sullivan, Jennifer L.; Israr, Ali; Lau, Frances; Klumb, Keith; Abnousi, Freddy; O’Malley, Marcia K.

doi:10.1007/978-3-319-93399-3_26

Cited by 26 publications

(34 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Looking at the dimensions of both the Stretch-Pro 1M, 70x32x18 mm, and Stretch-Pro 2M, 73x68x26 mm, it is worth noticing that these are smaller if compared to the Hap-Pro in [23], 90x65x30 mm. The dimension of [28] are comparable to the Stretch-Pro 1M: however if we would like to duplicate its architecture to provide different tactile elicitations, the dimensions would significantly grow, as reported in [31].…”

Section: Device Descriptionmentioning

confidence: 97%

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

Colella

Bianchi

Grioli

et al. 2019

IEEE Robot. Autom. Lett.

View full text Add to dashboard Cite

Without proprioception, i.e. the intrinsic capability of a body to perceive its own limb position, completing daily life activities would require constant visual attention and it would challenging or even impossible. This situation is similar to the one experienced after limb amputation and in robotic tele-operation, where the natural sensory-motor loop is broken. While some promising solutions based on skin stretch sensory substitution have been proposed to restore tactile properties in these conditions, there is still room for enhancing the intuitiveness of stimulus delivery and the integration of haptic feedback devices within user's body. To contribute to this goal, here we propose a wearable device based on skin stretch stimulation, the Stretch-Pro, which can provide proprioceptive information on artificial hand aperture. This system can be suitably integrated in a prosthetic socket, or can be easily worn by a user controlling remote robots. The system can imitate the stretching of the skin that would naturally occur on the intact limb, when it is used to accomplish motor tasks. Two versions of the system are presented, with 1 and 2 actuators, respectively, which deliver the stretch stimulus in different ways. Experiments with ablebodied participants and a preliminary test with one prosthesis user are reported. Results suggest that Stretch-Pro could be a viable solution to convey proprioceptive cues to upper limb prosthesis users, opening promising perspectives for tele-robotics applications.

show abstract

Section: Device Descriptionmentioning

confidence: 97%

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

Colella

Bianchi

Grioli

et al. 2019

IEEE Robot. Autom. Lett.

View full text Add to dashboard Cite

show abstract

“…There are two input functions required to compute the expected cost of a given mapping. D : M × M → R + represents the probability of confusing one cue for another, and was determined empirically using previous studies [4]. F : N × N → R + represents the cost of confusing one phoneme for another.…”

Section: Mapping Haptic Cues To Phonemesmentioning

confidence: 99%

“…After initial testing [4], the cost function was adjusted to make it easy for subjects to distinguish between consonants and vowels by constraining the assignment of consonant phonemes to cues with the squeeze enabled and vowel phonemes to cues with the squeeze disabled. This feature aids with memory recall, as it reduces the number of search items the subject needs to consider to either the set of vowels or the set of consonants based on whether the squeeze is included in the presented cue.…”

Section: Mapping Haptic Cues To Phonemesmentioning

confidence: 99%

“…In this paper, we introduce a haptic language through the use of the Multi-sensory Interface of Stretch, Squeeze, and Integrated Vibration Elements (MISSIVE) [4], a compact, wearable haptic device capable of producing multi-sensory cues. The MISSIVE is worn on the upper arm and leverages the ability to perceive different types of tactile sensations concurrently.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Conveying language through haptics

Dunkelberger

Sullivan

Bradley

et al. 2018

Proceedings of the 2018 ACM International Symposium on Wearable Computers

Self Cite

View full text Add to dashboard Cite

In our daily lives, we rely heavily on our visual and auditory channels to receive information from others. In the case of impairment, or when large amounts of information are already transmitted visually or aurally, alternative methods of communication are needed. A haptic language offers the potential to provide information to a user when visual and auditory channels are unavailable. Previously created haptic languages include deconstructing acoustic signals into features and displaying them through a haptic device, and haptic adaptations of Braille or Morse code; however, these approaches are unintuitive, slow at presenting language, or require a large surface area. We propose using a multi-sensory haptic device called MISSIVE, which can be worn on the upper arm and is capable of producing brief cues, sufficient in quantity to encode the full English phoneme set. We evaluated our approach by teaching subjects a subset of 23 phonemes, and demonstrated an 86% accuracy in a 50 word identification task after 100 minutes of training.

show abstract

“…Until recently, to understand the integration between kinesthetic and tactile information for manipulation and grip force control, studies used impaired sensory systems by studying neurological patients or by sensory elimination [34][35][36]. In the recent years, new devices were developed that can stimulate the tactile mechanoreceptors by deforming the skin, and thereby augment the tactile sensation [37]. Using these devices, it was shown that artificial skin deformation can increase the perceived mechanical properties [4,[38][39][40][41][42][43], possibly due to an increase in the perceived forces, and substitute and augment kinesthetic information in some motor tasks [44][45][46][47][48].…”

Section: Introductionmentioning

confidence: 99%

The effect of tactile augmentation on manipulation and grip force control during force-field adaptation

Avraham

Nisky

2020

J NeuroEngineering Rehabil

View full text Add to dashboard Cite

Background: When exposed to a novel dynamic perturbation, participants adapt by changing their movements' dynamics. This adaptation is achieved by constructing an internal representation of the perturbation, which allows for applying forces that compensate for the novel external conditions. To form an internal representation, the sensorimotor system gathers and integrates sensory inputs, including kinesthetic and tactile information about the external load. The relative contribution of the kinesthetic and tactile information in force-field adaptation is poorly understood. Methods: In this study, we set out to establish the effect of augmented tactile information on adaptation to forcefield. Two groups of participants received a velocity-dependent tangential skin deformation from a custom-built skin-stretch device together with a velocity-dependent force-field from a kinesthetic haptic device. One group experienced a skin deformation in the same direction of the force, and the other in the opposite direction. A third group received only the velocity-dependent force-field. Results: We found that adding a skin deformation did not affect the kinematics of the movement during adaptation. However, participants who received skin deformation in the opposite direction adapted their manipulation forces faster and to a greater extent than those who received skin deformation in the same direction of the force. In addition, we found that skin deformation in the same direction to the force-field caused an increase in the applied grip-force per amount of load force, both in response and in anticipation of the stretch, compared to the other two groups. Conclusions: Augmented tactile information affects the internal representations for the control of manipulation and grip forces, and these internal representations are likely updated via distinct mechanisms. We discuss the implications of these results for assistive and rehabilitation devices.

show abstract

Improving Perception Accuracy with Multi-sensory Haptic Cue Delivery

Cited by 26 publications

References 27 publications

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

Conveying language through haptics

The effect of tactile augmentation on manipulation and grip force control during force-field adaptation

Contact Info

Product

Resources

About