A Wearable Device Supporting Multiple Touch- and Gesture-Based Languages for the Deaf-Blind

Caporusso, Nicholas; Biasi, Luigi Di; Cinquepalmi, Giovanni; Trotta, Gianpaolo Francesco; Brunetti, Antonio; Bevilacqua, Vitoantonio

doi:10.1007/978-3-319-60639-2_4

Cited by 19 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Deafblind users send messages through tactile impulses effectuated by one of their hands positioned over the transducers on the palm of the other, glove-wearing hand. More recently, a more advanced dBGLOVE system with multilingual support was designed [3]. It enables deafblind users to choose their preferred tactile language among those supported by the system.…”

Section: The Db-hand and Dbglove Systemsmentioning

confidence: 99%

“…In contrast, people with acquired deafblindness must maintain language and the ability to communicate when deprived of previously good hearing and/or vision [2]. It is estimated that approximately 1.5 million people globally are completely deafblind, compared to 150 million people with different levels of blindness associated with deafness [3]. Given the importance placed on vision and hearing in our daily activities, including communication [4], accessing information, and mobility, those with deafblindness face many complex challenges that may hinder their functioning and participation in daily events and activities and require a variety of assistive, educational, and therapeutic services [5].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Communicating with Humans and Robots: A Motion Tracking Data Glove for Enhanced Support of Deafblind

Gelsomini¹,

Tomasuolo²,

Roccaforte³

et al. 2022

Proceedings of the Annual Hawaii International Conference on System Sciences

View full text Add to dashboard Cite

In this work, we discuss the design and development of a communication system for enhanced support of the deafblind. The system is based on an advanced motion tracking Data Glove that allows for high fidelity determination of finger postures with consequent identification of the basic Malossi alphabet signs. A natural, easy-to-master alphabet extension that supports single-hand signing without touch surface sensing is described, and different scenarios for its use are discussed. The focus is on using the extended Malossi alphabet as a communication medium in a Data Glove-based interface for remote messaging and interactive control of mobile robots. This may be of particular interest to the deafblind community, where distant communications and robotized support and services are rising. The designed Data Glove-based communication interface requires minimal adjustments to the Malossi alphabet and can be mastered after a short training period. The natural interaction style supported by the Data Glove and the popularity of the Malossi alphabet among the deafblind should greatly facilitate the wider adoption of the developed interface.

show abstract

Section: The Db-hand and Dbglove Systemsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Communicating with Humans and Robots: A Motion Tracking Data Glove for Enhanced Support of Deafblind

Gelsomini¹,

Tomasuolo²,

Roccaforte³

et al. 2022

Proceedings of the Annual Hawaii International Conference on System Sciences

View full text Add to dashboard Cite

show abstract

“…Pickering, J. et al [1] The author elaborates the review on the capability of the touch sensing in the displays and the various styles of their uses in satisfying the needs of the application and their designing Schaeffer et al [2] the author develops a sensor integrated robot arm to recognize the need of the elderly and the disabled Caporusso, et al [3] the author has put forward a system integrated with the already existing touch and the gesture based languages to bring out a unique device that supports the diverse societies with an reasonable clarifications. To have a more elaborate view of the touch sensitive devices let us move into the descriptions surveyed from the literature to have a basic knowledge of the touch sensitive devices, the technologies used in them and the categories of the…”

Section: Related Workmentioning

confidence: 99%

“…Where gives the permittivity of the electrospun nanofiber framed without any external touch and gives the volume of the pores. The equation (3) gives the gives the relationship between the external touch and the sensor capacitance ( ).…”

Section: Capacitive Touch Sensors With Pvdf-trfe Nano Fibers With the Carbon Nanotubesmentioning

confidence: 99%

Adaptable Multi-Touch Technology System for Touch Sensitive Devices

Vinothkanna¹

2019

JEEA

View full text Add to dashboard Cite

The touch sensing technology that has paved way for a user friendly interaction with the components has become a more prominent option in the recent days due to its capability of providing a direct communication by just one touch and its compatibility with the users of all age and different level of skills. The touch technology can be single or multi and supported by variety of technologies, such as resistive, capacitive, acoustic and infrared. Among all the technologies the capacitive sensor are widely opted as they possess a low hysteresis, good repeatability and faster response time. The paper also puts forward adaptable multi-touch technology system for the touch sensitive devices, by proposing a flexible capacitive touch sensor to make touch sensitive devices more users friendly with the a highest degree of sensitivity to the touch and satisfactory performance for a broader range of applications with the heightened durability.

show abstract

“…Through various forms of tactile stimulations such as skin stretching [ 28 , 29 ], vibration, force or painless electric shock, they substitute the hearing and vision impairments. Thus, they substantially rely on the tactile sensing [ 30 ] as well as tactile feedback (e.g., using actuators in tactile displays) to explore and manipulate objects around them [ 6 , 7 , 31 ]. Similarly, combination of tactile sensing [ 32 ] and tactile feedback is needed in areas such as minimal invasive surgery [ 2 , 5 ] and virtual reality [ 33 , 34 ] to improve the user’s haptic interaction experience.…”

Section: Introductionmentioning

confidence: 99%

Tacsac: A Wearable Haptic Device with Capacitive Touch-Sensing Capability for Tactile Display

Ozioko

Navaraj

Hersh

et al. 2020

Sensors

View full text Add to dashboard Cite

This paper presents a dual-function wearable device (Tacsac) with capacitive tactile sensing and integrated tactile feedback capability to enable communication among deafblind people. Tacsac has a skin contactor which enhances localized vibrotactile stimulation of the skin as a means of feedback to the user. It comprises two main modules—the touch-sensing module and the vibrotactile module; both stacked and integrated as a single device. The vibrotactile module is an electromagnetic actuator that employs a flexible coil and a permanent magnet assembled in soft poly (dimethylsiloxane) (PDMS), while the touch-sensing module is a planar capacitive metal-insulator-metal (MIM) structure. The flexible coil was fabricated on a 50 µm polyimide (PI) sheet using Lithographie Galvanoformung Abformung (LIGA) micromoulding technique. The Tacsac device has been tested for independent sensing and actuation as well as dual sensing-actuation mode. The measured vibration profiles of the actuator showed a synchronous response to external stimulus for a wide range of frequencies (10 Hz to 200 Hz) within the perceivable tactile frequency thresholds of the human hand. The resonance vibration frequency of the actuator is in the range of 60–70 Hz with an observed maximum off-plane displacement of 0.377 mm at coil current of 180 mA. The capacitive touch-sensitive layer was able to respond to touch with minimal noise both when actuator vibration is ON and OFF. A mobile application was also developed to demonstrate the application of Tacsac for communication between deafblind person wearing the device and a mobile phone user who is not deafblind. This advances existing tactile displays by providing efficient two-way communication through the use of a single device for both localized haptic feedback and touch-sensing.

show abstract

A Wearable Device Supporting Multiple Touch- and Gesture-Based Languages for the Deaf-Blind

Cited by 19 publications

References 4 publications

Communicating with Humans and Robots: A Motion Tracking Data Glove for Enhanced Support of Deafblind

Communicating with Humans and Robots: A Motion Tracking Data Glove for Enhanced Support of Deafblind

Adaptable Multi-Touch Technology System for Touch Sensitive Devices

Tacsac: A Wearable Haptic Device with Capacitive Touch-Sensing Capability for Tactile Display

Contact Info

Product

Resources

About