Haptic Speech Communication Using Stimuli Evocative of Phoneme Production

Vargas, Maurício Fontana de; Weill–Duflos, Antoine; Cooperstock, Jeremy R.

doi:10.1109/whc.2019.8816145

Cited by 9 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Even after this many hours of training the correct rate still was only 42%. A recent study in which the speech signal was decomposed into phonemes seems to be more promising [6]. After 100 minutes of training a correct rate of 45% for recognising words was achieved.…”

Section: Discussionmentioning

confidence: 99%

Learning the Vibrotactile Morse Code Alphabet

Plaisier

Vermeer

Kappers

2020

ACM Trans. Appl. Percept.

View full text Add to dashboard Cite

Vibrotactile Morse code provides a way to convey words using the sense of touch with vibrations. This can be useful in applications for users with a visual and/or auditory impairment. The advantage of using vibrotactile Morse code is that it is technically easy to accomplish. The usefulness of tactile Morse code also depends on how easy it is to learn to use without providing a visual representation of the code. Here we investigated learning of the vibrotactile the Morse code alphabet without any visual representation of the code and whether the learned letters can immediately be used to recognize words. Two vibration motors were used: one was attached to the left arm (dots) and the other to the right arm (dashes). We gave the participants a learning session of 30 minutes and determined how many letters they had learned. All participants managed to learn at least 15 letters in this time. Directly afterward, they were presented with 2-, 3-, 4-, or 5-letter words consisting of only the letters they had learned. Participants were able to identify words, but correct rates decreased rapidly with word length. We can conclude that it is possible to learn vibrotactile Morse code using only a vibrotactile representation (15 to 24 letters in 30 minutes). After the learning session, it was possible to recognise words, but to increase the recognition rates extra training would be beneficial.

show abstract

Section: Discussionmentioning

confidence: 99%

Learning the Vibrotactile Morse Code Alphabet

Plaisier

Vermeer

Kappers

2020

ACM Trans. Appl. Percept.

View full text Add to dashboard Cite

show abstract

“…This transfer of learning has also been demonstrated in studies with other tactile speech devices. Using the WhatsHap device, de Vargas et al [6] showed that performance was well above chance levels when new words were introduced into the vocabulary. In studies with the Tickle Talker.…”

Section: Discussionmentioning

confidence: 99%

“…Word-identification studies included probes of the ability to generalize performance from a set of trained words to novel words. Following 100 min of training, open-set identification of words from a 150-word vocabulary was 51% correct and fell to 39% correct for novel words [6]. In a later study, de Vargas et al [7] reported isolated word scores of roughly 50% correct for trained words compared to 45% correct for novel words in tests where the inter-phoneme interval was under the participant's control.…”

Section: Introductionmentioning

confidence: 95%

“…The present study was motivated by recent research on phoneme-based tactile speech communication systems conducted at Faceboook/Meta [1][2][3], Rice University [4,5], McGill University [6][7][8], and a collaborative effort between Purdue University and MIT [9][10][11][12][13][14]. Our approach assumes that the front end of the device contains a module for producing a string of phonemes extracted from either the acoustic speech signal (using automatic speech recognition) or written text (using a text-to-speech converter).…”

Section: Introductionmentioning

confidence: 99%

“…Another phoneme-based display, developed at McGill University and referred to as WhatsHap [6][7][8], consists of two tactors on the forearm used to encode 25 English phonemes based on salient acoustic features for 16 consonants and speech synthesis for nine vowels. Word-identification studies included probes of the ability to generalize performance from a set of trained words to novel words.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Tactile Speech Communication: Reception of Words and Two-Way Messages through a Phoneme-Based Display

Jung,

Reed,

Martinez

et al. 2024

Virtual Worlds

View full text Add to dashboard Cite

The long-term goal of this research is the development of a stand-alone tactile device for the communication of speech for persons with profound sensory deficits as well as for applications for persons with intact hearing and vision. Studies were conducted with a phoneme-based tactile display of speech consisting of a 4-by-6 array of tactors worn on the dorsal and ventral surfaces of the forearm. Unique tactile signals were assigned to the 39 English phonemes. Study I consisted of training and testing on the identification of 4-phoneme words. Performance on a trained set of 100 words averaged 87% across the three participants and generalized well to a novel set of words (77%). Study II consisted of two-way messaging between two users of TAPS (TActile Phonemic Sleeve) for 13 h over 45 days. The participants conversed with each other by inputting text that was translated into tactile phonemes sent over the device. Messages were identified with an accuracy of 73% correct in conjunction with 82% of the words. Although rates of communication were slow (roughly 1 message per minute), the results obtained with this ecologically valid procedure represent progress toward the goal of a stand-alone tactile device for speech communication.

show abstract