Acquisition of 500 English Words through a TActile Phonemic Sleeve (TAPS)

Tan, Hong Z.; Reed, Charlotte M.; Jiao, Yang; Perez, Zachary D.; Wilson, Eve; Jung, Jaehong; Martinez, Juan S.; Severgnini, Frederico M.

doi:10.1109/toh.2020.2973135

Cited by 42 publications

(38 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For the data of the seven subjects who were tested on IWI of 2,000, 1,000, and 750 ms, scores averaged 63.8%, 76.0%, and 67.6% correct, respectively. A one-way ANOVA conducted on the rationalized arcsine transformation of the percent-correct scores [31] indicated no significant effect of IWI (F(2,18) =1.22, p = .319).…”

Section: Resultsmentioning

confidence: 96%

“…Following 100 minutes of training, the best learners of the display were able to recognize words with an accuracy of 90% or greater (where chance performance was 1/100). Further study of word recognition through the TAPS device was reported by [31]. These experiments included 51 participants who advanced to testing with a 500-word vocabulary.…”

Section: Goals Of Current Studymentioning

confidence: 99%

“…The current study is concerned with extending our previous research on the use of a phonemic-based haptic display for word recognition [25,27,[29][30][31]. We present below a brief review of results obtained in previous studies concerned with the recognition of words through tactile-alone presentation for both spectral-based and phonemic-based tactile displays.…”

Section: Introduction 1overview Of Tactile Speech Communicationmentioning

confidence: 96%

“…Recent work has employed a phonemic-based strategy for a tactile display of speech, under the assumption that phonemic strings can be derived from ASR at the front end of the system [25][26][27][28][29][30][31][32][33][34][35]. This approach allows for the development of tactile displays that are no longer tied to displays of the acoustic speech spectrum, but instead allow for the design of displays that exploit the information-bearing properties of the tactual sense.…”

Section: Introduction 1overview Of Tactile Speech Communicationmentioning

confidence: 99%

See 3 more Smart Citations

Identification of Words and Phrases Through a Phonemic-Based Haptic Display

Reed

Tan

Jiao

et al. 2021

ACM Trans. Appl. Percept.

Self Cite

View full text Add to dashboard Cite

Stand-alone devices for tactile speech reception serve a need as communication aids for persons with profound sensory impairments as well as in applications such as human-computer interfaces and remote communication when the normal auditory and visual channels are compromised or overloaded. The current research is concerned with perceptual evaluations of a phoneme-based tactile speech communication device in which a unique tactile code was assigned to each of the 24 consonants and 15 vowels of English. The tactile phonemic display was conveyed through an array of 24 tactors that stimulated the dorsal and ventral surfaces of the forearm. Experiments examined the recognition of individual words as a function of the inter-phoneme interval (Study 1) and two-word phrases as a function of the inter-word interval (Study 2). Following an average training period of 4.3 hrs on phoneme and word recognition tasks, mean scores for the recognition of individual words in Study 1 ranged from 87.7% correct to 74.3% correct as the inter-phoneme interval decreased from 300 to 0 ms. In Study 2, following an average of 2.5 hours of training on the two-word phrase task, both words in the phrase were identified with an accuracy of 75% correct using an inter-word interval of 1 sec and an inter-phoneme interval of 150 ms. Effective transmission rates achieved on this task were estimated to be on the order of 30 to 35 words/min.

show abstract

Section: Resultsmentioning

confidence: 96%

Section: Goals Of Current Studymentioning

confidence: 99%

Section: Introduction 1overview Of Tactile Speech Communicationmentioning

confidence: 96%

Section: Introduction 1overview Of Tactile Speech Communicationmentioning

confidence: 99%

See 2 more Smart Citations

Identification of Words and Phrases Through a Phonemic-Based Haptic Display

Reed

Tan

Jiao

et al. 2021

ACM Trans. Appl. Percept.

Self Cite

View full text Add to dashboard Cite

show abstract

“…The goal of such efforts, unlike the conventional vibration signals presently employed as notifications in various devices, is to determine how to develop wearable tactual displays that transfer sufficient information relating to environmental perception by engaging haptic patterns or symbols [14]. However, unlike the notifying vibration patterns, such complex vibrotactile communication systems are yet to mature [15], even though some functionalities exist in some solutions. Nevertheless, with the developments in technology, a new wave of wearable haptic displays appears ready for significant improvements in auditory or sight to touch translation and reception.…”

Section: Introductionmentioning

confidence: 99%

A Study of Cutaneous Perception Parameters for Designing Haptic Symbols towards Information Transfer

Nyasulu

Steyn

et al. 2021

Electronics

View full text Add to dashboard Cite

Vibrotactile displays can substitute for sensory channels of individuals experiencing temporary or permanent impairments in balance, vision, or hearing, and can enhance the user experience in professional or entertainment situations. This massive range of potential uses necessitates primary research on human vibrotactile perception. One leading aspect to consider when developing such displays is how to develop haptic patterns or symbols to represent a concept. In most settings, individual patterns are sorted as alphabets of haptic symbols which formulate tactons. Tactons are structured and perceivable tactile patterns (i.e., messages) that transfer information to users by employing the sense of touch. Hence, haptic patterns are critical when designing vibrotactile displays, as they not only affect the rate of information transfer but also determine the design of the displays (e.g., the number and the placement of tactors engaged) and how the information is encoded to achieve separability. Due to this significance, this paper presents an overview study on the cutaneous perception parameters (i.e., intensity, loci, frequency, duration, illusions, and combinations of these) for designing haptic symbols to identify mutual best-practices and knowledge gaps for future work. The study also provides developers from different scientific backgrounds with access to complex notions when engaging this specialized topic (i.e., the use of cutaneous perception parameters towards information transfer). Finally, it offers recommendations on defining which parameters to engage for a specific task or pattern.

show abstract

Haptic Mediators for Remote Interpersonal Communication

McDaniel

Tadayon

2021

Multimedia for Accessible Human Computer Interfaces

View full text Add to dashboard Cite

Acquisition of 500 English Words through a TActile Phonemic Sleeve (TAPS)

Cited by 42 publications

References 33 publications

Identification of Words and Phrases Through a Phonemic-Based Haptic Display

Identification of Words and Phrases Through a Phonemic-Based Haptic Display

A Study of Cutaneous Perception Parameters for Designing Haptic Symbols towards Information Transfer

Haptic Mediators for Remote Interpersonal Communication

Contact Info

Product

Resources

About