Technology and perception: the contribution of sensory substitution systems

Lenay, Charles; Canu, S.; Villon, P.

doi:10.1109/ct.1997.617681

Cited by 47 publications

(59 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Cross-modal output, in the context of this research, uses more than one modality to represent the same data. Its use of the different senses allows the characteristics of one sensory modality to be transformed into stimuli for another sensory modality [11].…”

Section: Data Artifactsmentioning

confidence: 99%

How Does Representation Modality Affect User-Experience of Data Artifacts?

Hogan

Hornecker

2012

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. We present a study that explores people's affective responses when experiencing data represented through different modalities. In particular, we are interested in investigating how data representations that address haptic/tactile and sonic perception are experienced. We describe the creation of a number of data-driven artifacts that all represent the same dataset. In taking a phenomenological approach to our analysis, we used the Repertory Grid Technique (RGT) during a group session to elicit participant's personal constructs, which are used to describe and compare these artifacts. Our analysis examines these, traces the emergence of one exemplary personal construct and highlights other emergent themes. Our findings consist of a number of elicited constructs that illuminate how the affective qualities of data driven artifacts relate to the type of modality in use.

show abstract

Section: Data Artifactsmentioning

confidence: 99%

How Does Representation Modality Affect User-Experience of Data Artifacts?

Hogan

Hornecker

2012

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…Back-y-Rita's tvss enabled blind subjects to feel objects exterior to their bodies via substitution of vision by artificially produced vibrotactile patterns [4]. A most interesting, minimalist variant is described by Lenay et al where distal attribution is reported to occur for single-site, single-taps vibrotactile stimuli given under the proper sensorimotor coupling [52,36]. Recently, a dynamic form a distal attribution was reported by Yao and Hayward to occur when the tactile stimulation's frequency spectrum is appropriately correlated with the movement of an observer holding a stick.…”

Section: Distal Attributionmentioning

confidence: 99%

A brief taxonomy of tactile illusions and demonstrations that can be done in a hardware store

Hayward

2008

Brain Research Bulletin

140

101

View full text Add to dashboard Cite

This paper surveys more than twenty types of tactile illusions and discusses several of their aspects. These aspects include the ease with which they can be demonstrated and whether they have clear visual analogs. The paper also shows how to construct equipment made of simple supplies able to deliver well controlled tactile signals in order to conveniently demonstrate four different tactile illusions.

show abstract

“…The main application of these systems is increasing accessibility for those with sensory impairments. This class of systems include tactile vision substitution, tactile auditory substitution, and teletouch [84]. Sensory substitution research often focuses on the information processing capabilities of the skin and includes the design of tactile aids for visually and hearing impaired people.…”

Section: Sensory Substitutionmentioning

confidence: 99%

“…Sensory substitution systems take environmental data which would normally be processed by one sensory system and translate this data into stimuli for another sensory system [84]. The main application of these systems is increasing accessibility for those with sensory impairments.…”

Section: Sensory Substitutionmentioning

confidence: 99%

Crossmodal Audio and Tactile Interaction with Mobile Touchscreens

Hoggan

Social and Organizational Impacts of Emerging Mobile Devices

View full text Add to dashboard Cite

Touchscreen mobile devices often use cut-down versions of desktop user interfaces placing high demands on the visual sense that may prove awkward in mobile settings. The research in this thesis addresses the problems encountered by situationally impaired mobile users by using crossmodal interaction to exploit the abundant similarities between the audio and tactile modalities. By making information available to both senses, users can receive the information in the most suitable way, without having to abandon their primary task to look at the device.This thesis begins with a literature review of related work followed by a definition of crossmodal icons. Two icons may be considered to be crossmodal if and only if they provide a common representation of data, which is accessible interchangeably via different modalities. Two experiments investigated possible parameters for use in crossmodal icons with resultsshowing that rhythm, texture and spatial location are effective.A third experiment focused on learning multi-dimensional crossmodal icons and the extent to which this learning transfers between modalities. The results showed identification rates of 92% for three-dimensional audio crossmodal icons when trained in the tactile equivalents, and identification rates of 89% for tactile crossmodal icons when trained in the audio equivalent.Crossmodal icons were then incorporated into a mobile touchscreen QWERTY keyboard.Experiments showed that keyboards with audio or tactile feedback produce fewer errors and greater speeds of text entry compared to standard touchscreen keyboards. The next study examined how environmental variables affect user performance with the same keyboard. The data showed that each modality performs differently with varying levels of background noise or vibration and the exact levels at which these performance decreases occur were established.The final study involved a longitudinal evaluation of a touchscreen application, CrossTrainer, focusing on longitudinal effects on performance with audio and tactile feedback, the impact of context on performance and personal modality preference. The results show that crossmodal audio and tactile icons are a valid method of presenting information to situationally impaired mobile touchscreen users with recognitions rates of 100% over time.This thesis concludes with a set of guidelines on the design and application of crossmodal audio and tactile feedback to enable application and interface designers to employ such feedback in all systems.

show abstract

Technology and perception: the contribution of sensory substitution systems

Cited by 47 publications

References 8 publications

How Does Representation Modality Affect User-Experience of Data Artifacts?

How Does Representation Modality Affect User-Experience of Data Artifacts?

A brief taxonomy of tactile illusions and demonstrations that can be done in a hardware store

Crossmodal Audio and Tactile Interaction with Mobile Touchscreens

Contact Info

Product

Resources

About