The effect of sound on haptic fidelity perception

Melaisi, Mohammed; Nguyen, Minh; Uribe, Alvaro; Kapralos, Bill

doi:10.1109/educon.2017.7942926

Cited by 5 publications

(5 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is likely that audiohaptic interactions were able to influence a user's experience, leading to a more realistic perception of the simulated environment. These results verify prior findings from Melaisi and colleagues [21], who found that users perceived the highest level of haptic fidelity in a drilling task when presented with a drill audio recording, compared to listening to classical music, heavy metal, white noise, or no sound at all. The same participants also felt that sound was an important aspect of their experience, which highlights the importance of contextual stimuli [21].…”

Section: Discussionsupporting

confidence: 90%

“…These results verify prior findings from Melaisi and colleagues [21], who found that users perceived the highest level of haptic fidelity in a drilling task when presented with a drill audio recording, compared to listening to classical music, heavy metal, white noise, or no sound at all. The same participants also felt that sound was an important aspect of their experience, which highlights the importance of contextual stimuli [21]. The current study builds on this research and indicates that low-fidelity audiohaptic stimuli can enhance a user's perceived realism, when compared with audio stimuli alone.…”

Section: Discussionsupporting

confidence: 90%

“…A recent emergence of haptic and audiohaptic interactions within simulation research more accurately replicates the multimodal environment in which humans actually perform [21,22]. We are constantly engaging with various stimuli, and when two or more sensory inputs are congruent and presented simultaneously, we are able to process and respond to our environment more quickly than if the stimuli were presented separately [15,23].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Audiohaptic Feedback Enhances Motor Performance in a Low-Fidelity Simulated Drilling Task

et al. 2019

Self Cite

View full text Add to dashboard Cite

When used in educational settings, simulations utilizing virtual reality (VR) technologies can reduce training costs while providing a safe and effective learning environment. Tasks can be easily modified to maximize learning objectives of different levels of trainees (e.g., novice, intermediate, expert), and can be repeated for the development of psychomotor skills. VR offers a multisensory experience, providing visual, auditory, and haptic sensations with varying levels of fidelity. While simulating visual and auditory stimuli is relatively easy and cost-effective, similar representations of haptic sensation still require further development. Evidence suggests that mixing high- and low-fidelity realistic sensations (e.g., audition and haptic) can improve the overall perception of realism, however, whether this also leads to improved performance has not been examined. The current study examined whether audiohaptic stimuli presented in a virtual drilling task can lead to improved motor performance and subjective realism, compared to auditory stimuli alone. Right-handed participants (n = 16) completed 100 drilling trials of each stimulus type. Performance measures indicated that participants overshot the target during auditory trials, and undershot the target during audiohaptic trials. Undershooting is thought to be indicative of improved performance, optimizing both time and energy requirements.

show abstract

Section: Discussionsupporting

confidence: 90%

Section: Discussionsupporting

confidence: 90%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Audiohaptic Feedback Enhances Motor Performance in a Low-Fidelity Simulated Drilling Task

et al. 2019

Self Cite

View full text Add to dashboard Cite

show abstract

“…Additionally, we compared our results with another haptics scenario developed with Unity [37] (Fig. 3), where participants conducted four trials with five different scenarios comprised of i) no sound, ii) drilling sound, iii) metal music sound, iv) Classical music sound, and v) white noise.…”

Section: Resultsmentioning

confidence: 99%

Audio effects on haptics perception during drilling simulation

Valbuena

Uribe-Quevedo

Velasco-Vivas

2017

I2+D

View full text Add to dashboard Cite

La realidad virtual ha proporcionado inmersión e interacción a través de entornos generados por computador que intentan reproducir experiencias de la vida real a través de estímulos sensoriales. El realismo puede lograrse a través de interacciones multimodales que pueden mejorar la inmersión y las interacciones si se diseñan adecuadamente. Los avances más notorios están relacionados con la computación gráfica, donde el foto-realismo es la tendencia actual. Asimismo, se tienen otros avances relacionados con el sonido, la háptica y en menor medida, el olfato y el gusto. En la actualidad, las características de los sistemas de realidad virtual (sonido visual-háptico) se están utilizando masivamente en entretenimiento (por ejemplo, cine, videojuegos, arte) y en otros escenarios (por ejemplo, inclusión social, educación, capacitación, terapia y turismo). Por otra parte, la reducción de costos de las tecnologías de realidad virtual ha dado lugar a la disponibilidad a nivel de consumo, de varios tipos de dispositivos hápticos. Dichos dispositivos ofrecen experiencias de baja fidelidad debido a las propiedades de los sensores, pantallas y otros dispositivos electromecánicos, que pueden no ser adecuados para experiencias de alta precisión o en situaciones reales que requieran destreza. Sin embargo, se han realizado investigaciones sobre cómo superar o compensar la falta de fidelidad para proporcionar una experiencia de usuario atractiva utilizando historias, interacciones multimodales y elementos de juego.Nuestro trabajo se centra en analizar los posibles efectos de la percepción auditiva sobre la retroalimentación háptica dentro de un escenario de perforación con taladro, que implica interacciones multimodales. Esta tarea tiene múltiples aplicaciones en medicina, elaboración y construcción. Comparamos dos escenarios en los que dos grupos de participantes tuvieron que perforar madera mientras escuchaban sonidos contextuales y no contextuales. Además, recopilamos su percepción utilizando una encuesta después de completar la tarea. A partir de los resultados, establecemos que el sonido influye en la percepción háptica, pero se requieren más experimentos para comprender mejor las implicaciones y posibles aplicaciones médicas.

show abstract

“…The two haptic devices are illustrated in Figure 1 (Falcon) and Figure 2 (Touch 3D Stylus), while the implemented drilling models for the Falcon and Touch 3D Stylus are illustrated in Figures 3 and 4, respectively. A pilot study to test the simulation was carried out first to explore any potential training issues (described by Melaisi et al [48]).…”

Section: Methodsmentioning

confidence: 99%

Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations

et al. 2018

Self Cite

View full text Add to dashboard Cite

Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual environments. However, accurately simulating the sense of touch is difficult, requiring the use of high-fidelity haptic devices that are cost-prohibitive. Lower fidelity consumer-level haptic devices are becoming more widespread, yet are generally limited in perceived fidelity and the range of motion (degrees of freedom) required to realistically simulate many tasks. Studies into sound and vision suggest that the presence or absence of sound can influence task performance. Here, we explore whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task. Although the results of this study do not show any statistically significant difference in task performance with general (task-irrelevant) sound, we discuss how this is a necessary step in understanding the role of sound on haptic perception.

show abstract

The effect of sound on haptic fidelity perception

Cited by 5 publications

References 12 publications

Audiohaptic Feedback Enhances Motor Performance in a Low-Fidelity Simulated Drilling Task

Audiohaptic Feedback Enhances Motor Performance in a Low-Fidelity Simulated Drilling Task

Audio effects on haptics perception during drilling simulation

Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations

Contact Info

Product

Resources

About