The TouchBox: an open-source audio-haptic device for finger-based interaction

Papetti, Stefano; Fröhlich, Martin; Schiesser, Sébastien

doi:10.1109/whc.2019.8816172

Cited by 5 publications

(2 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experiment made use of a self-developed haptic device called TouchBox, which offers a Plexiglas touch panel measuring 3D forces (i.e., along normal, longitudinal and transverse directions), and provides rich vibrotactile feedback. The device is the latest iteration of a former design previously published in open-access form [13].…”

Section: Apparatusmentioning

confidence: 99%

Accuracy of Musical Pitch Control Through Finger Pushing and Pulling

Järveläinen

Papetti

Eric

2022

Haptic and Audio Interaction Design

Self Cite

View full text Add to dashboard Cite

An experiment with trained musicians was conducted to investigate how finger pushing and pulling gestures that control pitch bending of a synthesizer tone affect accuracy with respect to a given target pitch. Additionally, the effect of different interactive vibrotactile feedback was assessed. A self-developed haptic interface called TouchBox was used for this purpose. Finally, subjective evaluations were collected for perceived agency, confidence of correctness, and pleasantness of the experience.

show abstract

Section: Apparatusmentioning

confidence: 99%

Accuracy of Musical Pitch Control Through Finger Pushing and Pulling

Järveläinen

Papetti

Eric

2022

Haptic and Audio Interaction Design

Self Cite

View full text Add to dashboard Cite

show abstract

“…Building upon the growing research on gestural affordances, gesture meaning, and device usage in a musical context [10][11][12], we aimed to denote guidelines for the instinctive and fluid appropriation of MHDs as musical instruments by attempting to establish instinctive relations among interaction control gestures (e.g., touch manipulations, movement manipulations) and musical parameters (e.g., note onset, pitch, and duration). We conducted an experiment to understand how musically proficient users and lay users map interaction control gestures and musical parameters on MHDs.…”

Section: Introductionmentioning

confidence: 99%

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

Clement

Moreira

Rosa

et al. 2021

MTI

View full text Add to dashboard Cite

Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed the music ecosystem from production to distribution and consumption. Of interest here is the ever-expanding number of mobile music applications. Despite their growing popularity, their design in terms of interaction perception and control is highly arbitrary. It remains poorly addressed in related literature and lacks a clear, systematized approach. In this context, our paper aims to provide the first steps towards defining guidelines for optimal sonic interaction design practices in mobile music applications. Our design approach is informed by user data in appropriating mobile handheld devices. We conducted an experiment to learn links between control gestures and musical parameters, such as pitch, duration, and amplitude. A twofold action—reflection protocol and tool-set for evaluating the aforementioned links—are also proposed. The results collected from the experiment show statistically significant trends in pitch and duration control gesture mappings. On the other hand, amplitude appears to elicit a more diverse mapping approach, showing no definitive trend in this experiment.

show abstract

Augmenting Sonic Experiences Through Haptic Feedback

Fontana

Järveläinen

Papetti

2022

Sonic Interactions in Virtual Environments

View full text Add to dashboard Cite

Sonic experiences are usually considered as the result of auditory feedback alone. From a psychological standpoint, however, this is true only when a listener is kept isolated from concurrent stimuli targeting the other senses. Such stimuli, in fact, may either interfere with the sonic experience if they distract the listener, or conversely enhance it if they convey sensations coherent with what is being heard. This chapter is concerned with haptic augmentations having effects on auditory perception, for example how different vibrotactile cues provided by an electronic musical instrument may affect its perceived sound quality or the playing experience. Results from different experiments are reviewed showing that the auditory and somatosensory channels together can produce constructive effects resulting in measurable perceptual enhancement. That may affect sonic dimensions ranging from basic auditory parameters, such as the perceived intensity of frequency components, up to more complex perceptions which contribute to forming our ecology of everyday or musical sounds.

show abstract

The TouchBox: an open-source audio-haptic device for finger-based interaction

Cited by 5 publications

References 30 publications

Accuracy of Musical Pitch Control Through Finger Pushing and Pulling

Accuracy of Musical Pitch Control Through Finger Pushing and Pulling

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

Augmenting Sonic Experiences Through Haptic Feedback

Contact Info

Product

Resources

About