Continuous Sonic Feedback from a Rolling Ball

Rath, Matthias; Rocchesso, Davide

doi:10.1109/mmul.2005.24

Cited by 62 publications

(46 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Yao and Hayward [23], for example, created a convincing sensation of a ball rolling down a hollow tube using an audio and vibrotactile display. A similar sonification of the physical motion of a ball along a beam is described in detail in [15]; subjects were able to perceive the ball's motion from the sonification alone. Hermann et al [6] describe an interactive sonification based upon shaking a ball-shaped sensor pack instrumented with accelerometers.…”

Section: Background Reviewmentioning

confidence: 97%

See 1 more Smart Citation

Multimodal Excitatory Interfaces with Automatic Content Classification

Williamson

Murray-Smith

2009

The Engineering of Mixed Reality Systems

View full text Add to dashboard Cite

We describe a non-visual interface for displaying data on mobile devices, based around active exploration: devices are shaken, revealing the contents rattling around inside. This combines sample-based contact sonification with event playback vibrotactile feedback for a rich and compelling display which produces an illusion much like balls rattling inside a box. Motion is sensed from accelerometers, directly linking the motions of the user to the feedback they receive in a tightly closed loop. The resulting interface requires no visual attention and can be operated blindly with a single hand: it is reactive rather than disruptive. This interaction style is applied to the display of an SMS inbox. We use language models to extract salient features from text messages automatically. The output of this classification process controls the timbre and physical dynamics of the simulated objects. The interface gives a rapid semantic overview of the contents of an inbox, without compromising privacy or interrupting the user.Keywords Vibrotactile · Audio · Language model · Mobile MotivationWe propose a multimodal interaction style where the user excites information from a device and then negotiates with the system in a continuous, closed-loop interaction. This draws upon the work of Hermann [5,8,7], who introduced model-based sonification. In [7], the authors state:. . .why not sonify data spaces by taking the environmental sound production in our real world as a model. Nature has optimized our auditory senses to extract information from the auditory signal that is produced by our physical environment. Thus the idea is: build a virtual scenario from the data; define a kind of 'virtual physics' that permits vibrational reaction of its elements to external excitations; let the user interactively excite the system and listen.

show abstract

Section: Background Reviewmentioning

confidence: 97%

“…A number of impact sounds (8)(9)(10)(11)(12)(13)(14)(15)(16) are pre-recorded for each of a number of impact types (wood on glass, for example). These slight variations are critical to avoid artificial sounding effects.…”

Section: Sample Banksmentioning

confidence: 99%

Multimodal Excitatory Interfaces with Automatic Content Classification

Williamson

Murray-Smith

2009

The Engineering of Mixed Reality Systems

View full text Add to dashboard Cite

show abstract

“…Whereas Cohen focuses on enhancing user interfaces by speech (Cohen, 1992), Rath and Rocchesso for example use pure sound to enhance interaction. Their rolling ball example renders a bar to a virtual balance, feedback on the configuration is given by sound, which a rolling ball would make, when rolling according to the angle in which the bar is held (Rath & Rocchesso, 2005). Another possibility lies in the haptic feedback of virtual objects .…”

Section: Advances In Human-computer Interaction 314mentioning

confidence: 99%

Mobile Device Interaction in Ubiquitous Computing

Mahler¹,

Weber²

2008

Advances in Human Computer Interaction

View full text Add to dashboard Cite

“…Yao and Hayward [12], for example, created a convincing sensation of a ball rolling down a hollow tube using an audio and vibrotactile display. A similar sonification of the physical motion of a ball along a beam is described in detail in [8]; subjects were able to percieve the motion ball from the sonification alone. Granular approaches to realistic natural sound generation were explored in [6], where contact events sensed from a contact microphone underneath a bed of pebbles drove a sample-based granular synthesis engine.…”

Section: Introductionmentioning

confidence: 97%

Devices as interactive physical containers

Williamson

Murray-Smith

Hughes³

2007

CHI '07 Extended Abstracts on Human Factors in Computing Systems

View full text Add to dashboard Cite

Shoogle is a novel interface for sensing data within a mobile device, such as presence and properties of text messages or remaining resources. It is based around active exploration: devices are shaken, revealing the contents rattling around "inside". Vibrotactile display and realistic impact sonification create a compelling system. Inertial sensing is used for completely eyes-free, singlehanded interaction. Prototypes run on both PDA's and on standard mobile phones with a wireless sensor pack.

show abstract

Continuous Sonic Feedback from a Rolling Ball

Cited by 62 publications

References 5 publications

Multimodal Excitatory Interfaces with Automatic Content Classification

Multimodal Excitatory Interfaces with Automatic Content Classification

Mobile Device Interaction in Ubiquitous Computing

Devices as interactive physical containers

Contact Info

Product

Resources

About