A Camera-Based Music-Making Tool for Physical Rehabilitation

Gorman, Mikhail; Lahav, Amir; Saltzman, Elliot; Betke, Margrit

doi:10.1162/comj.2007.31.2.39

Cited by 19 publications

(10 citation statements)

References 27 publications

(33 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Other musical interfaces have been proposed to support individuals with motor and cognitive disabilities [4,14,16]. For example, MINWii [4] is a serious game for patients with dementia that allows them to play different songs.…”

Section: Musical Interfaces To Support Neurodiverse Users and Child Developmentmentioning

confidence: 99%

Interactions of children and young adults using large-scale elastic displays

et al. 2020

View full text Add to dashboard Cite

Elastic displays provide a unique and intuitive interaction and could be deployed at large-scale. As an emerging technology, open questions about the benefits large-scale elastic displays offer over rigid displays and their potential application to our everyday lives. In this paper, we present an overview of a 4-year project. First, we describe the development of a large-scale elastic display, called BendableSound. Second, we explain the results of a laboratory study, showing the elastic display has a better user and sensory experience than a rigid one. Third, we describe the results of two deployment studies showing how BendableSound could support the therapeutic practices of children with autism and the early development of toddlers. We close discussing open challenges to study the untapped potential of elastic displays in pervasive computing.

show abstract

Section: Musical Interfaces To Support Neurodiverse Users and Child Developmentmentioning

confidence: 99%

Interactions of children and young adults using large-scale elastic displays

et al. 2020

View full text Add to dashboard Cite

show abstract

“…We have focused on smart environments that interpret the user's movements as communication messages, in particular, movements of the user's eyes [70,89,12,11], eyebrows [44,66], mouth [89], head [107] or fingers [27,41] [41].…”

Section: Intelligent Devices For People With Motion Impairmentsmentioning

confidence: 99%

Intelligent Interfaces to Empower People with Disabilities

Betke

2010

Handbook of Ambient Intelligence and Smart Environments

Self Cite

View full text Add to dashboard Cite

“…Other plucked virtual instruments include the harp [9] and kalichord [10]. Augmented reality has been also used to support guitar learning [11] and rehabilitation courses where patients were invited to hear the sound of their own guitar playing actions [12].…”

Section: Introductionmentioning

confidence: 99%

Multisensory Plucked Instrument Modeling in Unity3D: From Keytar to Accurate String Prototyping

et al. 2020

View full text Add to dashboard Cite

Keytar is a plucked guitar simulation mockup developed with Unity3D that provides auditory, visual, and haptic feedback to the player through a Phantom Omni robotic arm. Starting from a description of the implementation of the virtual instrument, we discuss our ongoing work. The ultimate goal is the creation of a set of software tools available for developing plucked instruments in Unity3D. Using such tools, sonic interaction designers can efficiently simulate plucked string prototypes and realize multisensory interactions with virtual instruments for unprecedented purposes, such as testing innovative plucked string interfaces or training machine learning algorithms with data about the dynamics of the performance, which are immediately accessible from the machine.

show abstract

A Camera-Based Music-Making Tool for Physical Rehabilitation

Cited by 19 publications

References 27 publications

Interactions of children and young adults using large-scale elastic displays

Interactions of children and young adults using large-scale elastic displays

Intelligent Interfaces to Empower People with Disabilities

Multisensory Plucked Instrument Modeling in Unity3D: From Keytar to Accurate String Prototyping

Contact Info

Product

Resources

About