Camera-Based Motion Tracking and Performing Arts for Persons with Motor Disabilities and Autism

Kontogeorgakopoulos, Alexandros; Wechsler, Robert; Keay‐Bright, Wendy

doi:10.4018/978-1-4666-4442-7.ch009

Cited by 6 publications

(3 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Unlike acoustic instruments, DMI/NIMEs can be designed to afford been played by people without any training so they allow the design of specific exercises for disabled individuals (Camurri et al, 2003;Kontogeorgakopoulos et al, 2013). Project SATI (Therapeutic Interactive Audio-visual System, by its Spanish initials) concerns the treatment of individuals with moderate or severe cerebral palsy (Partesotti et al, 2018).…”

Section: Instruments That Are Manifestations Of Carementioning

confidence: 99%

Instruments that are more than instruments (and other stories)

Koutsomichalis

2022

Ricercare

View full text Add to dashboard Cite

Partly auto-ethnography, partly explanatory research, and partly an exercise in nontypical academic writing, this treatise focuses on music/multimedia instruments (and making paradigms thereof) that celebrate a more or less radical re-thinking of instrument-hood. ’Stories' of a sort are recounted so as to demonstrate the breadth of the many different (fascinating) ways in which instruments can be indeed much more than what the dominant hylonoetic view suggest. Instruments are discussed in broad thematic sections, raising common concerns and outlining related research veins. The author touches upon a surfacing opposition between hylonoetic and morphogenic perspectives and examines affairs of post or ‘hyper’ optimality in DIY making (recounting one last ‘story’). This treatise concludes with sketches for future work — for playful creative explorations and prospective instruments (that are intended to be ‘more than instruments’).

show abstract

Section: Instruments That Are Manifestations Of Carementioning

confidence: 99%

Instruments that are more than instruments (and other stories)

Koutsomichalis

2022

Ricercare

View full text Add to dashboard Cite

show abstract

“…Motor disabilities can also affect speech for individuals, Augmentative and Alternative Communication (AAC) software can help with these types of disabilities [24]. People with motor disabilities can interact through music, dance, and the visual arts, thanks to specialized apps [25].…”

Section: Motor Disability and Technologymentioning

confidence: 99%

Thinking about Inclusion: Designing a Digital App Catalog for People with Motor Disability

et al. 2021

View full text Add to dashboard Cite

Some apps serve as assistive technologies or digital therapeutic tools that can be used by rehabilitation professionals in the motor disability context, bringing benefits to therapists and people with disabilities. However, websites or catalogs do not provide reliable information, easy search, and intuitive access to these apps, causing access information difficulties. Therefore, this work proposes to develop a digital catalog of software focused on motor disability. This work performed a systematic search of websites and catalogs related to motor disability, a systematic search of the apps that the digital catalog would show, and a quality evaluation of selected apps using the Mobile Application Rating Scale tool. The digital catalog was developed with the information obtained in the previous phases combining the Prototyping and User Experience criteria, then assessed by final users, software testers, and a web accessibility evaluation tool. The catalog obtained a satisfactory quality score based on the end-users’ and therapists’ satisfaction when finding technological resources to use in their professional and health-care activities. This research aims to contribute to those interested in developing software for people with disabilities and encouraging them to create and design their implementations based on this study.

show abstract

“…Le ipotesi alla base dell'esperimento riguardavo la memorizzazione dell'associazione suono-colore, del movimento e del colore in sè (considerando che due dei tre gruppi non avevano previe conoscenze musicali), per osservare l'efficacia del prototipo a livello terapeutico e creativo e per poter sviluppare un futuro prototipo adattado ai feedback ottenuti. Considerando che i sistemi MOCAP permettono l'interazione fisica e l'espressione emotiva diretta (Kontogeorgakopoulos, Wechsler & Keay-Bright, 2013), si è osservato se il processo espressivo-creativo poteva fornire dati sulla situazione emotiva del partecipante, attraverso i questionari proposti e le registrazioni video, e se sussisteva un collegamento tra valence, arousal e la tipologia di movimenti applicati nella fase d'improvvisazione creativa. I risultati indicano che i livelli di valence e arousal sono collegati ai movimenti del soggetto e permetterebbero di disegnare grafici di valutazioni generali del processo emotivo dei partecipanti…”

Section: Introduzioneunclassified

L'interazione nelle tecnologie musicali di realtá mista: Il prototipo e-mocumu como esempio multimodale con propositi terapeutici

Partesotti¹

View full text Add to dashboard Cite

The main goal of this thesis is to study the interaction between the subject and the object within MIR (Mixed Interactive Reality) technologies from a therapeutic perspective. To see how this interaction works, I first consider the general structures of DMI (Digital Musical Interface) technologies, then look at the recently-developed motion capture system (MOCAP), and end by proposing six technologies of relevance to this context. These interactive technologies are significant in the HCI (Human Computer Interface) scenario, from both a historical and an applicative point of view. The first and second parts of this paper serve to introduce the theoretical aspects of the interaction. All the technologies described are grounded in the interaction between the action and the subject's perception of it. In the third part of the thesis, I describe proprioception, shaped by receptors that are fundamental both to movement and to self-awareness. I thus investigate the perceptive dimension of the interaction, referring to some fundamental theories on the philosophy of the body. This is useful for the pupose of taking a holistic perspective, based on the consideration of the human being as the subject, and the technological environment as the object. I then first discuss Presence, a concept acquired by other authors that I revisit within the interactive environment, which becomes a second "presence" interacting with the user. Then I introduce Gibson's theory of visual perception, lingering on the concept of Affordance, which refers to the characteristics of the environment offered to the subject. I continue with the notion of IS (Image Schemata) and Johnson's metaphor, which is functional to the comprehension of the MIR environment. The Sensorimotor Contingency Theory (SCT) advanced by O'Regan and Nöe is also helpful for elucidating how sensorimotor contingencies are involved in the perceptive process, within an interactive system. Finally, the Philosophy of Empowerment, interwoven with the aforementioned concepts, includes the experience and the perception that occurs with full control over our actions during the interaction. Bearing this theoretical basis in mind, we can understand the cross-modal interaction that takes place in a holistic view of the interaction between subject and object, in more than one sensory modality at a time. So it seems that images and sounds take part in this sensory integration that the user can experience within a MIR.

show abstract

Camera-Based Motion Tracking and Performing Arts for Persons with Motor Disabilities and Autism

Cited by 6 publications

References 27 publications

Instruments that are more than instruments (and other stories)

Instruments that are more than instruments (and other stories)

Thinking about Inclusion: Designing a Digital App Catalog for People with Motor Disability

L'interazione nelle tecnologie musicali di realtá mista: Il prototipo e-mocumu como esempio multimodale con propositi terapeutici

Contact Info

Product

Resources

About