MEDIATE – a responsive environment designed for children with autism

Gumtau, Simone; Newland, Paul; Creed, Chris; Kunath, Simon

doi:10.14236/ewic/ad2005.14

Cited by 14 publications

(7 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…MEDIATE, a multisensory environment designed for an interface between autistic and typical expression, using infrared cameras fed to the EyesWeb system to produce interactive output [66].…”

Section: Touchless 20mentioning

confidence: 99%

Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice

Frid

2019

MTI

View full text Add to dashboard Cite

Current advancements in music technology enable the creation of customized Digital Musical Instruments (DMIs). This paper presents a systematic review of Accessible Digital Musical Instruments (ADMIs) in inclusive music practice. History of research concerned with facilitating inclusion in music-making is outlined, and current state of developments and trends in the field are discussed. Although the use of music technology in music therapy contexts has attracted more attention in recent years, the topic has been relatively unexplored in Computer Music literature. This review investigates a total of 113 publications focusing on ADMIs. Based on the 83 instruments in this dataset, ten control interface types were identified: tangible controllers, touchless controllers, Brain–Computer Music Interfaces (BCMIs), adapted instruments, wearable controllers or prosthetic devices, mouth-operated controllers, audio controllers, gaze controllers, touchscreen controllers and mouse-controlled interfaces. The majority of the AMDIs were tangible or physical controllers. Although the haptic modality could potentially play an important role in musical interaction for many user groups, relatively few of the ADMIs (14.5%) incorporated vibrotactile feedback. Aspects judged to be important for successful ADMI design were instrument adaptability and customization, user participation, iterative prototyping, and interdisciplinary development teams.

show abstract

“…MEDIATE, a multisensory environment designed for an interface between autistic and typical expression, using infrared cameras fed to the EyesWeb system to produce interactive output [66].…”

Section: Touchless 20mentioning

confidence: 99%

Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice

Frid

2019

MTI

View full text Add to dashboard Cite

show abstract

“…Full-body interaction systems let multiple users interact in the same scenario, permitting face-to-face communication and movement in exploratory virtual environments. Examples include Mediate [70], a Multisensory interactive environment for an interface between autistic and allistic users to allow creative exploration through tactile, visual, and auditory stimuli. Similar research projects are Lightpools or Ball del Fanalet [71].…”

Section: Designing Full-body Interactionmentioning

confidence: 99%

Evaluating Interactional Synchrony in Full-Body Interaction with Autistic Children

Ragone

Howland

Brulé

2022

Interaction Design and Children

View full text Add to dashboard Cite

Interactional synchrony, the spontaneous coordination of movements during interaction, is increasingly considered important in research on the development of non-verbal communication by autistic children. There is evidence that interventions using embodiedinteraction technologies to support interactional synchrony are possible, but we do not have a shared framework in Human-Computer Interaction (HCI) for designing and evaluating such systems. We discuss existing measurement and evaluation tools used in experimental psychology and consider how the prevalent approach could be adapted to naturalistic HCI study contexts, with input from domain experts. We report on an exploratory case study evaluating a full-body interactive musical system with a group of ten autistic children. We provide methodological recommendations for the evaluation of future systems focusing on interactional synchrony, highlight limitations of current measurement tools and suggest mitigations. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI); HCI design and evaluation methods.

show abstract

“…The MEDIATE (Multisensory Environment Design for an Interface between Autistic and Typical Expressiveness) project uses a multi-sensory, responsive environment designed to stimulate interaction and expression through visual, aural and vibrotactile means [31][32]. It is an adaptive environment that generates realtime stimuli such that low functioning children with ASD, who have no verbal communication, can get a chance to play, explore, and be creative in a controllable and safe space [33].…”

Section: Introductionmentioning

confidence: 99%

A Robotic Framework to Facilitate Sensory Experiences for Children with Autism Spectrum Disorder

Javed

Burns

Jeon

et al. 2019

J. Hum.-Robot Interact.

View full text Add to dashboard Cite

The diagnosis of Autism Spectrum Disorder (ASD) in children is commonly accompanied by a diagnosis of sensory processing disorders as well. Abnormalities are usually reported in multiple sensory processing domains, showing a higher prevalence of unusual responses, particularly to tactile, auditory and visual stimuli. This paper discusses a novel robot-based framework designed to target sensory difficulties faced by children with ASD in a controlled setting. The setup consists of a number of sensory stations, together with robotic agents that navigate the stations and interact with the stimuli as they are presented. These stimuli are designed to resemble real world scenarios that form a common part of one's everyday experiences. Given the strong interest of children with ASD in technology in general and robots in particular, we attempt to utilize our robotic platform to demonstrate socially acceptable responses to the stimuli in an interactive, pedagogical setting that encourages the child's social, motor and vocal skills, while providing a diverse sensory experience. A preliminary user study was conducted to evaluate the efficacy of the proposed framework, with a total of 18 participants (5 with ASD and 13 typically developing) between the ages of 4 and 12 years. We describe our methods of data collection, coding of video data and the analysis of the results obtained from the study. We also discuss the limitations of the current work and detail our plans for the future work to improve the validity of the obtained results.

show abstract

MEDIATE – a responsive environment designed for children with autism

Cited by 14 publications

References 3 publications

Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice

Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice

Evaluating Interactional Synchrony in Full-Body Interaction with Autistic Children

A Robotic Framework to Facilitate Sensory Experiences for Children with Autism Spectrum Disorder

Contact Info

Product

Resources

About