CopyRobot: Interactive Mirroring Robotics Game for ASD Children

Santos, Laura; Geminiani, Alice; Olivieri, Ivana; Santos-Victor, José; Pedrocchi, Alessandra

doi:10.1007/978-3-030-31635-8_239

Cited by 4 publications

(3 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The mirroring coaching platform consists of the NAO robot (Aldebaran Robotics), and the Kinect as a motion tracking system [23]. NAO is a small and portable humanoid robot, widely used in robotic coaching systems [18], [13], [12].…”

Section: A Mirroring Systemmentioning

confidence: 99%

“…The keypoints positions extracted in the Kinect reference frame were mapped to the NAO reference frame. The angles between one limb segment and the reference frame axes, or between two limb segments were calculated by customized algorithms, and used as robot control angles (details in [23], [24]).…”

Section: A Mirroring Systemmentioning

confidence: 99%

“…(c) Adult-Master protocol: the adult leads the game, showing the exercise, which is then repeated by the robot and finally by the child while the robot is mirroring. Adapted from[23].…”

mentioning

confidence: 99%

See 2 more Smart Citations

Design of a Robotic Coach for Motor, Social and Cognitive Skills Training Toward Applications With ASD Children

Santos

Geminiani

Schydlo

et al. 2021

IEEE Trans. Neural Syst. Rehabil. Eng.

Self Cite

View full text Add to dashboard Cite

Socially assistive robots may help the treatment of autism spectrum disorder(ASD), through games using dyadic interactions to train social skills. Existing systems are mainly based on simplified protocols which qualitatively evaluate subject performance.We propose a robotic coaching platform for training social, motor and cognitive capabilities, with two main contributions: (i) using triadic interactions(adult, robot and child), with robotic mirroring, and (ii) providing quantitative performance indicators. The key system features were accurately designed, including type of protocols, feedback systems and evaluation metrics, contemplating the requirements for applications with ASD children.We implemented two protocols, Robot-Master and Adult-Master, where children performed different gestures guided by the robot or the adult respectively, eventually receiving feedback about movement execution. In both, the robot mirrors the subject during the movement. To assess system functionalities, with a homogeneous group of subjects, tests were carried out with 28 healthy subjects; one preliminary acquisition was done with an ASD child. Data analysis was customized to design protocolspecific parameters for movement characterization.Our tests show that robotic mirroring execution depends on the complexity and standardization of movements, as well as on the robot technical features. The feedback system evaluated movement phases and successfully estimated the completion of the exercises. Future work includes improving platform flexibility and adaptability, and clinical trials with ASD children to test the impact of the robotic coach on reducing symptoms. We trust that the proposed quantitative performance indicators extend the current state-of-the-art towards clinical usage of robotic-based coaching systems.

show abstract