Don’t Read My Lips: Assessing Listening and Speaking Skills Through Play with a Humanoid Robot

Polycarpou, Panayiota; Andreeva, Anna; Ioannou, Andri; Zaphiris, Panayiotis

doi:10.1007/978-3-319-40542-1_41

Cited by 8 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It has multiple degrees of freedom and sensors, as well as the integrated speech recognition support. There is a wide range of applications of NAO robot, including interventions for children with ASD [14], diabetes management [15], reduction of apathy and stabilization of cognitive performance in advanced dementia patients [16], supporting the learning of pupils with severe intellectual disabilities [17], rehabilitation training [18], reducing pediatric distress and pain in medical settings [19], and logopedic interventions [20,21]. Pepper is a humanoid robot that uses the same underlying platform.…”

Section: Robotic Technologiesmentioning

confidence: 99%

See 1 more Smart Citation

Intelligent Interactive Technologies for Mental Health and Well-Being

Jovanovic

Jevremović

Pejović-Milovančević

2021

Artificial Intelligence: Theory and Applications

View full text Add to dashboard Cite

Mental healthcare has seen numerous benefits from interactive technologies and artificial intelligence. Various interventions have successfully used intelligent technologies to automate the assessment and evaluation of psychological treatments and mental well-being and functioning. These technologies include different types of robots, video games, and conversational agents. The paper critically analyzes existing solutions with the outlooks for their future. In particular, we: i) give an overview of the technology for mental health, ii) critically analyze the technology against the proposed criteria, and iii) provide the design outlooks for these technologies.

show abstract

Section: Robotic Technologiesmentioning

confidence: 99%

“…The details of the underlying AI algorithms and data are not accessible to users (which may be expected since the robots have physical appearances.) [14][15][16][17][18][19][20][21][22].…”

Section: Transparency and Explainabilitymentioning

confidence: 99%

Intelligent Interactive Technologies for Mental Health and Well-Being

Jovanovic

Jevremović

Pejović-Milovančević

2021

Artificial Intelligence: Theory and Applications

View full text Add to dashboard Cite

show abstract

“…Sawada et al (2008) used a robotic voice simulator for speech therapy with hearing impaired children; the invented robot consisted of motor-controlled vocal organs (vocal cords), a vocal tract and a nasal cavity to generate a natural voice imitating a human vocalization. The robot reproduced the vocalization of the deaf children and taught them how to generate clearer speech through repeating the correct vocalization [40.] Moreover, NAO has been used in play activities for the assessment of listening and speaking skills of seven hearing-impaired students who use cochlear implant(s) deaf children [19]. A couple of other studies used intelligent robots with deaf children for manual communication.…”

Section: Play and Learning With Robotsmentioning

confidence: 99%

“…The unique feature of the technology has been identified by the authors of this work (an educational technologist and a speech therapist -researcher and practitioner) and has been used in this study to create a unique environment for auditory-verbal therapy sessions for children with hearing impairment. This study was inspired by a true need for engaging hearing-impaired children in auditory-verbal therapy sessions, as identified during previous work of the authors [19] as well as practical experience of the therapists involved. The present manuscript focuses on:…”

Section: Introductionmentioning

confidence: 99%

Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children

Ioannou

Andreva

2019

Human-Computer Interaction – INTERACT 2019

Self Cite

View full text Add to dashboard Cite

This study suggests an innovative way of using an intelligent robot to support speech therapy for hearing impaired children through play. Although medical technology (e.g., hearing aid, cochlear implant) for children with hearing impairment has advanced significantly, the amplification itself does not provide optimal development of hearing and speaking; it must be combined with specialized therapy. The present study focuses on the use of the humanoid robot NAO in auditory-verbal therapy, an approach to the development of auditory and verbal skills, which does not allow lipreading or other non-verbal cues to facilitate communication. NAO does not have a human mouth and therefore children with hearing impairment cannot do lipreading; this unique characteristic of the technology has been successfully used in the study to create playful and engaging auditory-verbal therapy sessions for six kindergarten hearing impaired children, allowing them to improve their ability to follow instructions using the hearing aid/ cochlear implant rather than visual clues in the environment. Our results, although preliminary, seem to encourage further research in supporting hearing-impaired children via play with intelligent robots.

show abstract

“…Also, Ioannou et al (2015) studied the effect of participation of the humanoid robot NAO in therapeutic conferences in children with autism [21]. Also, Polycarpou et al (2016) investigated the potential of using the humanoid robot, NAO, as a playful tool for assessing the listening and speaking skills of seven hearing impaired students who use cochlear implant(s) and sign language as their main communication modality [43].…”

Section: Design and Inclusion Of People With Disabilitiesmentioning

confidence: 99%

Towards the Use of Social Computing for Social Inclusion: An Overview of the Literature

Constantinou

Kosmas

Parmaxi

et al. 2018

Learning and Collaboration Technologies. Design, Development and Technological Innovation

Self Cite

View full text Add to dashboard Cite

Social computing constitutes a new computing paradigm in an interdisciplinary research community which will strongly influence informatics systems and applications in the years to come. Indeed, from a social perspective, considerable interest in examining the influences of Social Computing (SC) for Social Inclusion (SI) arises from researchers and designers. This paper addresses the existing literature on the use of SC for SI. Previous studies have been reviewed to report affordances of SC design in five different areas: (a) for the elderly, (b) for people with disabilities, (c) for gender studies, (d) for societal change, and (e) for the preservation of cultural heritage. Results from the literature overview provide some examples of applications of new technologies that were designed to reduce social exclusion. Our review further shows that the use of different tools used by different groups of people has a positive impact for those people who are either socially included or excluded from their use. However, further research is needed in these five directions, which are analysed in this document and direct research into the gaps identified.

show abstract

Don’t Read My Lips: Assessing Listening and Speaking Skills Through Play with a Humanoid Robot

Cited by 8 publications

References 8 publications

Intelligent Interactive Technologies for Mental Health and Well-Being

Intelligent Interactive Technologies for Mental Health and Well-Being

Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children

Towards the Use of Social Computing for Social Inclusion: An Overview of the Literature

Contact Info

Product

Resources

About