Human robot interactions using speech synthesis and recognition with lip synchronization

Luo, Ren C.; Chang, Shu-Ruei; Huang, Chien-Chieh; Yang, Yee‐Pien

doi:10.1109/iecon.2011.6119307

Cited by 10 publications

(3 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Robots that use audio modalities can recognize and generate human speech through the use of speech recognition and synthesis technologies (Lackey et al, 2011 ; Luo et al, 2011 ; Zhao et al, 2012 ; Tsiami et al, 2018 ; Deuerlein et al, 2021 ). Speech recognition allows the robot to understand spoken commands or questions from a human, while speech synthesis allows the robot to generate spoken responses or instructions.…”

Section: Modalities Used In Human–robot Interactionmentioning

confidence: 99%

“…Speech synthesis, also known as text-to-speech (TTS), is an important approach in multimodal human–robot interaction (HRI) as it allows robots to provide verbal feedback or instructions to the human user in a way that is similar to how a human would (Luo et al, 2011 ; Ashok et al, 2022 ). Robots can use text-to-speech (TTS) technology to generate spoken responses to humans.…”

Section: Techniques For Multimodal Human–robot Interactionmentioning

confidence: 99%

See 1 more Smart Citation

Recent advancements in multimodal human–robot interaction

Yang

et al. 2023

Front. Neurorobot.

View full text Add to dashboard Cite

Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.

show abstract

Section: Modalities Used In Human–robot Interactionmentioning

confidence: 99%

Section: Techniques For Multimodal Human–robot Interactionmentioning

confidence: 99%

Recent advancements in multimodal human–robot interaction

Yang

et al. 2023

Front. Neurorobot.

View full text Add to dashboard Cite

show abstract

“…Depending on the context, this experience of fear can be positive or negative. Furthermore, when angry, our body temperature, heart rate, and blood pressure all increase [63]. In some people, due to the change in temperature, the blood vessels dilate, causing the ears to change to a red color; similarly, the nose becomes red when cold.…”

Section: Physiological Channelmentioning

confidence: 99%

Design Path for a Social Robot for Emotional Communication for Children with Autism Spectrum Disorder (ASD)

Cano,

Díaz-Arancibia,

Arango-López

et al. 2023

Sensors

View full text Add to dashboard Cite

Children with autism spectrum disorder (ASD) have deficits in social interaction and expressing and understanding emotions. Based on this, robots for children with ASD have been proposed. However, few studies have been conducted about how to design a social robot for children with ASD. Non-experimental studies have been carried out to evaluate social robots; however, the general methodology that should be used to design a social robot is not clear. This study proposes a design path for a social robot for emotional communication for children with ASD following a user-centered design approach. This design path was applied to a case study and evaluated by a group of experts in psychology, human–robot interaction, and human–computer interaction from Chile and Colombia, as well as parents of children with ASD. Our results show that following the proposed design path for a social robot to communicate emotions for children with ASD is favorable.

show abstract