Human Robot Interaction Through Semantic Integration of Multiple Modalities, Dialog Management, and Contexts

Johnson, David; Agah, Arvin

doi:10.1007/s12369-009-0028-0

Cited by 21 publications

(5 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other speech enhancement techniques and their modification will be also taken into consideration in future research. A multimodal interface using a gyro sensor and positioning algorithms are also planned to improving the robustness of the communication interface as described in [4] and [5].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Service Robot SCORPIO with Robust Speech Interface

Ondáš

Juhar

Pleva

et al. 2013

International Journal of Advanced Robotic Systems

View full text Add to dashboard Cite

The SCORPIO is a small-size mini-teleoperator mobile service robot for booby-trap disposal. It can be manually controlled by an operator through a portable briefcase remote control device using joystick, keyboard and buttons. In this paper, the speech interface is described. As an auxiliary function, the remote interface allows a human operator to concentrate sight and/or hands on other operation activities that are more important. The developed speech interface is based on HMM-based acoustic models trained using the SpeechDatE-SK database, a small-vocabulary language model based on fixed connected words, grammar, and the speech recognition setup adapted for low-resource devices. To improve the robustness of the speech interface in an outdoor environment, which is the working area of the SCORPIO service robot, a speech enhancement based on the spectral subtraction method, as well as a unique combination of an iterative approach and a modified LIMA framework, were researched, developed and tested on simulated and real outdoor recordings.

show abstract

Section: Discussionmentioning

confidence: 99%

“…[3]. Multimodal interfaces in robotic systems also use a combination of different inputs, including head nodding, pointing, field of vision cooperating with dialogue management, semantics, context [4], and, with human-robot teamwork, also sharing knowledge using non-verbal communication [5] [6].…”

Section: Introductionmentioning

confidence: 99%

Service Robot SCORPIO with Robust Speech Interface

Ondáš

Juhar

Pleva

et al. 2013

International Journal of Advanced Robotic Systems

View full text Add to dashboard Cite

show abstract

“…In a social context, the intelligence that a robot display depends on the modalities it uses and each modality can have specific importance and effect on the human side of the interaction [88] which translates into the degree of trust that the robot has [89]. Moreover, the acceptance of robots in social interaction depends on their ability to express emotions and they require a proper design of emotional expressions to improve their likability and believability [90] as multimodal interaction can enhance the engagement [91][92][93].…”

Section: Modalities Of Human-robot Interactionmentioning

confidence: 99%

A Survey on Recent Advances in Social Robotics

et al. 2022

View full text Add to dashboard Cite

Over decades, social robotics has evolved as a concept that presently covers different areas of application, and interacts with different domains in technology, education, medicine and others. Today, it is possible to envision social robots in tasks that were not expected years ago, and that is not only due to the evolution of social robots, but also to the evolution of the vision humans have for them. This survey addresses recent advances in social robotics from different perspectives. Different contexts and areas of application of social robots are addressed, as well as modalities of interaction with humans. Different robotic platforms used in social contexts are shown and discussed. Relationships of social robotics with advances in other technological areas are surveyed, and methods and metrics used for the human evaluation of the interaction with robots are presented. The future of social robotics is also envisioned based on surveyed works and from different points of view.

show abstract

“…Zhang et al 2018), or results do not always reach significance (e.g. Johnson & Agah 2009). In addition, manipulations were not always tested with a control condition (e.g.…”

Section: Dialog Historymentioning

confidence: 99%

In the same boat

Fischer

Jensen

Zitzmann

2021

View full text Add to dashboard Cite

In this paper, we analyze what effects indicators of a shared situation have on a speaker’s persuasiveness by investigating how a robot’s advice is received when it indicates that it is sharing the situational context with its user. In our experiment, 80 participants interacted with a robot that referred to aspects of the shared context: Face tracking indicated that the robot saw the participant, incremental feedback suggested that the robot was following their actions, and comments about, and gestures towards, the shared physical situation and linguistic references to the dialog history indicated to participants that the robot had learned from the interaction and perceived its surroundings. The results show that especially the linguistic and gestural references to the shared context have a significant influence on participants’ compliance with the robot’s suggestions. Thus, indicating that it is ‘in the same boat’ with the user, i.e. that it is sharing the situational context, increases a robot’s persuasiveness during advice giving.

show abstract

Human Robot Interaction Through Semantic Integration of Multiple Modalities, Dialog Management, and Contexts

Cited by 21 publications

References 34 publications

Service Robot SCORPIO with Robust Speech Interface

Service Robot SCORPIO with Robust Speech Interface

A Survey on Recent Advances in Social Robotics

In the same boat

Contact Info

Product

Resources

About