Human-robot interface based on the mutual assistance between speech and vision

Yoshizaki, Mitsutoshi; Kuno, Yoshinori; Nakamura, Akio

doi:10.1145/971478.971483

Cited by 7 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Natural-language interfaces can be applied to make the use of intelligent robots more flexible, such as in the case of the autonomous mobile two-arm robot KAMRO (Lueth et al 1994). Combination of gesture and voice strategies gives place to multimodal interfaces, providing a large range of interactions, intuitive to humans and advantageous to service robots (Yoshizaki et al 2001). There is evidence that multimodal displays and input controls have great potential towards improving the teleoperation performance (Chen et al 2007).…”

Section: State Of the Artmentioning

confidence: 99%

Application of immersive technologies and natural language to hyper-redundant robot teleoperation

et al. 2019

View full text Add to dashboard Cite

This work presents an analysis of immersive realities and natural language applied to the teleoperation of hyper-redundant robots. Such devices have a large number of degrees of freedom, so they often exhibit complex configurations frustrating their spatial understanding. This work aims to contrast two hypotheses; first, if immersive interfaces enhance the telepresence and efficiency against conventional ones; and second, if natural language reduces workload and improves performance against other conventional tools. A total of 2 interfaces and 6 interaction tools have been tested by 50 people. As a result, immersive interfaces were more efficient, improved situational awareness and visual feedback, and were chosen by 94% of participants against conventional ones. On the other hand, participants performed better using natural language than conventional tools despite having less previous experience with the first ones. Additionally, according to 52% of the population, the preferred interaction tool was a mixed strategy that combined voice recognition and hand gestures. Therefore, it is concluded that immersive realities and natural language should play a very important role in the near future of hyper-redundant robots and their teleoperation.

show abstract

Section: State Of the Artmentioning

confidence: 99%

Application of immersive technologies and natural language to hyper-redundant robot teleoperation

et al. 2019

View full text Add to dashboard Cite

show abstract

“…An innovation of the work described here involves developing cattle and human behaviour models, perception techniques, and using them along with a specific herding technique, called low-stress herding (Smith, 1998), to carry out assistive or autonomous herding activities. Some researchers have attempted to communicate with assistive robots by developing speech and gesture recognition systems, to convey their intentions to the robot (Fischer et al, 1996, Topp et al, 2004, Yoshizaki et al, 2001. One differentiating aspect of our work is that no overt speech or gesture communication between the human and robot is used.…”

Section: Introductionmentioning

confidence: 99%

Autonomous Mobile Robot Assisted Herding

Thakkar¹,

Wesley

2005

Proceedings of the Second International Conference on Informatics in Control, Automation and Robotics

View full text Add to dashboard Cite

In this paper, we describe work that begins to address some of the issues related to developing an autonomous mobile robotic capability to assist humans with herding animals. A novel aspect of this work is the development of a capability to convey instructions to the robot via movements of a "toy human." In this work, no other explicit form of communication from the human to the robot is required. Furthermore, the robot is able detect if the human is absent or is unable to herd, and to herd the animal autonomously if required. We developed a herding framework that is based on low stress herding techniques. The robot uses a pan-tilt-zoom camera and a laser ranging sensor to track the human and interpret the human's movements. We conduct two sets of experiments that demonstrate autonomous and cooperative herding behaviour of the robot. We conclude by presenting experimental results that suggest our approach to developing a service robot with assistive herding capabilities holds promise for scaling to more complex and sophisticated tasks.

show abstract

“…Natural language interfaces can be applied to make the use of intelligent robots more flexible, such as in the case of the autonomous mobile two-arm robot KAMRO [235]. Combination of gesture and voice strategies give place to multimodal interfaces, providing a large range of interactions, intuitive to humans and advantageous to service robots [236]. There is evidence that multimodal displays and input controls have great potential towards improving the teleoperation performance [208].…”

Section: Teleoperationmentioning

confidence: 99%

Design, Modelling, Control and Teleoperation of Hyper-Redundant Robots

Martín-Barrio¹

View full text Add to dashboard Cite

acordarse siempre de mí y haberme abierto las puertas de una nueva etapa en mi vida. Gracias a todos vosotros.Con esta tesis, culmino 27 años incansables de estudio. Por lo tanto, quiero acordarme de todos los profesores apasionados tanto en el colegio como en la universidad que han dejado una huella en mí desde pequeño. Y también de todos los compañeros que, de una manera u otra, intentaron minarme hace ya mucho tiempo. Hoy soy mejor gracias a todos vosotros.A mis amigos: Alber, gracias por haber estado conmigo desde que tengo memoria; Sergio, gracias por estar pendiente de mis avances y preocuparte siempre por mí; Javi, en esta tesis sale Moira si buscas bien, gracias por saber escucharme y comprenderme; Velázquez, muchas gracias por tu sinceridad, te dedico este gusiluz; Paco, gracias por tu apoyo siempre; Yari, gracias por saber escucharme y preocuparte por mí; James, unconditional incorporation, thank you for being so supportive and always sticking up for me; Eric, cuenta con uno de estos robots para la policía; Guillermo y Vicky, gracias por haberme acogido como parte de vuestra familia; y a Alex., Elena, María, Rul, Dani, Sandra, Leo, Miki, por haber formado parte de este periodo de mi vida.Para finalizar, quiero dedicar este trabajo a mi familia. Mamá, si estoy aquí es gracias a ti. Gracias por dármelo todo, por enseñarme a vivir, y a sobrevivir, por tu cariño incondicional, por ser luz en mis oscuridades y por ser el mejor modelo a seguir. Papá, si algo me diferencia de los demás, es que me apasiona lo que hago, y eso lo he aprendido de ti. Gracias por enseñarme la importancia del trabajo duro desde la pasión, y sin concesiones. Abel, hermano, gracias por estar siempre de mi lado y por acompañarme en mis éxitos. Por último, también a todos los demás que, bien estéis conmigo o bien ya no pueda veros, espero que me miréis con el mismo orgullo que tengo yo de teneros a vosotros. A mis tías y tíos: Matilde, Mª Ángeles, Mª Eugenia, Carmen, Nadim, José Luís y Javier, por quererme y cuidarme como a un hijo; a mis primas y primos: Santiago, Ángel, Luis, Enita, Pablo y Clara, por formar parte de mis recuerdos más felices; a los pequeños: Ángela, Julia, June, Mateo y Alonso, por representar lo mejor de lo que está por llegar; y a mis abuelos: Santiago, Mª Ángeles, Teo y Pepe, por ser inmortales en mi memoria y por plantar la semilla que hoy me ha permitido confeccionarme en la persona que siempre he querido ser.A todos vosotros os dedico esta tesis doctoral.

show abstract

Human-robot interface based on the mutual assistance between speech and vision

Cited by 7 publications

References 3 publications

Application of immersive technologies and natural language to hyper-redundant robot teleoperation

Application of immersive technologies and natural language to hyper-redundant robot teleoperation

Autonomous Mobile Robot Assisted Herding

Design, Modelling, Control and Teleoperation of Hyper-Redundant Robots

Contact Info

Product

Resources

About