Development of automatic speech recognition system for voice activated Ground Control system

Kavitha, S.; Veena, S.; Kumaraswamy, R.

doi:10.1109/itact.2015.7492684

Cited by 11 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The idea is to combine voice, touch and gestures to reach simple, natural and fast interactions between operators and robots [ 24 ]. There are multiple approaches to command multi-robot missions by means of speech commands [ 25 ]. In addition to this, gesture commands can be employed in this context, developing not only hand gestures [ 26 ], but also combinations of face poses and hand gestures [ 27 ].…”

Section: State Of Artmentioning

confidence: 99%

Multi-Robot Interfaces and Operator Situational Awareness: Study of the Impact of Immersion and Prediction

Roldán

Peña-Tapia

Martín-Barrio

et al. 2017

Sensors

View full text Add to dashboard Cite

Multi-robot missions are a challenge for operators in terms of workload and situational awareness. These operators have to receive data from the robots, extract information, understand the situation properly, make decisions, generate the adequate commands, and send them to the robots. The consequences of excessive workload and lack of awareness can vary from inefficiencies to accidents. This work focuses on the study of future operator interfaces of multi-robot systems, taking into account relevant issues such as multimodal interactions, immersive devices, predictive capabilities and adaptive displays. Specifically, four interfaces have been designed and developed: a conventional, a predictive conventional, a virtual reality and a predictive virtual reality interface. The four interfaces have been validated by the performance of twenty-four operators that supervised eight multi-robot missions of fire surveillance and extinguishing. The results of the workload and situational awareness tests show that virtual reality improves the situational awareness without increasing the workload of operators, whereas the effects of predictive components are not significant and depend on their implementation.

show abstract

Section: State Of Artmentioning

confidence: 99%

Multi-Robot Interfaces and Operator Situational Awareness: Study of the Impact of Immersion and Prediction

Roldán

Peña-Tapia

Martín-Barrio

et al. 2017

Sensors

View full text Add to dashboard Cite

show abstract

“…La fusión de voz, tacto y gestos hace que las interacciones entre los operadores y los robots sean más fáciles, rápidas y naturales (Monajjemi et al, 2014). Los comandos de voz se han aplicado satisfactoriamente en misiones multi-robot (Kavitha et al, 2015), al igual que los comandos por gestos, usando tanto las manos (Mantecón et al, 2014) como la cara (Nagi et al, 2014).…”

Section: Interacciones Multimodalesunclassified

Una revisión de los sistemas multi-robot: desafíos actuales para los operadores y nuevos desarrollos de interfaces

Roldán‐Gómez

Rivas

Garcia-Aunon

et al. 2020

Rev. iberoam. autom. inform. ind.

View full text Add to dashboard Cite

<p class="icsmabstract">Los sistemas multi-robot están experimentando un gran desarrollo en los últimos tiempos, ya que mejoran el rendimiento de las misiones actuales y permiten realizar nuevos tipos de misiones. Este artículo analiza el estado del arte de los sistemas multi-robot, abordando un conjunto de temas relevantes: misiones, flotas, operadores, interacción humano-sistema e interfaces. La revisión se centra en los retos relacionados con factores humanos como la carga de trabajo o la conciencia de la situación, así como en las propuestas de interfaces adaptativas e inmersivas para solucionarlos.</p>

show abstract

“…With the rapid advancement of Automatic Speech Recognition (ASR) technologies, there are initiatives to make use of these developments in order to interact with flying robots. Recent works to develop voice activated ground control stations for aerial vehicles have yielded promising results [9], [10]. As to the best of our knowledge, state-of-theart systems for voice-controlled drones re so far able to recognise a limited number of commands and translate these directly into fixed controls signals [11], [12], [13].…”

Section: Related Workmentioning

confidence: 99%

An Interactive Indoor Drone Assistant

Fuhrman

Schneider

Altenberg

et al. 2019

2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

View full text Add to dashboard Cite

With the rapid advance of sophisticated control algorithms, the capabilities of drones to stabilise, fly and manoeuvre autonomously have dramatically improved, enabling us to pay greater attention to entire missions and the interaction of a drone with humans and with its environment during the course of such a mission. In this paper, we present an indoor office drone assistant that is tasked to run errands and carry out simple tasks at our laboratory, while given instructions from and interacting with humans in the space. To accomplish its mission, the system has to be able to understand verbal instructions from humans, and perform subject to constraints from control and hardware limitations, uncertain localisation information, unpredictable and uncertain obstacles and environmental factors. We combine and evaluate the dialogue, navigation, flight control, depth perception and collision avoidance components. We discuss performance and limitations of our assistant at the component as well as the mission level. A 78% mission success rate was obtained over the course of 27 missions.

show abstract

Development of automatic speech recognition system for voice activated Ground Control system

Cited by 11 publications

References 5 publications

Multi-Robot Interfaces and Operator Situational Awareness: Study of the Impact of Immersion and Prediction

Multi-Robot Interfaces and Operator Situational Awareness: Study of the Impact of Immersion and Prediction

Una revisión de los sistemas multi-robot: desafíos actuales para los operadores y nuevos desarrollos de interfaces

An Interactive Indoor Drone Assistant

Contact Info

Product

Resources

About