Multi-Sensor Context-Aware Based Chatbot Model: An Application of Humanoid Companion Robot

Abstract

In aspect of the natural language processing field, previous studies have generally analyzed sound signals and provided related responses. However, in various conversation scenarios, image information is still vital. Without the image information, misunderstanding may occur, and lead to wrong responses. In order to address this problem, this study proposes a recurrent neural network (RNNs) based multi-sensor context-aware chatbot technology. The proposed chatbot model incorporates image information with sound signals and gives appropriate responses to the user. In order to improve the performance of the proposed model, the long short-term memory (LSTM) structure is replaced by gated recurrent unit (GRU). Moreover, a VGG16 model is also chosen for a feature extractor for the image information. The experimental results demonstrate that the integrative technology of sound and image information, which are obtained by the image sensor and sound sensor in a companion robot, is helpful for the chatbot model proposed in this study. The feasibility of the proposed technology was also confirmed in the experiment.

Assisting Personalized Healthcare of Elderly People: Developing a Rule-Based Virtual Caregiver System Using Mobile Chatbot

“…Then, in 1966, the world’s first chatbot, ELIZA [ 66 ], was developed by Joseph, and since then, research on chatbots has developed. Today, the chatbot is a familiar technology for human beings, and it is used in many situations [ 67 , 68 , 69 , 70 , 71 ]. In particular, the use of chatbots in the field of mental health care has attracted a great deal of attention recently, because the chatbot has more potential to make people talk honestly than a real person [ 72 , 73 , 74 ].…”

From Gilgamesh’s quest for immortality to everlasting cloud hyper-collective mind: ethical implications for artificial intelligence

“…Moreover, AI can not only create robots, which are devices capable of carrying out a complex series of actions automatically, but also “humanoid robots”, hence human-made contraptions that could be endowed with cognitive capabilities (Chella et al , 2020; Graziano, 2017). In other words, we will witness the developing of a new complex multidimensional cybernetic system capable of allowing appropriate interactions between human beings and humanoid robots (Kuo et al , 2021) as well as of a meaningful interaction with the ecosystem.…”

Recommendations for designing conversational companion robots with older adults through foundation models

“…Similarly, despite the numerous studies investigating the use of conversational companion robots with older adults, only a few studies have employed autonomous conversational robots for open-domain dialogue (e.g., Sorbello et al, 2016 ; Kuo et al, 2021 ; Ostrowski et al, 2022 ; Khoo et al, 2023 ). Other studies focused on task-oriented dialogue that gives reminders, answers questions, provides weather reports, and plays games with this age group (e.g., Khosla and Chu (2013) ; de Graaf et al (2015) ; Carros et al (2020) .…”