Scenario-based dialogue system based on pause detection toward daily health monitoring

Abstract

Introduction We have conducted research on building a robot dialogue system to support the independent living of older adults. In order to provide appropriate support for them, it is necessary to obtain as much information, particularly related to their health condition, as possible. As the first step, we have examined a method to allow dialogue to continue for longer periods. Methods A scenario-based dialogue system utilizing pause detection for turn-taking was built. The practicality of adjusting the system based on the dialogue rhythm of each individual was studied. The system was evaluated through user studies with a total of 20 users, 10 of whom were older adults. Results The system detected pauses in the user’s speech using the sound level of their voice, and predicted the duration and number of pauses based on past dialogue data. Thus, the system initiated the robot’s voice-call after the user’s predicted speech. Conclusions Multiple turns of dialogue between robot and older adults are found possible under the system, despite several overlaps of robot’s and users’ speech observed. The users responded to the robot, including the questions related to health conditions. The feasibility of a scenario-based dialogue system was suggested; however, improvements are required.

Editorial: Early indicators of cognitive decline, Alzheimer's disease, and related dementias captured by neurophysiological tools

“…In light of other top-notch projects focusing on the positive effects of conversation-based interventions on cognitive function (Otake-Matsuura et al, 2021 ; Sugimoto and Otake-Matsuura, 2022 ; Sugimoto et al, 2023 ), this project deepens the grasp of how language, memory, and cognition interact and offer valuable insights into cognitive functions on a broader scale. In the foreseeable future, harnessing language processing during extended conversations facilitated by robots could prove pivotal in attaining profound insights into the health of elderly individuals (Kumagai et al, 2022 ; Figueroa et al, 2023 ). This forward-thinking strategy represents a transformative stride toward optimizing healthcare for an aging population worldwide.…”