Far-Field Multimodal Speech Processing and Conversational Interaction in Smart Spaces

Potamianos, Gerasimos; Huang, Jing; Marcheret, Etienne; Libal, Vit; Balchandran, Rajesh; Epstein, Mark; Seredi, L.; Labský, Martin; Ures, L.; Black, Matthew; Lucey, Patrick

doi:10.1109/hscma.2008.4538701

Cited by 9 publications

(5 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The special speech recognition system developed can help them solve speech disorders and ensure their safety and health in life [33][34][35][36][37]. (3) In order to satisfy the users in the long distance voice interaction under special environment requirements, the designers of the analysis of the intelligent building system in the process of long distance voice interaction in which may exist problems, put forward the speech recognition system for long distances, and broke the voice interaction possible distance limit, to improve the user experience in the intelligence environment [38][39][40][41][42][43][44].…”

Section: The Voice Interactionmentioning

confidence: 99%

A Review of Smart Design Based on Interactive Experience in Building Systems

Zhang

et al. 2020

Sustainability

View full text Add to dashboard Cite

Smart building is the result of the penetration of information technology and control technology into traditional buildings, and is the future development direction of buildings. User-centric building smart design can achieve a sustainable life, and smart technology integration based on smart design can support sustainable development and improve user satisfaction, happiness, and overall quality of life. In intelligent design, researchers focus on the “people-oriented” approach, designed to bring users the ultimate interactive experience. Based on the interactive experience principle of smart design in the smart building system, this article classifies and summarizes intelligent design from the “five senses” interaction, including visual interaction, voice interaction, tactile interaction, cognitive interaction, and emotional interaction. We analyze the application of smart design in architecture and discuss how to embody the principles of user-centered interactive experience design in the process of smart design. This article provides a comprehensive and systematic literature review, clarifies the importance of the “people-oriented” approach in the smart design of buildings, and summarizes how to improve the sustainability of intelligent buildings from the perspective of a “people-oriented” approach. This paper proposes future research suggestions and directions and promotes the sustainable development of the smart building.

show abstract

Section: The Voice Interactionmentioning

confidence: 99%

A Review of Smart Design Based on Interactive Experience in Building Systems

Zhang

et al. 2020

Sustainability

View full text Add to dashboard Cite

show abstract

“…For the speech interface, we used the EVV text-to-speech (TTS) engine embedded in a talking head avatar [7]. The interaction of the components and the logical control of the system were implemented in the Conversational Interaction Management Architecture (CIMA) dialog framework [8,9]. The system setup with a user in action is shown in Figure 1.…”

Section: Technical Realizationmentioning

confidence: 99%

Exercise Support System for Elderly: Multi-sensor Physiological State Detection and Usability Testing

Máček

Kleindienst

2011

Human-Computer Interaction – INTERACT 2011

View full text Add to dashboard Cite

We present an interactive system for physical exercise of older people and provide results of a usability study with target user group. The system motivates an elderly person to do regular physical activity based on an easy exercise in a monitored environment without a direct supervision from care-givers. Our system employs multi-modal interface including speech synthesis and speech recognition, as well as distance measurement using an ultrasound range finder. The system coaches the user through a sequence of body movements in the exercise utilizing an underlying human activity model. For evaluation of the performance of the user we present a statistical human activity model to estimate physical load of the user. The system tracks user load by monitoring heart rate and by scanning movement patterns using statistical estimators. At well-defined moments and when the scanning suggests there is a problem with the user, the user is asked to verify his ability to continue with the exercise. The system was tested on a set of elderly users to gather usability data and to estimate the acceptance of the system. While simplicity of the setup proved to work well for the users, suggestions for further extensions of the system were gathered. Usefulness of the concept was verified with a physiotherapist.

show abstract

“…Smart spaces applications for elderly care include a number of context-aware homes (Abowd et al, 2002;Meyer & Rakotonirainy, 2003). Some projects have also developed systems for monitoring the elderly activities in a domestic environment (Kasteren & Kröse, 2007;Potamianos et al, 2008). It should be noted that smart spaces systems are likely to employ various ergonomic devices (e.g., Tablet PCs, touch-screens, surface computers) in order to interact with the elderly users.…”

Section: Related Workmentioning

confidence: 99%

A Low-Cost Multi-Touch Surface Device Supporting Effective Ergonomic Cognitive Training for the Elderly

Theodoreli

Petsatodis

Soldatos

et al. 2010

International Journal of Ambient Computing and Intelligence

View full text Add to dashboard Cite

The emerging surface computing trend is a key enabler for a wide range of ergonomic interfaces and applications. Surface computing interfaces are considered appropriate toward facilitating elderly interaction with ICT devices and services. In this paper, the authors present the development of an innovative low-cost multi-surface device and its application in elderly cognitive training. The multi-touch device has been designed and implemented as a cost-effective motivating environment for elderly cognitive training. Along with the implementation of the device and the bundled services, this paper also presents a number of cognitive training exercises that have been developed on the device.

show abstract

Far-Field Multimodal Speech Processing and Conversational Interaction in Smart Spaces

Cited by 9 publications

References 14 publications

A Review of Smart Design Based on Interactive Experience in Building Systems

A Review of Smart Design Based on Interactive Experience in Building Systems

Exercise Support System for Elderly: Multi-sensor Physiological State Detection and Usability Testing

A Low-Cost Multi-Touch Surface Device Supporting Effective Ergonomic Cognitive Training for the Elderly

Contact Info

Product

Resources

About