Augmented Reality in Robotic Assistance for the Elderly

Lera, Francisco Javier Rodríguez; Rodriguez, Victor; Rodríguez, Carlos; Olivera, Vicente Matellán

doi:10.1007/978-3-319-02332-8_1

Cited by 18 publications

(12 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results and insights that are obtained through the conducted experiments will undoubtedly shape the care robots of tomorrow. Among all the mobile robots for elder care, several notable robots are briefly described in Table 10 [ 145 , 146 , 147 , 148 , 149 , 150 , 151 , 152 , 153 , 154 , 155 ].…”

Section: Ambient Sensors In Elderly Carementioning

confidence: 99%

Ambient Sensors for Elderly Care and Independent Living: A Survey

Uddin

Khaksar

Tørresen

2018

Sensors

141

View full text Add to dashboard Cite

Elderly care at home is a matter of great concern if the elderly live alone, since unforeseen circumstances might occur that affect their well-being. Technologies that assist the elderly in independent living are essential for enhancing care in a cost-effective and reliable manner. Elderly care applications often demand real-time observation of the environment and the resident’s activities using an event-driven system. As an emerging area of research and development, it is necessary to explore the approaches of the elderly care system in the literature to identify current practices for future research directions. Therefore, this work is aimed at a comprehensive survey of non-wearable (i.e., ambient) sensors for various elderly care systems. This research work is an effort to obtain insight into different types of ambient-sensor-based elderly monitoring technologies in the home. With the aim of adopting these technologies, research works, and their outcomes are reported. Publications have been included in this survey if they reported mostly ambient sensor-based monitoring technologies that detect elderly events (e.g., activities of daily living and falls) with the aim of facilitating independent living. Mostly, different types of non-contact sensor technologies were identified, such as motion, pressure, video, object contact, and sound sensors. Besides, multicomponent technologies (i.e., combinations of ambient sensors with wearable sensors) and smart technologies were identified. In addition to room-mounted ambient sensors, sensors in robot-based elderly care works are also reported. Research that is related to the use of elderly behavior monitoring technologies is widespread, but it is still in its infancy and consists mostly of limited-scale studies. Elderly behavior monitoring technology is a promising field, especially for long-term elderly care. However, monitoring technologies should be taken to the next level with more detailed studies that evaluate and demonstrate their potential to contribute to prolonging the independent living of elderly people.

show abstract

Section: Ambient Sensors In Elderly Carementioning

confidence: 99%

Ambient Sensors for Elderly Care and Independent Living: A Survey

Uddin

Khaksar

Tørresen

2018

Sensors

141

View full text Add to dashboard Cite

show abstract

“…A mobile AR system is relatively easy to develop and can provide a friendly user interface (UI) because it uses mobile devices. For example, applications have been developed that employ a mobile device's camera and provide related information through the device's display when the user uses a medicine case [17,18]. Developed for mobile AR games for health promotion through the user-friendly mobile devices [19].…”

Section: Related Workmentioning

confidence: 99%

Deep-cARe: Projection-Based Home Care Augmented Reality System with Deep Learning for Elderly

Park

Lee

et al. 2019

Applied Sciences

View full text Add to dashboard Cite

Developing innovative and pervasive smart technologies that provide medical support and improve the welfare of the elderly has become increasingly important as populations age. Elderly people frequently experience incidents of discomfort in their daily lives, including the deterioration of cognitive and memory abilities. To provide auxiliary functions and ensure the safety of the elderly in daily living situations, we propose a projection-based augmented reality (PAR) system equipped with a deep-learning module. In this study, we propose three-dimensional space reconstruction of a pervasive PAR space for the elderly. In addition, we propose the application of a deep-learning module to lay the foundation for contextual awareness. Performance experiments were conducted for grafting the deep-learning framework (pose estimation, face recognition, and object detection) onto the PAR technology through the proposed hardware for verification of execution possibility, real-time execution, and applicability. The precision of the face pose is particularly high by pose estimation; it is used to determine an abnormal user state. For face recognition results of whole class, the average detection rate (DR) was 74.84% and the precision was 78.72%. However, for face occlusions, the average DR was 46.83%. It was confirmed that the face recognition can be performed properly if the face occlusion situation is not frequent. By object detection experiment results, the DR increased as the distance from the system decreased for a small object. For a large object, the miss rate increased when the distance between the object and the system decreased. Scenarios for supporting the elderly, who experience degradation in movement and cognitive functions, were designed and realized, constructed using the proposed platform. In addition, several user interfaces (UI) were implemented according to the scenarios regardless of distance between users and the proposed system. In this study, we developed a bidirectional PAR system that provides the relevant information by understanding the user environment and action intentions instead of a unidirectional PAR system for simple information provision. We present a discussion of the possibility of care systems for the elderly through the fusion of PAR and deep-learning frameworks. Appl. Sci. 2019, 9, 3897 2 of 22 were usually attended to by their families; however, they are currently forced to lead independent lives [2]. There has been increasing interest in social welfare and medical support owing to the increasing aging rate. The social government is increasing social welfare and medical benefits to support elderly self-sustenance; however, most elderly people attend to various problems in their daily life on them own. Moreover, various diseases as well as physical and mental deterioration can occur with aging [3]. Muscle weakness is a representative example of physical deterioration. Muscle strength of people in their 60's decreases to approximately one half of that in their 20s, resulting in sign...

show abstract

“…Schall et al [6] developed a prototype system to support elderlies in hazard detection while driving a vehicle. A robot with an AR screen to support drug dose control has been proposed and tested by Lera et al [4].…”

Section: Introduction and Related Workmentioning

confidence: 99%

[Poster] Towards mobile augmented reality for the elderly

Kurz¹,

Fedosov²,

Diewald³

et al. 2014

2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

Figure 1: We conducted a user study to evaluate the usability of handheld AR applications for the elderly (a,b). Since the results show that elderly users have difficulties holding up a tablet computer over a long period of time, we tested whether using head-mounted displays is an alternative for them (c). We also propose improved AR user interfaces for tablet PCs that do not require continuously holding up the device (d). ABSTRACTMobility and independence are key aspects for self-determined living in today's world and demographic change presents the challenge to retain these aspects for the aging population. Augmented Reality (AR) user interfaces might support the elderly, for example, when navigating as pedestrians or by explaining how devices and mobility aids work and how they are maintained. This poster reports on the results of practical field tests with elderly subjects testing handheld AR applications. The main finding is that common handheld AR user interfaces are not suited for the elderly because they require the user to hold up the device so the back-facing camera captures the object or environment related to which digital information shall be presented. Tablet computers are too heavy and they do not provide sufficient grip to hold them over a long period of time. One possible alternative is using head-mounted displays (HMD). We present the promising results of a user test evaluating whether elderly people can deal with AR interfaces on a lightweight HMD. We conclude with an outlook to improved handheld AR user interfaces that do not require continuously holding up the device, which we hope are better suited for the elderly.

show abstract

Augmented Reality in Robotic Assistance for the Elderly

Cited by 18 publications

References 6 publications

Ambient Sensors for Elderly Care and Independent Living: A Survey

Ambient Sensors for Elderly Care and Independent Living: A Survey

Deep-cARe: Projection-Based Home Care Augmented Reality System with Deep Learning for Elderly

[Poster] Towards mobile augmented reality for the elderly

Contact Info

Product

Resources

About