Supporting people with dementia- Understanding their interactions with Mixed Reality Technologies

Desai, Shital; Blackler, Alethea; Fels, Deborah I.; Astell, Arlene

doi:10.21606/drs.2020.266

Cited by 3 publications

(5 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The voice of the conker was not clear to PwD. Although, audio prompts are more effective in successful perception in PwD (Desai et al, 2020), clear human voice is preferred. Graphic icons such as tap icon were also difficult to understand.…”

Section: 2mentioning

confidence: 98%

“…PwD respond differently to various types of objects and content in the physical and digital spaces due to their impairment (Desai et al, 2020). Thus, their experience of presence with blended reality spaces could also be different.…”

Section: Tangible Presencementioning

confidence: 99%

“…Research such as Astell, Smith, & Joddrell (2019) have shown that PwD engage with digital interfaces on tablets and smartphones. Recent works by , Desai et al (2020), Garzotto, Torelli, Vona, & Aruanno (2019b have explored the use of mixed reality technologies with PwD for cognitive assessment and rehabilitation. Desai et al (2020) studied interactions of PwD with off the shelf technologies.…”

Section: Introductionmentioning

confidence: 99%

“…Recent works by , Desai et al (2020), Garzotto, Torelli, Vona, & Aruanno (2019b have explored the use of mixed reality technologies with PwD for cognitive assessment and rehabilitation. Desai et al (2020) studied interactions of PwD with off the shelf technologies. They found that PwD could complete continuous perception action loops of interactions with appropriate audio and visual prompts presented by the MRT.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Designing for Experiences in Blended Reality Environments for People with Dementia

Desai

Fels

Astell

2020

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Blended Reality environments have the potential to provide scalable solutions that are affordable, adaptable and easily deployable to support people with dementia. Use of these technologies is associated with experience of presence which is an experience with technologically mediated perceptions that generates a feeling of being there and the illusion of non-mediation. Our study examines what constitutes an experience of presence for people with dementia when they interact with MRTs.An observational study with ten participants (MoCA = 18 to 23, Age= 63 to 88 years) played a game of Tangram on Osmo. Six of these participants also played Young Conker on HoloLens. The experiences of the participants in the digital space, the physical space, and their attention crossover between the two spaces were coded in Noldus Observer XT 14.1.The study found four main themes that have an impact on the experience of presence in PwD -correspondences, effortless access to physical and digital content, awareness of reality and emergence. Correspondences between physical and digital spaces require PwD to have constant information about the state and nature of physical and digital content. The transitions between physical and digital should be seamless. PwD demonstrated positive experiences with Osmo, an augmented Virtuality technology while their experience with HoloLens, augmented reality technology was negative. The factors impacting experience of presence were prominent in Osmo while they were mostly absent in HoloLens throughout the game play. The outcomes of this study have resulted in a set of recommendations and guidelines for designers to design correspondences for experience of presence. We are currently working on developing prototypes using these guidelines for evaluations with PwD.

show abstract

Section: 2mentioning

confidence: 98%

Section: Tangible Presencementioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Designing for Experiences in Blended Reality Environments for People with Dementia

Desai

Fels

Astell

2020

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…Our study fits this methodology in that we wanted to explore how movement-based play and games can lead to more joy and social togetherness to anticipate possible health-related complications in this regard. Similarly, Desai et al (2020) applied off-the-shelf products as probes in their study of how people with dementia interacted with mixed reality technologies.…”

Section: The Game System As a Technology Probementioning

confidence: 99%

Turning Eight Family Homes Into Interactive, Pervasive Playgrounds During the COVID-19 Pandemic Lockdown

Matjeka¹,

Svanæs²,

Wang³

2022

Front. Comput. Sci.

View full text Add to dashboard Cite

This paper presents an evaluation study of how eighth families adopted, played and experienced a movement-based game system of analog and digital technologies in their homes during a pandemic lockdown. The COVID-19 pandemic locked down many countries and grounded people in their homes with social and physical implications. A game system consisting of simple, tangible technologies with modular components was designed to meet these needs. The game system was developed for the players to set up in their homes easily and, therefore, should not depend on screens or extensive physical installations. The game system comprises simple, tangible technologies such as light and music cubes, a simple mobile robot, card game challenges, and a suite of mini-games combining the elements in a variety of playful experiences. Using the technology probes methodology, the game system was packed into a suitcase and evaluated by eight families that played the game in their homes, video-recorded their sessions, wrote a final report and were (informally) interviewed afterwards. The data set presents how the families turned their ordinary everyday spaces into interactive, pervasive playgrounds encouraging social and bodily exploration and play. Furthermore, the study shows how bodily movement and social play can be promoted through different technologies that stimulate various bodily senses and incorporate them through the different game and play structures into their everyday living environments. The findings resulted in four design implications to aid designers and researchers in future work on movement-based game systems and interactive, pervasive playground design. These design implications accommodate social and bodily activities in ordinary places otherwise not pre-allocated for play or game activities.

show abstract

Enriching Social Sharing for the Dementia Community: Insights from In-Person and Online Social Programs

Dai

Moffatt

2023

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

The dementia community faces major challenges in social engagements, which have been further complicated by the prolonged physical distancing measures due to the COVID-19 pandemic. Designing digital tools for in-person social sharing in family and care facility settings has been well explored, but comparatively little HCI work has focused on the design of community-based social technologies for virtual settings. We present our virtual fieldwork on remote social activities explored by one dementia community in response to the impacts of the pandemic. Building upon our previously published on-site fieldwork in this community, we expand on our initial publication by follow-up interviewing caregivers and facilitators and reflecting on a virtual social program. Through thematic analysis and contrasting in-person and online formats of the program, we deepened the understanding of virtual social engagements of the dementia community, examining their efforts to leverage physical objects and environments, enhance open and flexible experiences, and expand collaborative space. We propose to open new design opportunities through holistic approaches, including reimagining community social spaces, rethinking agency in people with dementia and caregivers, and diversifying HCI support across communities and stakeholders.

show abstract

Supporting people with dementia- Understanding their interactions with Mixed Reality Technologies

Abstract: This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Cited by 3 publications

References 31 publications

Designing for Experiences in Blended Reality Environments for People with Dementia

Designing for Experiences in Blended Reality Environments for People with Dementia

Turning Eight Family Homes Into Interactive, Pervasive Playgrounds During the COVID-19 Pandemic Lockdown

Enriching Social Sharing for the Dementia Community: Insights from In-Person and Online Social Programs

Contact Info

Product

Resources

About