Using Video Prototypes for Evaluating Design Concepts with Users: A Comparison to Usability Testing

Zwinderman, MJ Matthijs; Leenheer, RA Rinze; Shirzad, Azadeh; Chupriyanov, N Nikolay; Veugen, G Glenn; Zhang, B; Markopoulos, Panos

doi:10.1007/978-3-642-40480-1_55

Cited by 10 publications

(4 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Within this framework, we integrated 3 participatory activities deemed specifically effective for people with LHL. These were (1) “co-constructing stories” [ 43 ], (2) “experience prototype exhibition” [ 44 ], and (3) “video prototype evaluation” [ 45 ]. These activities were specifically selected as they would allow to effectively engage with the target group and understand their perspective.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Developing a Digital Medication Adherence Intervention for and With Patients With Asthma and Low Health Literacy: Protocol for a Participatory Design Approach

Faber¹,

Poot²,

Dekkers³

et al. 2023

JMIR Form Res

View full text Add to dashboard Cite

Background Current eHealth interventions are poorly adopted by people with low health literacy (LHL) as they often fail to meet their needs, skills, and preferences. A major reason for this poor adoption is the generic, one-size-fits-all approach taken by designers of these interventions, without addressing the needs, skills, and preferences of disadvantaged groups. Participatory design approaches are effective for developing interventions that fit the needs of specific target groups; yet, very little is known about the practical implications of executing a participatory design project for and with people with LHL. Objective This study aimed to demonstrate the application of participatory design activities specifically selected to fit the needs and skills of people with LHL and how these were manifested within an overarching eHealth design process. In addition, the study aims to present reflections and implications of these activities that could support future designers to engage people with LHL in their design processes. Methods We used the design process of a smart asthma inhaler for people with asthma and LHL to demonstrate participatory design activities. The study was framed under 5 stages of design thinking: empathize, define, ideate, prototype, and test within 2 major iteration cycles. We integrated 3 participatory design activities deemed specifically appropriate for people with LHL: co-constructing stories, experience prototype exhibition, and video prototype evaluation. Results Co-constructing stories was found to deepen the understanding of the participant’s motivation to use or not to use maintenance medication. This understanding informed and facilitated the subsequent development of diverse preliminary prototypes of possible interventions. Discussing these prototypes in the experience prototype exhibition helped provoke reactions, thoughts, and feelings about the interventions, and potential scenarios of use. Through the video prototype evaluation, we were able to clearly communicate the goal and functionality of the final version of our intervention and gather appropriate responses from our participants. Conclusions This study demonstrates a participatory design approach for and with patients with asthma and LHL. We demonstrated that careful consideration and selection of activities can result in participants that are engaged and feel understood. This paper provides insight into the practical implications of participatory activities with people with LHL and supports and inspires future designers to engage with this disadvantaged target group.

show abstract

Section: Methodsmentioning

confidence: 99%

“…A combination of paper and video prototypes would be more effective in communicating the concept toward people with LHL than paper-based prototypes alone. [ 45 , 49 ]. Videos have proven to be an effective tool in other intervention research and design efforts for asthma patients with LHL [ 50 , 51 ].…”

Section: Methodsmentioning

confidence: 99%

Developing a Digital Medication Adherence Intervention for and With Patients With Asthma and Low Health Literacy: Protocol for a Participatory Design Approach

Faber¹,

Poot²,

Dekkers³

et al. 2023

JMIR Form Res

View full text Add to dashboard Cite

show abstract

“…Using a video prototype allows us to discuss design ideas beyond the screen and focus on the use of generative AI in reminiscence contexts. In addition, the video prototype could present design ideas vividly and efficiently and support participatory design [51,94]. Specifically, the video prototype demonstrates how a virtual DJ (AI-DJ) guides listeners to recall and share their memories while listening to nostalgic songs.…”

Section: Workhop I: Understanding Older Adultsmentioning

confidence: 99%

Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older Adults

Jin,

Cai,

Chen

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Music-based reminiscence has the potential to positively impact the psychological well-being of older adults. However, the aging process and physiological changes, such as memory decline and limited verbal communication, may impede the ability of older adults to recall their memories and life experiences. Given the advanced capabilities of generative artificial intelligence (AI) systems, such as generated conversations and images, and their potential to facilitate the reminiscing process, this study aims to explore the design of generative AI to support music-based reminiscence in older adults. This study follows a user-centered design approach incorporating various stages, including detailed interviews with two social workers and two design workshops (involving ten older adults). Our work contributes to an in-depth understanding of older adults' attitudes toward utilizing generative AI for supporting music-based reminiscence and identifies concrete design considerations for the future design of generative AI to enhance the reminiscence experience of older adults. CCS CONCEPTS• Human-centered computing → User studies; Accessibility design and evaluation methods.

show abstract

“…Indeed, studies assessing the ecological validity of video-based study designs have shown the results to closely mirror reality, particularly when assessing user acceptance and usability considerations. The main difference between video and usage-based studies is that users may not always be able to fully assess restrictions posed by the context where the interaction takes place [35]. Video prototypes also offer other benefits as they help in obtaining a higher number of participants and responses from a variety of regions, where users opinion and adoption of multidevice systems can differ significantly, and as they help reproducing and replicating the study at different locations.…”

Section: Experiments Designmentioning

confidence: 99%

Intelligent Shifting Cues: Increasing the Awareness of Multi-Device Interaction Opportunities

Nguyen

Zuniga

Flores

et al. 2021

Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization

View full text Add to dashboard Cite

The ever-increasing ubiquity of smart devices is creating new opportunities for people to interact and engage with digital information using multiple devices. In the simplest case this can refer to choosing which device to use for a particular task (e.g., phone, laptop or smartwatch), whereas a more complex example is simultaneously taking advantage of the capabilities of different devices (e.g., laptop and smart TV). Despite these types of opportunities becoming increasing available, currently the full potential of multi-device interactions is not being realized as people struggle to take advantage of them. As our first contribution, we study people's willingness to engage with multi-device interactions and rank the factors that mediate this response through an online survey ( = 60). Our results show that users are strongly in favour of using multiple devices, but lack the awareness or information to engage with them, or feel that establishing the interactions is too laborious and would disrupt the fluidity of the interactions. Motivated by this result, as our second contribution we design and evaluate intelligent shifting cues, visualizations that offer information about available interaction opportunities and how to establish them, and study how they influence users willingness to engage in multi-device interactions. Results of our study show that the cues can be effective in helping people to engage with multiple devices, but that the suitability of the proposed device and fit with task are important mediating factors. We end the paper by deriving design implications for intelligent systems that can support people in engaging with multi-device interactions.

show abstract

Using Video Prototypes for Evaluating Design Concepts with Users: A Comparison to Usability Testing

Cited by 10 publications

References 8 publications

Developing a Digital Medication Adherence Intervention for and With Patients With Asthma and Low Health Literacy: Protocol for a Participatory Design Approach

Developing a Digital Medication Adherence Intervention for and With Patients With Asthma and Low Health Literacy: Protocol for a Participatory Design Approach

Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older Adults

Intelligent Shifting Cues: Increasing the Awareness of Multi-Device Interaction Opportunities

Contact Info

Product

Resources

About