Design Validation of a Relational Agent by COVID-19 Patients: Mixed Methods Study

Abstract

Background Relational agents (RAs) have shown effectiveness in various health interventions with and without doctors and hospital facilities. In situations such as a pandemic like the COVID-19 pandemic when health care professionals (HCPs) and facilities are unable to cope with increased demands, RAs may play a major role in ameliorating the situation. However, they have not been well explored in this domain. Objective This study aimed to design a prototypical RA in collaboration with COVID-19 patients and HCPs and test it with the potential users, for its ability to deliver services during a pandemic. Methods The RA was designed and developed in collaboration with people with COVID-19 (n=21) and 2 groups of HCPs (n=19 and n=16, respectively) to aid COVID-19 patients at various stages by performing 4 main tasks: testing guidance, support during self-isolation, handling emergency situations, and promoting postrecovery mental well-being. A design validation survey was conducted with 98 individuals to evaluate the usability of the prototype using the System Usability Scale (SUS), and the participants provided feedback on the design. In addition, the RA’s usefulness and acceptability were rated by the participants using Likert scales. Results In the design validation survey, the prototypical RA received an average SUS score of 58.82. Moreover, 90% (88/98) of participants perceived it to be helpful, and 69% (68/98) of participants accepted it as a viable alternative to HCPs. The prototypical RA received favorable feedback from the participants, and they were inclined to accept it as an alternative to HCPs in non-life-threatening scenarios despite the usability rating falling below the acceptable threshold. Conclusions Based on participants’ feedback, we recommend further development of the RA with improved automation and emotional support, ability to provide information, tracking, and specific recommendations.

Personalized Care in Eye Health: Exploring Opportunities, Challenges, and the Road Ahead for Chatbots

“…Creating an interactive and intuitive UI is pivotal for ophthalmology chatbots to effectively engage and assist users. The UI design should enable seamless navigation and provide a user-friendly experience [29].…”

Chatbots and COVID-19: Taking Stock of the Lessons Learned

“…Chatbots have been designed to provide a range of health-related services, from information sharing [6] to offering support for mental well-being [7,8], and diagnostic tools to assist health care workers [9]. They have been designed for a range of subgroups such as specific age-groups (eg, youth who are often considered the most likely group to accept and adopt mobile technology), people with specific diseases (eg, young people with diabetes [10]), or those in health care roles (eg, frontline health workers [11]).…”