"Alexa, I just ate a donut": A pilot study collecting food and drink intake data with voice input

Abstract

Background Voice-based systems such as Amazon Alexa may be useful to collect self-reported information in real-time from participants of epidemiology studies, using verbal input. We demonstrate the technical feasibility of using Alexa, investigate participant acceptability, and provide an initial evaluation of the validity of the collected data. We use food and drink information as an exemplar. Methods We recruited 45 staff and students at the University of Bristol (UK). Participants were asked to tell Alexa what they ate or drank for 7 days, and also to submit this information using a web form. Questionnaires asked for basic demographic information and about their experience during the study and acceptability of using Alexa. Results Of the 37 participants with valid data, most were 20-39 years old (N=30; 81%) and 23 (62%) were female. Across 29 participants with Alexa and web entries corresponding to the same intake event, 357 Alexa entries (61%) contained the same food/drink information as the corresponding web entry. Participants often reported that Alexa interjected, and this was worse when entering the food and drink information compared with the event date and time. The majority said they would be happy to use a voice-controlled system for future research. Conclusions While usability of our skill was poor, largely due to the conversational nature and because Alexa interjected if there was a pause in speech, participants were mostly open to participating in future research studies using Alexa. Many more studies are needed, in particular, to trial less conversational interfaces.