Interfacing participation in citizen science projects with conversational agents

Portela, Manuel

doi:10.15346/hc.v8i2.114

Cited by 5 publications

(1 citation statement)

References 51 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The interest of practitioners regarding the usage of chatbots to support end-users of services is growing even in susceptible domains, including, for instance, e-government [17,34] and health and rehabilitation [1,16,37]. As suggested by De Filippis et al [11] and Federici et al [16], there is a need for specific and calibrated tools to assess the quality of interaction of chatbots to support the designer during the development and the assessment of such systems.…”

Section: Discussionmentioning

confidence: 99%

A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation

Borsci

Schmettow

Malizia

et al. 2022

Pers Ubiquit Comput

View full text Add to dashboard Cite

The Bot Usability Scale (BUS) is a standardised tool to assess and compare the satisfaction of users after interacting with chatbots to support the development of usable conversational systems. The English version of the 15-item BUS scale (BUS-15) was the result of an exploratory factorial analysis; a confirmatory factorial analysis tests the replicability of the initial model and further explores the properties of the scale aiming to optimise this tool seeking for the stability of the original model, the potential reduction of items, and testing multiple language versions of the scale. BUS-15 and the usability metrics for user experience (UMUX-LITE), used here for convergent validity purposes, were translated from English to Spanish, German, and Dutch. A total of 1292 questionnaires were completed in multiple languages; these were collected from 209 participants interacting with an overall pool of 26 chatbots. BUS-15 was acceptably reliable; however, a shorter and more reliable solution with 11 items (BUS-11) emerged from the data. The satisfaction ratings obtained with the translated version of BUS-11 were not significantly different from the original version in English, suggesting that the BUS-11 could be used in multiple languages. The results also suggested that the age of participants seems to affect the evaluation when using the scale, with older participants significantly rating the chatbots as less satisfactory, when compared to younger participants. In line with the expectations, based on reliability, BUS-11 positively correlates with UMUX-LITE scale. The new version of the scale (BUS-11) aims to facilitate the evaluation with chatbots, and its diffusion could help practitioners to compare the performances and benchmark chatbots during the product assessment stage. This tool could be a way to harmonise and enable comparability in the field of human and conversational agent interaction.

show abstract

Section: Discussionmentioning

confidence: 99%

A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation

Borsci

Schmettow

Malizia

et al. 2022

Pers Ubiquit Comput

View full text Add to dashboard Cite

show abstract

Re-examining the chatBot Usability Scale (BUS-11) to assess user experience with customer relationship management chatbots

Borsci,

Schmettow

2024

Pers Ubiquit Comput

View full text Add to dashboard Cite

Intelligent systems, such as chatbots, are likely to strike new qualities of UX that are not covered by instruments validated for legacy human–computer interaction systems. A new validated tool to evaluate the interaction quality of chatbots is the chatBot Usability Scale (BUS) composed of 11 items in five subscales. The BUS-11 was developed mainly from a psychometric perspective, focusing on ranking people by their responses and also by comparing designs’ properties (designometric). In this article, 3186 observations (BUS-11) on 44 chatbots are used to re-evaluate the inventory looking at its factorial structure, and reliability from the psychometric and designometric perspectives. We were able to identify a simpler factor structure of the scale, as previously thought. With the new structure, the psychometric and the designometric perspectives coincide, with good to excellent reliability. Moreover, we provided standardized scores to interpret the outcomes of the scale. We conclude that BUS-11 is a reliable and universal scale, meaning that it can be used to rank people and designs, whatever the purpose of the research.

show abstract

Designing a conversational agent for supporting data exploration in citizen science

Stein,

Teubner,

Morana

2024

Electron Markets

View full text Add to dashboard Cite

Data is ubiquitous in today’s digitized society. However, access to and literacy in handling data plays a pivotal role in determining who can benefit from it and who can use—or potentially misuse—it. To combat inequalities and address issues such as misinformation, it is essential to enable citizens to effectively access and understand data within their local ecosystems. To address this challenge, we focus on the case of citizen science and propose using a conversational agent to support data exploration and lower barriers to citizen engagement in research projects. Using a design science research approach, we derive design principles and develop a prototypical artifact. Moreover, we conduct an experimental evaluation, demonstrating strong interest among citizens to participate in scientific data analysis and that conversational agents hold great potential in increasing data literacy.

show abstract

Interfacing participation in citizen science projects with conversational agents

Cited by 5 publications

References 51 publications

A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation

A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation

Re-examining the chatBot Usability Scale (BUS-11) to assess user experience with customer relationship management chatbots

Designing a conversational agent for supporting data exploration in citizen science

Contact Info

Product

Resources

About