A Textual Feedback Tool for Empowering Participants in Usability and UX Evaluations

Abstract

The usability movement has historically always sought to empower end-users of computers, so that they understand what is happening and can control the outcome. In this paper, we develop and evaluate a 'Textual feedback' tool for usability and UX evaluation that can be used to empower welleducated, but low-status, users in UX evaluations in countries and contexts with high power distances. The proposed tool contributes to the HCI community's pool of localized UX evaluation tools. We evaluate the tool with 40 users from two socio-economic groups in real-life UX usability evaluations setting in Malaysia.The results indicate that the Textual Feedback tool may help participants to give their thoughts in UX evaluation in high power distance contexts. In particular, the Textual Feedback tool helps high status females and low status males express more UX problems than they can do with traditional CTA alone. We found that classic concurrent think aloud UX evaluation works fine in high power contexts, but only with the addition of Textual feedback to mitigate the effects of socio-economic status in certain user groups. We suggest that future research on UX evaluation look more into how to empower certain user groups, such as low status female users, in UX evaluations done in high power distance contexts.

UX Professionals’ Definitions of Usability and UX – A Comparison Between Turkey, Finland, Denmark, France and Malaysia

“…Sivaji et al [50] found that also gender has an effect on the effectiveness of a method used in usability evaluation, in particular when gender interacts with the social status of the users performing the evaluation.…”

Evaluación de la Usabilidad del Repositorio Institucional de la Universidad de Brasília

“…Esta área se preocupa con el diseño, evaluación e implementación de sistemas computacionales interactivos para el uso humano. Así, como en el estudio de los principales fenómenos de uso (Hewett, 1996;Sivaji, Nielsen, Clemmensen, 2017).…”

User Experience and Usability in Agriculture – Selected Aspects for Design Systems

“…However, in order to be able to effectively monitor, measure and effectively apply this information to product development and subsequent iterations, many specialized disciplines are required. It is these different disciplines that are covered by one overarching term, called UX (Sivaji, et al, 2016).…”