Development and Evaluation of Usability Heuristics for Voice User Interfaces

Fulfagar, Lokesh; Gupta, Anupriya; Mathur, Arpit; Shrivastava, Abhishek

doi:10.1007/978-981-16-0041-8_32

Cited by 6 publications

(3 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The heuristics on Interfaces are based on the guidelines and research by (Drury et al, 2004;Clarkson and Arkin, 2007;Bauer et al, 2009;Andonovski et al, 2010;Weiss et al, 2010;Keebler et al, 2012;Adamides et al, 2014;Coronado et al, 2017;Maguire, 2019;Frijns and Schmidbauer, 2021;Fulfagar et al, 2021;Qbilat et al, 2021). They are organized into two levels: i) the basic level, which is composed of general issues, and ii) the advanced level, which is composed of four subcategories (visual, voice, gesture, and haptic).…”

Section: Interfacesmentioning

confidence: 99%

Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX)

Apraiz,

Mulet Alberola,

Lasa

et al. 2023

Front. Robot. AI

View full text Add to dashboard Cite

Humans and robots will increasingly have to work together in the new industrial context. Therefore, it is necessary to improve the User Experience, Technology Acceptance, and overall wellbeing to achieve a smoother and more satisfying interaction while obtaining the maximum performance possible out of it. For this reason, it is essential to analyze these interactions to enhance User Experience. The heuristic evaluation is an easy-to-use, low-cost method that can be applied at different stages of a design process in an iterative manner. Despite these advantages, there is rarely a list of heuristics in the current literature that evaluates Human-Robot interactions both from a User Experience, Technology Acceptance, and Human-Centered approach. Such an approach should integrate key aspects like safety, trust, and perceived safety, ergonomics and workload, inclusivity, and multimodality, as well as robot characteristics and functionalities. Therefore, a new set of heuristics, namely, the HEUROBOX tool, is presented in this work in the form of the HEUROBOX tool to help practitioners and researchers in the assessment of human-robot systems in industrial environments. The HEUROBOX tool clusters design guidelines and methodologies as a logic list of heuristics for human-robot interaction and comprises four categories: Safety, Ergonomics, Functionality, and Interfaces. They include 84 heuristics in the basic evaluation, while the advanced evaluation lists a total of 228 heuristics in order to adapt the tool to the evaluation of different industrial requirements. Finally, the set of new heuristics has been validated by experts using the System Usability Scale (SUS) questionnaire and the categories has been prioritized in order of their importance in the evaluation of Human-Robot Interaction through the Analytic Hierarchy Process (AHP).

show abstract

Section: Interfacesmentioning

confidence: 99%

Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX)

Apraiz,

Mulet Alberola,

Lasa

et al. 2023

Front. Robot. AI

View full text Add to dashboard Cite

show abstract

“…More specific heuristics have been developed for topics such as human-AI interaction [4], augmented reality [24,31], and mobile computing [8], among many others. Researchers have proposed numerous heuristics specific to conversational interaction with chatbots and voice assistants [30,36,47,53,58,82,94].…”

Section: Heuristics In Hci and Visualizationmentioning

confidence: 99%

Heuristics for Supporting Cooperative Dashboard Design

Setlur,

Correll,

Satyanarayan

et al. 2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Fig. 1: Successes and failures of cooperative dashboard design throughout the five analytic states of a conversation (a-e). Cooperative dashboards guide users through their data and, in contrast to static dashboards, provide bi-directional communication through interactivity to allow the user to change or refine their analytical goals, switch between topics of interest and levels of detail, correct or update the system if it provides irrelevant or incorrect information, and provide useful summaries of analytical actions. Note that these conversation states are not necessarily sequential and the analyst can move between these various states.

show abstract

“…However, the study noted that one was less problematic to use than the other [12]. A further study tested VUI heuristics to measure VA efficacy [13]. However, a critical factor that prevents the VA from adopting the heuristic currently available is the absence of a graphical user interface (GUI).…”

Section: Introductionmentioning

confidence: 99%

A Systematic Review of Voice Assistant Usability: An ISO 9241–11 Approach

et al. 2022

View full text Add to dashboard Cite

Voice assistants (VA) are an emerging technology that have become an essential tool of the twenty-first century. The VA ease of access and use has resulted in high usability curiosity in voice assistants. Usability is an essential aspect of any emerging technology, with every technology having a standardized usability measure. Despite the high acceptance rate on the use of VA, to the best of our knowledge, not many studies were carried out on voice assistants' usability. We reviewed studies that used voice assistants for various tasks in this context. Our study highlighted the usability measures currently used for voice assistants. Moreover, our study also highlighted the independent variables used and their context of use. We employed the ISO 9241-11 framework as the measuring tool in our study. We highlighted voice assistant's usability measures currently used; both within the ISO 9241-11 framework, as well as outside of it to provide a comprehensive view. A range of diverse independent variables are identified that were used to measure usability. We also specified that the independent variables still not used to measure some usability experience. We currently concluded what was carried out on voice assistant usability measurement and what research gaps were present. We also examined if the ISO 9241-11 framework can be used as a standard measurement tool for voice assistants.

show abstract

Development and Evaluation of Usability Heuristics for Voice User Interfaces

Cited by 6 publications

References 25 publications

Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX)

Development of a new set of Heuristics for the evaluation of Human-Robot Interaction in industrial settings: Heuristics Robots Experience (HEUROBOX)

Heuristics for Supporting Cooperative Dashboard Design

A Systematic Review of Voice Assistant Usability: An ISO 9241–11 Approach

Contact Info

Product

Resources

About