Component-Specific Usability Testing

Abstract

Abstract-This paper presents the results of a meta-analysis carried out on the results of six experiments to support the claim that component-specific usability measures are on average statistically more powerful than overall usability measures when comparing different versions of a part of a system. An increase in test effectiveness implies the need for fewer participants in usability tests that study different versions of a component. Three component-specific measures are presented and analyzed: an objective efficiency measure and two subjective measures, one about the ease-of-use and the other about the users' satisfaction. Whereas the subjective measures are obtained with a questionnaire, the objective efficiency measure is based on the number of user messages received by a component. Besides describing the testing method, this paper also discusses the underlying principles such as layered interaction and multiple negative-feedback loops. The main contribution of the work described is the presentation of component-based usability testing as an alternative for traditional holistic-oriented usability tests. The former is more aligned with the component-based software engineering approach, helping engineers to select the most usable versions of a component. IndexTerms-Component-based software engineering (CBSE), software testing, usability testing, user-centered design methodology.

Redefining and Extending the Scope of System Development Life Cycle: Perspective of Today's and Futuristic Human-System Interaction Environment

“…The concepts of usability, accuracy and efficiency have now become less important and significant as prime objective is now to design and weave an interaction environment and user experience that is superior in many more contexts other than engineering aspects. There is a rich set of techniques, methods and approaches through which the outcome of the previous phase can be assessed and appraisal report can be prepared [23,24] in relation to the criterion like usability, accuracy and efficiency.…”

Usability Analysis of a Novel Biometric Authentication Approach for Android-Based Mobile Devices

“…These aspects are always present in all test methods and the rest will change depending on the constraints of each project. A very important step is the usability test planning [29]. This phase is focused on a number of factors on which the entire test is based: test objectives, user characteristics, tasks and questionnaire characteristics at the end of test.…”

A Component-Based Evaluation Protocol for Clinical Decision Support Interfaces

“…In [5], the authors underscore how traditional usability tests that capture usability for the application as a whole are less effective at capturing the inherent interaction between application components: evaluating the overall usability of an application also cannot inform the selection of right components, their composition into a system and the analysis of their value which includes human-factor issues.…”