Can inspection methods generate valid new knowledge in HCI? The case of semiotic inspection

Abstract

HCI evaluation methods tend to be proposed and used to verify the interactive qualities of specific systems and design strategies. A discussion about the scientific merits of such methods to advance knowledge in HCI as a field is very rare, although much needed. This paper shows that, under certain conditions, inspection methods can be safely used in scientific research in HCI and extend their advantages beyond the territory of professional practice. Taking the Semiotic Inspection Method (SIM) as an example, we argue that its interpretive results are objective, can be validated, and produce scientific knowledge comparable to that generated by more widely accepted methods.

Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications

“…The Semiotic Inspection Method (SIM) [12,14,16,18] is a qualitative inspection method grounded in Semiotic Engineering that allows the evaluation of the communicability of a computer system through the analysis of its static, dynamic and meta-linguistic signs. The goal is to identify communication breakdowns that may take place during the user-system interaction and to reconstruct the designers' meta-message conveyed by the user interface.…”

“…Semiotic Engineering classifies the signs in three different types [12,16,18]: static, dynamic and meta-linguistic. Static signs express and mean the system's state.…”

“…On the other hand, when the user fails to understand the communication intended by the designer, a communication breakdown takes place that may hinder or even preclude the use of the system [11,12]. Semiotic Engineering has two qualitative and interpretive methods to assess the communicability of a user interface [11,12,16]: the Communicability Evaluation Method (CEM) [12,13], which involves user observation, and the Semiotic Inspection Method (SIM) [12,14,16,18], which involves user interface inspection. While CEM focuses on the reception of the meta-communication message by the users, SIM focuses on its emission by the designer.…”

Characterizing Interactions among Members of Deaf Communities in Orkut

“…This analysis intended to identify what was the impact of this connection on the interaction among community members within the community itself. The method used in this step was the Semiotic Inspection Method (SIM) [8], grounded on the Semiotic Engineering Theory [7]. The choice of this method was due to its ability to provide a theoretical based analysis of the observed user-interface-user interaction as meant by the designers, as well as the actual interaction that took place among users of a community [8].…”

“…To investigate this issue the Semiotic Inspection Method [8] was used to analyze the possibilities made available by the system to its users; and how users actually use what is offered.…”