Benefiting from legacy bias

Köpsel, Anne; Bubalo, Nikola

doi:10.1145/2803169

Cited by 42 publications

(13 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is also work on the role legacy bias plays in elicitation studies. Whereas Morris et al [27] and Nebeling et al [31] argue that legacy bias should be minimized, Köpsel and Bubalo [18] and Hoff et al [15] maintain that there are benefits to having participants suggest interactions similar to ones employed in existing technologies. There is also some work evaluating user-defined interactions and demonstrating the benefits of the elicitation study methodology by showing that user-defined interactions were more memorable than and preferable to those created by designers; see, e.g., Wobbrock et al [40], Morris et al [28] and Nacenta et al [29].…”

Section: Extending the End-user Elicitation Methodologymentioning

confidence: 99%

Crowdlicit

Ali

Morris

Wobbrock

2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

End-user elicitation studies are a popular design method. Currently, such studies are usually confined to a lab, limiting the number and diversity of participants, and therefore the representativeness of their results. Furthermore, the quality of the results from such studies generally lacks any formal means of evaluation. In this paper, we address some of the limitations of elicitation studies through the creation of the Crowdlicit system along with the introduction of end-user identification studies, which are the reverse of elicitation studies. Crowdlicit is a new web-based system that enables researchers to conduct online and in-lab elicitation and identification studies. We used Crowdlicit to run a crowd-powered elicitation study based on Morris's "Web on the Wall" study (2012) with 78 participants, arriving at a set of symbols that included six new symbols different from Morris's. We evaluated the effectiveness of 49 symbols (43 from Morris and six from Crowdlicit) by conducting a crowd-powered identification study. We show that the Crowdlicit elicitation study resulted in a set of symbols that was significantly more identifiable than Morris's. CCS CONCEPTS • Human-centered computing → HCI design and evaluation methods KEYWORDS End-user elicitation study; end-user identification study; user-driven design; crowdsourcing; Mechanical Turk.

show abstract

Section: Extending the End-user Elicitation Methodologymentioning

confidence: 99%

Crowdlicit

Ali

Morris

Wobbrock

2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Morris et al [49] proposed that more research efforts were needed to reduce legacy bias, i.e., the fact that user gesture preferences are influenced by their previous interaction experience with WIMP (windows, icons, menus, and pointing) icons. However, Köpsel et al [57] held the opinion that instead of rejecting legacy bias, it would be more helpful to take advantage of it. Besides, Tsandilas [56] pointed out that the raw agreement rates [23] should be carefully used depending on the type of study design and user groups.…”

Section: Previous Elicitation Studiesmentioning

confidence: 99%

User-Generated Gestures for Voting and Commenting on Immersive Displays in Urban Planning

Degbelo

Kray

2019

MTI

View full text Add to dashboard Cite

Traditional methods of public consultation offer only limited interactivity with urban planning materials, leading to a restricted engagement of citizens. Public displays and immersive virtual environments have the potential to address this issue, enhance citizen engagement and improve the public consultation process, overall. In this paper, we investigate how people would interact with a large display showing urban planning content. We conducted an elicitation study with a large immersive display, where we asked participants (N = 28) to produce gestures to vote and comment on urban planning material. Our results suggest that the phone interaction modality may be more suitable than the hand interaction modality for voting and commenting on large interactive displays. Our findings may inform the design of interactions for large immersive displays, in particular, those showing urban planning content.

show abstract

“…Although legacy bias is considered as a factor that may not produce originality in gesture proposals, sometimes it is considered to have positive effects in elicitation studies. Köpsel and Bubalo [64] argue that biased gestures have, in most cases, the advantage of being simplistic, do not require much time to be learned, or effort to be guessed, resulting in high agreement scores in elicitation studies. Such gestures are appropriate in cases when users do not have the time or desire to learn new interaction methods, or when the user's cognitive load should not be burdened.…”

Section: Controlling the Legacy Biasmentioning

confidence: 99%

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

View full text Add to dashboard Cite

Mid-air interaction involves touchless manipulations of digital content or remote devices, based on sensor tracking of body movements and gestures. There are no established, universal gesture vocabularies for mid-air interactions with digital content or remote devices based on sensor tracking of body movements and gestures. On the contrary, it is widely acknowledged that the identification of appropriate gestures depends on the context of use, thus the identification of mid-air gestures is an important design decision. The method of gesture elicitation is increasingly applied by designers to help them identify appropriate gesture sets for mid-air applications. This paper presents a review of elicitation studies in mid-air interaction based on a selected set of 47 papers published within 2011-2018. It reports on: (1) the application domains of mid-air interactions examined; (2) the level of technological maturity of systems at hand; (3) the gesture elicitation procedure and its variations; (4) the appropriateness criteria for a gesture; (5) participants number and profile; (6) user evaluation methods (of the gesture vocabulary); (7) data analysis and related metrics. This paper confirms that the elicitation method has been applied extensively but with variability and some ambiguity and discusses under-explored research questions and potential improvements of related research.Multimodal Technologies and Interact. 2018, 2, 65 2 of 21 such thing as a universal gesture vocabulary for every application" [15]. Thus, the identification of appropriate gestures for mid-air user interactions in terms of criteria like discoverability, memorability, performance, reliability and comfort, is an important design decision. This must be made at the early stages of system development and it severely affects the development course of every mid-air application project as well as the user experience (UX) of intended users.Emerging from the field of participatory design, gesture elicitation studies have been widely applied to help designers select the most appropriate gesture set for a given application. Although the method does not have a strict procedure, the main approach is to first define what operations (called "referents") have to be executed through gestures, then ask the end users to propose at least one gesture that they find preferable for each referent and finally to extract the gesture vocabulary after analysing the collected data [16]. The goal of a gesture elicitation study is to extract "good" gestures, which according to Morris et al. [17] are "gestures that meet certain design criteria such as discoverability, ease-of-performance, memorability, or reliability."Over the last few years, several elicitation studies have been conducted to identify mid-air gesture vocabularies for many different application domains and contexts, devices, types of digital content and tracking technologies subsumed. A survey of elicitation studies of mid-air interaction is useful to HCI researchers and interaction designers for deepening th...

show abstract

Benefiting from legacy bias

Cited by 42 publications

References 3 publications

Crowdlicit

Crowdlicit

User-Generated Gestures for Voting and Commenting on Immersive Displays in Urban Planning

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Contact Info

Product

Resources

About