Proceedings of the 16th International Conference on Human-Computer Interaction With Mobile Devices &Amp; Services 2014
DOI: 10.1145/2628363.2628398
|View full text |Cite
|
Sign up to set email alerts
|

Was it worth the hassle?

Abstract: Evaluation is considered one of the major cornerstones of human-computer interaction (HCI). During the last decade, several studies have discussed pros and cons of lab and field evaluations. Based on these discussions, we conduct a review to explore the past decade of mobile HCI research on field and lab evaluation, investigating responses in the literature to the "is it worth the hassle?" paper from 2004. We find that while our knowledge and experience with both lab and field studies have grown considerably, … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
34
0

Year Published

2016
2016
2022
2022

Publication Types

Select...
5
3
2

Relationship

0
10

Authors

Journals

citations
Cited by 71 publications
(34 citation statements)
references
References 53 publications
0
34
0
Order By: Relevance
“…There are, of course, numerous examples of HCI research based on literature review, for example looking at the production of theory [20], adoption of methods such as ethnography [8] and human computation [17], or summarizing progress in specific areas such as Mobile HCI [13,14] to name just a few. There are also examples of using bibliometric analysis to explore issues such as the nature of publications from different countries and organizations and the merit or otherwise of CHI Best Paper awards [2], conducting co-word analysis to establish a broad thematic mapping of the field [15], and even applying bibliometrics to rank individual scholars [16].…”
Section: Methodsmentioning
confidence: 99%
“…There are, of course, numerous examples of HCI research based on literature review, for example looking at the production of theory [20], adoption of methods such as ethnography [8] and human computation [17], or summarizing progress in specific areas such as Mobile HCI [13,14] to name just a few. There are also examples of using bibliometric analysis to explore issues such as the nature of publications from different countries and organizations and the merit or otherwise of CHI Best Paper awards [2], conducting co-word analysis to establish a broad thematic mapping of the field [15], and even applying bibliometrics to rank individual scholars [16].…”
Section: Methodsmentioning
confidence: 99%
“…Experimental design means balancing control with ecological validity [16]. Increased intervention increases control but also increases bias.…”
Section: Experience Controlmentioning
confidence: 99%
“…Field trials enable researchers to study the use of the innovation by test users in a natural use context and allow them to discover and understand how technologies are being used and adopted in a real-life setting, which is one of the key principles within living lab research (Ballon et al, 2005;Følstad, 2008;Kjeldskov & Skov, 2014;Schuurman et al, 2013). In contrast to other research methods, participation in field trials requires a prolonged engagement of test users because they are expected to test an innovation during a specific period.…”
Section: Factors Affecting the Attrition Of Test Users During Living mentioning
confidence: 99%