On the Ethics of Crowdsourced Research

Williamson, Vanessa

doi:10.1017/s104909651500116x

Cited by 58 publications

(45 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…A second concern is whether the use of MTurk samples is ethical, mostly because generally the payment for participants is very low: the average payment for a survey translates to an hourly wage about $2 an hour for workers in the United States (Ross et al 2010). To account for this, in line with suggestions by Williamson (2016), we paid an hourly wage, which was greater than the federal minimum hourly wage ($7.25), of approximately $10 per hour.…”

Section: Data and Participantsmentioning

confidence: 99%

Reconsidering the expectancy disconfirmation model. Three experimental replications

Grimmelikhuijsen

Porumbescu

2017

Public Management Review

View full text Add to dashboard Cite

The expectancy disconfirmation model (EDM) posits that disconfirmation (the difference between expectations and perceived performance) affects citizen satisfaction. Van Ryzin experimentally manipulated expectations and performance and found a direct effect of performance, but no disconfirmation. We performed: an exact replication; a conceptual replication with extreme manipulations; a conceptual replication that reversed the order of a performance and expectations manipulation. Study 1 and 2 reproduced original findings. In contrast, study 3 indicates that expectation cues are retrospectively used to anchor prior experiences of performance. As the rational assumptions underlying the EDM are increasingly challenged, we need a better understanding of how cognitive biases shape citizen satisfaction.

show abstract

Section: Data and Participantsmentioning

confidence: 99%

Reconsidering the expectancy disconfirmation model. Three experimental replications

Grimmelikhuijsen

Porumbescu

2017

Public Management Review

View full text Add to dashboard Cite

show abstract

“…Williamson, 2014): Each subject received a detailed HIT description before accepting participation (informed consent). Participation was anonymous.…”

Section: Methodsmentioning

confidence: 99%

Using crowdsourced online experiments to study context-dependency of behavior

Keuschnigg

Bader

Bracher

2016

Social Science Research

View full text Add to dashboard Cite

We use Mechanical Turk's diverse participant pool to conduct online bargaining games in India and the US. First, we assess internal validity of crowdsourced experimentation through variation of stakes ($0, $1, $4, and $10) in the Ultimatum and Dictator Game. For cross-country equivalence we adjust the stakes following differences in purchasing power. Our marginal totals correspond closely to laboratory findings. Monetary incentives induce more selfish behavior but, in line with most laboratory findings, the particular size of a positive stake appears irrelevant. Second, by transporting a homogeneous decision situation into various living conditions crowdsourced experimentation permits identification of context effects on elicited behavior. We explore contextdependency using session-level variation in participants' geographical location, regional affluence, and local social capital. Across "virtual pools" behavior varies in the range of stake effects. We argue that quasi-experimental variation of the characteristics people bring to the experimental situation is the key potential of crowdsourced online designs.

show abstract

“…Furthermore, with its emphasis on crowd sourcing and public engagement (as exemplifi ed by projects like Transcribe Bentham which invites members of the public to transcribe the manuscripts of the philosopher Jeremy Bentham (Causer and Wallace 2012 )), DH has seen a stronger participation of the non-specialist than has recently been the norm in the Humanities. Nevertheless, the ethics of crowd sourcing is increasingly questioned of late (Williamson 2016 ). In many cases, 'doing' DH necessitates the purchasing of equipment, the hiring of professionals skilled in programming and computing and the paying of costs associated with the hosting and longer-term maintenance of digital resources.…”

Section: Dh (C2006-present)mentioning

confidence: 99%

Introduction

Nyhan

Flinn

2016

Computation and the Humanities

View full text Add to dashboard Cite

This chapter begins with an introduction to Digital Humanities (DH) and outlines its development since c.1949. It demonstrates that the application of computing to cultural heritage has been ongoing for some 70 years yet the histories of DH have, until recently, remained mostly unwritten. After exploring some of the particular diffi culties that attend any attempt to write such histories the approach that we have taken in this book is explained in detail. We close by asking why histories of DH are needed and essential to undertake.

show abstract

On the Ethics of Crowdsourced Research

Cited by 58 publications

References 9 publications

Reconsidering the expectancy disconfirmation model. Three experimental replications

Reconsidering the expectancy disconfirmation model. Three experimental replications

Using crowdsourced online experiments to study context-dependency of behavior

Introduction

Contact Info

Product

Resources

About