2020
DOI: 10.1177/2053168019901185
|View full text |Cite
|
Sign up to set email alerts
|

Distinction without a difference? An assessment of MTurk Worker types

Abstract: Amazon’s Mechanical Turk (MTurk) platform is a popular tool for scholars seeking a reasonably representative population to recruit subjects for academic research that is cheaper than contract work via survey research firms. Numerous scholarly inquiries affirm that the MTurk pool is at least as representative as college student samples; however, questions about the validity of MTurk data persist. Amazon classifies all MTurk Workers into two types: (1) “regular” Workers, and (2) more qualified (and expensive) “m… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

2
16
0
1

Year Published

2020
2020
2024
2024

Publication Types

Select...
9
1

Relationship

0
10

Authors

Journals

citations
Cited by 40 publications
(19 citation statements)
references
References 21 publications
2
16
0
1
Order By: Relevance
“…Participants for the present study were recruited through Amazon.com's MTurk website in 2018. MTurk is the most frequently used online data collection site (Porter et al, 2019) that allows individuals, called "workers," to complete various human intelligence tasks (HITs), including research surveys (Loepp & Kelly, 2020). Participants recruited from MTurk tend to be similar to those recruited via other online survey platforms in terms of demographic characteristics (Huff & Tingley, 2015), and MTurk provides equivalent to superior data quality when compared to marketing research companies and lab-based studies (Casler et al, 2013;Kees et al, 2017;Paolacci & Chandler, 2014).…”
Section: Methods Participants and Proceduresmentioning
confidence: 99%
“…Participants for the present study were recruited through Amazon.com's MTurk website in 2018. MTurk is the most frequently used online data collection site (Porter et al, 2019) that allows individuals, called "workers," to complete various human intelligence tasks (HITs), including research surveys (Loepp & Kelly, 2020). Participants recruited from MTurk tend to be similar to those recruited via other online survey platforms in terms of demographic characteristics (Huff & Tingley, 2015), and MTurk provides equivalent to superior data quality when compared to marketing research companies and lab-based studies (Casler et al, 2013;Kees et al, 2017;Paolacci & Chandler, 2014).…”
Section: Methods Participants and Proceduresmentioning
confidence: 99%
“…However, Amazon MTurk Master Workers are more likely to be female, older, and more experienced in their assignments than regular workers, and were excluded to minimize potential sampling bias. 18…”
Section: Methodsmentioning
confidence: 99%
“… 1 MTurk Master Workers are automatically granted this status by a proprietary statistical model that analyzes performance based on data points such as quality of results (indicated by approval rates), length of tenure, and variety of work performed. It is unclear whether or not there is an advantage in utilizing them, as burgeoning research suggests that “research findings are only minimally impacted by Worker type” ( Loepp and Kelly (2020) , p. 7). …”
mentioning
confidence: 99%