Amazon Mechanical Turk (MTurk) is becoming a prevalent source of quick and cost effective data for organizational research, but there are questions about the appropriateness of the platform for organizational research. To answer these questions, we conducted an integrative review based on 75 papers evaluating the MTurk platform and 250 MTurk samples used in organizational research. This integrative review provides four contributions: (1) we analyze the trends associated with the use of MTurk samples in organizational research; (2) we develop a systems perspective (recruitment system, selection system, and work management system) to synthesize and organize the key factors influencing data collected on MTurk that may affect generalizability and data quality; (3) within each factor, we also use available MTurk samples from the organizational literature to analyze key issues (e.g., sample characteristics, use of attention checks, payment); and (4) based on our review, we provide specific recommendations and a checklist for data reporting in order to improve data transparency and enable further research on this issue.
m t urk a dva n tag e s , c ha l l e ng e s , a n d r e c om m e n dat ion s 171 workers are appropriate or inappropriate samples for research questions relevant to the field of I-O psychology. MTurk is a potentially valuable source of data for I-O psychologists, and as such, we need to examine and explore it more fully.
Purpose
The purpose of this paper is to provide an investigation of how different types of gig workers engage in the gig economy. Specifically, the authors distinguish between workers who view gig work as primary income (or not) and those workers who view it as a job (or not).
Design/methodology/approach
In total, 1,190 Mechanical Turk (MTurk) workers completed surveys across two studies examining whether types of workers differ based on demographic characteristics, utilization of MTurk, why they participate in the gig economy on MTurk (i.e. push and pull factors) and how this impacts life satisfaction.
Findings
Workers relying on MTurk as a primary income had lower incomes and spent more time completing large numbers of work units. This group of workers also reported fewer pull factors (e.g. enjoyment) as a reason for working in the gig economy and had lower levels of self-reported current and predicted future life satisfaction. Individuals who view MTurk as a job were more likely to treat MTurk like a job – engaging in online communities and having a regular work schedule. These workers were more likely to report pull factors (e.g. enjoyment and challenge) and did not differ on life satisfaction.
Originality/value
The current research contributes to our understanding of MTurk, one of the largest online platforms for gig work, as part of the diverse gig economy and highlights potential areas for future research.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.