Swapping bricks for clicks: Crowdsourcing longitudinal data on Amazon Turk

Daly, Timothy M.; Nataraajan, Rajan

doi:10.1016/j.jbusres.2015.05.001

Cited by 112 publications

(67 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, recent evidence suggests that MTurk panelists provide responses that match or exceed the quality of data collected from student samples at universities, in person as well as online, or other internet panels such as those supplied through survey software companies like Qualtrics (Goodman, Cryder, & Cheema, ; Kees, Berry, Burton, & Sheehan, ). Additionally, MTurk has strong reliability for longitudinal research designs (Daly & Nataraajan, ). Its diverse sample characteristics, reliability, low cost, and speed are all reasons that MTurk is a “highly recommended” option for social science researchers (Goodman et al, , p. 222).…”

Section: Methodsmentioning

confidence: 99%

The Mediating Effects of Spiritual Bypass on Depression, Anxiety, and Stress

Fox

Picciotto

2019

Counseling and Values

View full text Add to dashboard Cite

Spiritual bypass is a defensive psychological posture that prevents people from feeling the pain of difficult emotions or experiences through 2 primary pathways: (a) Psychological Avoidance and (b) Spiritualizing. The authors collected a sample (783 participants) from the general population and tested a parallel mediation model in which 2 factors of spiritual bypass mediated the effect of spirituality on depression, anxiety, and stress. The results demonstrated that Psychological Avoidance and Spiritualizing partially mediated the effect of spirituality on depression and anxiety, whereas they completely mediated the effect of spirituality on stress. The findings are presented in the context of the study's limitations, and implications for clinical practice and research are provided.

show abstract

Section: Methodsmentioning

confidence: 99%

The Mediating Effects of Spiritual Bypass on Depression, Anxiety, and Stress

Fox

Picciotto

2019

Counseling and Values

View full text Add to dashboard Cite

show abstract

“…We also wanted to ensure small effects could be detected at both time points in the event that we experienced lower than expected re-response rates (Bakker et al 2016;Daly and Nataraajan 2015). In total, the Time 1 survey was completed by 1516 participants.…”

Section: Methods Participants and Proceduresmentioning

confidence: 99%

Amazon’s Mechanical Turk as a Viable Source for Organizational and Occupational Health Research

et al. 2017

View full text Add to dashboard Cite

Crowdsourcing is an increasingly popular method for organizational and occupational health research. Amazon's Mechanical Turk (MTurk) is at the forefront of this trend, but few studies have examined the labor market characteristics of MTurk workers (Turkers) or results of organizational and occupational health data as compared to published benchmarks. To address these gaps, we review the current MTurk literature and present the results of a multi-wave study of Turker labor characteristics and organizational and occupational health variable relationships. We found Turkers to be broadly distributed across the labor market, indicating MTurk is a viable option for both generalizable and understudied samples, as well as a source for targeted occupational sectors. Additionally, we found effect size magnitudes to be comparable to published benchmarks, and data displayed high levels of test-retest reliability and stability of relationships across time. Our results support the use of MTurk as a viable source for organizational and occupational health research assuming general methodological concerns and validity threats are addressed (see Cheung et al. Journal of Business and Psychology 1-15, 2016).Keywords Crowdsourcing . Mechanical Turk . Occupational health research . Organizational research . Survey research Amazon's Mechanical Turk (MTurk) is a virtual labor marketplace where "requesters" create Human Intelligence Tasks (HITs) for "workers" to complete for monetary compensation. There are two primary actors on MTurk -requesters (requesters create HITs) and workers (workers complete HITs). Requesters are analogous to employers in an organizational context or researchers in a research context, while workers are Occup Health Sci (2018) 2:83-98 https://doi

show abstract

“…One practical benefit of mTurk is the unique identifiers assigned to participants that allow for easy and efficient repeated research contact in test–retest and other longitudinal designs. For example, Daly and Nataraajan () observed response rates of 75% at 2 months, 56% at 4 months, and 47% at 13 months across three independent surveys. In substance‐using populations specifically, Kim and Hodgins () observed high 1‐week follow up rates (> 87%) when evaluating alcohol‐using, cannabis‐using, and gambling participants.…”

mentioning

confidence: 99%

Feasibility, acceptability, and validity of crowdsourcing for collecting longitudinal alcohol use data

Strickland

Stoops

2018

J Exper Analysis Behavior

View full text Add to dashboard Cite

Challenges to conducting longitudinal research include financial, time, and geographic constraints. An emerging sampling method positioned to address these concerns is crowdsourcing. This study evaluated the feasibility, acceptability, and validity of collecting intensive longitudinal alcohol use data with the crowdsourcing platform, Amazon.com's Mechanical Turk (mTurk). Participants (N = 278) recruited from mTurk provided weekly recordings of daily alcohol and soda use over an 18-week period. Construct and external validity was evaluated using generalized linear mixed models describing associations of between-subject (e.g., alcohol use severity) and within-subject (e.g., day of week) variables with prospectively collected alcohol and soda use. High response rates were observed across the 18-week period demonstrating feasibility (64.1%-86.8%). The design was acceptable with 94% of participants indicating they were satisfied with the procedures. Multilevel models supported construct and external validity by replicating expected associations, such as more frequent and heavier drinking by individuals with higher AUDIT scores and on weekends. These effects were specific to alcohol use and did not extend to soda consumption. These data support the feasibility, acceptability, and validity of using mTurk for intensive longitudinal data collection. Future studies may leverage this platform to generate large, geographically diverse samples for prospective behavioral analytic research.

show abstract

Swapping bricks for clicks: Crowdsourcing longitudinal data on Amazon Turk

Cited by 112 publications

References 32 publications

The Mediating Effects of Spiritual Bypass on Depression, Anxiety, and Stress

The Mediating Effects of Spiritual Bypass on Depression, Anxiety, and Stress

Amazon’s Mechanical Turk as a Viable Source for Organizational and Occupational Health Research

Feasibility, acceptability, and validity of crowdsourcing for collecting longitudinal alcohol use data

Contact Info

Product

Resources

About