2023
DOI: 10.1027/1866-5888/a000309
|View full text |Cite
|
Sign up to set email alerts
|

Scale Mean and Variance Differences in MTurk and Non-MTurk Samples

Abstract: Abstract. We meta-analytically examined mean and variance differences between MTurk and non-MTurk samples for a variety of scales used in the organizational sciences. The influence of moderators (i.e., construct domain and valence, sample type, use of qualifications, and data cleaning procedures) was also examined. Across all scales (120 scales, N = 110,090), we found that, overall, MTurk and non-MTurk samples do not have significantly different scale means or variances. Our moderator analyses, however, indica… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
9
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
7
1

Relationship

1
7

Authors

Journals

citations
Cited by 15 publications
(9 citation statements)
references
References 65 publications
0
9
0
Order By: Relevance
“…We collected data via Amazon MTurk, which had the advantage that participants did not come from a single or only a few organizations (Landers & Behrend, 2015). Moreover, MTurk samples are similar in data quality compared to other traditional samples such as student or community samples (Buhrmester et al, 2011;Cheung et al, 2017; PREDICTING DECISION-MAKERS' ALGORITHM USE 21 Keith et al, 2022). Additionally, to ensure data quality, we followed recommendations and carefully screened participants based on attention checks and impossible answers (Aguinis et al, 2021).…”
Section: Discussionmentioning
confidence: 99%
“…We collected data via Amazon MTurk, which had the advantage that participants did not come from a single or only a few organizations (Landers & Behrend, 2015). Moreover, MTurk samples are similar in data quality compared to other traditional samples such as student or community samples (Buhrmester et al, 2011;Cheung et al, 2017; PREDICTING DECISION-MAKERS' ALGORITHM USE 21 Keith et al, 2022). Additionally, to ensure data quality, we followed recommendations and carefully screened participants based on attention checks and impossible answers (Aguinis et al, 2021).…”
Section: Discussionmentioning
confidence: 99%
“…Numerous studies have demonstrated MTurk's ability to deliver heterogeneous, representative samples comparable to other samples (e.g. nationally representative and organisational; Keith et al, 2023; Merz et al, 2020). For example, Grawitch et al's (2013) organisational sample included mostly women; our sample, consistent with similar MTurk samples (Wayne et al, 2017, 2022), is more aligned with demographics of the current U.S. employed population (Bureau of Labor Statistics, 2023).…”
Section: Discussionmentioning
confidence: 99%
“…We 400 full-time employees from various work contexts using Amazon's Mechanical Turk platform (MTurk). Though meta-analytic studies show MTurk samples produce su ciently valid data (e.g., Keith et al, 2022), we utilized several of Aguinis et al's (2021) procedures for reducing validity concerns. We doublescreened all participants for study inclusion criteria, activated MTurk's premium screening tool, employed CAPTCHA veri cation, utilized two attention checks, and ran the Qualtrics fraud detection tool to analyze suspicious patterns of responses, including inattention.…”
Section: Participantsmentioning
confidence: 99%