An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk

Kees, Jeremy; Berry, Christopher; Burton, Scot; Sheehan, Kim Bartel

doi:10.1080/00913367.2016.1269304

Cited by 776 publications

(460 citation statements)

References 39 publications

Supporting

Mentioning

448

Contrasting

Order By: Relevance

“…Authors of this work demonstrated heterogeneity of workers in demographic propensities over time . Two studies report that the quality of the data collected from MTurk is comparable to that from other convenience samples such as undergraduate students or professional panels …”

Section: Methodsmentioning

confidence: 90%

Concordance of Rural‐Urban Self‐identity and ZIP Code‐Derived Rural‐Urban Commuting Area (RUCA) Designation

Onega

Weiss

Alford‐Teaster

et al. 2019

The Journal of Rural Health

View full text Add to dashboard Cite

Purpose This study examined the concordance between individuals’ self‐reported rural‐urban category of their community and ZIP Code‐derived Rural‐Urban Commuting Area (RUCA) category. Methods An Internet‐based survey, administered from August 2017 through November 2017, was used to collect participants’ sociodemographic characteristics, self‐reported ZIP Code of residence, and perception of which RUCA category best describes the community in which they live. We calculated weighted kappa (ĸ) coefficients (95% confidence interval [CI]) to test for concordance between participants’ ZIP Code‐derived RUCA category and their selection of RUCA descriptor. Descriptive frequency distributions of participants' demographics are presented. Findings A total of 622 survey participants, residents of New Hampshire (63%) and Vermont (37%), responded to the survey's self‐reported rural‐urban category. The overall ĸ was 0.33 (95% CI: 0.27‐0.38). The highest concordance was found among those living in a small rural area (N = 81, 13%): 62% of this group identified their communities as small rural. Sixty‐five percent (300/459) of participants residing in urban or large rural areas reported their community as more rural (small rural or isolated). Sixty‐eight percent (111/163) of participants living in small rural or isolated areas identified their community as more urban (large rural or urban). Conclusions Discordance was found between self‐report of rural‐urban category and ZIP Code‐derived RUCA designation. Caution is warranted when attributing rural‐urban designation to individuals based on geographic unit, since perceived rurality/urbanicity of their community that relates to health behaviors may not be reflected.

show abstract

Section: Methodsmentioning

confidence: 90%

Concordance of Rural‐Urban Self‐identity and ZIP Code‐Derived Rural‐Urban Commuting Area (RUCA) Designation

Onega

Weiss

Alford‐Teaster

et al. 2019

The Journal of Rural Health

View full text Add to dashboard Cite

show abstract

“…To improve data quality (cf. Kees, Berry, Burton, & Sheehan, ), an attention check was incorporated into the survey (“To show me your attention, please select ‘6’”).…”

Section: Methodsologymentioning

confidence: 99%

The “little emperor” and the luxury brand: How overt and covert narcissism affect brand loyalty and proneness to buy counterfeits

Fastoso

Bartikowski

Wang

2018

Psychology and Marketing

View full text Add to dashboard Cite

The authors build on approach‐avoidance motivations theory to investigate the relationship between narcissism and luxury brand consumption. Narcissistic consumers, that is, those showing excessive conceit, are prone to consuming high‐prestige products and are thus attractive targets for luxury brands. Yet despite research in psychology distinguishing two types of narcissism, overt (or grandiose) and covert (or vulnerable) narcissism, little is known about how luxury consumption varies by these forms of narcissism. This paper focuses on Chinese Generation Y consumers to examine how overt and covert narcissism differ in their effects on luxury brand loyalty and proneness to purchase counterfeits as well as the moderating role of brand‐image self‐image congruity on the relationship between overt/covert narcissism and brand loyalty. Findings highlight the need for marketers to understand narcissistic targets more clearly in order to develop successful strategies to foster brand loyalty and diminish counterfeit consumption.

show abstract

“…Participants were 260 community members recruited on Mechanical Turk, an online work distribution website (Paolacci & Chandler, ). Although some researchers question the validity of samples derived from MTurk in the Fourth Amendment context (Kugler & Strahilevitz, , ), research indicates that participants recruited on MTurk do not differ significantly in their responses to surveys from other community samples in other contexts (Kees, Berry, Burton, & Sheehan, ; Sheehan, ; Walter, Siebert, Goering, & O'Boyle, ). Data was collected in December 2017, six months prior to the Supreme Court handing down a decision in the Carpenter case in June 2018.…”

Section: Methodsmentioning

confidence: 99%

“…, research indicates that participants recruited on MTurk do not differ significantly in their responses to surveys from other community samples in other contexts(Kees, Berry, Burton, & Sheehan, 2017;Sheehan, 2018; Walter, Siebert, Goering, & O'Boyle, 2019). Data was collected in December 2017, six months prior to the Supreme Court handing down a decision in the Carpenter case in June 2018.…”

mentioning

confidence: 99%

Police surveillance of cell phone location data: Supreme Court versus public opinion

Marshall

Groscup

Brank

et al. 2019

Behavioral Sci & The Law

View full text Add to dashboard Cite

The Fourth Amendment to the US Constitution protects individuals from unreasonable searches and seizures. As technology evolves, courts must examine Fourth Amendment concerns implicated by the introduction of new and enhanced police surveillance techniques. Recent Supreme Court cases have demonstrated a trend towards reconsidering the mechanical application of traditional Fourth Amendment doctrine to define the scope of constitutional protections for modern technological devices and personal data. The current research examined whether public opinion regarding privacy rights in electronic communications is in accordance with these Supreme Court rulings. Results suggest that cell phone location data is perceived as more private and deserving of protections than other types of location data, but the privacy of other types of information recorded on cell phones is valued even more than location data. These results have implications for the police and courts considering how the Fourth Amendment will apply to smart phone technologies.

show abstract

An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk

Cited by 776 publications

References 39 publications

Concordance of Rural‐Urban Self‐identity and ZIP Code‐Derived Rural‐Urban Commuting Area (RUCA) Designation

Concordance of Rural‐Urban Self‐identity and ZIP Code‐Derived Rural‐Urban Commuting Area (RUCA) Designation

The “little emperor” and the luxury brand: How overt and covert narcissism affect brand loyalty and proneness to buy counterfeits

Police surveillance of cell phone location data: Supreme Court versus public opinion

Contact Info

Product

Resources

About