A preregistered replication was conducted to examine the evidence for the basic dilution effect in a performance prediction context. Participants (n = 796) were presented with either diagnostic information alone or diagnostic + nondiagnostic information in a grade point average (GPA) prediction task. The diagnostic information was either indicative of a low GPA or a high GPA. The basic dilution effect predicts less extreme predictions when nondiagnostic information (e.g., the student describes himself as a cheerful person) is included with the diagnostic information.Despite an unusually large sample, a strong manipulation, and the use of stimulus sampling, results showed no evidence for dilution in GPA predictions. Reasons for the failure to replicate under optimal conditions are discussed.
Abstract. We meta-analytically examined mean and variance differences between MTurk and non-MTurk samples for a variety of scales used in the organizational sciences. The influence of moderators (i.e., construct domain and valence, sample type, use of qualifications, and data cleaning procedures) was also examined. Across all scales (120 scales, N = 110,090), we found that, overall, MTurk and non-MTurk samples do not have significantly different scale means or variances. Our moderator analyses, however, indicated that MTurk samples may have larger variances than non-MTurk samples under certain conditions. Additionally, our results highlight the importance of data screening and cleaning procedures such that MTurk samples had larger variances than non-MTurk samples when MTurk samples were subjected to more stringent data screening and cleaning procedures.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.