Impression formation is a basic module of fundamental research in social cognition, with broad implications for applied research on interpersonal relations, social attitudes, employee selection, and person judgments in legal and political context. Drawing on a pool of 28 predominantly positive traits used in Solomon Asch's (1946) seminal impression studies, two research teams have investigated the impact of the number of person traits sampled randomly from the pool on the evaluative impression of the target person. Whereas Norton, Frost, and Ariely (2007) found a "less-is-more" effect, reflecting less positive impressions with increasing sample size , Ullrich, Krueger, Brod, and Groschupf (2013) concluded that an-independent averaging rule can account for the data patterns obtained in both labs. We address this issue by disentangling different influences of on resulting impressions, namely varying baserates of positive and negative traits, different sampling procedures, and trait diagnosticity. Depending on specific task conditions, which can be derived on theoretical grounds, the strength of resulting impressions (in the direction of the more prevalent valence) (a) increases with increasing for diagnostic traits, (b) is independent of for nondiagnostic traits, or (c) decreases with when self-truncated sampling produces a distinct primacy effect. This refined pattern, which holds for the great majority of individual participants, illustrates the importance of strong theorizing in cumulative science (Fiedler, 2017) built on established empirical laws and logically sound theorizing. (PsycINFO Database Record
The current debate about how to improve the quality of psychological science revolves, almost exclusively, around the subordinate level of statistical significance testing. In contrast, research design and strict theorizing, which are superordinate to statistics in the methods hierarchy, are sorely neglected. The present article is devoted to the key role assigned to manipulation checks (MCs) for scientific quality control. MCs not only afford a critical test of the premises of hypothesis testing but also (a) prompt clever research design and validity control, (b) carry over to refined theorizing, and (c) have important implications for other facets of methodology, such as replication science. On the basis of an analysis of the reality of MCs reported in current issues of the Journal of Personality and Social Psychology, we propose a future methodology for the post– p < .05 era that replaces scrutiny in significance testing with refined validity control and diagnostic research designs.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.