Robust Standards in Cognitive Science

Crüwell, Sophia; Stefan, Angelika; Evans, Nathan J.

doi:10.31234/osf.io/4rs6q

Cited by 1 publication

(1 citation statement)

References 64 publications

(110 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Just like confirmatory research, nonconfirmatory research should be transparent and reproducible. Subfields of psychology and neighboring disciplines in which nonconfirmatory research activities are common practice have already begun to tackle these issues (see, e.g., Crüwell et al, 2019 ; Jacobs, 2020 ; Moravcsik, 2014 ). Drawing on existing expertise in these fields, exchanging resources, and starting broader discussions about underused methods may help us overcome our unhealthy fixation on hypothesis tests.…”

Section: Discussionmentioning

confidence: 99%

Why Hypothesis Testers Should Spend Less Time Testing Hypotheses

Scheel

Tiokhin

Isager

et al. 2020

Perspect Psychol Sci

272

228

View full text Add to dashboard Cite

For almost half a century, Paul Meehl educated psychologists about how the mindless use of null-hypothesis significance tests made research on theories in the social sciences basically uninterpretable. In response to the replication crisis, reforms in psychology have focused on formalizing procedures for testing hypotheses. These reforms were necessary and influential. However, as an unexpected consequence, psychological scientists have begun to realize that they may not be ready to test hypotheses. Forcing researchers to prematurely test hypotheses before they have established a sound “derivation chain” between test and theory is counterproductive. Instead, various nonconfirmatory research activities should be used to obtain the inputs necessary to make hypothesis tests informative. Before testing hypotheses, researchers should spend more time forming concepts, developing valid measures, establishing the causal relationships between concepts and the functional form of those relationships, and identifying boundary conditions and auxiliary assumptions. Providing these inputs should be recognized and incentivized as a crucial goal in itself. In this article, we discuss how shifting the focus to nonconfirmatory research can tie together many loose ends of psychology’s reform movement and help us to develop strong, testable theories, as Paul Meehl urged.

show abstract

Section: Discussionmentioning

confidence: 99%