The Spread of Statistical Significance Testing in Psychology

Hubbard, Raymond; Parsa, Rahul; Luthy, Michael R.

doi:10.1177/0959354397074006

Cited by 37 publications

(30 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of null hypothesis significance tests is widespread in OP research (Bonett & Wright, 2007;Hubbard, Parsa, & Luthy, 1997). This practice follows naturally from our tendency to pose hypotheses that predict a nonnull effect of unstated magnitude, which are then tested by determining whether a test statistic differs from zero at some conventional probability level, such as p < .05.…”

Section: Adopt Alternatives To Null Hypothesis Significance Testsmentioning

confidence: 99%

To prosper, organizational psychology should … overcome methodological barriers to progress

2008

View full text Add to dashboard Cite

SummaryProgress in organizational psychology (OP) research depends on the rigor and quality of the methods we use. This paper identifies ten methodological barriers to progress and offers suggestions for overcoming the barriers, in part or whole. The barriers address how we derive hypotheses from theories, the nature and scope of the questions we pursue in our studies, the ways we address causality, the manner in which we draw samples and measure constructs, and how we conduct statistical tests and draw inferences from our research. The paper concludes with recommendations for integrating research methods into our ongoing development goals as scholars and framing methods as tools that help us achieve shared objectives in our field.

show abstract

Section: Adopt Alternatives To Null Hypothesis Significance Testsmentioning

confidence: 99%

To prosper, organizational psychology should … overcome methodological barriers to progress

2008

View full text Add to dashboard Cite

show abstract

“…As concluded by Lehmann (1992) [32] in a comprehensive review, despite its shortcomings, the new paradigm of statistical hypothesis, and the many developments carried out within its framework continue to play a central role in both the theory and practice of statistics. However, significance testing has particularly been the favored statistical tool in some experimental social sciences [33], while other fields have favored the estimation of parameters (e.g., effect size). It is used as a substitute for the traditional comparison of the predicted value and experimental result at the core of the scientific method.…”

Section: On the Old And New Way Of Doing Sciencementioning

confidence: 99%

The Sciences Underlying Smart Sustainable Urbanism: Unprecedented Paradigmatic and Scholarly Shifts in Light of Big Data Science and Analytics

Bibri

2019

Smart Cities

View full text Add to dashboard Cite

As a new area of science and technology (S&T), big data science and analytics embodies an unprecedentedly transformative power—which is manifested not only in the form of revolutionizing science and transforming knowledge, but also in advancing social practices, catalyzing major shifts, and fostering societal transitions. Of particular relevance, it is instigating a massive change in the way both smart cities and sustainable cities are understood, studied, planned, operated, and managed to improve and maintain sustainability in the face of expanding urbanization. This relates to what has been dubbed data-driven smart sustainable urbanism, an emerging approach that is based on a computational understanding of city systems that reduces urban life to logical and algorithmic rules and procedures, as well as employs a new scientific method based on data-intensive science, while also harnessing urban big data to provide a more holistic and integrated view and synoptic intelligence of the city. This paper examines the unprecedented paradigmatic and scholarly shifts that the sciences underlying smart sustainable urbanism are undergoing in light of big data science and analytics and the underlying enabling technologies, as well as discusses how these shifts intertwine with and affect one another in the context of sustainability. I argue that data-intensive science, as a new epistemological shift, is fundamentally changing the scientific and practical foundations of urban sustainability. In specific terms, the new urban science—as underpinned by sustainability science and urban sustainability—is increasingly making cities more sustainable, resilient, efficient, and livable by rendering them more measurable, knowable, and tractable in terms of their operational functioning, management, planning, design, and development.

show abstract

“…Hubbard, Parsa, and Luthy (1997) tracked the uptake of NHST in the JAP from 1917 to 1994. In the following two sections, we discuss briefly some studies of journal reporting practices of most relevance to our own analysis.…”

Section: Official Jap Standards For Reportingmentioning

confidence: 99%

Colloquium on Effect Sizes: the Roles of Editors, Textbook Authors, and the Publication Manual

Finch¹,

Cumming

Thomason

2001

Educational and Psychological Measurement

View full text Add to dashboard Cite

Reformers have long argued that misuse of Null Hypothesis Significance Testing (NHST) is widespread and damaging. The authors analyzed 150 articles from the Journal of Applied Psychology (JAP) covering 1940 to 1999. They examined statistical reporting practices related to misconceptions about NHST, American Psychological Association (APA) guidelines, and reform recommendations. The analysis reveals (a) inconsistency in reporting alpha and p values, (b) the use of ambiguous language in describing NHST, (c) frequent acceptance of null hypotheses without consideration of power, (d) that power estimates are rarely reported, and (e) that confidence intervals were virtually never used. APA guidelines have been followed only selectively. Research methodology reported in JAP has increased greatly in sophistication over 60 years, but inference practices have shown remarkable stability. There is little sign that decades of cogent critiques by reformers had by 1999 led to changes in statistical reporting practices in JAP.

show abstract

The Spread of Statistical Significance Testing in Psychology

Cited by 37 publications

References 26 publications

To prosper, organizational psychology should … overcome methodological barriers to progress

To prosper, organizational psychology should … overcome methodological barriers to progress

The Sciences Underlying Smart Sustainable Urbanism: Unprecedented Paradigmatic and Scholarly Shifts in Light of Big Data Science and Analytics

Colloquium on Effect Sizes: the Roles of Editors, Textbook Authors, and the Publication Manual

Contact Info

Product

Resources

About