Increasing the Credibility of Political Science Research: A Proposal for Journal Reforms

The Research Reproducibility Crisis and Economics of Science

“…In several other disciplines there is an active discussion whether similar policies should be imposed (Maniadis et al ., , ; Nyhan, ; Cook, ; Byington and Felps, ) but the relative deficit in quantitative research synthesis makes this assessment difficult (but, in social sciences, note the seminal work of Franco et al ., ). In economics, there is empirical work (particularly recent) on the reproducibility of economic findings, pointing in different directions, and with some subfields faring better than others.…”

Power analysis for parameter estimation in structural equation modeling: A discussion and tutorial

“…Consequently, such power discussions remain scarce in the empirical SEM literature, and sample size planning based on rules of thumb is still common. This consequence is unfortunate in the current era of moving toward more robust research (Begley & Ellis, 2012;Ledgerwood, 2016;McNutt, 2014;Nosek, Spies, & Motyl, 2012;Nyhan, 2015;Vazire, 2017): As the field of psychology and many other sciences seek to improve statistical power and recognize the problems with underpowered studies, understanding what power is and seeking ways to increase it are important steps toward more accurate, reliable findings (Button et al, 2013;Cohen, 1962).…”

Pre-acceptance as a method to combat publication bias in area studies: a pilot in the Caucasus

“…Caucasus Survey's competition builds on a growing number of journals in the social sciences that have used pre-acceptance, though to my knowledge this is the first such competition in an areas studies journal. The pre-acceptance model, which in psychology was known as registered reports, was first suggested in the social sciences in a report written for the American Political Science Association (APSA) (Nyhan 2014). A special issue of Comparative Political Studies first attempted the model within political science, highlighting different types of studies: lab (Bush et al 2016), survey (Huff and Kruszewska 2016), and quasi-experimental observational (Hidalgo, Canello, and Lima-de-Oliveira 2016).…”