Transparency and Replication in Brazilian Political Science: A First Look

Abstract

We provide the first replication study of political science research published in Brazil by attempting to replicate every quantitative article published in five major Brazilian journals between 2012 and 2016. We also tested whether replication rates varied between established fields, more traditional and where the use of quantitative data is more common, and emerging fields. Our results show that transparency and reproduction are still in a development stage in Brazilian Political Science. Of the 650 articles reviewed, we asked for data to 197 quantitative articles. From those, only 28% agreed to share datasets and computed codes. We were able to attempt a replication for only 14%, and successfully reproduce the results of less than 5%. We conclude by suggesting the adoption of transparency and replicability procedures that are standard in other scientific communities.

Open Data in Science Education Research: Perspectives, Challenges, and Possibilities

“…Finding authors and receiving answers was quite challenging, with success only in 37% of the cases, and the probability of finding functional e-mail addresses decreased by 7% per year (Vines et al, 2014). More recent findings in other contexts, such as political science, have also reported difficulties in accessing data and complementary materials from published studies and replicating these studies (Avelino et al, 2021).…”

Dados Abertos Na Pesquisa Em Educação Em Ciências: Perspectivas, Desafios E Possibilidades

“…Encontrar pessoas autoras e receber respostas foi desafiador, com sucesso em apenas 37% dos casos, e a probabilidade de encontrar endereços de e-mail funcionais diminuiu 7% ao ano (Vines et al, 2014). Levantamentos mais recentes em outros contextos, como na ciência política, também registraram dificuldades de acesso a dados e materiais complementares de estudos publicados bem como na replicação desses estudos (Avelino et al, 2021).…”

Datos Abiertos en La Investigación en Educación en Ciencias: Perspectivas, Desafíos Y Posibilidades

“…Encontrar personas autoras y recibir respuestas fue difícil, con éxito en solamente 37% de los casos, ya la probabilidad de encontrar direcciones de correo electrónico funcio-nales disminuyó 7% al año (Vines et al, 2014). Investigaciones más recientes en otros contextos, como el de las ciencias políticas, también han informado de dificultades para acceder a datos y materiales complementarios de estudios publicados, así como para replicar estos estudios (Avelino et al, 2021).…”