Data Sharing: a Primer from UKRN

Towse, John N.; Rumsey, Sally; Owen, Nicholas; Langford, Patrick; Jaquiery, Matt; Bolibaugh, Cylcia

doi:10.31219/osf.io/wp4zu

Cited by 6 publications

(9 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This positive cultural change should now be followed by a coordinated, across-the-board effort by publishers to support open access policies and publishing platforms. Funders, institutions (through subscriptions), and individuals (through targeted outlets) can all incentivise publishers to broaden and improve open access policies as well as other avenues that elevate OaTR practice such as pre-registration; Registered Reports [27,28]; and mandates for sharing data [29], materials, and code [30].…”

Section: Coordinating a Positive Culture Of Open And Transparent Rese...mentioning

confidence: 99%

Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads

et al. 2022

View full text Add to dashboard Cite

Many disciplines are facing a “reproducibility crisis”, which has precipitated much discussion about how to improve research integrity, reproducibility, and transparency. A unified effort across all sectors, levels, and stages of the research ecosystem is needed to coordinate goals and reforms that focus on open and transparent research practices. Promoting a more positive incentive culture for all ecosystem members is also paramount. In this commentary, we—the Local Network Leads of the UK Reproducibility Network—outline our response to the UK House of Commons Science and Technology Committee’s inquiry on research integrity and reproducibility. We argue that coordinated change is needed to create (1) a positive research culture, (2) a unified stance on improving research quality, (3) common foundations for open and transparent research practice, and (4) the routinisation of this practice. For each of these areas, we outline the roles that individuals, institutions, funders, publishers, and Government can play in shaping the research ecosystem. Working together, these constituent members must also partner with sectoral and coordinating organisations to produce effective and long-lasting reforms that are fit-for-purpose and future-proof. These efforts will strengthen research quality and create research capable of generating far-reaching applications with a sustained impact on society.

show abstract

Section: Coordinating a Positive Culture Of Open And Transparent Rese...mentioning

confidence: 99%

Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Nonetheless, they are not particularly illuminating to the researcher looking to share their data and analysis code now. An overview of issues involved in making research data available for dissemination can be found in the data sharing primer from UKRN (Towse et al, 2020). Further tangible guidance is available in recently published tutorials such as Klein, Hardwicke, Aust, Breuer, Danielsson, Hofelich Mohr, Ijzerman, Nilsonne, Vanpaemel and Frank (2018), as well as the inaugural issue of Advances in Methods and Practices in Psychological Science (Challenges in Making Data Available, 2018).…”

Section: Good Practice In Reproducibilitymentioning

confidence: 99%

Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research

2021

Self Cite

View full text Add to dashboard Cite

The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review, we survey current practices and advocate a credibility revolution in bilingualism research through the adoption of minimum standards of transparency. Full disclosure of data and code is necessary not only to assess the reproducibility of original findings, but also to test the robustness of these findings to different analytic specifications. Similarly, full provision of experimental materials and protocols underpins assessment of both the replicability of original findings, as well as their generalisability to different contexts and samples. We illustrate the review with examples where good practice has advanced the agenda in bilingualism research and highlight resources to help researchers get started.

show abstract

“…Low reproducibility was primarily due to unavailable, incomplete, or ambiguous data, as well as unclear analytic pipelines, an issue compounded by a lack of scripting in a statistical language such as R. However, estimated reproducibility was around 70% for 2018. It appears that open research practices are increasingly being adopted -a shift attributable to changes in academic norms, journal requirements, and technological capabilities.There are several advantages to open data, code, and materials (Towse et al 2020). Innovation is promoted through the re-use of data and code.…”

mentioning

confidence: 99%

“…There are several advantages to open data, code, and materials (Towse et al 2020). Innovation is promoted through the re-use of data and code.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Commentary on the beyond WEIRD special issue: The importance of open research practices to empirical research in the evolutionary social sciences

Kenny

2021

Evolution and Human Behavior

View full text Add to dashboard Cite

The importance of open research practices to the evolutionary social sciences has been underscored of late (e.g. Beheim 2016; Kavanagh and Kapitány 2021). The "Beyond WEIRD" special issue has exemplary demonstrations of several practices, including, but not limited to, data archiving, code sharing, and open materials. Here, I focus on these three open research practices. I reiterate their benefits for comparative cross-cultural research in the evolutionary social sciences. I also highlight some of the challenges researchers might face in their implementation, and provide pointers to possible solutions. Finally, I list elements of open research that merit greater discussion in this area of research. For brevity, the focus here is on experimental work, although open research practices apply to other empirically based cross-cultural research more broadly.First, how common is the implementation of open research practices in the evolutionary social sciences? An indication is provided by a recent survey of the social learning literature, including cultural evolution and evolutionary psychology, conducted by Minocher et al. (2020). The authors were able to reproduce one in four results from 1955 to 2018, i.e. to re-derive the results using the same data and methods as in the original research. Low reproducibility was primarily due to unavailable, incomplete, or ambiguous data, as well as unclear analytic pipelines, an issue compounded by a lack of scripting in a statistical language such as R. However, estimated reproducibility was around 70% for 2018. It appears that open research practices are increasingly being adopted -a shift attributable to changes in academic norms, journal requirements, and technological capabilities.There are several advantages to open data, code, and materials (Towse et al. 2020). Innovation is promoted through the re-use of data and code. Open practices provide opportunities for collaboration; minimally, they allow researchers not part of large research programmes to integrate work. Generally, openness ensures the transparency and credibility of the scientific record. As such, these practices should be adopted, unless opting out can be justified.Open data can facilitate cross-cultural comparisons and meta-analyses, and can help situate a primary study within the broader literature. With researchers encouraged to expand samples beyond students from "WEIRD" contexts, MTurkers, and individuals from "small-scale societies", public data will allow comparison across populations (Apicella and Barrett 2016;Milfont and Klein 2018). Townsend et al. (2020) is an illustration of the type of cross-cultural research that could draw upon open data. The authors demonstrated that sharing in a dictator game

show abstract

Data Sharing: a Primer from UKRN

Abstract: Make research data available to ensure transparency and a reliable scientific record.

Cited by 6 publications

References 0 publications

Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads

Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads

Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research

Commentary on the beyond WEIRD special issue: The importance of open research practices to empirical research in the evolutionary social sciences

Contact Info

Product

Resources

About