The Trade Secret Taboo: Open Science Methods are Required to Improve Prediction Models in Sports Medicine and Performance

Objective: To investigate the extent and qualitatively synthesize open science practices within research published in the top five sports medicine journals from 01 May 2022 and 01 October 2022. Design: Meta-research systematic review Data Sources: MEDLINE Eligibility Criteria: Studies were included if they were published in one of the identified top five sports medicine journals as ranked by Clarivate. Studies were excluded if they were systematic reviews, qualitative research, grey literature, or animal or cadaver models. Results: 243 studies were included. The median number of open science practices met per study was 2, out of a maximum of 12 (Range: 0-8; IQR: 2). 234 studies (96%, 95% CI: 94-99) provided an author conflict of interest statement and 163 (67%, 95% CI: 62-73) reported funding. 21 studies (9%, 95% CI: 5-12) provided open access data. 54 studies (22%, 95% CI: 17-27) included a data availability statement and 3 (1%, 95% CI: 0-3) made code available. 76 studies (32%, 95% CI: 25-37) had transparent materials and 30 (12%, 95% CI: 8-16) included a reporting guideline. 28 studies (12%, 95% CI: 8-16) were pre-registered. 6 studies (3%, 95% CI: 1-4) published a protocol. 4 studies (2%, 95% CI: 0-3) reported the availability of an analysis plan. 7 studies (3%, 95% CI: 1-5) reported patient and public involvement. Conclusion: Sports medicine open science practices are extremely limited. The least followed practices were sharing code, data, and analysis plans. Without implementing open practices, barriers concerning the ability to aggregate findings and create cumulative science will continue to exist.

show abstract

Training-Load Management Ambiguities and Weak Logic: Creating Potential Consequences in Sport Training and Performance

West,

Shrier,

Impellizzeri

et al. 2024

International Journal of Sports Physiology and Performance

View full text Add to dashboard Cite

Background: The optimization of athlete training load is not a new concept; however in recent years, the concept of “load management” is one of the most widely studied and divisive topics in sports science and medicine. Purpose: Discuss the challenges faced by sports when utilizing training load monitoring and management, with a specific focus on the use of data to inform load management guidelines and policies/mandates, their consequences, and how we move this field forward. Challenges: While guidelines can theoretically help protect athletes, overzealous and overcautious guidelines may restrict an athlete’s preparedness, negatively influence performance, and increase injury risk. Poor methods, wrong interpretation of study findings, and faulty logic do not allow for systematic scientific evaluations to inform guidelines. Practical Solutions: Guidelines and mandates should be developed through a systematic research process with stronger research designs and clear research questions. Collaborating with statistical and epidemiological experts is essential. Implementing open science principles and sharing all sports training load data increase transparency and allow for more rapid and valid advancements in knowledge. Practitioners should incorporate multiple data streams and consider individual athlete responses, rather than applying broad guidelines based on average data. Conclusion: Many current training load guidelines and mandates in sports come from good intentions; however, they are arbitrary without sound knowledge of the underlying scientific principles or methods. Common sense guidelines are helpful when there is sparse literature, but they should be careful to avoid arbitrarily choosing findings from weak research. Without precise scientific inquiries, implementing training load interventions or guidelines can have negative implications.

show abstract

The Trade Secret Taboo: Open Science Methods are Required to Improve Prediction Models in Sports Medicine and Performance

Cited by 6 publications

References 55 publications

Epidemiology of injuries in elite female rink hockey players: A two season observational study

Epidemiology of injuries in elite female rink hockey players: A two season observational study

Up front and open, shrouded in secrecy, or somewhere in between? A Meta Research Systematic Review of Open Science Practices in Sport Medicine Research

Training-Load Management Ambiguities and Weak Logic: Creating Potential Consequences in Sport Training and Performance

Contact Info

Product

Resources

About