ObjectiveIt has been estimated that much of health research may be wasted, resulting in billions of dollars in wasteful research spending worldwide each year. Given the increased use of randomized trials and their influence on medicine, one method to combat research waste is to conduct randomized clinical trials (RCTs) only when a systematic review (SR) suggests more data are needed or when no previous SRs are identified. Here, we analyzed RCTs to determine whether SRs were cited as justification for conducting a trial.MethodsWe analyzed phase III RCTs published between 2016 and 2018 in New England Journal of Medicine, Lancet, and JAMA. We performed duplicate and independent data extraction to ensure the accuracy and validity of our data. For each trial, we extracted whether SRs were cited as justification for conducting the clinical trial.ResultsWe examined 637 RCTs that cited 728 SRs. Overall, 38.1% (243/637) of RCTs cited an SR as either verbatim (6.9%, 44/637) or inferred (31.2%, 199/637) for trial justification. The 79 remaining RCTs cited SRs in other ways. Approximately, 49.5% (315/637) of RCTs did not cite a SR.ConclusionsLess than half of the analyzed clinical trials cited a SRs as the basis for undertaking the trial. We believe trialists should be required to present relevant SRs to an ethics or peer review committee demonstrating an unmet need prior to initiating a trial. Eliminating research waste is both a scientific and ethical responsibility.
Objectives/Hypothesis
Clinical research serves as the foundation for evidence‐based patient care, and reproducibility of results is consequently critical. We sought to assess the transparency and reproducibility of research studies in otolaryngology by evaluating a random sample of publications in otolaryngology journals between 2014 and 2018.
Study Design
Review of published literature for reproducible and transparent research practices.
Methods
We used the National Library of Medicine catalog to identify otolaryngology journals that met the inclusion criteria (available in the English language and indexed in MEDLINE). From these journals, we extracted a random sample of 300 publications using a PubMed search for records published between January 1, 2014 and December 31, 2018. Specific indicators of reproducible and transparent research practices were evaluated in a blinded, independent, and duplicate manner using a pilot‐tested Google form.
Results
Our initial search returned 26,498 records, from which 300 were randomly selected for analysis. Of these 300 records, 286 met inclusion criteria and 14 did not. Among the empirical studies, 2% (95% confidence interval [CI]: 0.4%‐3.5%) of publications indicated that raw data were available, 0.6% (95% CI: 0.3%‐1.6%) reported an analysis script, 5.3% (95% CI: 2.7%‐7.8%) were linked to an accessible research protocol, and 3.9% (95% CI: 1.7%‐6.1%) were preregistered. None of the publications had a clear statement claiming to replicate, or to be a replication of, another study.
Conclusions
Inadequate reproducibility practices exist in otolaryngology. Nearly all studies in our analysis lacked a data or material availability statement, did not link to an accessible protocol, and were not preregistered. Taking steps to improve reproducibility would likely improve patient care.
Level of Evidence
NA Laryngoscope, 130: 1894–1901, 2020
Background Given the increased amount of research being funded in the eld of urology, reducing the amount of research waste is vital. Systematic reviews are an essential tool in aiding in reducing waste in research; they are a comprehensive summary of the current data on a clinical question. The aim of this study is to evaluate the use of systematic reviews as justi cation in conducting randomized clinical trials (RCT) in high impact urology journals. Methods On December 13, 2019, one of us (BJ) conducted a PubMed search for randomized controlled trials published in the top four urology journals according to their Google Scholar h5-index. Using a masked data extraction process each RCT was searched for systematic reviews. Then each review was evaluated for if it was justi cation for conducting the trial based on the context the systematic review was used. Results Of the 566 articles retrieved 281 were included. Overall 60.5% (170/281) trials cited a systematic review. We found only 47.6% (134/281) studies cited a systematic review as "verbatim" justi cation for
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.