Context Considering the substantial increase in research funding in the field of urology, minimizing research waste should be a top priority. Systematic reviews (SRs) compile available evidence regarding a clinical question into a single critical resource. If properly utilized, SRs can help minimize redundant studies, focus attention to unsubstantiated treatments, and reduce research waste. Objectives To appraise the use of SRs as justification for conducting randomized controlled trials (RCTs) published in high impact urology journals, and to report the ways SRs were incorporated into RCT manuscripts published in the top four urology journals by h5 index. Methods On December 13, 2019, a PubMed search was conducted for RCTs published in the top four urology journals according to the Google Scholar h5-index: European Urology, BJU International, The Journal of Urology, and Urology. For an article to be eligible for inclusion in this study, it must have been a full length RCT, published between November 30, 2014, and November 30, 2019 in one of the identified journals, reported only human subjects, and been accessible in English. The following data points were extracted independently by select investigators from each included RCT: manuscript title, year of publication, journal title, type of intervention (drug, medical device, procedure, other), funding source (government, hospital/university, industry, mixed) type of trial (parallel groups, crossover, cluster), and total number of participants reported in each RCT. The included RCTs were searched for reference to an SR, which was then recorded as “yes – verbatim,” “yes – inferred,” or “not used as justification” and the location in the manuscript where the SR was cited was recorded. Results Of the 566 articles retrieved, 276 were included. Overall, 150 (54.3%) RCTs cited an SR as either verbatim (108; 39.1%) or inferred (42; 15.2%) trial justification, while 126 (45.7%) did not use an SR for RCT justification. Of those 126, 107 (84.9%) RCTs did not cite an SR to any extent. A significant association was noted between verbatim justification and type of intervention (x 2=20.23, p=0.017), with 18 of 31 (58.1%) “other” interventions (i.e. psychosocial intervention, exercise programs, and online therapy) having an SR cited as verbatim justification. Only 39 of 118 (33.1%) pharmaceutical trials referenced an SR as verbatim justification. Of 403 systematic review citations, 205 (50.8%) appeared in the Discussion section, while 15 (3.7%) were in the Methods section. Conclusions We found that RCTs published in four high impact urology journals inconsistently referenced an SR as justification and 39.1% of our entire sample did not reference an SR at all. These findings indicate that a divide exists between the instruction and implementation of evidence based medicine in the field of urology concerning RCTs published in the top four journals. Educating clinicians and researchers on the use of SR as justification for RCTs in urology may reduce research waste and increase the quality of RCTs in the field.
Background Given the increased amount of research being funded in the eld of urology, reducing the amount of research waste is vital. Systematic reviews are an essential tool in aiding in reducing waste in research; they are a comprehensive summary of the current data on a clinical question. The aim of this study is to evaluate the use of systematic reviews as justi cation in conducting randomized clinical trials (RCT) in high impact urology journals. Methods On December 13, 2019, one of us (BJ) conducted a PubMed search for randomized controlled trials published in the top four urology journals according to their Google Scholar h5-index. Using a masked data extraction process each RCT was searched for systematic reviews. Then each review was evaluated for if it was justi cation for conducting the trial based on the context the systematic review was used. Results Of the 566 articles retrieved 281 were included. Overall 60.5% (170/281) trials cited a systematic review. We found only 47.6% (134/281) studies cited a systematic review as "verbatim" justi cation for
Take Home MessageMany components of transparency and reproducibility are lacking in urology publications, making study replication, at best, difficult.IntroductionReproducibility is essential for the integrity of scientific research. Reproducibility is measured by the ability of investigators to replicate the outcomes of an original publication by using the same materials and procedures.MethodsWe sampled 300 publications in the field of urology for assessment of multiple indicators of reproducibility, including material availability, raw data availability, analysis script availability, pre-registration information, links to protocols, and whether the publication was freely available to the public. Publications were also assessed for statements about conflicts of interest and funding sources.ResultsOf the 300 sample publications, 171 contained empirical data and could be analyzed for reproducibility. Of the analyzed articles, 0.58% (1/171) provided links to protocols, and none of the studies provided analysis scripts. Additionally, 95.91% (164/171) did not provide accessible raw data, 97.53% (158/162) did not provide accessible materials, and 95.32% (163/171) did not state they were pre-registered.ConclusionCurrent urology research does not consistently provide the components needed to reproduce original studies. Collaborative efforts from investigators and journal editors are needed to improve research quality, while minimizing waste and patient risk.
Objective: Scholastic activity through research involvement is a fundamental aspect of a physician’s training and may have a significant influence on future academic success. Here, we explore publication rates before, during, and after otolaryngology residency training and whether publication efforts correlate with future academic achievement. Methods: This cross-sectional analysis included a random sample of 50 otolaryngology residency programs. From these programs, we assembled a list of residents graduating from the years in 2013, 2014, and 2015. Using SCOPUS, PubMed, and Google Scholar, we compiled the publications for each graduate, and data were extracted in an independent, double-blinded fashion. Results: We included 32 otolaryngology residency programs representing 249 residents in this analysis. Graduates published a mean of 1.3 (SD = 2.7) articles before residency, 3.5 (SD = 4.3) during residency, and 5.3 (SD = 9.3) after residency. Residents who pursued a fellowship had more total publications ( t247 = −6.1, P < .001) and more first author publications ( t247 = −5.4, P < .001) than residents without fellowship training. Graduates who chose a career in academic medicine had a higher number of mean total publications ( t247 = −8.2, P < .001) and first author publications ( t247 = −7.9, P < .001) than those who were not in academic medicine. There was a high positive correlation between residency program size and publications during residency ( r = 0.76). Conclusion: Research productivity correlated with a number of characteristics such as future fellowship training, the pursuit of an academic career, and overall h-index in this study.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.