Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review

Abstract

Objective To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Design Systematic review.Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name.Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals).Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score.Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. ConclusionsThe completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence.Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews.

A manifesto for reproducible science

“…In medicine there is strong evidence for the effectiveness of CONSORT guidelines -journals that do not endorse the CONSORT statement show poorer reporting quality compared with endorsing journals 79 . For the ARRIVE (Animal Research: Reporting of In Vivo Experiments) guidelines 80 , studies comparing the reporting of ARRIVE items in specific fields of research before and after the guidelines were published report mixed results [81][82][83] .…”

Evidence-based clinical practice: Overview of threats to the validity of evidence and how to minimise them

“…Comparisons of protocols with publications showed that most trials had at least one primary outcome changed, introduced, or omitted; and investigators of new trials rarely set their findings in the context of a systematic review 20 . Reporting guidelines such as CONSORT and PRISMA aim to improve the quality of research reports, but these guidelines should be followed much more thoroughly 67 . 55 , and the WHO has also called for public disclosure of all trials (http://www.who.int/ ictrp/results/WHO_Statement_results_reporting_ clinical_trials.pdf).…”

A history of the evolution of guidelines for reporting medical research: the long road to the EQUATOR Network

“…Research topics include reviews of time trends in the nature and quality of publications; the development of tools and strategies to improve the planning, design, conduct, management and reporting of biomedical research; investigating strategies to help journals to improve the quality of manuscripts; and so on (e.g. Hopewell et al, 79 Stevens et al, 80 Barnes et al, 81 Mahady et al 82 ).…”