Guidance for Increasing Primary Study Inclusion and the Usability of Data in Meta-Analysis: A Reporting Tutorial

Abstract

Meta-analyses can be used to comprehensively summarize the state of a given literature base, understand development and relations between constructs, and synthesize intervention effects to identify “what works for whom,” all of which can directly inform research, practice, and policy. In this tutorial, we first argue that data reporting in primary studies can meaningfully affect the results of meta-analyses and, most importantly, the subsequent interpretations and use of the findings in research, practice, and policy in speech, language, and hearing sciences. Though reporting guidelines have been well established for the results of meta-analyses, there is limited focus on the essentials for primary study reporting that allow for inclusion in meta-analyses. To this end, we provide guidance for primary study authors to ensure their studies can maximize their contributions to research syntheses and, specifically, to meta-analyses. We discuss current and ongoing issues related to reporting, provide data-based examples of instances where lack of reporting or transparency has rendered a study ineligible from inclusion in a meta-analysis, encourage editorial teams and peer reviewers to be flexible in the inclusion of supplemental data reporting based on journal requirements and limits, and suggest being explicit and earnest about why these requests are important to advancing the field. Supplemental Material: https://doi.org/10.23641/asha.23117996

A systematic review and meta‐analysis on the efficacy of sleep interventions to treat suicidal ideation

“…Regarding the reporting of information from clinical trials, there is a need for clear and explicit reporting of demographic characteristics, as is advocated for by meta-analytical researchers (Chow et al, 2023).…”

Evidence-b(i)ased practice: Selective and inadequate reporting in early childhood autism intervention research

“…Others provided summary data upon request when contacted. These practices and others, such as depositing de-identified data in an open-access repository, are recommended to ensure that primary studies are included in all relevant meta-analyses for which they are eligible (Chow et al, 2023).…”

Conducting high-quality and reliable acoustic analysis: A tutorial focused on training research assistants

“…The Journal of Speech, Language, and Hearing Research recently published a forum on open science practices in CSDs, edited by Guest Editor Dr. Rachel Teodore. This issue includes tutorials on preregistration, 2 a discussion on the importance of including data that can be accessed for future meta-analysis, 3 and a tutorial discussing reproducibility in studies with only a few participants (small-N). 4 Additionally, papers were included that examined current open science practices in CSD, 5 the effect that open access has on metrics of impact, 6 and the importance of including marginalized populations that are historically excluded from research in open science work, 7 as well as other important topics in this area.…”