2019
DOI: 10.31234/osf.io/5p7dj
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

A Guide to Conducting a Meta-Analysis with Non-Independent Effect Sizes

Abstract: Please cite this paper as:Cheung, M.W.-L. (in press). A guide to conducting a meta-analysis with non-independent effect sizes. Neuropsychology Review. AbstractConventional meta-analytic procedures assume that effect sizes are independent. When effect sizes are non-independent, conclusions based on these conventional models can be misleading or even wrong. Traditional approaches, such as averaging the effect sizes and selecting one effect size per study, are usually used to remove the dependence of the effect s… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
81
0

Year Published

2019
2019
2022
2022

Publication Types

Select...
6
2

Relationship

0
8

Authors

Journals

citations
Cited by 60 publications
(81 citation statements)
references
References 29 publications
0
81
0
Order By: Relevance
“…Finally, restricted likelihood three-level meta-regression models were used to investigate the moderating effect of AMSTAR score, year of publication and number of included studies on overall effect estimate on objective cognitive outcomes. Given many of the included reviews provided more than one effect estimate per outcome for analysis, three-level metaregression analyses assessed the extent to which the model explains heterogeneity within ( (2) 2 ) and between studies ( (3) 2 ), expressed as (2) 2 and (3) 2 , respectively (Cheung, 2019) .…”
Section: Discussionmentioning
confidence: 99%
See 1 more Smart Citation
“…Finally, restricted likelihood three-level meta-regression models were used to investigate the moderating effect of AMSTAR score, year of publication and number of included studies on overall effect estimate on objective cognitive outcomes. Given many of the included reviews provided more than one effect estimate per outcome for analysis, three-level metaregression analyses assessed the extent to which the model explains heterogeneity within ( (2) 2 ) and between studies ( (3) 2 ), expressed as (2) 2 and (3) 2 , respectively (Cheung, 2019) .…”
Section: Discussionmentioning
confidence: 99%
“…Analyses of composite scores of multiple outcome measures might avoid this problem, but may overestimate within-study variance and thus underestimate between-study heterogeneity. Multivariate and multilevel approaches are likely to be more efficient alternatives, as they account for within-and between-study variance and thus allow not only to control for dependency among effect sizes but also to investigate potential sources of variance in each level (for review, see Cheung, 2019).…”
Section: Implications For Researchmentioning
confidence: 99%
“…For example, if a study had several treatments (e.g., N addition rates) or the responses were measured several times over the study period (e.g., annually), the observations were non‐independent. However, all these observations were extracted and included into the dataset, to utilize all available data to address relevant questions (Cheung, 2015a, 2019), such as how N addition rate and experimental duration affect the responses. It should be noted that, since multiple observations for the same species in the same study are non‐independent, and to take the non‐independence into account, they were treated using a “shifting the unit of analysis” approach in the present study (see Section 2.4.2 below).…”
Section: Materialsandmethodsmentioning
confidence: 99%
“…We also conducted a three‐level meta‐analysis using the metaSEM package in R, which was proposed to deal with non‐independent effect sizes (Cheung, 2015b, 2019). The results of the conventional meta‐analysis and those of the three‐level meta‐analysis were similar (Table S2).…”
Section: Materialsandmethodsmentioning
confidence: 99%
“…Pooling of outcomes across studies will be conducted using random-effects models. All eligible outcomes per analysis will be used, accounting for dependency structure of effect sizes within studies [26,27]. Sensitivity analyses for the primary outcome will be conducted by comparing results from multilevel and robust variance estimation models.…”
Section: Data Synthesismentioning
confidence: 99%