This third article for 'Tips and tricks for understanding and using SR results' in Evidence-Based Child Health is, like the previous articles, aimed at helping to understand the results of systematic reviews and to use the results in clinical practice. This time, we focus on the concepts of meta-analysis and heterogeneity. The information in this article is based on earlier papers, the Cochrane Handbook, and the collective experience of the authors in teaching evidence-based medicine (1-5).
Understanding SR results
Meta-analysisA meta-analysis can be one of the components of a systematic review. In a meta-analysis the results of several individual studies are combined. A metaanalysis can only be performed if the study design, participants, interventions, and outcomes in the individual studies are similar. The overall effect estimate will be calculated as a weighted average of the treatment effects estimated in the individual studies. The weighted average is based on the treatment effect and the standard error of the results; larger and/or more precise studies have more influence than the smaller ones. By combining the results of several individual studies in a meta-analysis the presence of relatively small effects can be more easily detected.In general there are two statistical models to perform a meta-analysis: the fixed effects model and the random effects model (3). They differ in the way the variability of the results between the individual studies is treated. The fixed effects model assumes that the true effect of treatment (in both magnitude and direction) is the same value in every study (i.e. fixed across studies) and that the observed variability in the metaanalysis is exclusively due to random variation. The random effects model assumes a different underlying effect for each study and takes this into consideration as an additional source of variation, which leads to somewhat wider confidence intervals, a more even distribution of study weights, and a slightly different interpretation in the combined estimate compared to the fixed effects model. A substantial difference in the *Correspondence to: Leontien C. M. Kremer, Department of Paediatrics, Emma Children's Hospital/Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands. E-mail: l.c.kremer@amc.uva.nl overall effect estimate (and corresponding confidence interval) calculated by the fixed and random effects models will be seen only if studies are markedly heterogeneous.
What is heterogeneity?Inevitably, studies brought together in systematic reviews will differ. Variability among the individual studies is called heterogeneity. There are different types of heterogeneity (1): clinical heterogeneity may be caused by variability in the participants, interventions and outcomes studied, and methodological heterogeneity may be caused by variability in study design and quality.A consequence of clinical and/or methodological heterogeneity, sometimes referred to as diversity, is the occurrence of statistical heterogeneity, which is variabil...