A Framework for Developing a Coding Scheme for Meta-Analysis

Abstract

The prominence of systematic reviews as bases for evidence-based practice is increasingly recognized and has significance for practice disciplines such as nursing. Synthesizing research findings is key to informing the clinical care of individuals burdened with health problems. A major issue in conducting such reviews involves developing reliable and valid coding procedures for extracting data from the research literature. A formalized process is described for developing coding instruments that have been used in five separate studies. Initial instrument development for a diabetes self-management education meta-analysis is described, followed by a discussion of adapting the instruments for subsequent meta-analytic studies of self-management interventions in diabetes care and of interventions to reduce caregiver burden of individuals with Alzheimer's disease dementia. Although time and effort are required for development of coding processes for research synthesis, these instrument development activities are one of the critical elements of producing reliable and clinically useful information.

Data extraction for complex meta-analysis (DECiMAL) guide

“…Although there are previous examples of guides and forms available for evidence synthesis [2, 3], these are aimed more at those wishing to perform data extractions for standard pairwise meta-analyses. Currently, no such guide exists for more complex evidence synthesis techniques, such as NMA or multivariate meta-analyses, which often require larger and more complex data extractions.…”

“…Brown et al report on a framework for developing a coding scheme for data extraction for meta-analysis, but the authors did not cover the more technical issues that can arise during complex meta-analysis, such as multiple arms and correlated outcomes [2]. We also identified several data extraction templates developed by the Cochrane Collaboration which provides guidance on topics to be covered in data extraction and quality assessment at a study level but does not suggest methods for organising multiple studies [3].…”

Physical Activity Intervention Effects on Physical Function Among Community-Dwelling Older Adults: A Systematic Review and Meta-Analysis

“…Data were extracted using a codebook developed from prior relevant research (Brown, Upchurch, & Acton, 2003; Chase, 2014; Conn, Valentine, & Cooper, 2002) and expert consultation. The codebook was pilot tested on 10 randomly selected studies to identify any possible missed themes or problem coding items prior to use on the entire sample (Wilson, 2009).…”

Biobehavioral determinants of glycemic control in type 2 diabetes: A systematic review and meta-analysis

“…Specific inclusion criteria were then applied in the third review to the studies determined to contain data. Raters were trained extensively in applying inclusion criteria; members of the research team arbitrated disagreements at regularly scheduled team meetings [17]. …”