We have successfully identified a variety of methodological assessment tools for different types of study design. However, further efforts in the development of critical appraisal tools are warranted since there is currently a lack of such tools for other fields, e.g. genetic studies, and some existing tools (nested case-control studies and case reports, for example) are in need of updating to be in line with current research practice and rigor. In addition, it is very important that all critical appraisal tools remain subjective and performance bias is effectively avoided.

BackgroundMobile health apps for diabetes self-management have different functions. However, the efficacy and safety of each function are not well studied, and no classification is available for these functions.ObjectiveThe aims of this study were to (1) develop and validate a taxonomy of apps for diabetes self-management, (2) investigate the glycemic efficacy of mobile app-based interventions among adults with diabetes in a systematic review of randomized controlled trials (RCTs), and (3) explore the contribution of different function to the effectiveness of entire app-based interventions using the taxonomy.MethodsWe developed a 3-axis taxonomy with columns of clinical modules, rows of functional modules and cells of functions with risk assessments. This taxonomy was validated by reviewing and classifying commercially available diabetes apps. We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials, the Chinese Biomedical Literature Database, and ClinicalTrials.gov from January 2007 to May 2016. We included RCTs of adult outpatients with diabetes that compared using mobile app-based interventions with usual care alone. The mean differences (MDs) in hemoglobin A1c (HbA1c) concentrations and risk ratios of adverse events were pooled using a random-effects meta-analysis. After taxonomic classification, we performed exploratory subgroup analyses of the presence or absence of each module across the included app-based interventions.ResultsAcross 12 included trials involving 974 participants, using app-based interventions was associated with a clinically significant reduction of HbA1c (MD 0.48%, 95% CI 0.19%-0.78%) without excess adverse events. Larger HbA1c reductions were noted among patients with type 2 diabetes than those with type 1 diabetes (MD 0.67%, 95% CI 0.30%-1.03% vs MD 0.37%, 95% CI –0.12%-0.86%). Having a complication prevention module in app-based interventions was associated with a greater HbA1c reduction (with complication prevention: MD 1.31%, 95% CI 0.66%-1.96% vs without: MD 0.38%, 95% CI 0.09%-0.67%; intersubgroup P=.01), as was having a structured display (with structured display: MD 0.69%, 95% CI 0.32%-1.06% vs without: MD 0.69%, 95% CI –0.18%-0.53%; intersubgroup P=.03). However, having a clinical decision-making function was not associated with a larger HbA1c reduction (with clinical decision making: MD 0.19%, 95% CI –0.24%-0.63% vs without: MD 0.61%, 95% CI 0.27%-0.95%; intersubgroup P=.14).ConclusionsThe use of mobile app-based interventions yields a clinically significant HbA1c reduction among adult outpatients with diabetes, especially among those with type 2 diabetes. Our study suggests that the clinical decision-making function needs further improvement and evaluation before being added to apps.

No abstract