BackgroundThis systematic review examined the reliability and validity of the Morisky Medication Adherence Scale-8 (MMAS-8), which has been widely used to assess patient medication adherence in clinical research and medical practice.MethodsOf 418 studies identified through searching 4 electronic databases, we finally analyzed 28 studies meeting the selection criteria of this study regarding the reliability and validity of MMAS-8 including sensitivity and specificity. Meta-analysis for Cronbach’s α, intraclass correlation coefficient (ICC), sensitivity and specificity to detect a patient with nonadherence to medication were performed. The pooled estimates for Cronbach’s α and ICC were calculated using the random-effects weighted T transformation. A bivariate random-effects model was used to estimate pooled sensitivity and specificity.FindingsThe pooled Cronbach's α estimate for type 2 diabetes group in 7 studies and osteoporosis group in 3 studies were 0.67 (95% Confidence Interval(CI), 0.65 to 0.69) and 0.77 (95% CI, 0.72 to 0.83), respectively. With regard to test-retest, the pooled ICC for type 2 diabetes group in 3 studies and osteoporosis group in 2 studies were 0.81 (95% CI, 0.75 to 0.85) and 0.80 (95% CI, 0.74 to 0.85). For a cut-off value of 6, the pooled sensitivity and specificity in 12 studies were 0.43 (95% CI, 0.33 to 0.53) and 0.73 (95% CI, 0.68 to 0.78), respectively.ConclusionsThe MMAS-8 had acceptable internal consistency and reproducibility in a few diseases like type 2 diabetes. Using the cut-off value of 6, criterion validity was not enough good to validly screen a patient with nonadherence to medication. However, this study did not calculated a pooled estimate for criterion validity using the higher values than 6 as a cut-off value since most of included individual studies did not report criterion validity based on those values.
This article performs a systemic review of psychometric properties of Internet Addiction Test (IAT)-the most widely used tool for assessing Internet addiction in clinic and research field. Studies measuring psychometric properties of IAT (original version) were searched through MEDLINE, The Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, and Embase. A total of 25 studies including 18,421 subjects were reviewed in our study. Based on meta-analysis for internal consistency, the pooled Cronbach's alpha coefficient from college/university students with a single department subgroup was 0.90 (95percent confidence interval [CI], 0.89-0.91), and that from middle-/high-school students (older than 15 years) subgroup was 0.93 (95 percent CI, 0.92-0.93). According to test-retest analysis, the pooled Spearman's correlation coefficient from college/university students with a single department subgroup was high at 0.83 (95 percent CI, 0.81-0.85), along with low publication bias. Convergent validity showed correlation coefficients of 0.62-0.84, as compared with major tools. For construct validity, the number of factors is believed to be 1-2, only considering studies that followed the guidelines. IAT appears to have acceptable internal consistency, test-retest reliability, and convergent validity in specific groups. To verify these values, well-designed evidence-based studies assessing psychometric properties of IAT across diverse populations are warranted.
Background In the recent years, machine learning algorithms have been more widely and increasingly applied in biomedical fields. In particular, their application has been drawing more attention in the field of psychiatry, for instance, as diagnostic tests/tools for autism spectrum disorder (ASD). However, given their complexity and potential clinical implications, there is an ongoing need for further research on their accuracy. Objective This study aimed to perform a systematic review and meta-analysis to summarize the available evidence for the accuracy of machine learning algorithms in diagnosing ASD. Methods The following databases were searched on November 28, 2018: MEDLINE, EMBASE, CINAHL Complete (with Open Dissertations), PsycINFO, and Institute of Electrical and Electronics Engineers Xplore Digital Library. Studies that used a machine learning algorithm partially or fully for distinguishing individuals with ASD from control subjects and provided accuracy measures were included in our analysis. The bivariate random effects model was applied to the pooled data in a meta-analysis. A subgroup analysis was used to investigate and resolve the source of heterogeneity between studies. True-positive, false-positive, false-negative, and true-negative values from individual studies were used to calculate the pooled sensitivity and specificity values, draw Summary Receiver Operating Characteristics curves, and obtain the area under the curve (AUC) and partial AUC (pAUC). Results A total of 43 studies were included for the final analysis, of which a meta-analysis was performed on 40 studies (53 samples with 12,128 participants). A structural magnetic resonance imaging (sMRI) subgroup meta-analysis (12 samples with 1776 participants) showed a sensitivity of 0.83 (95% CI 0.76-0.89), a specificity of 0.84 (95% CI 0.74-0.91), and AUC/pAUC of 0.90/0.83. A functional magnetic resonance imaging/deep neural network subgroup meta-analysis (5 samples with 1345 participants) showed a sensitivity of 0.69 (95% CI 0.62-0.75), specificity of 0.66 (95% CI 0.61-0.70), and AUC/pAUC of 0.71/0.67. Conclusions The accuracy of machine learning algorithms for diagnosis of ASD was considered acceptable by few accuracy measures only in cases of sMRI use; however, given the many limitations indicated in our study, further well-designed studies are warranted to extend the potential use of machine learning algorithms to clinical settings. Trial Registration PROSPERO CRD42018117779; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=117779
Aim To assess the accuracy of the Childhood Autism Rating Scale (CARS) through systematic review and meta‐analysis. Method Studies that provided quantitative values for the reliability and validity for all versions of CARS were searched through MEDLINE, CINAHL, PsycINFO, Embase, and OpenDissertations. Results A total of 24 studies with 4433 participants were included in our analysis. Meta‐analysis showed that the summary Cronbach's alpha regarding a team of physicians and psychologists or others subgroup, derived from six studies (952 participants), was considered to be acceptable at 0.90 (95% confidence interval, 0.87–0.92) with moderate heterogeneity. Analysis of two ‘low risk of bias’ studies on the criterion validity for CARS with a cut‐off of 30 and DSM‐IV resulted in sensitivity of 0.86 and 0.71 and specificity of 0.79 and 0.75. Interpretation Through the results of the current systematic review and meta‐analysis, the internal consistency can be considered to be acceptable for a team of physicians and psychologists or others subgroup. In terms of the criterion validity, the sensitivity was thought to be acceptable although the specificity was not, suggesting that CARS should be used along with other confirmatory tools. What this paper adds The Childhood Autism Rating Scale can be considered as a supplementary diagnostic tool for autism spectrum disorder.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.