How about the evidence assessment tools used in education and management systematic reviews?

Abstract

ObjectivesTo systematically analyze the use of evidence assessment tools in systematic reviews of management and education.Study design and settingWe systematically searched selected literature databases and websites to identify systematic reviews on management and education. We extracted general information of the included studies and information about the evidence assessment tool they applied, including whether it was used for methodological quality assessment, reporting quality assessment or evidence grading, as well as the name, reference, publication year, version and original intended use of the tool, the role of the tool in the systematic review, and whether the quality determination criteria were given.ResultsA total of 299 systematic reviews were included, of which only 34.8% used evidence assessment tools. A total of 66 different evidence assessment tools were used, of which Risk of Bias (ROB) and its updated version (n = 16, 15.4%) were the most frequent. The specific roles of the evidence assessment tools were reported clearly in 57 reviews, and 27 reviews used two tools.ConclusionEvidence assessment tools were seldom used in systematic reviews in social sciences. The understanding and reporting of evidence assessment tools among the researchers and users still needs improvement.

Effects of Arts-Based Pedagogy on Competence Development in Nursing: A Critical Systematic Review

“…The Council for Exceptional Children (CEC) Standards for Evidence-Based Practices in Special Education [ 74 ] is the selected assessment tool for this review. Evidence assessment tools developed for health research are not entirely applicable to evaluate articles in education research [ 75 ]. The CEC Standards were chosen because they are specifically designed for pedagogical intervention studies and allow for a more rigorous appraisal than other approaches in education research [ 76 , 77 , 78 ].…”

“…Utilizing a different assessment tool and altering the weighting scheme will alter results [154]. Tools for assessing evidence specific to the social sciences are still deficient [75]. The field of education is currently engaged in intense debate about the definition of evidence and the standards that should be applied [91,147,155,156].…”