The effectiveness of intelligent tutoring systems on K‐12 students' reading comprehension: A meta‐analysis

Abstract

This meta‐analysis examined the effectiveness of improving reading comprehension for students in K‐12 classrooms using intelligent tutoring systems (ITSs), a computer‐based learning environment that provides customizable and immediate feedback to the learner. Nineteen studies from 13 publications incorporating approximately 10 000 students were included in the final analysis; using robust variance estimation to account for statistical dependencies, the 19 studies yielded 88 effect size estimates. The meta‐analysis indicated that the overall random effect size of ITSs on reading comprehension was 0.60 (using a mix of standardized and researcher‐designed measures) with a 95% confidence interval 0.36 to 0.85 (p < 0.001). This review confirms previous studies comparing ITSs to human tutoring: ITSs produced a small effect size when compared to human tutoring (0.20, 0.02–0.38, p = 0.036, n = 21). All comparisons to human tutoring used standardized measures. This review also found that ITSs produced a larger effect size on reading comprehension when compared to traditional instruction (0.86) for mixed measures and (0.26) for standardized measures. These findings may be of interest to practitioners and policy makers seeking to improve reading comprehension using consistent and accessible ITSs. Recommendations for researchers include conducting studies to understand the difference between traditional and updated versions of ITSs and employing valid and reliable standardized tests and researcher‐designed measures.

The method of student's query analysis while intelligent computer tutoring in SQL

“…For the case when strings are of different lengths there is a question, which one of the two numbers of the word forms should be stated in the formula (2). It is obvious, if we compare the number of matches with the smaller of two values the similarity rate could be higher.…”

“…In the recent decades information technology (IT) significantly transformed the environment of human life. They are currently used as a main tool for the information and knowledge processing [1,2].…”

Development of an Intelligent Tutoring System for English Reading Comprehension: Design Based on Philippine Public School Flexible Learning Experience

“…In 2019, the study was conducted on the effectiveness of intelligent tutoring systems on K-12 students' reading comprehension, based on the result of the study ITSs produce a larger effect size on reading comprehension when compared to traditional instruction, ITSs for reading produce a small effect size when compared to human tutoring. The effect size of ITSs on reading comprehension is inflated when studies use researcher-designed tests [16]. These results may be of interest to researchers and policymakers aiming to enhance reading comprehension through the use of reliable and widely available ITSs.…”

“…However, this study found that ITSs yield a larger effect size than the standard teaching process. [6] Additionally, an Intelligent Tutoring System aims to provide immediate and customized instruction or feedback to learners, usually without requiring intervention from a human teacher. According to Ken Koedinger, professor of human-computer interaction and psychology, Intelligent Tutoring Systems are programmed to monitor student success in real-time, include next-step hints, and select practice tasks that help students develop new skills.…”

Understanding user trust in artificial intelligence‐based educational systems: Evidence from China

“…For much of the last 30 years, the AI in education community has been focusing on creating AI-based systems, such as Intelligent Tutoring Systems (ITSs), Intelligent Learning Environments (ILEs) and AI-driven educational robots (Serholt et al, 2017;Roll & Wylie, 2016;Nye, 2015), to mimic expert human one-to-one tutoring and provide personalized learning, to maximize users' learning quality (Boulay, 2019) and to address the social needs of students (Serholt et al, 2017). AI-based systems are characterized by their autonomy, adaptability and interactivity (Richards & Dignum, 2019;Xu, Wijekumar, Ramirez, Hu, & Irey, 2019). AI techniques can capture and analyze learners' behavioral and psychological data, connect to knowledge networks (Sullivan & Keith, 2019), change customized learning plans based on learners' responses, rather than being a set procedure designed by some experts.…”