Conducting classroom-based educational research trials is important for establishing the efficacy and effectiveness of specific instructional interventions. Such endeavours, however, are challenging to implement. This was made evident during a recent independent evaluation of the efficacy of the MiniLit program, wherein various difficulties emerged relating to the dosage and fidelity of instruction, and the measures and analyses employed by the research team. As such, this served as an object lesson in what can, and frequently does, go wrong in even the best planned intervention research enterprises conducted in schools. The present article is intended to capture the authors’ experiences in implementing research trials in school contexts, with specific examples drawn from the independent evaluation of MiniLit. In particular, this study has reinforced the need to select assessment measures carefully, according to how well they represent targeted skills in the specific population of interest. In addition, it has highlighted the importance of planning program efficacy trials such that participants can receive enough exposure of the intervention to progress to a realistic extent.
The aim of the present study was to determine the efficacy of a small-group reading instruction program that was delivered over two school terms to Australian students in Years 3 through 6. A large cohort (n = 239) of primary school children was assessed on their literacy skills before and after receiving ‘MacqLit’, a phonics-based program designed for older struggling readers. Parametric and nonparametric difference tests were used to compare results at pre- and postintervention time points. Statistically significant improvements with large effect sizes were observed on all raw score measures of word reading, nonword reading, passage reading and spelling. Statistically significant improvements were also observed on standard score measures of nonword reading and passage reading, suggesting the gains were greater than what might be expected to have resulted from typical classroom instruction. The results indicate that older middle primary school-aged students may benefit from phonics-based, small-group reading instruction.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.