Quantifying CALL: significance, effect size and variation

Abstract

Good practice in primary research has evolved over many decades of research in applied linguistics to counter human fallibility and biases. Surprisingly, perhaps, synthesising such research in an entire field has only recently started to develop its own methodologies and recommendations. This paper outlines some of the issues involved, especially in terms of quantitative research and meta-analysis. A second-order synthesis of meta-analyses in Computer-Assisted Language Learning (CALL) provides only medium effect sizes, but the figures are interpreted in terms of realistic expectations. The inevitable variation in effect sizes can be attributed in principle either to the research methodologies (both primary and secondary) ormore interestingly-to real-world phenomena.

Narrative review and meta-analysis of MALL research on L2 skills

“…Finally, the meta-analysis is complemented with a narrative review, which categorizes the characteristics of MALL studies in terms of the language aspects targeted, theoretical frameworks addressed, technology type adopted, and multimedia components used. As noted by Boulton (2016), a quantitative analysis could provide essential insights, but it does not capture the whole picture. Instead, it needs to be complemented with qualitative analysis that is more thought provoking and heuristically rich.…”