Comparative Study on Reliability Between Online and Paper-Based Versions of a Test for Reading in English as a Foreign Language

Abstract

The aim of this study is to examine how reliable the results of the internet-based version of a reading test are, with a view to replacing paper tests with the online versions. This is of increasing importance as universities focus on improving efficiency and supporting SDGs by going paperless.The study was also suggested by the need to test reading comprehension of larger numbers of students across the university and deliver meaningful results on which to base intensive programs of instruction quickly. The Extensive Reading Foundation's online reading test and the (now discontinued) Edinburgh Project for Extensive Reading's placement test (paper-based), were administered to university students under controlled conditions, and the data was analyzed for possible relationships. An initial one-way ANOVA analysis of the results suggested little evidence of a relationship between online and paper-based test scores. However, further analysis using other measures found evidence of interaction between them, and a second ANOVA analysis, only of scores for students who had completed all versions of the test found a significant relationship.Familiarity with both versions of the test was considered as a possible factor. Although this is only a small-scale study, the findings help to support the argument for adopting the online version of the test, with its various potential benefits to schools and educators.

The Asian Conference on Education 2022: Official Conference Proceedings

“…This test has been widely used and found to be a reliable measure. The first author has employed both the original EPER paper test and the more recent ERF online test and found that either of the two modes may be reliably used to assess ability (Ihata, 2019). In both groups, test format and procedure for taking the test were explained clearly in advance, both orally in class and in a written handout, and subjects were encouraged to familiarize themselves with the test.…”

Students’ Reading Comprehension Skill: The Roles of Text Readability and Question Difficulty

“…Some may argue that the lower score obtained might stem from the usage of a computer-based test, instead of a paper-based test. Ihata (2019) mentions that both paper-based and computer or onlinebased tests can be used interchangeably without much problem, and using the online tests is beneficial in reducing the time and cost of a test. However, in order to ascertain that one of the causes for the lower score is not students' unfamiliarity with using a computer, we let students be familiar with how to operate the program and give them time to try out the test using several sample questions.…”