The global and the local in educational assessment

Abstract

and the thematic issue 4/2016 (Hopfenbeck, 2016), have discussed the increasing use of international test results. Now, more than even before, there is a need to critically investigate the validity and reliability of comparisons using international test scores. Additionally, there is a need for monitoring and examining the tests used, how the results are interpreted, and to what extent it is possible to compare across different contexts, as these tests have implications for different education systems, educational policies and sometimes even the individual students. The question whether it is possible to compare test results across different countries and contexts is not a new one. Indeed, scholars have debated whether it is possible to compare test scores since the 'Father of Comparative Education' Marc-Antoine Jullien de Paris compared the school systems in Switzerland, Germany and Italy in the first quarter of the nineteenth century (Fraser, 1963;Jullien, 1817). The difference now, is the number of national and international tests administered, and how these tests shape and influence the education system locally and globally. The globalisation of education and the increase in testing preparation services offered from different organisations worldwide (Verger, Lubienski, & Steiner-Khamsi, 2016), is also an indication of the need for critically investigating whether the tools and tests offered for the education systems are fit for purpose. How can we test whether they measure what they are supposed to measure and whether results can be interpreted and compared across countries? On what criteria should the tests be assessed?The first article in this regular issue, by Ivanova, A., Kardanova, E., Merrell, C., Tymms, P. and D. Hawker, addresses some of these questions by presenting a study where the primary focus of the paper is methodological. The researchers ask: Is it possible to compare the results in assessments of mathematics across countries with different curricula, traditions and age of starting school? In their study, a Russian version of the Performance Indicators in Primary Schools (PIPS) baseline assessment (Tymms, 1999) is used. Trial data from about 300 Russian children at the start and end of their first year at school were matched with parallel data from representative samples of children in England and Scotland. Similar as in the PISA tests, the researchers used Rasch measurement when equating what scales were explored. The researchers argue that although a few items showed invariance across the three countries, it was possible to link PIPS scores in mathematics from the start and end of the first year at schools across Scotland, England and Russia. Hence, meaningful interpretations of test results were possible. At the same time, the researchers acknowledge the limited number (n = 300) of students in their study, and accept that they need to replicate the study with a bigger sample.But still, the question of whether a test can be used and results compared across countries and contexts involves mor...

E-Assessment at Jordan’s Universities in the Time of the COVID-19 Lockdown: Challenges and Solutions

“…One of the participants mentioned in the open-ended question that the most irksome experience s/he had with e-learning was the incessant resolutions made by the university, which took faculty members 'out of their depth.' Those challenges were in line with the concerns posited by Hopfenbeck (2018), as mentioned earlier in the literature review. Oncu and Cakir (2011) state that any university that has delivered education exclusively in the traditional classrooms is Arab World English Journal www.awej.org ISSN: 2229-9327 45 unlikely to have a clear vision for VLE learning, and this definitely casts doubt on the reliability, validity and security of its e-assessment.…”

E-Assessment at Jordan’s Universities in the Time of the COVID-19 Lockdown: Challenges and Solutions

“…Vlachou (2018) stated that "classroom assessment is a process in which teachers and students gather evidence of student learning through several assessment practices" (p. 2). Hopfenbeck (2018) pointed out that certain validity and reliability procedures must be implemented in the classroom to ensure that student assessment is properly achieved but that in Arab World English Journal www.awej.org ISSN: 2229-9327 40 VLEs assessment poses genuine concerns. These concerns are innumerable.…”

Preparedness of Institutions of Higher Education for Assessment in Virtual Learning Environments During the COVID-19 Lockdown: Evidence of Bona Fide Challenges and Pragmatic Solutions

“…It is known that "classroom assessment is a process in which teachers and students gather evidence of student learning through several assessment practices" (Vlachou, 2018, p. 2). This process requires validity and reliability procedures that are actually achieved in the direct classroom learning context, but might raise concerns in onlineonly assessment (Hopfenbeck, 2018). Among these concerns is the likelihood that students may receive assistance from their family and/or friends, or that they may turn to the textbook or a website to obtain answers to test questions.…”