No abstract

Studies from various disciplines have reported that spatial location of options in relation to processing order impacts the ultimate choice of the option. A large number of studies have found a primacy effect, that is, the tendency to prefer the first option. In this paper we report on evidence that position of the key in four-option multiple-choice (MC) listening test items may affect item difficulty and thereby potentially introduce construct-irrelevant variance. Two sets of analyses were undertaken. With Study 1 we explored 30 test takers’ processing via eye-tracking on listening items from the Aptis Test. An unexpected finding concerned the amount of processing undertaken on different response options on the MC questions, given their order. Based on this, in Study 2 we looked at the direct effect of key position on item difficulty in a sample of 200 live Aptis items and around 6000 test takers per item. The results suggest that the spatial location of the key in MC listening tests affects the amount of processing it receives and the item’s difficulty. Given the widespread use of MC tasks in language assessments, these findings seem crucial, particularly for tests that randomize response order. Candidates who by chance have many keys in last position might be significantly disadvantaged.

In online environments, listening involves being able to pause or replay the recording as needed. Previous research indicates that control over the listening input could improve the measurement accuracy of listening assessment. Self-pacing also supports the second language (L2) comprehension processes of test-takers with specific learning difficulties (SpLDs) or, more specifically, of learners with reading-related learning difficulties who might have slower processing speed and limited working memory capacity. Our study examined how L1 literacy skills influence L2 listening performance in the standard single-listening and self-paced administration mode of the listening section of the Test of English as a Foreign Language (TOEFL) Junior Standard test. In a counterbalanced design, 139 Austrian learners of English completed 15 items in a standard single-listening condition and another 15 in a self-paced condition. L1 literacy skills were assessed via a standard reading, non-word reading, word-naming, and non-word repetition test. Generalized Linear Mixed-Effects Modelling revealed that self-pacing had no statistically significant effect on listening scores nor did it boost the performance of test-takers with lower L1 literacy scores indicative of reading-related SpLDs. The results indicate that young test-takers might require training in self-pacing or that self-paced conditions may need to be carefully implemented when they are offered to candidates with SpLDs.

No abstract

BackgroundGrey matter volume (GMV) decline is a frequent finding in multiple sclerosis (MS), the most common chronic neurological disease in young adults. Increases of GMV were detected in language related brain regions following second language (L2) learning in healthy adults. Effects of L2 learning in people with MS (pwMS) have not been investigated so far.MethodsThis study prospectively evaluated the potential of an eight-week L2 training on grey matter plasticity measured by 3T-MRI, L2 proficiency and health-related quality of life (HRQoL) in people with relapsing-remitting MS (pwMS, n = 11) and healthy, sex- and age-matched controls (HCs; n = 12).ResultsCategorical voxel-based analysis revealed significantly less GMV bilaterally of the insula extending to the temporal pole in pwMS at baseline. Following L2 training, significant increases of GMV were evident in the right hippocampus, parahippocampus and putamen of pwMS and in the left insula of HCs. L2 training resulted in significant improvements of listening comprehension, speaking fluency and vocabulary knowledge in both pwMS and HCs. GMV increases of right hippocampus and parahippocampus significantly correlated with vocabulary knowledge gain and L2 learning was associated with a significant increase of HRQoL in pwMS.ConclusionOur findings demonstrate distinct patterns of GMV increases of language related brain regions in pwMS and HCs and indicate disease-related compensatory cortical and subcortical plasticity to acquire L2 proficiency in pwMS.