This paper examines the VARK learning preferences evaluation tool for evidence of context effect as a result of the questionnaire design using a common scenario stimulus to elicit learning preferences. Confirmatory Factor Analysis (CFA) is used to test the overall model fit of a multidimensional hierarchical model which included a context scenario effect and a non-hierarchical model which does not explicitly model a context effect. The results show that half of the scenarios in the VARK learning preferences questionnaire have significant context effect, which in turn introduce response bias. The presence of context response bias in some of the questions offers a possible explanation to the lack of consistent empirical evidence for the existence of preference styles flagged by educators, which contradicts findings from neuroscience and psychology of a convergence effect between learning modality preferences and learning approaches. The findings have significant implications for designers of learning preference tools in particular and educational measurement tools in general as they highlight the risks of the inadvertent introduction of possible response bias when implementing scenario-based evaluation tools.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.