Measuring growth in students’ proficiency in MOOCs: Two component dynamic extensions for the Rasch model

Abstract

Massive open online courses (MOOCs) are increasingly popular among students of various ages and at universities around the world. The main aim of a MOOC is growth in students' proficiency. That is why students, professors, and universities are interested in the accurate measurement of growth. Traditional psychometric approaches based on item response theory (IRT) assume that a student's proficiency is constant over time, and therefore are not well suited for measuring growth. In this study we sought to go beyond this assumption, by (a) proposing to measure two components of growth in proficiency in MOOCs; (b) applying this idea in two dynamic extensions of the most common IRT model, the Rasch model; (c) illustrating these extensions through analyses of logged data from three MOOCs; and (d) checking the quality of the extensions using a cross-validation procedure. We found that proficiency grows both across whole courses and within learning objectives. In addition, our dynamic extensions fit the data better than does the original Rasch model, and both extensions performed well, with an average accuracy of .763 in predicting students' responses from real MOOCs.

Conflicts Among Students: The Formation of Tolerant Relations

“…The principle of brainstorming with a priori acceptance of everyone's opinion allows not only to come to a common denominator, but also to reveal hidden leadership and oratorical potentials, to remove the barriers of communication, to give an impetus to personal growth and development. Obviously, the majority of people do not enjoy conflicts, and moreover, doctors note the devastating consequences of stresses, most of which are caused by conflict (Bandura, 2017;Abbakumov et al, 2018). Is it possible to say that some style of behavior in a conflict situation is the only right one?…”

The effect of adaptivity in digital learning technologies. Modelling learning efficiency using data from an educational game

“…This approach uses a longitudinal generalised mixed modelling framework to model moment-by-moment learning. The modelling approach has been previously used to model learning in, for instance, an online learning environment with statistics exercises (Kadengye, et al, 2015) and in Massive Open Online Courses (MOOCs; Abbakumov et al, 2019). We briefly describe the most relevant parameters of the modelling approach here, a detailed discussion is provided in online Appendix B.…”

Psychometrics of MOOCs: How to Measure Proficiency?

“…To cover this gap, researchers proposed to measure this growth via the estimation of individual effect of the cumulative sum of video lectures a learner watched before a certain assessment task on the correctness of his/her response this task in a MOOC (Abbakumov, Desmet, & Van den Noortgate, 2019). The use of the extension showed that the probability of the correct response grows with every new watched lecture and the growth effect is specific for individual learners -for some learners, the growth may be intensive, while for some learners it may be almost flat through the whole course.…”