Empowering online teachers through predictive learning analytics

Abstract

This study presents an advanced predictive learning analytics system, OU Analyse (OUA), and evidence from its evaluation with online teachers at a distance learning university. OUA is a predictive system that uses machine learning methods for the early identification of students at risk of not submitting (or failing) their next assignment. Teachers have access, via interactive dashboards, to weekly predictions of risk of failing for each of their students. In this study, we examined how the degree of OUA usage by 559 teachers, of which 189 were given access to OUA, related to student learning outcomes of more than 14 000 students in 15 undergraduate courses. Teachers who made “average” use of OUA, that is accessed OUA throughout the life cycle of a course presentation, and in particular between 10% and 40% of the weeks a course was running, and intervened with students flagged as at risk were found to benefit their students the most; after controlling for differences in academic performance, these students were found to have significantly better performance than their peers in the previous year's course presentation during which the same teachers made no use of predictive learning analytics. Predictive learning analytics is an innovative student's support approach in online pedagogy that, as shown in this study, can empower online teachers in effectively monitoring and intervening with their students, over and above other approaches, and result in improved learning outcomes. What is already known about this topic Pedagogical and personal support to students is a significant responsibility of online teachers. Student's support is a challenging activity due to the lack of face‐to‐face interactions. Predictive learning analytics (PLA) can identify students at risk of failing their studies. What this paper adds One of the few large‐scale studies is available for examining the impact of analytics on student's performance. Teachers' usage of PLA was significantly related to better learning outcomes. Online teachers had students with better learning outcomes when accessing PLA data rather than when they had no access. Implications for practice and/or policy PLA can empower online teachers and complement the teaching practice. PLA can help in the identification and proactive intervention of students at risk of failing their studies. Actions should be taken to motivate and engage online teachers with PLA.

Investigating the Influence of Interaction on Learning Persistence in Online Settings: Moderation or Mediation of Academic Emotions?

“…Transactional distance theory is a well-established contemporary theory on the interplay between individuals, environments, and interaction patterns [26]. In online learning environments, this theory addresses the relationship between interaction patterns and pedagogical subjects [9].…”

Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC‐LIWC‐based approach

“…Herodotou et al . (2019) empowered online teachers by using predictive learning analytics (PLA) to identify the students at risk of failing their courses and help these students to achieve better learning outcomes. Mavrikis, Geraniou, Gutierrez Santos, and Poulovassilis (2019) combined the intelligent analysis of interaction data from an exploratory learning environment with data visualisations and empirically demonstrated the usefulness of this approach in supporting classroom orchestration.…”

Artificial intelligence in schools: Towards a democratic future

“…An example of this might be the Intelligent Zoning Engine (IZE), which has been used since 2017 to determine optimal catchment areas for the Berlin district of Tempelhof-Schöneberg through calculation of travel time/distance, even though this may inadvertently entrench disadvantage through a form of inadvertent ghettoization of deprived students in particular schools (Algorithm Watch, n.d.). Another example might be the Open University's use of the OU Analyse tracking system (Herodotou et al, 2019), which identifies students requiring tutorial intervention, but that may be limited in scope for wider use given the predominantly mature, part-time university population that the tool has been trained upon. If systems such as these are to be used in a different context, they will need completely retraining on a new data set, as reliability can only ever be population-specific.…”