Curricular Concept Maps as Structured Learning Diaries: Collecting Data on Self-Regulated Learning and Conceptual Thinking for Learning Analytics Applications

Abstract

The collection and selection of the data used in learning analytics applications deserve more attention. Optimally, selection of data should be guided by pedagogical purposes instead of data availability. Using design science research methodology, we designed an artifact to collect time-series data on students' self-regulated learning and conceptual thinking. Our artifact combines curriculum data, concept mapping, and structured learning diaries. We evaluated the artifact in a case study, verifying that it provides relevant data, requires a limited amount of effort from students, and works in different educational contexts. Combined with learning analytics applications and interventions, our artifact provides possibilities to add value for students, teachers, and academic leaders. Notes for Practice• Data about constructs related to self-regulated learning, such as motivation, emotion, and metacognitive experiences, is highly relevant in learning analytics applications.• While this data is difficult to capture automatically, learning diaries can gather process data about students' internal states.• The main contribution of this article is to present a methodology in which concept maps are used as learning diaries to gather meaningful data for learning analytics applications.• In the future, this method of data gathering can be combined with different kinds of learning analytics interventions, including personalized feedback at scale.

Diario de aprendizaje y aprendizaje autorregulado en estudiantes universitarios: Revisión sistemática

“…Modo de aplicación de los DA 1. Kivimäki et al, (2019) Inv. Se destacó el modelo de AAR de Zimmerman, el cual fue usado en la mayoría de estudios, representando el 53% (n=10) del total.…”

Structured learning diary and epistemic beliefs predict academic achievement in higher education

“…2.3.1. Structured learning diary Kivimäki et al (2019) designed this study's structured learning diary tool. This study focuses on the competence, emotion, and difficulty scales explained in Figure 1.…”

Improvement of Teaching and Learning Experience by Online Course Diary Tool: Qualitative Exploration of Teachers’ Perspective

“…In this paper, Course Diaries refers to a learning analytics tool that was thus named by students. Course Diaries is a tool that combines student-and teacher-facing tools and has value in collecting metacognitive data for research purposes (Kivimäki et al, 2019). From a student's perspective, the tool constitutes a structured learning diary that promotes metacognitive thinking through individual reflection on course content.…”

“…The first concept of the Course Diaries tool was presented at the EUNIS congress 2018 by Kivimäki et al (2018). At that time, the conceptual work was referred to as Dynamic Feedback System (DFS).…”

“…The concept was further developed from a theoretical perspective by Kivimäki et al (2019), and the effects of the tool on self-regulation and school engagement were studied by Pesonen et al (2020). Today, the tool is available for the Moodle digital learning platform as well as Android and iOS mobile platforms.…”