Learning Analytics for Knowledge Creation and Inventing in K-12: A Systematic Review

Apiola, Mikko-Ville; Lipponen, Sofia; Seitamaa, Aino; Korhonen, Tiina; Hakkarainen, Kai

doi:10.1007/978-3-031-10467-1_15

Cited by 4 publications

(6 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 4 illustrates that the majority of MMLA studies found here focus on higher education. Having said that, there is evidence that the field is expanding its reach into pre‐higher education (Apiola et al, 2022; Chejara et al, 2021) with associated concerns about more vulnerable populations (Beerwinkle, 2021). Note that a large number of articles did not provide details of the study samples.…”

Section: Methodsmentioning

confidence: 99%

Multimodal learning analytics—In‐between student privacy and encroachment: A systematic review

Prinsloo,

Slade,

Khalil

2023

Brit J Educational Tech

View full text Add to dashboard Cite

Since the emergence of learning analytics (LA) in 2011 as a distinct field of research and practice, multimodal learning analytics (MMLA), shares an interdisciplinary approach to research and practice with LA in its use of technology (eg, low cost sensors, wearable technologies), the use of artificial intelligence (AI) and machine learning (ML), and the provision of automated, mostly real‐time feedback to students and instructors. Much of MMLA takes place in experimental and laboratory settings, researching students' learning in in‐between spaces—between research and classroom application, in‐between students' learning in private and public spaces as researchers track students' learning both in their use of social media and connected devices, and through the use of context‐aware and adaptive devices; and lastly, in‐between respecting students' privacy while increasingly using intrusive technologies. This study seeks to establish what is known about MMLA in terms of rationale for applications, the nature and scope of data collected, the study contexts, evidence of commercial interests and/or downstream uses of students' data, and consideration of ethics, privacy, and the protection of student data. This systematic review analysed 192 articles using a search string consisting of various combinations of multimodal (data) and learning analytics. The main findings include, inter alia, that though MMLA provide insights into learning and teaching, there is little evidence of MMLA findings successfully being applied to classroom settings, at scale. Given that the nature of MMLA research often necessitates the use of a range of (intrusive) sensors and recording technologies and can include children in its samples; the encroachment of students' right to privacy is a huge concern that is not addressed. There is also a need to reconsider the rationale for collecting multimodal data, the conditions under which such data collection will be ethical and in service of students' wellness, and the boundaries that should protect their (multimodal) data. Practitioner notesWhat is already known about this topic Experimental educational research predates both multimodal learning analytics (MMLA) and educational data mining (EDM). MMLA has been an integral part of learning analytics as research focus and practice since its inception. The increased digitisation and datafication, advances in technology (eg, sensor technology, geo‐tracking, etc.) and a growing normalisation of wearable technologies provides greater scope for collecting multimodal data. There is a vast body of published MMLA research providing a range of insight into students' and educators' behaviours aiming to increase the effectiveness of teaching. What this paper adds While there are several studies providing insights into the state of MMLA research, this study provides insight to a selected range of factors in MMLA research such as the type of research (empirical/conceptual); the nature and scope of data collected; the sample populations (pre‐higher education, higher education, etc.); evidence of commercial interests or consideration of downstream uses; issues pertaining to consent, privacy, data protection and ethics; and evidence of how findings were used to improve teaching and learning. The vast majority of MMLA research targets higher education, is empirical in nature and is based on relatively small samples of participation in experimental settings. Confirms previous research that found the predominance of small samples, and a lack of replicability and, as a result, lacking scalability. That there is very little explicit discussion of the ethical and privacy implications and data protection, either at design stage or for future implementation. Similarly, that there is little consideration of potential commercial interests or downstream uses of data. Implications for practice and/or policy MMLA in its essence requires interdisciplinary approaches and teams. For MMLA to move beyond small‐scale, experimental settings to application in real (classroom) settings, larger, replicable studies should be conducted together with ways to make study findings actionable for teachers and students. Ethical issues, commercial interests and downstream uses of collected data must be considered within the design and approval of MMLA research.

show abstract

Section: Methodsmentioning

confidence: 99%

Multimodal learning analytics—In‐between student privacy and encroachment: A systematic review

Prinsloo,

Slade,

Khalil

2023

Brit J Educational Tech

View full text Add to dashboard Cite

show abstract

“…Most participants in the research analyzed in the reviews consisted of undergraduate students [2,[11][12][13][14][15][16][17][18][19][20][21] and graduate students [2,[11][12][13]19,20], or, if not specified, simply defined by 'higher education' students or "course demographics" [12,[22][23][24][25][26][27], and teacher/lecturer group [16,21,27,28]. While virtually all reviews included studies conducted in higher education [2,12,13,[16][17][18][19]26], studies with K12 students were fewer, and only two reviews focused solely on K12 [29,30]. This is comprehensible because of: (1) ethical issues; it is easier to ask an adult to participate in a research study where data security, privacy, and ethics are important implementation challenges [30,32]; (2) much of the educational data generated in higher education is made anonymous and freely available online with which to test visualization techniques [32]; (3) school systems are immensely diverse in terms of culture, customs, and attitudes toward technology and data…”

Section: Target Usersmentioning

confidence: 99%

“…Common visualization techniques were various graphs [2,12,13,19,21,23,25,26,28], such as line charts, bar charts, progress bars, pie charts, and timelines. In some of the reviews, there was no mention of what visualizations are represented in the dashboards [15][16][17][18]20,27,29,31].…”

Section: Visualization Elements Of Dashboardsmentioning

confidence: 99%

“…Among the theoretical frameworks, Self-Regulated Learning (SRL) [2,[12][13][14]20,23,25,28] and game-based learning [13,[17][18][19]23,26,30] theories seemed to be the most adopted for dashboard design. While a variety of less-used theories were motivation theory [2,13,23,25], open learner models [23], social learning theory [2], activity theory [12], inquiry-based learning [19], constructivism [12,29], collaborative knowledge construction [17], and multimodal learning or contextualizable learning analytics [15,19,27]. Human-centered design, i.e., functions and attributes of dashboards are defined by the people who are intended to use the system, and not imposed by designers and researchers, is also used [21,22,25,29].…”

Section: Theoretical Framework Used In the Design Of Dashboardsmentioning

confidence: 99%

“…While a variety of less-used theories were motivation theory [2,13,23,25], open learner models [23], social learning theory [2], activity theory [12], inquiry-based learning [19], constructivism [12,29], collaborative knowledge construction [17], and multimodal learning or contextualizable learning analytics [15,19,27]. Human-centered design, i.e., functions and attributes of dashboards are defined by the people who are intended to use the system, and not imposed by designers and researchers, is also used [21,22,25,29]. Other reviews lacked any theoretical framework [14,16,23,24,31].…”

Section: Theoretical Framework Used In the Design Of Dashboardsmentioning

confidence: 99%

See 2 more Smart Citations

A Current Overview of the Use of Learning Analytics Dashboards

Masiello,

Mohseni,

Palma

et al. 2024

Education Sciences

View full text Add to dashboard Cite

The promise of Learning Analytics Dashboards in education is to collect, analyze, and visualize data with the ultimate ambition of improving students’ learning. Our overview of the latest systematic reviews on the topic shows a number of research trends: learning analytics research is growing rapidly; it brings to the front inequality and inclusiveness measures; it reveals an unclear path to data ownership and privacy; it provides predictions which are not clearly translated into pedagogical actions; and the possibility of self-regulated learning and game-based learning are not capitalized upon. However, as learning analytics research progresses, greater opportunities lie ahead, and a better integration between information science and learning sciences can bring added value of learning analytics dashboards in education.

show abstract

The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research

Apiola

Saqr

López-Pernas

2023

Past, Present and Future of Computing Education Research

View full text Add to dashboard Cite

Learning Analytics for Knowledge Creation and Inventing in K-12: A Systematic Review

Cited by 4 publications

References 43 publications

Multimodal learning analytics—In‐between student privacy and encroachment: A systematic review

Multimodal learning analytics—In‐between student privacy and encroachment: A systematic review

A Current Overview of the Use of Learning Analytics Dashboards

The Evolving Themes of Computing Education Research: Trends, Topic Models, and Emerging Research

Contact Info

Product

Resources

About