Cacophony of Networks in Learning Analytics

Abstract

Network analysis, a suite of techniques to quantify relations, is among core methods in learning analytics (LA). However, insights derived from the application of network analysis in LA have been disjointed and difficult to synthesize. We suggest that such is due to the naïve adoption of network analysis method into the methodologies of measuring and modelling interpersonal activity in digital learning. This chapter describes the diversity of empirical research using network analysis as a cacophony of network approaches. Focusing on LA studies that evaluate social behavior of individuals or model networks, the chapter exemplifies aspects of the analytical process that require rigor, justification, and alignment to overcome the cacophony of empirical findings. The chapter argues that the clarity of network definitions, hypotheses about network formation, and examination of the validity of individual-level measures are essential for coherent empirical insights and indicators. Future work should also make effort to model the temporal nature, multiplex ties, and dynamic interaction between the levels where interpersonal interactions unfold.

The i-SUN process to use social learning analytics: a conceptual framework to research online learning interaction supported by social presence

“…We argue that through SLA, network analytic methods are a coherent approach to online learning because they can illuminate the interdependencies of the learning ecosystem. However, the complexity of network measures and their indiscriminate use in educational research poses interpretative challenges for researchers leading to a "cacophony of networks" (Poquet and Joksimovic, 2022). Therefore, this framework does not focus on further analyzing empirical data but rather on "integrating existing perspectives into a more holistic view" (McGregor, 2019, p. 7) that connects the bodies of literature of online learning interaction, SLA, and network analysis.…”

“…Nevertheless, SLA faces the interdisciplinary challenge of bridging the social network analysis field that rooted in graph theory and sociology with the educational research field. Lack of rigor in the implementation of SLA results in unsystematic reporting of network measures without sound theoretical foundation on what they mean within the learning context resembling to what Poquet and Joksimovic (2022) call a "cacophony of networks. "…”

“…The multiplicity of network analysis terms combined with the lack of theoretical integration of online learning interaction and social presence theory compounds the challenge of implementing SLA. In response to the call for "refinement and rigor" in SLA (Poquet and Joksimovic, 2022), we propose a conceptual framework for educators and researchers to understand online learning interaction through SLA and social presence. To guide the development of this framework, we used concepts from communication networks theory and online learning literature integrated into a new perspective to analyze and assess learners' online behaviors and interactions.…”