Advancing Sociotechnical-Pedagogical  Heuristics for the Usability Evaluation  of Online Courses for Adult Learners

Jahnke, Isa; Riedel, Nathan; Singh, Kanupriya; Moore, Joi L.

doi:10.24059/olj.v25i4.2439

Cited by 9 publications

(7 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To conduct the first usability study, sociotechnical-pedagogical heuristics (Jahnke et al, 2021) were used to evaluate the first RIFI prototype. The heuristic evaluation gave recommendations to improve the first prototype.…”

Section: Usability (Study 1) Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Quality of digital learning experiences – effective, efficient, and appealing designs?

Jahnke¹

2022

IJILT

Self Cite

View full text Add to dashboard Cite

PurposeFischer et al. (2022) present a framework for rethinking education, including broad design components such as learning-on-demand or learning takes place in the context of authentic problems. How can we bring those design components into practice? I argue that the design of innovative learning approaches for the digital age requires rigor in design and evaluation methods to understand what works and how and why it works.Design/methodology/approachThis case study applies the research to improve approach with iterative steps of design, development, and formative evaluation. Methods to be used are borrowed from user and learning experience fields, such as usability studies and pre/posttests for learning growth.FindingsThe design of digital learning experiences rests on the three dimensions of how learners interact with (a) the digital tool, space, or service; (b) the pedagogical elements of goals, activities, and assessments (e.g. sense-making); and (c) other peers or instructors.Originality/valueThis study provides useful insights on how to conduct research to improve versus research to prove and indicates the importance of data analysis related to the effectiveness, efficiency, and attractiveness of digital learning experiences. Learning experience design and research provides sufficient rigor and could play an important role in new ways of learning in the digital age with the goal “making learning a part of life” as pointed out by Fischer et al. (2022).

show abstract

Section: Usability (Study 1) Resultsmentioning

confidence: 99%

“…To conduct the first usability study, sociotechnical-pedagogical heuristics (Jahnke et al. , 2021) were used to evaluate the first RIFI prototype.…”

Section: Case Study: Illustrating Learning Experience Design and Eval...mentioning

confidence: 99%

Quality of digital learning experiences – effective, efficient, and appealing designs?

Jahnke¹

2022

IJILT

Self Cite

View full text Add to dashboard Cite

show abstract

“…The second research question centered around the nature of learner experience with Diabetes Journey. On the basis of empathy methods and borrowing from Jahnke et al ( 2021 ) STP framework, we developed a series of sociotechnical-pedagogical design principles to guide the design of Diabetes Journey. User testing suggests participants had predominantly positive experiences when experiencing the resulting learning designs.…”

Section: Discussionmentioning

confidence: 99%

“…However, these methods and instruments mainly focus on technological usability, which researchers suggest may be insufficient when evaluating applications in learning or educational contexts (Lim & Lee, 2007 ; Reeves, 1994 ). This tension has led to calls to extend usability evaluation of educational technologies to include pedagogical considerations (Granić & Ćukušić, 2011 ; Jahnke et al, 2020 ; Pham et al, 2019 ), as well as social interactions and the social roles of users (Gamage et al, 2020 ; Jahnke et al, 2021 ). Responding to this tension, Jahnke et al ( 2020 ) analyzed 13 articles with usability evaluation criteria, and categorized them into three dimensions: (a) technological (e.g., Nielsen’s 10 heuristics, navigation, learnability), (b) pedagogical (e.g., learner context, learning activities, learner control, tasks), and (c) social (e.g., collaboration, communication, roles and/or relationships, social interactivity).…”

Section: Conceptual Frameworkmentioning

confidence: 99%

Learning experience design of an mHealth self-management intervention for adolescents with type 1 diabetes

Schmidt

Lu²,

Luo³

et al. 2022

Education Tech Research Dev

View full text Add to dashboard Cite

Type 1 diabetes (T1D) is a lifelong and chronic condition that can cause severely compromised health. The T1D treatment regimen is complex, and is a particular challenge for adolescents, who frequently experience a number of treatment adherence barriers (e.g., forgetfulness, planning and organizational challenges, stress). Diabetes Journey is a gamified mHealth program designed to improve T1D self-management through a specific focus on decreasing adherence barriers and improving executive functioning skills for adolescents. Grounded in situativity theory and guided by a sociotechnical-pedagogical usability framework, Diabetes Journey was designed, developed, and evaluated using a learning experience design approach. This approach applied design thinking methods within a Successive Approximation Model design process. Iterative design and formative evaluation were conducted across three design phases, and improvements were implemented following each phase. Findings from the user testing phase indicate Diabetes Journey is a user-friendly mHealth program with high usability that holds promise for enhancing adolescents' T1D self-management. Implications for future designers and researchers are discussed regarding the social dimension of the sociotechnical-pedagogical usability framework. An extension to the framework is proposed to extend the social dimension to include socio-cultural and contextual considerations when designing mHealth applications. Consideration of the pedagogical and sociocultural dimensions of learning is imperative when developing psychoeducational interventions.

show abstract

“…At the same time, scientists note the existence of problematic issues related to the standardization of the use of methods for checking the usability of study program interfaces [25] To solve them, I. Jahnke, N. Riedel, K. Singh, and J. Moore, based on the analysis of scientific sources, proposed a list of characteristics that will ensure obtaining high-quality and valid results of online course verification. According to this list, the interface should be checked in the following 16 directions: social presence, activities, easy to use, page layout, ecosystem, navigation, functionality, accessibility, diverse material, material organization, material delivery, material quality or interactive material, assessment, syllabus, teaching / learning goals, guidance [26]. Another convincing thesis that confirms the importance of checking software tools for adaptability to use in the educational process is that among the list of tests related to the introduction of virtual and mixed reality technologies into the educational process, there is a usability check of controls and necessary software.…”

Section: Introductionmentioning

confidence: 99%

Usability of Program Interfaces for Teaching 3d Graphics in a School Course of Informatics

Mosiiuk

Sikora

Usata

2023

ITLT

View full text Add to dashboard Cite

The study of three-dimensional graphics is an important part of a school course of informatics. This is a consequence of the fact that in today's world it is impossible to imagine a sphere of human activity where 3D modeling and 3D printing technologies are not used. At the same time, issues related to the study of this field of information technology at school are unfortunately not sufficiently outlined. Students' perception of the complex interfaces of the corresponding graphic software is also a problematic point. At the same time, the degree of their impact on educational activity has not been studied at a sufficient level. Considering that the complexity of organizing the interaction between the user and the control elements is inherent in the vast majority of graphic 3D programs, the purpose of the exploratory research was to study this very issue only in the context of the educational learning process. When choosing software for testing, the following selection criteria were followed: the software must be distributed on the basis of the open GPL license, and online services must be able to be freely registered and used in work; it is necessary that graphic complexes of three-dimensional graphics satisfy sufficiently democratic system requirements of school computers; the presence of a large number of localizations is also important, and in terms of functionality, 3D programs should approach similar leading commercial software tools and corresponding online services. In the work, considerable attention was paid to the description of research planning. In particular, it was indicated how the sample of respondents was formed and the main approaches to testing program interfaces in the context of their use in the educational process were revealed. An online tool for testing - UsabilityHub.com - is described separately. The obtained data are described and supplemented by specialized graphic heat maps of clicks. As a result, the data is analyzed in detail, it is indicated that the obtained results of the exploration research are an important basis for conducting further scientific research related to this topic and will allow better investigation of problematic issues. The authors also formulate recommendations for the study of three-dimensional graphics editors in a school course of informatics and note methodological points that teachers should pay attention to when preparing for classes.

show abstract

Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners

Cited by 9 publications

References 10 publications

Quality of digital learning experiences – effective, efficient, and appealing designs?

Quality of digital learning experiences – effective, efficient, and appealing designs?

Learning experience design of an mHealth self-management intervention for adolescents with type 1 diabetes

Usability of Program Interfaces for Teaching 3d Graphics in a School Course of Informatics

Contact Info

Product

Resources

About