Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review

Vlachogianni, Prokopia; Tselios, Nikolaos

doi:10.3390/su151712954

Cited by 13 publications

(3 citation statements)

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this questionnaire, a score ranging from 50 to 70 is considered marginally acceptable and indicates room for improvement, while a score exceeding 70 is considered acceptable [57,58]. As shown in Table 5, students' responses indicate that modular boards appear to be a usable approach for teaching microcontrollers, contributing to an enhanced and positive learning experience [59][60][61][62]. Furthermore, a strong correlation was observed between the SUS score and student performance in the coding learning unit (r = 0.384, p = 0.006).…”

Section: Discussionmentioning

confidence: 99%

Exploring Students’ Hands-On Performance, Attitudes, and Usability with Arduino Modular Boards

Tselegkaridis,

Sapounidis

2024

Information

View full text Add to dashboard Cite

Utilizing Arduino development boards for learning microcontroller circuits is a prevalent practice across various educational levels. Nevertheless, the literature offers limited insights into the impact of these boards on student performance and attitudes. Therefore, this paper aims to investigate the performance of 58 university students in learning microcontroller circuits with modular boards designed for Arduino through a series of 4 exercises. Specifically, students’ performance is assessed through pre-tests and post-tests, in three learning units: (a) microcontroller, (b) coding, and (c) circuit. Additionally, the study captures students’ attitudes and measures their perceived usability of modular boards. For this purpose, the students completed a specially designed attitude questionnaire and the system usability scale (SUS) questionnaire. Statistical analysis is conducted using t-tests, ANOVA, and ANCOVA, along with bootstrapping. The findings reveal statistically significant differences between pre-tests and post-tests in all cases. Among the three learning units, the use of modular boards appears to have the most significant impact on coding. Based on students’ responses, the SUS results indicate that modular boards appear to be a quite usable approach for teaching microcontrollers. Finally, students generally express positive attitudes toward modular boards.

show abstract

Section: Discussionmentioning

confidence: 99%

Exploring Students’ Hands-On Performance, Attitudes, and Usability with Arduino Modular Boards

Tselegkaridis,

Sapounidis

2024

Information

View full text Add to dashboard Cite

show abstract

“…PSSUQ is a method consisting of 16 standard questions to measure the end-user satisfaction level with a system or application focusing on the information quality of a system [32], [33]. The data collection instrument was a questionnaire carried out using Google Form, with 48 valid respondents successfully collected.…”

Section: Post-study System Usability Questionnaire (Pssuq)mentioning

confidence: 99%

E-Dharmagita Learning Model Innovation with Mobile and Multimedia Technology

Sudana,

Sukma,

Wirdiani

et al. 2024

SJI

View full text Add to dashboard Cite

Purpose: Yadnya ceremony is a sacred sacrifice performed with sincere and wholehearted devotion by Hindus to God, spiritual leaders or teachers, fellow humans, the ancestors, and Bhuta_Kala. The implementation of the Yadnya ceremony is_usually accompanied by a spiritual chant of the Hindus known as Dharmagita. Nowadays, a lot of young generations do not know and are even more indifferent to the Dharmagita. Using books as a source of Dharmagita information is less attractive since there are no audio examples or recordings of correct songs that can be listened to. The Android-based e-Dharmagita application was built to overcome these problems to facilitate the younger generation in getting more interesting information about Dharmagita.Methods: e-Dharmagita was constructed with the support of mobile and multimedia technology. In addition, the information presented was related to the Yadnya Ceremony by implementing a complex Tree Algorithm.Results: This research produced an e-Dharmagita Application, of which user acceptance testing using the PSSUQ Method resulted in a score incudes in the excellent category. Therefore, the application could be accepted well in the implementation the Information Technology in Balinese Culture and Hinduism, especially the innovation of a more modern and attractive Dharmagita learning model.Novelty: The Dharmagita learning model using a mobile application is a new model that has not existed before.

show abstract

“…Educational technology can also be evaluated regarding usability and user experience aspects [33]. For instance, the System Usability Scale (SUS) and similar evaluation instruments have been used to evaluate the use of internet platforms, tutoring systems, mobile applications, and multimedia in education [34,35]. In our study, to evaluate the Bing Chat CAI tool in educational settings, the variables from the following aforementioned approaches for evaluation of learning technology were selected: TAM, ISSM, usability, and user experience.…”

Section: Introductionmentioning

confidence: 99%

Development of an Assessment Scale for Measurement of Usability and User Experience Characteristics of Bing Chat Conversational AI

Bubaš,

Čižmešija,

Kovačić

2023

Future Internet

View full text Add to dashboard Cite

After the introduction of the ChatGPT conversational artificial intelligence (CAI) tool in November 2022, there has been a rapidly growing interest in the use of such tools in higher education. While the educational uses of some other information technology (IT) tools (including collaboration and communication tools, learning management systems, chatbots, and videoconferencing tools) have been frequently evaluated regarding technology acceptance and usability attributes of those technologies, similar evaluations of CAI tools and services like ChatGPT, Bing Chat, and Bard have only recently started to appear in the scholarly literature. In our study, we present a newly developed set of assessment scales that are related to the usability and user experiences of CAI tools when used by university students, as well as the results of evaluation of these assessment scales specifically regarding the CAI Bing Chat tool (i.e., Microsoft Copilot). The following scales were developed and evaluated using a convenience sample (N = 126) of higher education students: Perceived Usefulness, General Usability, Learnability, System Reliability, Visual Design and Navigation, Information Quality, Information Display, Cognitive Involvement, Design Appeal, Trust, Personification, Risk Perception, and Intention to Use. For most of the aforementioned scales, internal consistency (Cronbach alpha) was in the range from satisfactory to good, which implies their potential usefulness for further studies of related attributes of CAI tools. A stepwise linear regression revealed that the most influential predictors of Intention to Use Bing Chat (or ChatGPT) in the future were the usability variable Perceived Usefulness and two user experience variables—Trust and Design Appeal. Also, our study revealed that students’ perceptions of various specific usability and user experience characteristics of Bing Chat were predominantly positive. The evaluated assessment scales could be beneficial in further research that would include other CAI tools like ChatGPT/GPT-4 and Bard.

show abstract

Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review

Cited by 13 publications

References 59 publications

Exploring Students’ Hands-On Performance, Attitudes, and Usability with Arduino Modular Boards

Exploring Students’ Hands-On Performance, Attitudes, and Usability with Arduino Modular Boards

E-Dharmagita Learning Model Innovation with Mobile and Multimedia Technology

Development of an Assessment Scale for Measurement of Usability and User Experience Characteristics of Bing Chat Conversational AI

Contact Info

Product

Resources

About