Are UX Evaluation Methods Providing the Same Big Picture?

Nakamura, Walter Takashi; Ahmed, Iftekhar; Redmiles, David; Oliveira, Edson Cesar de; Fernandes, David; Oliveira, Elaine; Conte, Tayana

doi:10.3390/s21103480

Cited by 9 publications

(4 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…During the learning process, both teachers and students needs to learn how to use the platform. If the platform does not provide a good usability, the users will spend more time trying to understand how to use it rather than learning or using its contents (Abuhlfaia & de Quincey, 2018;Nakamura, et. al.…”

Section: Literature Reviewmentioning

confidence: 99%

Educators’ Perspectives on Usability of the Moodle LMS: A Case of the National Institute of Transport, Tanzania

Phillip Bhalalusesa,

Said Kombo,

Godwin Mwakalinga

et al. 2023

EAJESS

View full text Add to dashboard Cite

The purpose of this study was to assess the usability of the Moodle LMS at the National Institute of Transport in Tanzania. The study employed a descriptive research design that involved the use of a questionnaires and interview to collect data from 35 educators who were using the Moodle LMS. Quantitative data was analyzed using the SPSS while qualitative data involved content analysis. The study identified effectiveness, satisfaction, memorability, learnability and errors factors to be used to assess usability issues. The study revealed that educators encountered usability problems related to navigation, content, layout, interaction, feedback, help and support. The study recommends that the NIT should focus on providing a user-friendly interface, clear content, consistent layout, enhanced interaction and timely feedback to improve the usability of the Moodle LMS. By addressing these usability problems, NIT will enhance the effectiveness of teaching and learning activities. Moreover, the study recommends regular training to teachers on how to use the Moodle LMS.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Educators’ Perspectives on Usability of the Moodle LMS: A Case of the National Institute of Transport, Tanzania

Phillip Bhalalusesa,

Said Kombo,

Godwin Mwakalinga

et al. 2023

EAJESS

View full text Add to dashboard Cite

show abstract

“…In complex software engineering systems, in particular, focus-group interviews may be used in combination with quantitative data to acquire information from involved individuals such as developers or end-users [46]. This combination of database-derived quantitative data with qualitative feedback straight from specialized staff that are routinely interacting with the system creates a multifaceted evaluation process that has the ability to identify the causes behind negative and positive attitudes [47] and as such may also be used to provide useful insights concerning other similar advanced content management environments and multi-site general purpose WCMSs.…”

Section: Methodsmentioning

confidence: 99%

User Experience, Functionality and Aesthetics Evaluation in an Academic Multi-Site Web Ecosystem

Giannakoulopoulos,

Pergantis,

Lamprogeorgos

2024

Future Internet

View full text Add to dashboard Cite

The present study focuses on using qualitative and quantitative data to evaluate the functionality, user experience (UX), and aesthetic approach offered by an academic multi-site Web ecosystem consisting of multiple interconnected websites. Large entities in various industry fields often have the need for an elaborate Web presence. In an effort to address the challenges posed by this need specifically in the field of academia, the authors developed, over a period of many years, a multi-site ecosystem within the Ionian University, which focuses on interconnectivity and a collaborative approach to academic content management. This system, known as “Publish@Ionio”, uses a singular content management infrastructure to allow for the creation of content for different websites that share both information and resources while at the same time allowing for individual variations in both functionality and aesthetics. The ecosystem was evaluated through quantitative data from its operation and qualitative feedback from a focus-group interview with experts, including website editors and administrative staff. The collected data were used to assess the strengths and weaknesses of the multi-site approach based on the actions and needs of the individuals in charge of generating content. The study led to conclusions on the advantages that interoperability offers in terms of digital and human resource management, the benefits of a unified aesthetic approach that allows for variability, and the necessity of collaborative content management tools that are tailored to the content’s nature.

show abstract

“…Questionnaires are the most used methods to evaluate UX because it is possible to obtain quantitative data about the interaction with the product or service. However, the obtained data can be biased or impacted due to external influences such as the participant's attitude or their current emotional state, among others [52]. Therefore, many UX researchers have introduced the use of psycho-physiological methods such as electroencephalography (EEG), electromyography (EMG), or Galvanic Skin Response (GSR) in order to obtain a relative objective UX evaluation [18].…”

Section: User Experiencementioning

confidence: 99%

Development of a Framework for the Communication System Based on KNX for an Interactive Space for UX Evaluation

Lopez-Aguilar,

Bustamante-Bello,

Navarro-Tuch

et al. 2023

Sensors

View full text Add to dashboard Cite

Domotics (Home Automation) aims to improve the quality of life of people by integrating intelligent systems within inhabitable spaces. While traditionally associated with smart home systems, these technologies have potential for User Experience (UX) research. By emulating environments to test products and services, and integrating non-invasive user monitoring tools for emotion recognition, an objective UX evaluation can be performed. To achieve this objective, a testing booth was built and instrumented with devices based on KNX, an international standard for home automation, to conduct experiments and ensure replicability. A framework was designed based on Python to synchronize KNX systems with emotion recognition tools; the synchronization of these data allows finding patterns during the interaction process. To evaluate this framework, an experiment was conducted in a simulated laundry room within the testing booth to analyze the emotional responses of participants while interacting with prototypes of new detergent bottles. Emotional responses were contrasted with traditional questionnaires to determine the viability of using non-invasive methods. Using emulated environments alongside non-invasive monitoring tools allowed an immersive experience for participants. These results indicated that the testing booth can be implemented for a robust UX evaluation methodology.

show abstract

Are UX Evaluation Methods Providing the Same Big Picture?

Cited by 9 publications

References 50 publications

Educators’ Perspectives on Usability of the Moodle LMS: A Case of the National Institute of Transport, Tanzania

Educators’ Perspectives on Usability of the Moodle LMS: A Case of the National Institute of Transport, Tanzania

User Experience, Functionality and Aesthetics Evaluation in an Academic Multi-Site Web Ecosystem

Development of a Framework for the Communication System Based on KNX for an Interactive Space for UX Evaluation

Contact Info

Product

Resources

About