Using computer‐assisted assessment heuristics for usability evaluations

Sim, Gavin; Read, Janet C.

doi:10.1111/bjet.12255

“…This might be because of the good classification of OP system design requirements, as the tool was broken down into specific questions and SQs to help users consider the different design and managerial aspects. The breakdown makes the tool logically useful for users with different years of experience (Sim and Read, 2016). According to Shackel (1986), effectiveness, learnability, and flexibility are the factors defining a tool/system usability to achieve their goals in a particular context (Shackel, 1986).…”

Section: Discussionmentioning

confidence: 99%

The Integration of Human Factors to Warehousing and Manual Order Picking Operations

Setayesh

2023

Preprint

0

View full text Add to dashboard Cite

<p>Human Factors (HF) identified as the main concern of studies since poor HF and system design interaction has a negative impact on quality, error occurrence, system performance, and worker’s well-being. This dissertation takes literature review and sensitivity analysis to assess human- system errors by focusing on: 1) finding the most suitable model to estimate human-system errors, 2) identifying failure modes causing human-system errors, 3) creating a tool that capable of identifying the source of pick errors and degraded quality at the initial stage of a design, 4) evaluating the usability, functionality, and usefulness of the developed tool. The most common Human Reliability Assessment (HRA) models were studied to identify the most suitable model to estimate human error probability (HEP) in various contexts. The qualitative and quantitative analysis among the most common HRA models showed that these models are suffering from lack of guideline on Performance Indicating Factors (PIFs) selection and multiplier values allocation. Hence, a need for creating and validating new empirically based models in different sectors were recognized. Therefore, the focus of the research study was changed from finding a suitable model to determining the source of errors in manual order picking operation. The developed Warehouse Design Error Prevention (WDEP) checklist tool integrated HF aspects to both Order Picking (OP) design elements and warehouse management elements based on the identified failure modes from literature and field studies as elaborated in chapter 3 of this dissertation. Tool usability, functionality, and usefulness were evaluated through the survey study and qualitative interviews. The outcome of the user evaluation found the created tool useful, functional, and useable both at the initial stage of a design as well as during process improvement process. These dissertation findings illustrate the need for developing HF measures that contribute to pick errors and optimize OP system design strategies concerning HF demands by creating and validating the error prevention checklist tool. </p>

show abstract

“…This might be because of the good classification of OP system design requirements, as the tool was broken down into specific questions and SQs to help users consider the different design and managerial aspects. The breakdown makes the tool logically useful for users with different years of experience (Sim and Read, 2016). According to Shackel (1986), effectiveness, learnability, and flexibility are the factors defining a tool/system usability to achieve their goals in a particular context (Shackel, 1986).…”

Section: Discussionmentioning

confidence: 99%

The Integration of Human Factors to Warehousing and Manual Order Picking Operations

Setayesh

2023

Preprint

0

View full text Add to dashboard Cite

<p>Human Factors (HF) identified as the main concern of studies since poor HF and system design interaction has a negative impact on quality, error occurrence, system performance, and worker’s well-being. This dissertation takes literature review and sensitivity analysis to assess human- system errors by focusing on: 1) finding the most suitable model to estimate human-system errors, 2) identifying failure modes causing human-system errors, 3) creating a tool that capable of identifying the source of pick errors and degraded quality at the initial stage of a design, 4) evaluating the usability, functionality, and usefulness of the developed tool. The most common Human Reliability Assessment (HRA) models were studied to identify the most suitable model to estimate human error probability (HEP) in various contexts. The qualitative and quantitative analysis among the most common HRA models showed that these models are suffering from lack of guideline on Performance Indicating Factors (PIFs) selection and multiplier values allocation. Hence, a need for creating and validating new empirically based models in different sectors were recognized. Therefore, the focus of the research study was changed from finding a suitable model to determining the source of errors in manual order picking operation. The developed Warehouse Design Error Prevention (WDEP) checklist tool integrated HF aspects to both Order Picking (OP) design elements and warehouse management elements based on the identified failure modes from literature and field studies as elaborated in chapter 3 of this dissertation. Tool usability, functionality, and usefulness were evaluated through the survey study and qualitative interviews. The outcome of the user evaluation found the created tool useful, functional, and useable both at the initial stage of a design as well as during process improvement process. These dissertation findings illustrate the need for developing HF measures that contribute to pick errors and optimize OP system design strategies concerning HF demands by creating and validating the error prevention checklist tool. </p>

show abstract

“…(Hadjerrouit, 2010) Usability Heuristics for E-Learning Design (Mehlenbacher, Bennett, Bird, Ivey, Lucas, Morton, & Whitman, 2005) The Design Principles for Flow Experience in Educational Games (Kiili, Freitas, Arnabb & Lainema, 2012) Gameflow Model (Sweetser & Wyeth, 2005) Pedagogical playability heuristics (Tan, Goh, Ang & Huang, 2013) Events of instruction (Gagné, Wager, Golas, Keller, & Russell, 2005) Computer-Assisted Assessment (CAA) Heuristics (Sim & Read, 2015) Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge. (Mishra, & Koehler, 2006) Coding framework for design portion of international Learning solution Expert Evaluations (Table 1) and combining its features with knowledge gained from previous frameworks.…”

Section: Table 2 Additional Framework Analysedmentioning

confidence: 99%