Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method

Ghalibaf, Azadeh Kamel; Jangi, Majid; Habibi, Mohammad Reza Mazaheri; Zangouei, Sara; Khajouei, Reza

doi:10.19082/6682

Cited by 7 publications

(16 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…54 Cognitive Walkthrough was suggested by the experts as a potentially useful eHealth usability evaluation method. Research supports this suggestion, since Cognitive Walkthrough has been frequently used to evaluate eHealth systems, 55 56 57 although it was criticized in 2013 for its effort and the time required for implementation. 32 This led to the creation of simplified versions of Cognitive Walkthrough, such as Cognitive Jogthrough 58 or Streamlined Cognitive Walkthrough.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation

Sinabell

Ammenwerth

2022

Appl Clin Inform

View full text Add to dashboard Cite

Background Electronic health (eHealth) usability evaluations of rapidly developed eHealth systems are difficult to accomplish because traditional usability evaluation methods require substantial time in preparation and implementation. This illustrates the growing need for fast, flexible, and cost-effective methods to evaluate the usability of eHealth systems. To address this demand, the present study systematically identified and expert-validated rapidly deployable eHealth usability evaluation methods. Objective Identification and prioritization of eHealth usability evaluation methods suitable for agile, easily applicable, and useful eHealth usability evaluations. Methods The study design comprised a systematic iterative approach in which expert knowledge was contrasted with findings from literature. Forty-three eHealth usability evaluation methods were systematically identified and assessed regarding their ease of applicability and usefulness through semi-structured expert interviews with 10 European usability experts and systematic literature research. The most appropriate eHealth usability evaluation methods were selected stepwise based on the experts' judgements of their ease of applicability and usefulness. Results Of these 43 eHealth usability evaluation methods identified as suitable for agile, easily applicable, and useful eHealth usability evaluations, 10 were recommended by the experts based on their usefulness for rapid eHealth usability evaluations. The three most frequently recommended eHealth usability evaluation methods were Remote User Testing, Expert Review, and Rapid Iterative Test and Evaluation Method. Eleven usability evaluation methods, such as Retrospective Testing, were not recommended for use in rapid eHealth usability evaluations. Conclusion We conducted a systematic review and expert-validation to identify rapidly deployable eHealth usability evaluation methods. The comprehensive and evidence-based prioritization of eHealth usability evaluation methods supports faster usability evaluations, and so contributes to the ease-of-use of emerging eHealth systems.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Cognitive Walkthrough has been frequently used to evaluate eHealth systems, [55][56][57] although it was criticized in 2013 for its effort and the time required for implementation. 32 This led to the creation of simplified versions of Cognitive Walkthrough, such as Cognitive Jogthrough 58 or Streamlined Cognitive Walkthrough.…”

Section: Discussionmentioning

confidence: 99%

Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation

Sinabell

Ammenwerth

2022

Appl Clin Inform

View full text Add to dashboard Cite

show abstract

“…Several other researchers have successfully had nonclinical evaluators–most often software developers or usability experts—use CWs to assess the usability of complex health technologies. 42 – 47 …”

Section: Discussionmentioning

confidence: 99%

Clinical decision support for intervention reduction in neonatal patients: A usability assessment

Tremoulet

2022

DIGITAL HEALTH

View full text Add to dashboard Cite

Objective This study investigated how effectively simplified cognitive walkthroughs, performed independently by four nonclinical researchers, can be used to assess the usability of clinical decision support software. It also helped illuminate the types of usability issues in clinical decision support software tools that cognitive walkthroughs can identify. Method A human factors professor and three research assistants each conducted an independent cognitive walkthrough of a web-based demonstration version of T3, a physiologic monitoring system featuring a new clinical decision support software tool called MAnagement Application (MAP). They accessed the demo on personal computers in their homes and used it to walk through several pre-specified tasks, answering three standard questions at each step. Then they met to review and prioritize the findings. Results Evaluators acknowledged several positive features including concise, helpful tooltips and an informative column in the patient overview which allows users direct (one-click) access to protocol eligibility and compliance criteria. Recommendations to improve usability include: modify the language to clarify what user actions are possible; visually indicate when eligibility flags are snoozed; and specify which protocol's data is currently being shown. Conclusion Independent, simplified cognitive walkthroughs can help ensure that clinical decision support software tools will appropriately support clinicians. Four researchers used this technique to quickly, inexpensively, and effectively assess T3's new MAP tool, which suggests positive actions, such as removing a patient from a ventilator. Results indicate that, while there is room for usability improvements, the MAP tool may help reduce clinician's cognitive load, facilitating improved care. The study also confirmed that cognitive walkthroughs identify issues that make clinical decision support software hard to learn or remember to use.

show abstract

“…Terdapat sembilan artikel yang memenuhi kriteria inklusi terdiri dari tiga artikel menggunakan metode heuristic (Atashi et al, 2016;Ebnehoseini et al, 2018;Rangraz Jeddi et al, 2020) dua artikel menggunakan metode cognitive walkthrough (Farzandipour, Nabovati, et al, 2021;Kamel Ghalibaf et al, 2018), satu artikel menggunakan metode System Usability Scale (SUS) (Farrahi et al, 2019), satu artikel menggunakan metode user view point , dan dua artikel menggunakan campuran dua metode (satu artikel menggunakan Think A Loud and Heuristic (Khajouei & Farahani, 2020) serta satu artikel menggunakan Think A Loud dan dilanjutkan dengan PSSUQ (Zahiri Esfahani et al, 2018)).…”

Section: Hasil Dan Pembahasanunclassified

Systematic Review of the Usability Evaluation Methodology of Health Information Systems

Kristina

Yulianto

Widayanti

2022

JFSP

View full text Add to dashboard Cite

A good information system will support the implementation of the tasks and functions of the organization. This systematic review aims to identify and characterize the methods and attributes in usability evaluation and identify measurement techniques in usability evaluation. This systematic review uses the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology. The search was carried out using two databases, namely PubMed and Science Direct, by limiting information systems related to health published from 2015 to 2021. Articles that met the criteria were evaluated for methods, attributes, measurement techniques, and usability criteria used. Article quality was assessed using a modified Downs and Black checklist. The search identified 132 articles. The results of abstract screening and duplication-checking obtained 128 articles. The screening was carried out through a complete review of the inclusion and exclusion criteria, obtained 9 articles that met the criteria. There are five methods used for usability evaluation, namely Think aloud (TA), Heuristic evaluation (HE), System Usability Scale (SUS), User viewpoint, and Cognitive Walkthrough Method. Six problem definitions used in usability evaluation are ISO, Nielsen, user-based, TAUCHI, 19 item usability questions, and successful completion of scenarios. The measurement technique is done by qualitative and quantitative analysis. Effectiveness, efficiency, and satisfaction are criteria that are always assessed from almost all articles reviewed. The heuristic evaluation method with quantitative measurement techniques using an evaluator in evaluating usability based on scenarios then proceeding with qualitative measurement techniques to deepen problems and provide solutions is the most ideal usability evaluation measurement technique.

show abstract

Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method

Cited by 7 publications

References 13 publications

Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation

Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation

Clinical decision support for intervention reduction in neonatal patients: A usability assessment

Systematic Review of the Usability Evaluation Methodology of Health Information Systems

Contact Info

Product

Resources

About