Mobile Technology in Medicine: Development and Validation of an Adapted System Usability Scale (SUS) Questionnaire and Modified Technology Acceptance Model (TAM) to Evaluate User Experience and Acceptability of a Mobile Application in MRI Safety Screening

Abstract

Background Magnetic resonance imaging (MRI) safety screening is a crucial procedure for patient preparation before entering into MRI room. Many hospitals in Malaysia are still using the MRI safety checklist printed form. Besides, clinicians will not get a definite conclusion about whether the patient is contraindicated for MRI or not. Hence, we have created one mobile application named MagnetoSafe to overcome this issue. The application will provide an instant decision on whether the patient has no contraindication, relative contraindication, or absolute contraindicated for MRI. We need to check for acceptability and user experience for any newly created mobile application. Objective This study was designed to check the validity of the adapted Technology Acceptance Model (TAM) and System Usability Scale (SUS) Questionnaire. Method The validity and reliability of the questionnaire were investigated. Subsequently, 52 fully completed responses were collected. Results Face and content validity of the questionnaires are considered acceptable with only minor changes to Item 10 of SUS. The Cronbach's alpha for the SUS questionnaire (10 questions) is −0.49, which is not acceptable. The Cronbach's alpha for TAM questionnaire (3 domains; 14 questions) is acceptable, which is 0.910 for perceived usefulness, 0.843 for perceived ease of use, and 0.915 for intention to use. Conclusion Face validity of the adapted SUS and modified TAM questionnaires is acceptable with only minor changes to Item 10 in SUS. Content validity with experts is good. However, the reliability of the SUS questionnaire is not acceptable and therefore adapted SUS will not be used for assessing user experience. The reliability of the modified TAM questionnaire with the original three-factor structure is considered acceptable and can be used to evaluate the user's acceptability of MagnetoSafe.

Improving shared decision making for lung cancer treatment by developing and validating an open-source web based patient decision aid for stage I–II non-small cell lung cancer

“…Consistency across different studies and cancer types strengthens the evidence supporting the positive impact of PDAs in healthcare. This study used a mixed-methods approach, followed by Dutch guidelines for lung cancer treatment, and adhered to the IPDAS Evidence Update 2.0 recommendations (15,17).…”

“…The 40-item questionnaire, based on elements of the validated System Usability Scale and a study-specific questionnaire (17,18), assessed the performance, potential, and value of the application. Comprehensibility, usability, and the value of the information presented were all considered in the responses about satisfaction with the iPDA.…”

Usability Evaluation and Solution Design Improvement of OCTO Friends as Banking Referral Application

“…References in using this research instrument were obtained from the Systematic Literature Review (SLR) process by Kitchenham through analyzing previous research relevant to this study [11]. Based on the SLR, seven studies were found which were used as reference points for evaluating the usability of a banking app [12], e-commerce [13], ShopeePay [14], educational chatbot [15], Mobile Application MRI Safety Screening [16], GCash, Maya, Grabpay [17], and e-wallet applications [18]. In addition, in-depth interviews were also included so as to complement the usability testing.…”

Navigation Patterns and Design Strategies to Minimize Mobile Usability Issues

“…We may assess various goods and services using this questionnaire, including hardware, software, portable electronics, websites, and software applications. As a result of the development of technology, SUS is now a widely accepted industry standard cited in more than 1300 articles and publications [20].…”