Background The Smart Angel home medical device allows ambulatory surgery patients to monitor their own health by taking their blood pressure and oxygen levels and answering a health questionnaire from home. Currently, this device is a prototype in the design phase, and no usability evaluation has been performed. This preventive device must be usable by patients with different profiles; however, it is important to select patients carefully to ensure their safety when using the device. As such, it would be interesting to know how to select or exclude patients. However, the links between user characteristics and the usability of this home medical device remain unclear. Objective This study aims to better understand the links between certain characteristics of potential patients (ie, age, education, technophilia, and health literacy) and the usability (ie, effectiveness, efficiency, and satisfaction) of Smart Angel, as defined by the ISO 9241-11. Methods We conducted an experimental study involving 36 participants investigating the effects of 4 patient characteristics (ie, age, education, technophilia, and health literacy) on usability, measured in terms of effectiveness, efficiency, and satisfaction. A mixed methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). First, to help participants project themselves into the real use of the Smart Angel device, they watched a scenario in a video. Second, the participants completed a set of questionnaires to show the extent of their health literacy level (Newest Vital Sign [NVS] and the Health Literacy Survey [HLS]) and then operated Smart Angel devices. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (System Usability Scale [SUS]). The qualitative observational data were coded using inductive analysis by 2 independent researchers specialized in cognitive psychology and cognitive ergonomics. Results The results show a moderate and positive correlation between age and effectiveness (r=0.359; P=.03) and efficiency (r=0.357; P=.03). There is strong correlation between health literacy scored by the NVS and effectiveness (r=0.417; P=.01), efficiency (r=-0.38; P=.02), and satisfaction (r=0.45; P=.006). However, there is a weak correlation between technophilia and usability and no relationship between education level and usability. Conclusions Our results show that literacy level and age are 2 important factors to consider when selecting future users of the Smart Angel device to ensure patient safety. This study also serves as an example promoting mixed methodologies in assessments of medical device usability that cannot be performed under real-world conditions.

Background Studies on the usability of health care devices are becoming more common, although usability standards are not necessarily specified and followed. Yet, there is little knowledge about the impact of the context of use on the usability outcome. It is specified in the usability standard (ISO 9241-11, 2018) of a device that it may be affected by its context of use and especially by the characteristics of its users. Among these, prior health knowledge (ie, knowledge about human body functioning) is crucial. However, no study has shown that prior health knowledge influences the usability of medical devices.  Objective Our study aimed to fill this gap by analyzing the relationship between the usability of two home medical devices (soon to be used in the context of ambulatory surgery) and prior health knowledge through an experimental approach. Methods For assessing the usability of two home medical devices (blood pressure monitor and pulse oximeter), user tests were conducted among 149 students. A mixed-methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). Participants completed a questionnaire to show the extent of their previous health knowledge and then operated both devices randomly. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (system usability scale [SUS]). The qualitative observational data were coded using inductive analysis by two independent researchers specialized in cognitive psychology and cognitive ergonomics. Correlational analyses and clusters were performed to test how usability relates to sociodemographic characteristics and prior health knowledge. Results The results indicated a lack of usability for both devices. Regarding the blood pressure monitor (137 participants), users made approximately 0.77 errors (SD 1.49), and the mean SUS score was 72.4 (SD 21.07), which is considered “satisfactory.” The pulse oximeter (147 participants) appeared easier to use, but participants made more errors (mean 0.99, SD 0.92), and the mean SUS score was 71.52 (SD 17.29), which is considered “satisfactory.” The results showed a low negative and significant correlation only between the effectiveness of the two devices and previous knowledge (blood pressure monitor: r=−0.191, P=.03; pulse oximeter: r=−0.263, P=.001). More subtly, we experimentally identified the existence of a threshold level (χ²2,146=10.9, P=.004) for health knowledge to correctly use the pulse oximeter, but this was missing for the blood pressure monitor. Conclusions This study has the following two contributions: (1) a theoretical interest highlighting the importance of user characteristics including prior health knowledge on usability outcomes and (2) an applied interest to provide recommendations to designers and medical staff.

Research showed that immersive technologies can significantly improve the design process. However, it is important to consider the ease of implementation of solutions (e.g. price, simplicity). Therefore, the objective of this study was to analyze the uses of two types of virtual environments that are relatively simple to implement: a basic model of a room and its 3D scan. Participants made sketches using a virtual reality application, provided by the instructors, in each of the two different VR environments. The sketches are proposals to a furniture co-creation task. Results indicate a better co-creation process during the second session than during the first, which reveals that training is an important criterion in this case. Furthermore, co-creation is felt to be better in the case of the modeled place compared to the 3D scan. This result could be due to the presence of useless virtual objects that can cause a distraction to the participants. These results are discussed from an applicative standpoint.

Background Remote monitoring of mean arterial blood pressure (MAP), heart rate (HR) or oxygen saturation (SpO2) remains a challenge in outpatient surgery. This study evaluates a new digital technology (Smart Angel™) for remotely monitoring hemodynamic data in real time: data transmitted from the patient’s home to a central server, using a dedicated web-based software package. Methods Adults scheduled for elective outpatient surgery were prospectively enrolled. In the first 5 postoperative days, patients completed a self-report questionnaire (pain, comfort, nausea, vomiting) and recorded SpO2, HR and MAP via two wireless Bluetooth monitors connected to a 4G tablet to transmit the data to a website, in real time, using Smart Angel™ software. Before transmission to the website, these data were also self-reported by the patient on a paper form. The primary outcome was the proportion of variables (self-monitored physiological data + questionnaire scores) correctly transmitted to the hospital via the system compared with the paper version. On Day 5, a system usability scale survey (SUS score 1–100) was also attributed. Results From May 2018 to September 2018, data were available for 29 out of 30 patients enrolled (1 patient was not discharged from hospital after surgery). The remote monitoring technology recorded 2038 data items (62%) compared with 2656 (82%) items recorded on the paper form (p = 0.001). The most common errors with the remote technology were software malfunctioning when starting the MAP monitor and malfunctioning between the tablet and the Bluetooth monitor. No serious adverse events were noted. The SUS score for the system was 85 (68–93) for 26 patients. Conclusion This work evaluates the ability of a pilot system for monitoring remote physiological data using digital technology after ambulatory surgery and highlights the digital limitations of this technology. Technological improvements are required to reduce malfunctioning (4G access, transmission between apps). Trial registration ClinicalTrials.gov (NCT03464721) (March 8, 2018).

No abstract