Background With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation. Objectives Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques. Methods We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni. Results Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose. Conclusion Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.

No abstract

Objective Assess the effect of non-pharmacological alcohol interventions on reducing heavy episodic drinking (HED) outcomes in sub-Saharan Africa. Methods A systematic review of the available literature through August 19, 2020 was conducted. Randomized and non-randomized controlled trials testing non-pharmacological interventions on alcohol consumption in sub-Saharan Africa were eligible for inclusion. Eligible outcomes included measures of HED/binge drinking, and measures indicative of this pattern of drinking, such as high blood alcohol concentration or frequency of intoxication. Three authors extracted and reconciled relevant data and assessed risk of bias. The review protocol is available on PROSPERO (registration number: CRD42019094509). The Cochrane Handbook recommendations for the review of interventions and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines guided all methodology. Results Thirteen intervention trials were identified that met our inclusion criteria and measured change in HED. Studies were judged of moderate quality. A beneficial effect of non-pharmacological interventions on HED was reported in six studies, three of which were deemed clinically significant by the review authors; no statistically significant effects were identified in the other seven studies. Interventions achieving statistical and/or clinical significance had an intervention dose of two hours or greater, used an array of psychosocial approaches, including Motivational Interviewing integrated in Brief Intervention, cognitive behavioral therapy and integrated risk reduction interventions, and were delivered both individually and in groups. Conclusions Evidence for the effectiveness of non-pharmacological interventions to reduce HED in sub-Saharan African settings was limited, demonstrating the need for more research. To strengthen the literature, future research should employ more rigorous study designs, improve consistency of HED measurement, test interventions developed specifically to address HED, and explore structural approaches to HED reduction.

No abstract