Developing the VA Geriatric Scholars Programs' Clinical Dashboards Using the PDSA Framework for Quality Improvement

Abstract

Background Involving clinician end users in the development process of clinical dashboards is important to ensure that user needs are adequately met prior to releasing the dashboard for use. The challenge with following this approach is that clinician end users can undergo periodic turnover, meaning, the clinicians that played a role in the initial development process may not be the same individuals that use the dashboard in future. Objectives Here, we summarize our Plan, Do, Study, Act (PDSA)-guided clinical dashboard development process for the VA Geriatric Scholars Program (GSP) and the value of continuous, iterative development. We summarize dashboard adaptations that resulted from two PDSA cycles of improvement for the potentially inappropriate medication dashboard (PIMD), one of many Geriatric Scholars clinical dashboards. We also present the evaluative performance of the PIMD. Methods Evaluation of the PIMD was performed using the system usability scale (SUS) and through review of user interaction logs. Routine end users that were Geriatric Scholars and had evidence of 5 or more dashboard views were invited to complete an electronic form that contained the 10-item SUS. Results The proportion of Geriatric Scholars that utilized the PIMD increased for each iterative dashboard version that was produced as a byproduct from feedback (31.0% in 2017 to 60.2% in 2019). The overall usability of the PIMD among routine users was found to be above average (SUS score: 75.2 [95% CI 70.5–79.8]) in comparison to the recommended standard of acceptability (SUS score: 68) Conclusion The solicitation of feedback during dashboard orientations led to iterative adaptations of the PIMD that broadened its intended use. The presented PDSA-guided process to clinical dashboard development for the VA GSP can serve as a valuable framework for development teams seeking to produce well-adopted and usable health information technology (IT) innovations.

Advancing Newborn Screening Long-Term Follow-Up: Integration of Epic-Based Registries, Dashboards, and Efficient Workflows

“…The nurse analyst continuously created new registries or streamlined existing ones and provided training. The literature on continuous improvement supports the idea that it is essential to engage with healthcare providers during the initial planning stages of the registry and dashboard development and throughout multiple iterative cycles [ 11 , 12 ]. From the onset, the Network set up a mutually agreed-upon schedule of quarterly meetings to review data trends, address emerging challenges, brainstorm innovative workflows to expedite the closure of care gaps, and refine how metrics are presented on dashboards.…”

Use of a Medication Safety Audit and Feedback Tool in the Emergency Department Is Affected by Prescribing Characteristics

“… 9 10 11 Poor dashboard utilization and lack of engagement may be responsible for the inconsistencies observed in the evidence base. 12 The integration of human factors principles during dashboard development followed by implementation of formal usability study can lead to improved dashboard satisfaction, 13 14 15 16 17 but beyond age, 18 there is little evidence on what factors may initially drive dashboard engagement once made available for routine use. Developing a better understanding of the facilitators and barriers to clinical dashboard utilization in different clinical settings would add further insight into dashboard orientation strategies and work practice implementation.…”