Designing clinical practice feedback reports: three steps illustrated in Veterans Health Affairs long-term care facilities and programs

Abstract

Background: User-centered design (UCD) methods are well-established techniques for creating useful artifacts, but few studies illustrate their application to clinical feedback reports. When used as an implementation strategy, the content of feedback reports depends on a foundational audit process involving performance measures and data, but these important relationships have not been adequately described. Better guidance on UCD methods for designing feedback reports is needed. Our objective is to describe the feedback report design method for refining the content of prototype reports. Methods: We propose a three-step feedback report design method (refinement of measures, data, and display). The three steps follow dependencies such that refinement of measures can require changes to data, which in turn may require changes to the display. We believe this method can be used effectively with a broad range of UCD techniques. Results: We illustrate the three-step method as used in implementation of goals of care conversations in long-term care settings in the U.S. Veterans Health Administration. Using iterative usability testing, feedback report content evolved over cycles of the three steps. Following the steps in the proposed method through 12 iterations with 13 participants, we improved the usability of the feedback reports. Conclusions: UCD methods can improve feedback report content through an iterative process. When designing feedback reports, refining measures, data, and display may enable report designers to improve the user centeredness of feedback reports.

Partnered innovation to implement timely and personalized care: A case study

“…Fourth, the co-creation observed here aligned with user/ human-centered design principles and "designing for dissemination" central to implementation science [18][19][20][21]; research impact [22] and entrepreneurship [1]. A "not fully developed" innovation was piloted with end users, whose feedback contributed to refinement.…”

Small and Large Animal Veterinarian Perceptions of Antimicrobial Use Metrics for Hospital-Based Stewardship in the United States

“…Sociobehavioral research on the way human medicine clinicians respond to AMU data targeted at them individually demonstrates that considerable skepticism and lack of trust can surround feedback reports, contributing to gaming and workarounds (17). Before implementing an ASP intervention, clinician confidence in the measurement system must be secured to boost clinicians' acceptance of feedback data and increase motivation to change (18,19). The goal of this study was therefore to identify the perceptions that veterinary clinicians working in the US hospital setting hold toward different AMU metrics used for the systematic tracking and reporting of AMU for purposes of stewardship.…”

Opportunities to improve the impact of two national clinical audit programmes: a theory-guided analysis

“…reducing cognitive load and feedback complexity) is considered a key requirement of an effective feedback intervention [ 4 , 6 ]. User-centred design processes may help to ensure user-friendly feedback designs by identifying and rectifying problems earlier in the design process [ 14 ]. Similarly, feedback that also supports action planning or presents specific recommendations for action is consistently recommended by reviews in this field [ 2 , 4 , 6 ].…”