Physician activity during outpatient visits and subjective workload

Abstract

We describe methods for capturing and analyzing EHR use and clinical workflow of physicians during outpatient encounters and relating activity to physicians' self-reported workload. We collected temporally-resolved activity data including audio, video, EHR activity, and eye-gaze along with post-visit assessments of workload. These data are then analyzed through a combination of manual content analysis and computational techniques to temporally align streams, providing a range of process measures of EHR usage, clinical workflow, and physician-patient communication. Data was collected from primary care and specialty clinics at the Veterans Administration San Diego Healthcare System and UCSD Health, who use Electronic Health Record (EHR) platforms, CPRS and Epic, respectively. Grouping visit activity by physician, site, specialty, and patient status enables rank-ordering activity factors by their correlation to physicians' subjective work-load as captured by NASA Task Load Index survey. We developed a coding scheme that enabled us to compare timing studies between CPRS and Epic and extract patient and visit complexity profiles. We identified similar patterns of EHR use and navigation at the 2 sites despite differences in functions, user interfaces and consequent coded representations. Both sites displayed similar proportions of EHR function use and navigation, and distribution of visit length, proportion of time physicians attended to EHRs (gaze), and subjective work-load as measured by the task load survey. We found that visit activity was highly variable across individual physicians, and the observed activity metrics ranged widely as correlates to subjective workload. We discuss implications of our study for methodology, clinical workflow and EHR redesign.

Human Factors and Usability for Health Information Technology: Old and New Challenges

“…We should extend the evaluation of health IT design beyond individual “subjective” measures such as end-user satisfaction, and include team outcomes such as shared understanding and team communication, as well as “objective” measures, e.g., task duration, number of clicks and scrolls needed to navigate through the technology, and proxy clinical outcomes such as the number of medication errors, the number of correct diagnoses, and appropriate clinical decision making. We need further research efforts to develop innovative human factors and usability methodologies such as those relying on multiple methods, including sensors and EHR-based methods 59 .…”

Efficiency of Emergency Physicians: Insights from an Observational Study using EHR Log Files

“…16 However, other researchers have described the impact of EHRs on improving cost-effectiveness for care, 17 management of privacy, 18,19 and improvements in chronic care. 20 More interestingly, what is less known is how the necessity to comply with these requirements has potentially affected how clinicians perform their routine activities. In other words, despite the widespread implementation and adoption of EHRs, very little is known about their direct impact on clinical activities and workflow.…”

“…Similar efforts to track clinical documentation and activities provided insights regarding EHR use in general. 20,29 However, the use of such techniques has been limited at best.…”

Characterizing and Visualizing Display and Task Fragmentation in the Electronic Health Record: Mixed Methods Design

“…There is a range of methodologies that can further inform our understanding of the problem. For example, eye movement studies have the potential to elucidate the relationship between the visual apprehension of information and clinical reasoning [4,[29][30][31]. It should also be noted that EHR-mediated workflow extends beyond the confines of navigational complexity to a host of other issues necessitating convergent methodologies [32][33][34][35][36].…”