Modeling the Implementation Context of a Telemedicine Service: Work Domain Analysis in a Surgical Setting

Abstract

Background A telemedicine service enabling remote surgical consultation had shown promising results. When the service was to be scaled up, it was unclear how contextual variations among different clinical sites could affect the clinical outcomes and implementation of the service. It is generally recognized that contextual factors and work system complexities affect the implementation and outcomes of telemedicine. However, it is methodologically challenging to account for context in complex health care settings. We conducted a work domain analysis (WDA), an engineering method for modeling and analyzing complex work environments, to investigate and represent contextual influences when a telemedicine service was to be scaled up to multiple hospitals. Objective We wanted to systematically characterize the implementation contexts at the clinics participating in the scale-up process. Conducting a WDA would allow us to identify, in a systematic manner, the functional constraints that shape clinical work at the implementation sites and set the sites apart. The findings could then be valuable for informed implementation and assessment of the telemedicine service. Methods We conducted observations and semistructured interviews with a variety of stakeholders. Thematic analysis was guided by concepts derived from the WDA framework. We identified objects, functions, priorities, and values that shape clinical procedures. An iterative “discovery and modeling” approach allowed us to first focus on one clinic and then readjust the scope as our understanding of the work systems deepened. Results We characterized three sets of constraints (ie, facets) in the domain: the treatment facet, administrative facet (providing resources for procedures), and development facet (training, quality improvement, and research). The constraints included medical equipment affecting treatment options; administrative processes affecting access to staff and facilities; values and priorities affecting assessments during endoscopic retrograde cholangiopancreatography; and resources for conducting the procedure. Conclusions The surgical work system is embedded in multiple sets of constraints that can be modeled as facets of the system. We found variations between the implementation sites that might interact negatively with the telemedicine service. However, there may be enough motivation and resources to overcome these initial disruptions given that values and priorities are shared across the sites. Contrasting the development facets at different sites highlighted the differences in resources for training and research. In some cases, this could indicate a risk that organizational demands for efficiency and effectiveness might be prioritized over the long-term outcomes provided by the telemedicine service, or a reduced willingness or ability to accept a service that is not yet fully developed or adapted. WDA proved effective in representing and analyzing these complex clinical contexts in the face of technological change. The models serve as examples of how to analyze and represent a complex sociotechnical context during telemedicine design, implementation, and assessment.

Context and Complexity in Telemedicine Evaluation: Work Domain Analysis in a Surgical Setting

“…A detailed account of specific findings is provided in “Modeling implementation context in telemedicine” [ 10 ].…”

“…While this may seem obvious, these factors are beyond the control of the clinical staff and may interfere with teleguidance use over time. The WDA helped us identify and represent these types of issues in detail [ 10 ].…”

“…Data collection and analysis are described in more detail in an adjacent paper, “Modeling implementation context in telemedicine” [ 10 ].…”

“…Work domain analysis is a type of modeling specifically developed to design and analyze complex, adaptive sociotechnical systems. We include examples of how the method was used to analyze and represent many different sources of complexity that shape work in a surgical setting [ 10 ].…”

User Experience in Remote Surgical Consultation: Survey Study of User Acceptance and Satisfaction in Real-Time Use of a Telemedicine Service

“…The service, called teleguidance, had shown success in a feasibility study [ 1 ], and health economic modeling showed its potential for improving clinical and economic outcomes [ 2 ]. Teleguidance practice was to be scaled up to 4 additional hospitals (5 in total including the first hospital), and efforts were made to understand the context into which the telemedicine intervention was introduced [ 3 ], and potential users’ attitudes toward the service prior to implementation [ 4 ]. This paper describes an investigation of practitioners’ experience of real-time use of teleguidance, based on surgeons’ expectations of how the service might contribute to performance and outcomes in a particular procedure, and their satisfaction with teleguidance immediately after the procedure.…”