Interprofessional healthcare team function is critical to the effective delivery of patient care. Team members must possess teamwork competencies, as team function impacts patient, staff, team, and healthcare organizational outcomes. There is evidence that team training is beneficial; however, consensus on the optimal training content, methods, and evaluation is lacking. This manuscript will focus on training content. Team science and training research indicates that an effective team training program must be founded upon teamwork competencies. The Team FIRST framework asserts there are 10 teamwork competencies essential for healthcare providers: recognizing criticality of teamwork, creating a psychologically safe environment, structured communication, closed-loop communication, asking clarifying questions, sharing unique information, optimizing team mental models, mutual trust, mutual performance monitoring, and reflection/debriefing. The Team FIRST framework was conceptualized to instill these evidence-based teamwork competencies in healthcare professionals to improve interprofessional collaboration. This framework is founded in validated team science research and serves future efforts to develop and pilot educational strategies that educate healthcare workers on these competencies.
Background
As part of the worldwide call to enhance the safety of patient handovers of care, the Association of American Medical Colleges (AAMC) requires that all graduating students “give or receive a patient handover to transition care responsibly” as one of its Core Entrustable Professional Activities (EPAs) for Entering Residency. Students therefore require educational activities that build the necessary teamwork skills to perform structured handovers. To date, a reliable instrument designed to assess teamwork competencies, like structured communication, throughout their preclinical and clinical years does not exist.
Method
Our team developed an assessment instrument that evaluates both the use of structured communication and two additional teamwork competencies necessary to perform safe patient handovers. This instrument was utilized to assess 192 handovers that were recorded from a sample of 229 preclinical medical students and 25 health professions students who participated in a virtual course on safe patient handovers. Five raters were trained on utilization of the assessment instrument, and consensus was established. Each handover was reviewed independently by two separate raters.
Results
The raters achieved 72.22 % agreement across items in the reviewed handovers. Krippendorff’s alpha coefficient to assess inter-rater reliability was 0.6245, indicating substantial agreement among the raters. A confirmatory factor analysis (CFA) demonstrated the orthogonal characteristics of items in this instrument with rotated item loadings onto three distinct factors providing preliminary evidence of construct validity.
Conclusions
We present an assessment instrument with substantial reliability and preliminary evidence of construct validity designed to evaluate both use of structured handover format as well as two team competencies necessary for safe patient handovers. Our assessment instrument can be used by educators to evaluate learners’ handoff performance as early as their preclinical years and is broadly applicable in the clinical context in which it is utilized. In the journey to optimize safe patient care through improved teamwork during handovers, our instrument achieves a critical step in the process of developing a validated assessment instrument to evaluate learners as they seek to accomplish this goal.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.