We describe an initial analysis of speech during team-based medical scenarios and its potential to indicate process delays in an emergency medical setting. We analyzed the speech of trauma resuscitation teams in cases with delayed intravenous/intraosseous (IV/IO) line placement, a significant contributor to delays during life-saving interventions. The insights gained from this analysis will inform the design of a clinical decision support system (CDSS) that will use multiple sensor modalities to alert medical teams to errors in real time. We contribute to the literature by determining how the intention of each speech line and the sentence can support real-time, automatic detection of delays during time-critical team activities.

Designing computerized approaches to support complex teamwork requires an understanding of how activity-related information is relayed among team members. In this paper, we focus on verbal communication and describe a speech-based model that we developed for tracking activity progression during time-critical teamwork. We situated our study in the emergency medical domain of trauma resuscitation and transcribed speech from 104 audio recordings of actual resuscitations. Using the transcripts, we first studied the nature of speech during 34 clinically relevant activities. From this analysis, we identified 11 communicative events across three different stages of activity performance-before, during, and after. For each activity, we created sequential ordering of the communicative events using the concept of narrative schemas. The final speech-based model emerged by extracting and aggregating generalized aspects of the 34 schemas. We evaluated the model performance by using 17 new transcripts and found that the model reliably recognized an activity stage in 98% of activity-related conversation instances. We conclude by discussing these results, their implications for designing computerized approaches that support complex teamwork, and their generalizability to other safety-critical domains.