A Comparison of Global Rating Scale and Checklist Scores in the Validation of an Evaluation Tool to Assess Performance in the Resuscitation of Critically Ill Patients During Simulated Emergencies (Abbreviated as “CRM Simulator Study IB”)

Kim, John; Neilipovitz, David; Cardinal, Pierre; Chiu, Michelle

doi:10.1097/sih.0b013e3181880472

Cited by 125 publications

(88 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…ATHCTS 65 The Ottawa Global Rating Scale has been used in multi-specialty education as an objective measurement of an individual's crisis resource management skills in simulated scenarios. 211,212 This tool has been shown to differentiate among residents' level of training when applied in simulated medical crisis scenarios. 211 Consequences validity refers to the outcomes associated with scores from teamwork tools.…”

Section: Description and Validity Evidence For Teamwork Assessment Toolsmentioning

confidence: 99%

“…211,212 This tool has been shown to differentiate among residents' level of training when applied in simulated medical crisis scenarios. 211 Consequences validity refers to the outcomes associated with scores from teamwork tools. For many tools (35, 48 %), outcomes included satisfaction or opinion of participants (Table 2).…”

Section: Description and Validity Evidence For Teamwork Assessment Toolsmentioning

confidence: 99%

See 1 more Smart Citation

Teamwork Assessment in Internal Medicine: A Systematic Review of Validity Evidence and Outcomes

et al. 2013

View full text Add to dashboard Cite

OBJECTIVE: Valid teamwork assessment is imperative to determine physician competency and optimize patient outcomes. We systematically reviewed published instruments assessing teamwork in undergraduate, graduate, and continuing medical education in general internal medicine and all medical subspecialties. DATA SOURCES: We searched MEDLINE, MEDLINE In-process, CINAHL and PsycINFO from January 1979 through October 2012, references of included articles, and abstracts from four professional meetings. Two content experts were queried for additional studies. STUDY ELIGIBILITY: Included studies described quantitative tools measuring teamwork among medical students, residents, fellows, and practicing physicians on single or multi-professional (interprofessional) teams. STUDY APPRAISAL AND SYNTHESIS METHODS:Instrument validity and study quality were extracted using established frameworks with existing validity evidence. Two authors independently abstracted 30 % of articles and agreement was calculated. RESULTS: Of 12,922 citations, 178 articles describing 73 unique teamwork assessment tools met inclusion criteria. Interrater agreement was intraclass correlation coefficient 0.73 (95 % CI 0.63-0.81). Studies involved practicing physicians (142, 80 %), residents/fellows (70, 39 %), and medical students (11, 6 %). The majority (152, 85 %) assessed interprofessional teams. Studies were conducted in inpatient (77, 43 %), outpatient (42, 24 %), simulation (37, 21 %), and classroom (13, 7 %) settings. Validity evidence for the 73 tools included content (54, 74 %), internal structure (51, 70 %), relationships to other variables (25, 34 %), and response process (12, 16 %). Attitudes and opinions were the most frequently assessed outcomes. Relationships between teamwork scores and patient outcomes were directly examined for 13 (18 %) of tools. Scores from the Safety Attitudes Questionnaire and Team Climate Inventory have substantial validity evidence and have been associated with improved patient outcomes. LIMITATIONS: Review is limited to quantitative assessments of teamwork in internal medicine. CONCLUSIONS:There is strong validity evidence for several published tools assessing teamwork in internal medicine. However, few teamwork assessments have been directly linked to patient outcomes. 3,4 Recognizing this, the Institute of Medicine, the Joint Commission, the Agency for Healthcare Research and Quality (AHRQ), and others have made teamwork a top priority in their recommendations for improving healthcare. [5][6][7][8][9] Teamwork is also prominently positioned within the American Board of Internal Medicine (ABIM) requirements for maintenance of certification for internists, 10 as well as the Accreditation Council for Graduate Medical Education's core competencies, 11 milestones, 12 and medical student competencies. 13 As such, every physician at the undergraduate, graduate, and continuing professional level must demonstrate competency in teamwork.While there is broad agreement on the imperative to improve teamwork, there is littl...

show abstract

Section: Description and Validity Evidence For Teamwork Assessment Toolsmentioning

confidence: 99%

Section: Description and Validity Evidence For Teamwork Assessment Toolsmentioning

confidence: 99%

Teamwork Assessment in Internal Medicine: A Systematic Review of Validity Evidence and Outcomes

et al. 2013

View full text Add to dashboard Cite

show abstract

“…1 Vooralsnog zijn geen verschillen in betrouwbaarheid aangetoond; gebruikers hadden wel een lichte voorkeur voor de globale lijst omdat dit gemakkelijker was in gebruik en zich meer leende voor formatieve beoordeling.…”

Section: Technische En Niet-technische Vaardighedenunclassified

“…Kim et al hebben een checklist ontwikkeld waarbij ook criteria zijn opgenomen (Bijlage 4). 1 Het meten van veranderingen in de praktijk blijkt nog zeer lastig. Instrumenten als een Korte Praktijk Beoordeling (KPB) en Multi Source Feedback (MSF), eventueel in een aangepaste versie, zouden ingezet kunnen worden om te bepalen of na trainingen het handelen van een arts in opleiding tot specialist (aios) is veranderd ten opzichte van voorheen.…”

Section: Beoordelingunclassified

Achtergronden bij de Richtlijn simulatie teamtraining

Fluit¹,

Klaassen²

2011

TS MEDISCH ONDERWIJS

View full text Add to dashboard Cite

“…Los simulacros de reanimación pueden alcanzar el objetivo de brindar seguridad a la hora de prescribir medicamentos, si se lo plantea dentro del conjunto de competencias por cumplir. 13,18,19 El objetivo principal de este estudio fue determinar la cantidad de errores de prescripción en los que incurrían los médicos durante la realización de simulaciones de emergencias pediátricas en nuestro medio. Secundariamente, fue explorar acerca del impacto emocional de los errores cometidos.…”

Section: Introductionunclassified

Errores en la prescripción de medicación durante la realización de reanimaciones y otras urgencias pediátricas simuladas

et al. 2017

View full text Add to dashboard Cite

A Comparison of Global Rating Scale and Checklist Scores in the Validation of an Evaluation Tool to Assess Performance in the Resuscitation of Critically Ill Patients During Simulated Emergencies (Abbreviated as “CRM Simulator Study IB”)

Abstract: Construct validity seems to be present when using both the Ottawa GRS and CRM checklist to evaluate CRM performance during simulated emergencies. Data also indicate the presence of moderate inter-rater reliability when using both the Ottawa GRS and CRM checklist.

Cited by 125 publications

References 28 publications

Teamwork Assessment in Internal Medicine: A Systematic Review of Validity Evidence and Outcomes

Teamwork Assessment in Internal Medicine: A Systematic Review of Validity Evidence and Outcomes

Achtergronden bij de Richtlijn simulatie teamtraining

Errores en la prescripción de medicación durante la realización de reanimaciones y otras urgencias pediátricas simuladas

Contact Info

Product

Resources

About