Assessment of Clinical Performance during Simulated Crises Using Both Technical and Behavioral Ratings 

Abstract

Both technical and behavioral performance can be assessed from videotapes of simulations. The behavioral rating system can be improved; one particular difficulty was aggregating a single rating for a behavior that fluctuated over time. These performance assessment tools might be useful for educational research or for tracking a resident's progress. The rating system needs more refinement before it can be used to assess clinical competence for residency graduation or board certification.

Cricothyrotomy training increases adherence to the ASA difficult airway algorithm in a simulated crisis: a randomized controlled trial

“…Although there is limited evidence to suggest a positive correlation between technical skill and non-technical behaviours, 13,14 we did not find that cricothyrotomy technical skill had a direct effect on non-technical behaviours. That is, there were no differences in ANTS scores between groups for the four behavioural categories, including decision-making, which implies that hands-on training does not affect non-technical behaviours.…”

“…Although technical and non-technical attributes are usually taught and assessed separately, several studies have demonstrated that technical skills performance and non-technical behavioural performance are positively associated. 13,14 Although these findings provide empirical evidence to suggest that these two sets of attributes are interrelated, those authors did not evaluate the nature of this relationship or the influence of technical skills training on non-technical behaviours. Understanding how these two skill sets interact could have broad implications for clinical performance in airway crisis management.…”

Effect of videotape feedback on anaesthetists' performance while managing simulated anaesthetic crises: a multicentre study

“…This variability may be related to the attitude of each subject to accurate record keeping, or reflect the difficulty in maintaining a contemporaneous record during a crisis. However, other workers have commented on this variability when measuring the performance of anaesthetists by other techniques [12] and it may therefore be a reflection of the unpredictability of human performance during complex tasks.…”

Development of a competency framework for the nutrition in emergencies sector

“…Competency-based training naturally leads on to competency-based assessment methods. In studies on assessment methods from the medical sector, it has been shown that in addition to standard essay and exam questions, assessing technical and behavioural competencies through observation of simulated situations is a valid method (23) . This approach facilitates the assessment of a person's behaviours such as decision-making capacity in addition to technical competencies.…”