Does direct observation of procedural skills reflect trainee's progress in otolaryngology?

Abstract

Otolaryngology DOPS is a useful tool in assessing otolaryngology trainees especially from CT1-ST3 level. DOPS can also differentiate between junior and senior trainees. However, it was not able to demonstrate progress at levels above ST3, most likely due to the simplicity of the procedures which trainees tend to master in the first few years of training.

Utilisation and outcomes of Case‐based discussion in otolaryngology training

“…While all WBA tools are mandatory, and thus, trainees are not free to disengage from the process, trainees and supervisors are free to choose between different WBAs. CBDs were frequently used demonstrating the tool's popularity in comparison to other WBAs …”

“…CBDs were frequently used demonstrating the tool's popularity in comparison to other WBAs. 10 This study presents CBD outcomes from one training region in the UK, and findings may not apply to all programmes. Variation will depend on the level of engagement within each region and numbers of CBDs submitted.…”

“…Unlike procedure‐based assessment (PBA) and direct observation of procedural skills (DOPS), CBD is a generic tool that can be used across specialities, in differing clinical environments and in cases of varying complexity . Although there are sections within the form to document these variables, they do not feature in the portfolio summary generated by the ISCP .…”

“…Unlike procedure-based assessment (PBA) and direct observation of procedural skills (DOPS), CBD is a generic tool that can be used across specialities, in differing clinical environments and in cases of varying complexity. [10][11][12] Although there are sections within the form to document these variables, they do not feature in the portfolio summary generated by the ISCP. 7,13 The ISCP evaluation report, produced in 2012, states that CBD is more frequently used in early years training, while procedure specific tools, such as PBA and DOPS, are more favoured at later stages.…”

Utilisation, Reliability and Validity of Clinical Evaluation Exercise in Otolaryngology Training

“…While a provisional list of recommended CEX encounters is provided, there is total user discretion in selecting the case and topic for assessment. Allowing a breadth of encounters and permitting submission of CEX even when some domains are incomplete makes the tool flexible and encourages high utilisation …”