Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training

Jefferies, Ann L; Simmons, Brian; Tabak, Diana; McIlroy, Jodi Herold; Lee, Kyong-Soon; Roukema, Henry; Skidmore, Martin

doi:10.1080/01421590701302290

Cited by 73 publications

(70 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It has been viewed as the cornerstone of health care professional assessment for a number of years as it provides a standardised approach to assessment (Byrne and Smyth, 2008;Rushforth, 2007;Jefferies et al, 2007). However there are a number of limitations to this form of assessment for non-medical prescribing students.…”

Section: Osce and 'Live' Practice Based Assessmentmentioning

confidence: 99%

Non-medical prescribing assessment – An evaluation of a nationally agreed multi method approach

Paterson

Redman

Unwin

et al. 2016

Nurse Education in Practice

View full text Add to dashboard Cite

Section: Osce and 'Live' Practice Based Assessmentmentioning

confidence: 99%

Non-medical prescribing assessment – An evaluation of a nationally agreed multi method approach

Paterson

Redman

Unwin

et al. 2016

Nurse Education in Practice

View full text Add to dashboard Cite

“…Much excellent work has been accomplished in this field in other domains of medical education. 15,16 Surgical residents are rarely observed or evaluated when they are doing histories and physical examinations, talking to patients about ethical issues, or discussing the risks and gains of surgical treatment. It is unusual for a senior surgeon to observe a resident in any interaction with patients other than performing operations or procedures.…”

Section: Commentsmentioning

confidence: 99%

The formal and informal surgical ethics curriculum: views of resident and staff surgeons in Toronto

Howard

McKneally

Upshur

et al. 2012

The American Journal of Surgery

View full text Add to dashboard Cite

“…23,24 An OSCE has also been used to assess multiple CanMEDS competencies in other fields of postgraduate training, such as radiology and neonatology. 6,25 To our knowledge, no research exists regarding methods of assessing the intrinsic roles in orthopedic postgraduate training. We hypothesized that an OSCE designed to assess multiple intrinsic CanMEDS roles would have sufficient reliability and validity to distinguish between different years of postgraduate training in orthopedic residents.…”

mentioning

confidence: 99%

“…4 A survey of a wide variety of medical and surgical program directors in Canada identified that the ITER is the most commonly used method to evaluate the CanMEDS roles, despite its acknowledged subjective nature. [5][6][7] Respondents reported dissatisfaction with current methods of evaluating the intrinsic roles, especially the manager and health advocate roles.…”

mentioning

confidence: 99%

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE)

Dwyer

Takahashi

Hynes

et al. 2014

cjs

View full text Add to dashboard Cite

Background: Assessing residents' understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid. Methods:The OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs).Results: Twenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores. Conclusion:An OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program.Contexte : Évaluer la compréhension et l'application des 6 rôles intrinsèques Can-MEDS (communicateur, professionnel, gestionnaire, collaborateur, promoteur de la santé, érudit) chez les résidents pose un défi pour les responsables de la formation médi-cale postdoctorale. Nous avons émis l'hypothèse selon laquelle un examen clinique objectif structuré (ECOS) conçu pour évaluer plusieurs rôles CanMEDS intrinsèques serait suffisamment fiable et valide.Méthodes : L'ECOS comportait 6 stations de 10 minutes, permettant chacune d'évaluer 2 rôles intrinsèques à l'aide de scénarios basés sur des cas (avec ou sans recours à des patients standardisés). Les résidents ont été notés au moyen d'échelles en 5 points et d'une évaluation globale de leur rendement à chacune des stations. La validité convergente a été vérifiée par corrélation avec les rapports d'évaluation en cours de formation (RÉF) des 12 mois précédents et un classement chiffré créé par les directeurs du programme (DP).Résultats: Vingt-cinq résidents des années 0, 3 et 5 y ont participé. La fiabilité interstation pour les scores totaux aux tests (en pourcentage) a été de 0,87, tandis que la fiabilité pour chacun des rôles de communicateur, collaborateur, gestionnaire et professionnel, a été supérieure à 0,8. Les scores totaux aux tests, les scores aux stations individuelles et les scores pour les rôles CanMEDS indivi...

show abstract

Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training

Abstract: The OSCE may be useful as a reliable and valid method of simultaneously assessing multiple physician competencies.

Cited by 73 publications

References 19 publications

Non-medical prescribing assessment – An evaluation of a nationally agreed multi method approach

Non-medical prescribing assessment – An evaluation of a nationally agreed multi method approach

The formal and informal surgical ethics curriculum: views of resident and staff surgeons in Toronto

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE)

Contact Info

Product

Resources

About