Evaluation of Postgraduate Dental Specialty Residents: A Survey of Program Directors

Abstract

The professional dental literature is lacking in information concerning the use of technology in evaluation procedures utilized in postgraduate dental education. The purpose of this study was to identify the methods of evaluation of U.S. postgraduate specialty residents currently in place. The study also sought to determine if there were any patterns among programs more likely to utilize electronic submission in the evaluation process. An electronic survey consisting of eighteen questions was sent to the program directors of all accredited U.S. dental specialty programs (n=416). The survey yielded 150 responses, for a 36 percent response rate. The results showed that the majority of responding program directors (68 percent) evaluate their residents using a hardcopy evaluation instrument, while a minority of directors (32 percent) reported using an electronic evaluation instrument. The majority of respondents (58 percent) said they require faculty members to formally evaluate residents semiannually. Fifty percent of responding program directors reported a need for improvement in their current evaluation system. Those reporting a need for improvement were less likely to be using an electronic format. There was no statistical signiicance between faculty responsiveness and the mode of evaluation used. With many program directors reporting room for improvement in their current evaluation system, innovation in the evaluation systems of postgraduate dental education is needed.

An overview of current evaluation methods of postgraduate dental specialty residents

“…These findings contradict a previously reported finding by Jolly et al, which suggested a lack of evaluation practices in some programs. 3 The CODA requirements for each of the 14 postgraduate dental specialties accredited by the CODA was reviewed prior to this study, affirming that some form of resident assessment/evaluation be performed as part of program's accreditation. 10 The inclusion of CODA requirements and the prior review of accreditation standards emphasize the commitment of programs to incorporating evaluation as part of their accreditation process.…”

“…The study questions were modified to address the goals of this study. 3 The new survey was piloted to two program directors, and refined based on their evaluation. Survey participation was anonymous, voluntary, no monetary benefit was offered, and the privacy of the respondents protected.…”

“…2 Despite the obvious benefits of strong evaluative practices, such as early identification of deficiencies along with corrective guidance, previous literature suggests the assessment of trainees is frequently inadequate or nonexistent. 3 Over the years, research has been conducted to understand the various aspects of performance evaluations, with particular emphasis on the content of the assessment itself. The existing literature emphasizes the need for a competency-driven model that encompasses a wider range of evaluations, focusing on real-world work experiences and interactions with patients.…”

“…An existing study even demonstrated that a majority of postgraduate dental specialty programs were still utilizing physical paper evaluations for faculty colleagues to assess their residents' performance. 3 While technological advancements have revolutionized various aspects of dentistry, including clinical practice and education, a thorough PubMed search utilizing keywords such as "dental resident evaluation," "dental residency evaluation," "dental resident feedback," and "graduate dental education" yielded no existing literature that touches upon the extent to which novel evaluation software is being utilized to assess resident performance and improve standardization. The integration of innovative evaluation tools has the potential to enhance objectivity, efficiency, and consistency in evaluating resident performance.…”

“…In the final stages of a student doctor's education, the evaluation process plays a critical role in facilitating a resident's optimal development 2 . Despite the obvious benefits of strong evaluative practices, such as early identification of deficiencies along with corrective guidance, previous literature suggests the assessment of trainees is frequently inadequate or nonexistent 3 …”