Use of Peer Ratings to Evaluate Physician Performance

Difficulty giving feedback on underperformance undermines the educational value of multi-source feedback

“…The 'gaming' behaviour reported by study participants, in which they selected raters perceived to be sympathetic 'doves', raises the potential that this could bias the process. One of the first MSF studies suggested that results were not affected by selection of raters by subjects compared with selection by their supervisors (Ramsey 1993). However, more recently, a study of MSF scores of doctors referred to the UK National Clinical Assessment Service (NCAS) found that scores were significantly lower when the MSF process was repeated with rater selection by the referring body, rather than by the subject themselves (Archer & McAvoy 2011).…”

“…The validity, reliability and feasibility of MSF have been extensively examined (Ramsey et al 1993;Archer et al 2005;Campbell et al 2008;Davies et al 2008;Wilkinson et al 2008;Mackillop et al 2011), in part to satisfy the needs of regulatory stakeholders such as the GMC and Joint Royal Colleges of Physicians Training Board. However, there is a relative lack of evidence regarding the acceptability of MSF from a trainee perspective and, importantly, whether MSF achieves its intended educational purposes for its learner stakeholders.…”

Effect of Multisource Feedback on Resident Communication Skills and Professionalism

“…While the current study used a research assistant to collect data, there is evidence to suggest that physician self-selection of raters does not bias results. 9 Construction of an economical and efficient data collection infrastructure is essential if residency programs are to have sustained success with multisource feedback.…”

“…8 Multisource feedback has been used to reliably evaluate communication skills and professionalism among practicing physicians and residents in a variety of medical settings. [9][10][11] Also known as 360°feedback, multisource feedback is a questionnaire-based assessment that gathers perspectives from several people within one's sphere of influence, as well as self-assessment. 12 To varying degrees, physicians are willing to accept feedback from multiple sources and contemplate or initiate change as a result.…”

Erfahrungen mit Methoden der systematischen Kompetenzdarlegung und Rezertifizierung in der Medizin in Kanada

“…Er füllt den Bo gen zur Selbs t eva lua ti on aus und ver teilt Fra ge bö gen an 25 Pa ti en ten, 8 Arzt kol le gen so wie 8 Ange hö ri ge nicht-ärzt li cher Ge sund heits beru fe. Die nahe lie gen de An nah me, dass die Aus wahl durch den Arzt selbst zu einer po si ti ven Ver zer rung der Er geb nis se führt, trifft nach bis he ri gen Er kennt nissen nicht zu [42]. Denk bar sind an dieser Stel le je doch be trü ge ri sche Ma ni pu latio nen in Form di rek ter Ein fluss nah men auf die Per so nen, die zur Be ur tei lung ausge wählt wer den.…”