Simplifying the 360-Degree Peer Evaluation in a Physical Medicine and Rehabilitation Residency Program

Abstract

The factor analysis suggests that one overall opinion of the evaluated resident was informing the responses of the evaluator. Shortening the instrument to the three items responsible for the greatest influence on the survey does not result in a large decrease in reliability as measured by Cronbach alpha. It is possible that time limitations prevent residents from putting thought into the evaluation of their peers, which results in unidimensional responses. Shortening the instrument may improve evaluations and should be studied in the future.

Development of the Objective, Structured Communication Assessment of Residents (OSCAR) Tool for Measuring Communication Skills With Patients

“…30 Individuals evaluating residents using 360-degree surveys may not have much time to actually observe the resident's communication skills in challenging situations. 30 Additionally, feedback to residents and program directors from 360-degree evaluations is often delayed, and our approach to assessing communication skills provided for real-time feedback.…”

“…Ratings on 360-degree evaluations are often unidimensional in that raters give an overall impression rather than differentiate areas of specific competence. 30,31 With 360-degree evaluations, there is often a substantial burden in collecting, managing, and reporting data collected from the comprehensive set of persons interacting with residents. 30 Individuals evaluating residents using 360-degree surveys may not have much time to actually observe the resident's communication skills in challenging situations.…”

“…30,31 With 360-degree evaluations, there is often a substantial burden in collecting, managing, and reporting data collected from the comprehensive set of persons interacting with residents. 30 Individuals evaluating residents using 360-degree surveys may not have much time to actually observe the resident's communication skills in challenging situations. 30 Additionally, feedback to residents and program directors from 360-degree evaluations is often delayed, and our approach to assessing communication skills provided for real-time feedback.…”

Multi-observer Assessment of Trainee Dentists

“…It is widely used in Europe and America (1)(2)(3)(4) and has recently been adopted in Japan (5,6). In the medical field, multi-observer assessment is employed to provide formative feedback during regular one-on-one meetings in order to increase the professional competence (integration of capacity and ambition) of medical residents (1,4,5,7,8), but it is rarely used in dentistry. This report describes multiobserver assessment of the performance of trainee dentists at training facilities.…”

“…Multi-observer assessment (360-degree assessment) involves the assessment of a personʼs work behavior by more than one colleague at the same time for the purpose of human resource development and capacity building (1)(2)(3)(4)(5). It is widely used in Europe and America (1)(2)(3)(4) and has recently been adopted in Japan (5,6).…”