An innovative evaluation method in an internal medicine clerkship

Speer, Alice J.; Solomon, David; Ainsworth, Michael

doi:10.1097/00001888-199601000-00048

Cited by 29 publications

(25 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, groups also were more liberal in their rating criteria. On the other hand, Speer and colleagues 78 found that grades assigned to medical students on an internal medicine clerkship were lower and closer to the faculty-stated appropriate average grade for clerks when the grades were assigned after a group discussion by faculty. These investigators attributed this difference to committee impartiality compared to individual faculty observers who worked with the students regularly on their internal medicine clerkship.…”

Section: Influence By Other Evaluatorsmentioning

confidence: 97%

“…Speer et al 78 reported on their efforts to modify the clinical rating process in an internal medicine clerkship toward the goal of reducing grade inflation. In the original grading system, the average grade assigned to students by preceptors was an A.…”

Section: Inflation Of Ratingsmentioning

confidence: 99%

“…Finally, available evidence suggests that groups are more likely to make unpopular promotion decisions than are individual raters making decisions in isolation. 78,79 However, some physicians are reluctant to use a group process for fear that a person with a strong view will unduly sway the opinions of others. There is no evidence on this issue one way or the other.…”

Section: Consider Making Promotion and Grading Decisions Via A Group mentioning

confidence: 99%

See 2 more Smart Citations

SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance Ratings

Williams¹,

Klamen²,

McGaghie³

2003

Teaching and Learning in Medicine

348

250

View full text Add to dashboard Cite

show abstract

Section: Influence By Other Evaluatorsmentioning

confidence: 97%

Section: Inflation Of Ratingsmentioning

confidence: 99%

Section: Consider Making Promotion and Grading Decisions Via A Group mentioning

confidence: 99%

See 1 more Smart Citation

SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance Ratings

Williams¹,

Klamen²,

McGaghie³

2003

Teaching and Learning in Medicine

348

250

View full text Add to dashboard Cite

show abstract

“…Create Objectivity There was broad consensus that the criteria provided in the milestones were more helpful than traditional, normative scales, ranging from unsatisfactory (1-3) to superior (7)(8)(9). Many agreed that faculty too often used the high end of such scales, limiting their ability to stratify residents.…”

Section: Behavioral Anchors Help With Discrimination Andmentioning

confidence: 99%

Early Feedback on the Use of the Internal Medicine Reporting Milestones in Assessment of Resident Performance

Aagaard¹,

Kane²,

Conforti³

et al. 2013

Journal of Graduate Medical Education

View full text Add to dashboard Cite

Background The educational milestones were designed as a criterion-based framework for assessing resident progression on the 6 Accreditation Council for Graduate Medical Education competencies. Objective We obtained feedback on, and assessed the construct validity and perceived feasibility and utility of, draft Internal Medicine Milestones for Patient Care and Systems-Based Practice. Methods All participants in our mixed-methods study were members of competency committees in internal medicine residency programs. An initial survey assessed participant and program demographics; focus groups obtained feedback on the draft milestones and explored their perceived utility in resident assessment, and an exit survey elicited input on the value of the draft milestones in resident assessment. Surveys were tabulated using descriptive statistics. Conventional content analysis method was used to assess the focus group data. Results Thirty-four participants from 17 programs completed surveys and participated in 1 of 6 focus groups. Overall, the milestones were perceived as useful in formative and summative assessment of residents. Participants raised concerns about the length and complexity of some draft milestones and suggested specific changes. The focus groups also identified a need for faculty development. In the exit survey, most participants agreed that the Patient Care and Systems-Based Practice Milestones would help competency committees assess trainee progress toward independent practice. Conclusions Draft reporting milestones for 2 competencies demonstrated significant construct validity in both the content and response process and the perceived utility for the assessment of resident performance. To ensure success, additional feedback from the internal medicine community and faculty development will be necessary.

show abstract

“…[5][6][7][8] Unfortunately, DECs, along with other forms of WBAs, do not always reflect the assessor's actual judgment of the trainee's performance. [9][10][11][12] Interventions to improve the quality of completion of WBAs have been designed, including faculty development workshops and rater training initiatives. [13][14][15] To evaluate the effectiveness of these interventions, a tool is needed that can measure outcomes beyond participant satisfaction.…”

Section: Introductionmentioning

confidence: 99%