Developing a Scoring Rubric for Resident Research Presentations: A Pilot Study

The Development of a Competency-Based Assessment Rubric to Measure Resident Milestones

“…Within the health professions, rubrics have been used for assessing literature review skills, 9 grading papers, 20 assessing presentations, 21,22 improving the quality of online courses, 23 participating in online discussions, 24 determining clinical performance in the operating room, 16 and measuring skill development of aseptic techniques. 25 Overall, rubrics promote consistency in scoring, encourage selfimprovement and self-assessment, motivate learners to achieve the next level, provide timely feedback, and improve instruction.…”

‘And the Winner is…’– a scoring rubric for grading surgical oral presentations: how we do it

“…Musial et al. 3 looked at scoring resident research presentations under the five headlines (literature search, hypothesis/aim/objective, statistical analysis, presentation skills and personal conduct), each graded 1–3. Their mean score was 16.6 (of a maximum 25), while the mean in this study was very similar at 34.45 and 35.69 (out of a maximum 50) for consultants and trainees, respectively.…”

“…The reliability of ratings across evaluators may be influenced by excessively harsh/lenient reviews and by the halo effect (where biased ratings are given owing to an overall impression of the presenter). Few guidelines exist, and the perfect scoring system remains elusive 3 …”

Rubric Evaluation of Pediatric Emergency Medicine Fellows

“…The scoring rubric is a method of assessment that has been extensively studied and is gaining recognition in professional education. 10,[14][15][16][17][18][19][20][21][22][23][24][25] It uses specified evaluation criteria and proficiency levels to gauge student achievement; each point on a fixed scale is described by a list of performance characteristics. 10,[26][27][28] Rubrics can aid teachers in the measurement of ''products, progress, and the process of learning,'' 26(p2) as well as provide clear performance targets.…”

“…27,28 Advantages associated with well-written rubrics include their relative ease of use by instructors and learners, their ability to provide informative feedback to students, their consistency in scoring, their ability to facilitate communication between evaluators and learners, their support for learner self-assessment and skill development, and their familiarity to physician evaluators (Apgar Score and the Glasgow Coma Scale). 10,15,16 The challenges with rubrics are related to the development process in which criteria for evaluation are identified, levels of performance are described, and definitive examples of performance at various levels are written in measurable terms. 27 Appropriately designed scoring rubrics with objective criteria and strong psychometric properties have benefits as an assessment method for evaluating resident physicians' acquisition of competencies and providing them with both formative and summative evaluations.…”