Validity of Faculty Ratings of Studentsʼ Clinical Competence in Core Clerkships in Relation to Scores on Licensing Examinations and Supervisorsʼ Ratings in Residency

Callahan, Clara A.; Erdmann, James B.; Hojat, Mohammadreza; Veloski, J. Jon; Rattner, Susan L.; Nasca, Thomas J.; Gonnella, Joseph S.

doi:10.1097/00001888-200010001-00023

Cited by 20 publications

(25 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It may be argued that these findings could be due to the influence of the 'halo effect' of personality on competence ratings. Although further research is needed to refute this argument, our previous study on the long-term predictive validity of competence ratings (Callahan et al, 2000) indicates that the influence of the 'halo effect' would not significantly distort the validity of the ratings. Improving our understanding of specific psychosocial attributes that are associated with the assessments of clinical competence has important implications for the selection and counselling of medical students.…”

Section: Discussionmentioning

confidence: 98%

See 1 more Smart Citation

Students' personality and ratings of clinical competence in medical school clerkships: a longitudinal study

Hojat¹,

Callahan²,

Gonnella³

2004

Psychology, Health & Medicine

View full text Add to dashboard Cite

This study was designed to examine the associations between students' personality and assessments of their clinical competence in medical school. A set of questionnaires was completed by 1710 medical students to measure their self-esteem, sociability, loneliness, general anxiety, test anxiety, neuroticism (emotionality), perceptions of early relationships with parents, and general health. Students were divided into three groups of the low, moderate, and high competent based on the number of 'Honours' ratings they received in core clinical clerkships during the third year of medical school. Multivariate statistical analyses showed that the low competent students scored significantly lower on the self-esteem and sociability, but higher on the loneliness scale. The low competent students also perceived their early relationships with their parents as less satisfactory. Findings suggest that medical students' clinical competence assessments are associated with some aspects of their personality and with perceptions of early relationships with their parents. Findings have implications for the development of educational remedies and counseling strategies.

show abstract

Section: Discussionmentioning

confidence: 98%

“…These ratings were completed in each clerkship by faculty, using a 4-point scale ('High Honours,' 'Excellent,' 'Good,' and 'Marginal Competence'). Data on psychometrics of these ratings have been reported (Callahan et al, 2000). 248 M. HOJAT ET AL.…”

Section: Measure Of Clinical Competencementioning

confidence: 99%

Students' personality and ratings of clinical competence in medical school clerkships: a longitudinal study

Hojat¹,

Callahan²,

Gonnella³

2004

Psychology, Health & Medicine

View full text Add to dashboard Cite

show abstract

“…However, a prior study evaluating the predictive validity of student evaluations in basic clerkships on performance for USMLE Step 2 and 3 scores and supervisors' ratings in residency found the strongest association in evaluations from the internal medicine clerkship. 33 This affirms the use of clerkship performance evaluations across a range of skills and to assess change over time. Finally, our analyses are limited by an inability to test for other potential predictor variables, such as clerkship site (location of clerkship) or setting (inpatient vs. outpatient), due to restrictions on data use by Human Subjects considerations.…”

Section: Limitationsmentioning

confidence: 63%

“…[30][31][32] Faculty ratings of students' clinical competence have been predictive of performance on medical licensing examinations and clinical competence ratings in residency. 33 Evaluations at the UWSOM include a final numeric rating on a Likert scale (1-7) for each of 12 clinical skills domains (Table 1). Clinical clerkships at the UWSOM are conducted at clinical sites throughout five states-Washington, Wyoming, Alaska, Montana, and Idaho.…”

Section: Instrumentmentioning

confidence: 99%

Impact of a Pre-Clinical Clinical Skills Curriculum on Student Performance in Third-Year Clerkships

et al. 2009

View full text Add to dashboard Cite

BACKGROUND:Research on the outcomes of preclinical curricula for clinical skills development is needed to assess their influence on medical student performance in clerkships.OBJECTIVE: To better understand the impact of a clinical-skills curriculum in the pre-clinical setting on student performance. DESIGN:We conducted a non-randomized, retrospective, pre-post review of student performance evaluations from 3rd-year clerkships, before and after implementation of a clinical-skills curriculum, the Colleges (2001Colleges ( -2007. MAIN RESULTS:Comparisons of clerkship performance data revealed statistically significant differences favoring the post-Colleges group in the Internal Medicine clerkship for 9 of 12 clinical-skills domains, including Technical Communication Skills (p<0.023, effect size 0.16), Procedural Skills (p<0.031, effect size 0.17), Communication Skills (p<0.003, effect size 0.21), Patient Relationships (p<0.003, effect size 0.21), Professional Relationships (p < 0.021, effect size 0.17), Educational Attitudes (p<0.001, effect size 0.24), Initiative and Interest (p<0.032, effect size 0.15), Attendance and Participation (p<0.007, effect size 0.19), and Dependability (p<0.008, effect size 0.19). Statistically significant differences were identified favoring the postColleges group in technical communication skills for three of six basic clerkships (Internal Medicine, Surgery, and Pediatrics).CONCLUSIONS: Implementation of a pre-clinical fundamental skills curriculum appears to be associated with improved clerkship performance in the 3rd year of medical school, particularly in the Internal Medicine clerkship. Similar curricula, focused on teaching clinical skills in small groups at the bedside with personalized mentoring from faculty members, may improve student performance. Continued efforts are needed to understand how to best prepare students for clinical clerkships and how to evaluate outcomes of similar preclinical skills programs.

show abstract

“…E-mail: woloschu@ucalgary.ca more promising, 6,15 low correlations between the two have also been reported. 16,17 The primary purpose of this study was to determine whether undergraduate performance of our graduates is predictive of their postgraduate performance. In order to study this relationship we first needed to examine the structure of the postgraduate assessment tool.…”

mentioning

confidence: 99%

Is Undergraduate Performance Predictive of Postgraduate Performance?

Woloschuk

McLaughlin

Wright

2010

Teaching and Learning in Medicine

View full text Add to dashboard Cite

show abstract

Validity of Faculty Ratings of Studentsʼ Clinical Competence in Core Clerkships in Relation to Scores on Licensing Examinations and Supervisorsʼ Ratings in Residency

Cited by 20 publications

References 6 publications

Students' personality and ratings of clinical competence in medical school clerkships: a longitudinal study

Students' personality and ratings of clinical competence in medical school clerkships: a longitudinal study

Impact of a Pre-Clinical Clinical Skills Curriculum on Student Performance in Third-Year Clerkships

Is Undergraduate Performance Predictive of Postgraduate Performance?

Contact Info

Product

Resources

About