African Journal of Psychiatry • March 2012
119
IntroductionWithin medical education throughout the world's universities, there are several means of evaluating student performance in examinations. These include written and oral examinations as well as objective structured clinical/practical examinations (OSCE/OSPE). 1,2 Health Sciences faculties in South Africa favour oral and OSCE/OSPE type examinations. Both of these modalities have specific advantages and disadvantages. OSC(P)E is a competence based examination that has been shown in many medical settings to assess clinical skills and knowledge in a reliable and valid fashion, a reflection of how communication skills are taught to medical students. In this method, learners are assessed by direct observation of their ability to communicate with simulated patients. The standardized evaluation setting in which this takes place reflects real life clinical encounters and the context of situations or problems that learners will encounter in actual medical practice. OSC(P)Es vary in length and scoring is done with a task specific checklist or a combination of checklists and rating scales. Studies exploring the link between OSCE and student performance have produced varying results. While some 3,4 have shown that OSC(P)Es have the ability to predict future postgraduate performance and that they motivate students to actively improve their clinicial skills others There are several methods of evaluating medical students' performance, such as written examination, oral examination and objective structured clinical examination (OSCE). Many studies have focused on the reliability and validity of these methods but few studies have explored comparison between these methods. Psychiatry is the only subject at the University of Stellenbosch where the final assessment consists of solely an oral component. The aim of the study was to compare students' final overall and discipline specific examination marks (i.e. in the other subjects) with the examination marks in psychiatry, and to determine if content or structure (e,g. oral, written or OSCE format) of examination impacts more on the student performance in the examination. Method: 343 final year medical students were included. All undertook their psychiatry rotation at the University of Stellenbosch, South Africa during 2008 and 2009. Data of marks obtained in all the disciplines during 2008 and 2009 were collected and class marks were compared with their final examination marks across all disciplines. Bland-Altman plots were used to assess the level of agreement between the class and examination marks. Cases below the lower threshold were compared to all other cases across all disciplines. The odds ratio for group status was calculated for gender distribution of examiners. Results: The psychiatry class mark and final oral examination mark provided similar measures within a width of 31.5. Cases below the threshold had poorer performance in two other disciplines. The gender distribution of the examiners (female-female) significant...