No abstract

BackgroundEducating doctors is expensive and poor performance by future graduates can literally cost lives. Whilst the practice of medicine is highly evidence based, medical education is much less so. Research on medical school selection, undergraduate progression, Fitness to Practise (FtP) and postgraduate careers has been hampered across the globe by the challenges of uniting the data required. This paper describes the creation, structure and access arrangements for the first UK-wide attempt to do so.OverviewA collaborative approach has created a research database commencing with all entrants to UK medical schools in 2007 and 2008 (UKMED Phase 1). Here the content is outlined, governance arrangements considered, system access explained, and the potential implications of this new resource discussed. The data currently include achievements prior to medical school entry, admissions tests, graduation point information and also all subsequent data collected by the General Medical Council, including FtP, career progression, annual National Training Survey (NTS) responses, career choice and postgraduate exam performance data. UKMED has grown since the pilot phase with additional datasets; all subsequent years of students/trainees and stronger governance processes. The inclusion of future cohorts and additional information such as admissions scores or bespoke surveys or assessments is now being piloted. Thus, for instance, new scrutiny can be applied to selection techniques and the effectiveness of educational interventions. Data are available free of charge for approved studies from suitable research groups worldwide.ConclusionIt is anticipated that UKMED will continue on a rolling basis. This has the potential to radically change the volume and types of research that can be envisaged and, therefore, to improve standards, facilitate workforce planning and support the regulation of medical education and training. This paper aspires to encourage proposals to utilise this exciting resource.

ObjectivesCurrently relative performance at medical school (educational performance measure (EPM) decile), additional educational achievements and the score on a situational judgement test (SJT) are used to rank applicants to the UK Foundation Years postgraduate medical training programme. We sought to evaluate whether these three measures were predictive of subsequent successful completion of the programme, and thus were valid selection criteria.MethodsData were obtained from the UK Medical Education Database (UKMED) on 14 131 UK applicants to the foundation programme starting in 2013 and 2014. These data included training outcomes in the form of Annual Reviews of Competency Progression (ARCPs), which indicated whether the programme was successfully completed. The relationship between applicants’ performance on the three selection measures to the odds of successful programme completion were modelled.ResultsOn univariable analyses, all three measures were associated with the odds of successful completion of the programme. Converting the SJT score to deciles to compare the effect sizes suggested that one decile increase in the EPM increased the odds of completing the programme by approximately 15%, whereas the equivalent value was 8% for the SJT scores. On multivariable analyses (with all three measures included in the model), these effects were only independently and statistically significant for EPM decile (OR 1.14, 95% CI 1.10 to 1.18, p<0.001) and SJT z-score decile (OR 1.05, 95% CI 1.01 to 1.09, p=0.02).ConclusionsThe EPM decile and SJT scores may be effective selection measures for the foundation programme. However, educational achievements does not add value to the other two measures when predicting programme completion. Thus, its usefulness in this context is less clear. Moreover, our findings suggest that the weighting for the EPM decile score, relative to SJT performance, should be increased.

Background: Gateway courses are increasingly popular widening participation routes into medicine. These six year courses provide a more accessible entry route into medical school and aim to support under-represented students' progress and graduation as doctors. There is little evidence on the performance of gateway students and this study compares attainment and aptitude on entry, and outcomes at graduation of students on the UK's three longest running gateway courses with students studying on a standard entry medical degree (SEMED) course at the same institutions. Methods: Data were obtained from the UK Medical Education Database for students starting between 2007 and 2012 at three UK institutions. These data included A-levels and Universities Clinical Aptitude Test scores on entry to medical school and the Educational Performance Measure (EPM) decile, Situational Judgement Test (SJT) and Prescribing Safety Assessment (PSA) scores as outcomes measures. Multiple regression models were used to test for difference in outcomes between the two types of course, controlling for attainment and aptitude on entry. Results: Four thounsand three hundred forty students were included in the analysis, 560 on gateway courses and 3785 on SEMED courses. Students on SEMED courses had higher attainment (Cohen's d = 1.338) and aptitude (Cohen's d = 1.078) on entry. On exit SEMED students had higher EPM scores (Cohen's d = 0.616) and PSA scores (Cohen's d = 0.653). When accounting for attainment and aptitude on entry course type is still a significant predictor of EPM and PSA, but the proportion of the variation in outcome explained by course type drops from 6.4 to 1.6% for EPM Decile and from 5.3% to less than 1% for the PSA score. There is a smaller significant difference in SJT scores, with SEMED having higher scores (Cohen's d = 0.114). However, when measures of performance on entry are accounted for, course type is no longer a significant predictor of SJT scores. Conclusions: This study shows the differences of the available measures between gateway students and SEMED students on entry to their medical degrees are greater than the differences on exit. This provides modest evidence that gateway courses allow students from under-represented groups to achieve greater academic potential.

No abstract