BackgroundAlthough Peyton’s four-step approach is a widely used method for skills-lab training in undergraduate medical education and has been shown to be more effective than standard instruction, it is unclear whether its superiority can be attributed to a specific single step.PurposeWe conducted a randomized controlled trial to investigate the differential learning outcomes of the separate steps of Peyton’s four-step approach.MethodsVolunteer medical students were randomly assigned to four different groups. Step-1 group received Peyton’s Step 1, Step-2 group received Peyton’s Steps 1 and 2, Step-3 group received Peyton’s Steps 1, 2, and 3, and Step-3mod group received Peyton’s Steps 1 and 2, followed by a repetition of Step 2. Following the training, the first independent performance of a central venous catheter (CVC) insertion using a manikin was video-recorded and scored by independent video assessors using binary checklists. The day after the training, memory performance during delayed recall was assessed with an incidental free recall test.ResultsA total of 97 participants agreed to participate in the trial. There were no statistically significant group differences with regard to age, sex, completed education in a medical profession, completed medical clerkships, preliminary memory tests, or self-efficacy ratings. Regarding checklist ratings, Step-2 group showed a superior first independent performance of CVC placement compared to Step-1 group (P<0.001), and Step-3 group showed a superior performance to Step-2 group (P<0.009), while Step-2 group and Step-3mod group did not differ (P=0.055). The findings were similar in the incidental free recall test.ConclusionOur study identified Peyton’s Step 3 as being the most crucial part within Peyton’s four-step approach, contributing significantly more to learning success than the previous steps and reaching beyond the benefit of a mere repetition of skills demonstration.
BackgroundThe Objective Structured Clinical Examination (OSCE) is increasingly used at medical schools to assess practical competencies. To compare the outcomes of students at different medical schools, we introduced standardized OSCE stations with identical checklists.MethodsWe investigated examiner bias at standardized OSCE stations for knee- and shoulder-joint examinations, which were implemented into the surgical OSCE at five different medical schools. The checklists for the assessment consisted of part A for knowledge and performance of the skill and part B for communication and interaction with the patient. At each medical faculty, one reference examiner also scored independently to the local examiner. The scores from both examiners were compared and analysed for inter-rater reliability and correlation with the level of clinical experience. Possible gender bias was also evaluated.ResultsIn part A of the checklist, local examiners graded students higher compared to the reference examiner; in part B of the checklist, there was no trend to the findings. The inter-rater reliability was weak, and the scoring correlated only weakly with the examiner’s level of experience. Female examiners rated generally higher, but male examiners scored significantly higher if the examinee was female.ConclusionsThese findings of examiner effects, even in standardized situations, may influence outcome even when students perform equally well. Examiners need to be made aware of these biases prior to examining.Electronic supplementary materialThe online version of this article (doi:10.1186/s12909-017-0908-1) contains supplementary material, which is available to authorized users.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.