The interrater reliability of an objective structured practical examination in measuring the clinical reasoning ability of chiropractic students

Abstract

Objective: The objective structured practical examination (OSPE) is a case-based assessment that can be used to assess the clinical reasoning ability of students. The reliability of using an OSPE for this purpose has not been reported in the literature. The objective of this study was to determine the interrater reliability of the OSPE in measuring the clinical reasoning ability of chiropractic students. Methods: Two examiners tested each student simultaneously when enough were available as a check for interrater reliability. The scores for students over 4 exam administrations were compiled, and we calculated an intraclass correlation coefficient (ICC) using 1-way random single measures. Results: Paired scores were available for 133 students. The ICC was .685, showing a fair-to-good level of agreement for faculty in assessing the clinical reasoning ability of chiropractic students using an OSPE. Conclusion: The OSPE can be a valuable tool for testing clinical reasoning abilities because it can simulate the decision-making process that needs to be implemented in clinical practice. Faculty members at our chiropractic college were able to achieve an acceptable level of reliability in measuring the clinical reasoning abilities of students using an OSPE. Other health professional programs may consider using this tool for assessing the clinical reasoning skills of their students.

An Educational Experiment in Parasitology Implemented on Preclinical Medical Students in Discipline-Based and Integrated Programs at AFCM

“…Each commentary station was based on a clinical vignette that was formulated to relate the presented parasitic specimen to a clinical/laboratory/epidemiologic setting, attached example (1.c). This was conducted to prepare the students for clinical reasoning [18]. Being in the preclinical phase, student performance was identified on items with clinical stem, and the percentage of students who correctly answered each item was determined [19].…”

The Validity and Reliability of Developing Assessment Instruments for Students in Electrical Installation and Maintenance Work: Concentration on Psychomotor Skills Assessment

“…As learning outcomes that a student has gained at the conclusion (or as a result of) his or her participation in a specific set of learning experiences, mastery of knowledge and skills can be considered. Roy (2014) asserts that learning outcomes are more concerned with student accomplishments than instructor intentions (represented in the goals of a module or course). According to Lile & Bran (2014), the need that society has expressed to acquire skilled graduates in a variety of domains of activity has increased the concern for the assessment of learning outcomes in the present.…”

Educator's Learning Alignment Instrument (ELAI):

“…[15][16][17][18] Learning how to think through problems and organize information (cognitivism) is an important part of developing diagnostic and clinical decision-making skills. 19,20 Experiential learning occurs through several mechanisms, including internships. 18,21 These disparate types of learning, which may occur simultaneously, require different learning activities and assessment methods.…”