Assessing Competency in Family Medicine Residents Using the Osteopathic Manipulative Medicine Mini-Clinical Evaluation Exercise

Abstract

Context: The Mini-Clinical Evaluation Exercise (Mini-CEX) is one example of a direct observation tool used for workplace-based skills assessment. The Mini-CEX has been validated as a useful formative evaluation tool in graduate medical education. However, no Mini-CEX has been reported in the literature that specifically assesses the osteopathic manipulative medicine (OMM) skills of family medicine residents. Therefore, the authors created and studied an OMM Mini-CEX to fill this skills assessment gap. Objective: To determine whether the OMM Mini-CEX is perceived as an effective evaluation tool for assessing the OMM core competencies of family medicine residents. Methods: Faculty and residents of The Wright Center for Graduate Medical Education National Family Medicine Residency program participated in the study. Each resident was evaluated at least once using the OMM Mini-CEX. Surveys were used to assess faculty and resident perceptions of the usefulness and effectiveness of the OMM Mini-CEX for assessing OMM competencies. Results: Eighty-one responses were received during 2 survey cycles within a 7-month period. The internal consistency of the survey responses had a high reliability (Cronbach α=0.93). Considering respondents who agreed that they had a clear understanding of the general purpose of a Mini-CEX, the perceived effectiveness score for the OMM Mini-CEX was higher among those who agreed that a Mini-CEX was a useful part of training than among those who disagreed or were unsure of its usefulness (median score, 4.0 vs 3.4, respectively; P=.047). Conclusions: The results suggest the OMM Mini-CEX can be a useful direct observation evaluation tool to assess OMM core competencies in family medicine residents. Additional research is needed to determine its perceived effectiveness in other clinical specialties and in undergraduate medical education.

Competence-Based Assessment Tools in Family and Community Medicine Residence: Integrative Review

“…For LeBeau et al (2019), six essential competencies must be evaluated during the training of residents: 1-medical knowledge, 2-patient care and procedural skills, 3interpersonal and communication skills, 4professionalism, 5-learning and improvement based on practice, and 6-systems-based practice. The author states that direct observation tools are a great way to assess these clinical skills, mainly because they are able to assess the student in real moments of direct contact with the patient.…”

“…The student is ranked according to their performance in the different dimensions of competences and then receives immediate feedback on their performance. (LEBEAU et al, 2019). LeBeau et al (2019) cite as an example a medical residency program that uses 2 forms per month as an evaluation form, totaling 16 forms per year.…”

“…(LEBEAU et al, 2019). LeBeau et al (2019) cite as an example a medical residency program that uses 2 forms per month as an evaluation form, totaling 16 forms per year. Each form can be used to fulfill the desired requirement, and there are several categories, such as: breast assessments, neurological assessments, pelvic exams, psychiatric assessments and others.…”

“…This assessment method differs from a traditional practical assessment in several respects, mainly due to the duration -while in the first one the student is evaluated in a consultation that would last more than an hour, with Miniex the student is evaluated during a specific consultation, goal, with a maximum duration of 15 minutes. (LEBEAU et al, 2019). This short period allows this tool to be repeated more than once throughout the year.…”

Application of modified mini‐clinical evaluation exercise in the cultivation of orthopaedic students

“…Clinical skill tests should include doctor–patient communication and assessment items such as operating norms and skills. Lawrence 8 further developed the OMM Mini‐CEX, which was based on the original Mini‐CEX, to evaluate the orthopaedic operation skills of family doctors. Therefore, improving the surgical department's Mini‐CEX and increasing operation assessment projects became vital.…”