Validity, reliability and acceptability of Professionalism Mini-Evaluation Exercise (P-MEX) for emergency medicine residency training

Amirhajlou, Leila; Bidari, Ali; Alipour, Fateme; Yaseri, Mehdi; Vaziri, Samira; Rezai, Mahdi; Tavakoli, Nader; Farsi, Davood; Yasinzadeh, Mohammadreza; Mosaddegh, Reza; Hashemi, Akram

doi:10.18502/jmehm.v12i12.1641

Cited by 10 publications

(16 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Before commencing the research, we determined the clinics and residents to participate in the study, P-MEX evaluators, and when and how many times P-MEX assessments would be undertaken, and all the study stages were in compliance with these prede ned protocols. In this regard, our research differs from previous studies (20)(21)(22)(23).…”

Section: Discussioncontrasting

confidence: 90%

“…Similarly, in the original P-MEX study, the major limitation of the instrument was reported to be the time-consuming nature of observing students, recording results, and providing feedback (20). In a study from Iran, it was emphasized that P-MEX assessment and feedback were negatively affected during peak hours in emergency clinics (23). In another P-MEX study conducted with residency students in Singapore, 113 (34%) of the 333 participants stated that the instrument was too long to administer (28).…”

Section: Discussionmentioning

confidence: 99%

“…To date, the validation of the P-MEX instrument has been undertaken in two cultures: Japanese and Iranian (21)(22)(23). Another study showed a correlation between the P-MEX evaluations performed before residency and at the end of the rst residency year were correlated (24).…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Adaptation of the Professionalism Mini- Evaluation Exercise Instrument Into Turkish: A Validity and Reliability Study

Taşçı

Akdeniz

Gülpınar

et al. 2023

Preprint

View full text Add to dashboard Cite

Background There is an ongoing search for standardized scales appropriate for each culture to evaluate professionalism, which is one of the basic competencies of a physician. The Professionalism Mini-evaluation Exercise (P-MEX) instrument measures professionalism that was developed in Canada. This study aimed to adapt P-MEX into Turkish and evaluate the validity and reliability of the Turkish version. Methods A total of 58 resident students at Bakirkoy Dr. Sadi Konuk Training and Research Hospital were assessed with the Turkish version of P-MEX by 24 raters consisting of faculty members, attending physicians, peer residents, and nurses during patient room visits and outpatient clinic and group practices. For construct validity, the confirmatory factor analysis through structural equation modeling was performed. For reliability, a decision study were undertaken, and Cronbach’s alpha scores were calculated. After the administration of P-MEX was completed, the participants were asked to provide feedback on the acceptability, feasibility, and educational impact of the instrument. Results A total of 696 forms were obtained from the administration of P-MEX. The content validity of P-MEX was found to be appropriate by the faculty members. In the confirmatory factor analysis of the original structure of the 24-item Turkish scale, the goodness-of-fit parameters were calculated as follows: CFI = 0.675, TLI = 0.604, and RMSEA = 0.089. In the second stage, the factors on which the items loaded were changed without removing any item, and the model was modified. For the modified model, the CFI, TLI, and RMSEA values were calculated as 0.857, 0.834, and 0.057, respectively. The decision study on the results obtained from the use of P-MEX in a Turkish population revealed the necessity to perform this evaluation 18 times to correctly evaluate professionalism with this instrument. Cronbach’s alpha score was 0.844. All the faculty members provided positive feedback on the acceptability, feasibility, and educational impact of the adapted P-MEX. Conclusion The findings of this study showed that the Turkish version of P-MEX had sufficient validity and reliability in assessing professionalism among resident students. Similarly, the acceptability and feasibility of the instrument were found to be high, and it had a positive impact on education. Trial registration: 2020/249, Bakirkoy Dr. Sadi Konuk Training and Research Hospital

show abstract

Section: Discussioncontrasting

confidence: 90%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Adaptation of the Professionalism Mini- Evaluation Exercise Instrument Into Turkish: A Validity and Reliability Study

Taşçı

Akdeniz

Gülpınar

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…Scoring was conducted through beyond expectation (4), within expectation (3), below expectation (2), and unacceptable (1) validity and reliability of the P‐MEX confirmed in the study of Amirhajlou et al. (Cronbach's alpha of 0.88) 10 . In the present study, content validity in the context of dentistry was evaluated by Delphi technique.…”

Section: Methodsmentioning

confidence: 60%

Assessment of dental residents’ professionalism through Professionalism Mini‐Evaluation Exercise (P‐MEX)

Kazemipoor¹,

Keshmiri

Owlia

et al. 2020

Journal of Dental Education

View full text Add to dashboard Cite

Purpose/objectives The aim of the study was to assess the professional behavior of dental residents through Professionalism Mini‐Evaluation Exercise (P‐MEX). Methods This was a descriptive‐analytical study. Content validity of P‐MEX form was investigated for use in the context of dentistry. A total of 24‐item version of P‐MEX consisted of doctor–patient relationship skills (n = 7), reflective skills (n = 5), time management (n = 3), and interprofessional relationship skills (n = 9) was used in the present study. Residents in different dental specialties (n = 56) were evaluated by trained raters (448 times). Data were analyzed by descriptive (mean, SD) and analytical tests (Pearson, ANOVA, and post hoc test (Bonferroni)). Results Validity of P‐MEX was approved in the field of dentistry. The mean score of professional behavior in residents were reported 2.79 ± 0.24, with minimum and maximum scores of 2.17 and 3.62, respectively. The residents' professional behavior in the domain of reflective skills and doctor–patient relationship skills were lower than the other domains. Conclusion(s) The results showed that the scores of professional behavior among dental residents were classified in the below expectation level and their scores have followed a downward trend from the second year. Therefore, planning for training and continuous assessment of professional behavior among residents in the faculty of dentistry should be considered.

show abstract

“…14 The P-MEX effectively and reliably assesses both medical student and resident professionalism behaviors in the clinical setting. 10,14,[18][19][20] In a prior study, we were able to demonstrate validity evidence for the integration of the P-MEX in a residency admissions process using standardized patients (SPs). 19 Furthermore, the P-MEX demonstrated predictive validity evidence for future professional behavior in residency training.…”

mentioning

confidence: 96%

A Meaningful and Actionable Professionalism Assessment: Validity Evidence for the Professionalism Mini-Evaluation Exercise (P-MEX) Across 8 Years

et al. 2021

View full text Add to dashboard Cite

PurposeWith the growing importance of professionalism in medical education, it is imperative to develop professionalism assessments that demonstrate robust validity evidence. The Professionalism Mini-Evaluation Exercise (P-MEX) is an assessment that has demonstrated validity evidence in the authentic clinical setting. Identifying the factorial structure of professionalism assessments determines professionalism constructs that can be used to provide diagnostic and actionable feedback. This study examines validity evidence for the P-MEX, a focused and standardized assessment of professionalism, in a simulated patient setting. MethodThe P-MEX was administered to 275 pediatric residency applicants as part of a 3-station standardized patient encounter, pooling data over an 8-year period (2012 to 2019 residency admission years). Reliability and construct validity for the P-MEX were evaluated using Cronbach's alpha, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA). ResultsCronbach's alpha for the P-MEX was 0.91. The EFA yielded 4 factors: doctor-patient relationship skills, interprofessional skills, professional demeanor, and reflective skills. The CFA demonstrated good model fit with a root-mean-square error of approximation of .058 and a comparative fit index of .92, confirming the reproducibility of the 4-factor structure of professionalism. ConclusionsThe P-MEX demonstrates construct validity as an assessment of professionalism, with 4 underlying subdomains in doctor-patient relationship skills, interprofessional skills, professional demeanor, and reflective skills. These results yield new confidence in providing diagnostic and actionable subscores within the P-MEX assessment. Educators may wish to integrate the P-MEX assessment into their professionalism curricula.

show abstract

Validity, reliability and acceptability of Professionalism Mini-Evaluation Exercise (P-MEX) for emergency medicine residency training

Cited by 10 publications

References 25 publications

Adaptation of the Professionalism Mini- Evaluation Exercise Instrument Into Turkish: A Validity and Reliability Study

Adaptation of the Professionalism Mini- Evaluation Exercise Instrument Into Turkish: A Validity and Reliability Study

Assessment of dental residents’ professionalism through Professionalism Mini‐Evaluation Exercise (P‐MEX)

A Meaningful and Actionable Professionalism Assessment: Validity Evidence for the Professionalism Mini-Evaluation Exercise (P-MEX) Across 8 Years

Contact Info

Product

Resources

About