Sélection des candidats en médecine : validité prédictive des
          mini entrevues multiples en contexte francophone

Renaud, Jean-Sébastien; Cantat, Adrien; Lakhal, Sawsen; Bourget, Martine; St‐Onge, Christina

doi:10.1051/pmed/2016026

Cited by 9 publications

(7 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Predictive validity was estimated by the association of interview and role‐play scores with average clerkship performance. A previous study showed that the IF‐MMI correlated better with clerkship performance than with the annual progress test and integrative courses used at this institution 34 …”

Section: Methodsmentioning

confidence: 80%

Effect of station format on the psychometric properties of Multiple Mini Interviews

et al. 2022

Self Cite

View full text Add to dashboard Cite

Background: Given the widespread use of Multiple Mini Interviews (MMIs), their impact on the selection of candidates and the considerable resources invested in preparing and administering them, it is essential to ensure their quality. Given the variety of station formats used and the degree to which that factor resides in the control of training programmes that we know so little about, format's effect on MMI quality is a considerable oversight. This study assessed the effect of two popular station formats (interview vs. role-play) on the psychometric properties of MMIs. Methods: We analysed candidate data from the first 8 years of the Integrated French MMIs (IF-MMI) (2010-2017, n = 11 761 applicants), an MMI organised yearly by three francophone universities and administered at four testing sites located in two Canadian provinces. There were 84 role-play and 96 interview stations administered, totalling 180 stations. Mixed design analyses of variance (ANOVAs) were used to test the effect of station format on candidates' scores and stations' discrimination. Cronbach's alpha coefficients for interview and role-play stations were also compared. Predictive validity of both station formats was estimated with a mixed multiple linear regression model testing the relation between interview and role-play scores with average clerkship performance for those who gained entry to medical school (n = 462). Results: Role-play stations (M = 20.67, standard deviation [SD] = 3.38) had a slightly lower mean score than interview stations (M = 21.36, SD = 3.08), p < 0.01, Cohen's d = 0.2. The correlation between role-play and interview stations scores was r = 0.5 (p < 0.01). Discrimination coefficients, Cronbach's alpha and predictive validity statistics did not vary by station format. Conclusion:Interview and role-play stations have comparable psychometric properties, suggesting format to be interchangeable. Programmes should select station format based on match to the personal qualities for which they are trying to select.

show abstract

Section: Methodsmentioning

confidence: 80%

Effect of station format on the psychometric properties of Multiple Mini Interviews

et al. 2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…A fairly consistent finding is that MMI scores are uncorrelated or inversely correlated to GPA or other measures of previous academic performance [11][12][13]. Positive associations were found between MMI scores and OSCE scores in medical school [12,[14][15][16], clerkship rotation evaluations [16][17][18], and in some contexts with exam scores [15]. Two multicenter studies have found correlations between MMI that were developed and implemented by institutions independently [10,19], suggesting some overlap between the constructs assessed in various settings.…”

Section: Introductionmentioning

confidence: 85%

“…In recent years, the IFMMI relied on a mix of discussion stations, role-plays and collaborative stations. It has already been found to show reliable scores [17,27] and some predictive validity with clerkship rotation performance [17,18]. Thus, the present study is part of a validation process which aims to appraise the dimensions that are evaluated by the IFMMI on the basis of their station format.…”

Section: Introductionmentioning

confidence: 97%

Are different station formats assessing different dimensions in multiple mini-interviews? Findings from the Canadian integrated French multiple mini-interviews

et al. 2022

Self Cite

View full text Add to dashboard Cite

Background Multiple mini-interviews (MMI) are used to assess non-academic attributes for selection in medicine and other healthcare professions. It remains unclear if different MMI station formats (discussions, role-plays, collaboration) assess different dimensions. Methods Based on station formats of the 2018 and 2019 Integrated French MMI (IFMMI), which comprised five discussions, three role-plays and two collaboration stations, the authors performed confirmatory factor analysis (CFA) using the lavaan 0.6-5 R package and compared a one-factor solution to a three-factor solution for scores of the 2018 (n = 1438) and 2019 (n = 1440) cohorts of the IFMMI across three medical schools in Quebec, Canada. Results The three-factor solution was retained, with discussions, role-plays and collaboration stations all loading adequately with their scores. Furthermore, all three factors had moderate-to-high covariance (range 0.44 to 0.64). The model fit was also excellent with a Comparative fit index (CFI) of 0.983 (good if > 0.9), a Tucker Lewis index of 0.976 (good if > 0.95), a Standardized Root Mean Square Residual of 0.021 (good if < .08) and a Root Mean Square Error of 0.023 (good if < 0.08) for 2018 and similar results for 2019. In comparison, the single factor solution presented a lower fit (CFI = 0.819, TLI = 0.767, SRMR = 0.049 and RMSEA = 0.070). Conclusions The IFMMI assessed three dimensions that were related to stations formats, a finding that was consistent across two cohorts. This suggests that different station formats may be assessing different skills, and has implications for the choice of appropriate reliability metrics and the interpretation of scores. Further studies should try to characterize the underlying constructs associated with each station format and look for differential predictive validity according to these formats.

show abstract

“…Data sources regarding Black people representation along the medical school admission continuum in Quebec, CanadaApplicants invited to Multiple Mini-Interviews (MMI) in 2019 and enrolled in a medical school All Quebec medical schools use an MMI in the second step of their selection process, where applicants go through a series of short interview stations in which they have to discuss topics with assessors, interact with actors, or accomplish a specific task 6. Université de Sherbrooke, Université Laval and Université de Montréal share the same interview, the Integrated French MMI (IFMMI),7 whereas McGill University has a different MMI.…”

mentioning

confidence: 99%

Black students applying and admitted to medicine in the province of Quebec, Canada: what do we know so far?

et al. 2021

Self Cite

View full text Add to dashboard Cite

To address the underrepresentation of Black students in medical schools in Canada and identify barriers in selection processes, we compare data from the latest Canadian census to that of an exit-survey conducted after a situational judgment test (Casper) among medical school applicants and from questionnaires done after selection interviews in Quebec, Canada. The proportion of Black people aged 15-34 years old in Quebec in 2016 was 5.3% province-wide and 8.2% in the Montreal metropolitan area. The proportion in the applicant pool for 2020 in Quebec was estimated to be 4.5% based on Casper exit-survey data. Comparatively, it is estimated that Black people represented 1.8% of applicants invited to admission interviews and 1.2% of admitted students in Quebec in 2019. Although data from different cohorts and data sources do not allow for direct comparisons, these numbers suggest that Black students applying to medical school are disproportionately rejected at the first step compared to non-Black students. Longitudinal data collection among medical school applicants will be necessary to monitor the situation. Further studies are required to pinpoint the factors contributing to this underrepresentation, to keep improving the equity of our selection processes.

show abstract

Sélection des candidats en médecine : validité prédictive des mini entrevues multiples en contexte francophone

Cited by 9 publications

References 23 publications

Effect of station format on the psychometric properties of Multiple Mini Interviews

Effect of station format on the psychometric properties of Multiple Mini Interviews

Are different station formats assessing different dimensions in multiple mini-interviews? Findings from the Canadian integrated French multiple mini-interviews

Black students applying and admitted to medicine in the province of Quebec, Canada: what do we know so far?

Contact Info

Product

Resources

About