John C Burkhardt1, R Brent Stansfield2, Taher Vohra3, Eve Losman2, Danielle Turner-Lawrence4, Laura R Hopson2. 1. Department of Emergency Medicine, University of Michigan, Ann Arbor, Michigan; Department of Medical Education, University of Michigan, Ann Arbor, Michigan. 2. Department of Medical Education, University of Michigan, Ann Arbor, Michigan. 3. Department of Emergency Medicine, Henry Ford Hospital/Wayne State University, Detroit, Michigan. 4. Department of Emergency Medicine, William Beaumont Hospital/Oakland University, Rochester, Minnesota.
Abstract
BACKGROUND: The Multiple Mini-Interview (MMI) uses short, structured contacts, and is known to predict medical school success better than traditional interviews and application materials. Its utility in Emergency Medicine residency selection is untested. OBJECTIVES: We investigate whether it provides additional information regarding future first-year resident performance that can be useful in resident selection. METHODS: From three Emergency Medicine residency programs, 71 interns in their first month completed an MMI developed to focus on desirable resident characteristics. Application data were reviewed. First-year resident performance assessments covering the American Council for Graduate Medical Education (ACGME) core competencies, along with professionalism and performance concerns, were obtained. Multiple logistic regressions were employed and MMI correlations were compared with program rank lists and typical selection factors. RESULTS: An individual's score on the MMI correlated with overall performance (p < 0.05) in single logistic regression. MMI correlated with ACGME individual competencies patient care and procedural skills at a less robust level (p < 0.1), but not with any other outcomes. Rank list position correlated with the diagnostic skill competency (p < 0.05), but no others. Traditional selection factors correlated with overall performance, disciplinary action, patient care, medical knowledge, and diagnostic skills (p < 0.05). MMI was not correlated significantly with the outcomes when included in multiple ordinal logistic regression with other selection factors. CONCLUSIONS: MMI scores correlate with overall performance, but are not statistically significant when other traditional selection factors were considered. The MMI process seems potentially superior to program rank list at correlating with first-year performance. The MMI may provide additional benefit when examined using a larger and more diverse sample.
BACKGROUND: The Multiple Mini-Interview (MMI) uses short, structured contacts, and is known to predict medical school success better than traditional interviews and application materials. Its utility in Emergency Medicine residency selection is untested. OBJECTIVES: We investigate whether it provides additional information regarding future first-year resident performance that can be useful in resident selection. METHODS: From three Emergency Medicine residency programs, 71 interns in their first month completed an MMI developed to focus on desirable resident characteristics. Application data were reviewed. First-year resident performance assessments covering the American Council for Graduate Medical Education (ACGME) core competencies, along with professionalism and performance concerns, were obtained. Multiple logistic regressions were employed and MMI correlations were compared with program rank lists and typical selection factors. RESULTS: An individual's score on the MMI correlated with overall performance (p < 0.05) in single logistic regression. MMI correlated with ACGME individual competencies patient care and procedural skills at a less robust level (p < 0.1), but not with any other outcomes. Rank list position correlated with the diagnostic skill competency (p < 0.05), but no others. Traditional selection factors correlated with overall performance, disciplinary action, patient care, medical knowledge, and diagnostic skills (p < 0.05). MMI was not correlated significantly with the outcomes when included in multiple ordinal logistic regression with other selection factors. CONCLUSIONS: MMI scores correlate with overall performance, but are not statistically significant when other traditional selection factors were considered. The MMI process seems potentially superior to program rank list at correlating with first-year performance. The MMI may provide additional benefit when examined using a larger and more diverse sample.
Authors: Jaime Jordan; Kevan Sternberg; Mary R C Haas; Shuhan He; Lalena M Yarris; Teresa M Chan; Nicole M Deiorio Journal: J Grad Med Educ Date: 2020-12-18
Authors: John C Burkhardt; Kendra P Parekh; Fiona E Gallahue; Kory S London; Mary A Edens; A J Humbert; M Tyson Pillow; Sally A Santen; Laura R Hopson Journal: J Grad Med Educ Date: 2020-11-20