Fern R Juster1, Robin Camhi Baum, Christopher Zou, Don Risucci, Anhphan Ly, Harold Reiter, D Douglas Miller, Kelly L Dore. 1. F.R. Juster was senior associate dean and associate professor of clinical pediatrics, New York Medical College School of Medicine, Valhalla, New York, at the time of this study. She is currently senior associate dean emeritus, New York Medical College School of Medicine, Valhalla, New York, and graduate student, Health Sciences Education Master's Program, David Braley Health Science Centre, McMaster University, Hamilton, Ontario, Canada. R.C. Baum is assistant dean of admissions, New York Medical College School of Medicine, Valhalla, New York. C. Zou is research scientist, Altus Assessments, Toronto, Ontario, Canada. D. Risucci is assistant dean for assessment and evaluation and professor of surgery, New York Medical College School of Medicine, Valhalla, New York. A. Ly is former director of analytics, Academic Administration, New York Medical College School of Medicine, Valhalla, New York. H. Reiter is professor, Department of Oncology, McMaster University, Hamilton, Ontario, Canada. D.D. Miller is former dean and professor of medicine, New York Medical College School of Medicine, Valhalla, New York. K.L. Dore is associate professor of medicine, McMaster University, Hamilton, Ontario, Canada.
Abstract
PURPOSE: To examine the magnitudes of score differences across different demographic groups for three academic (grade point average [GPA], old Medical College Admission Test [MCAT], and MCAT 2015) and one nonacademic (situational judgment test [SJT]) screening measures and one nonacademic (multiple mini-interview [MMI]) interview measure (analysis 1), and the demographic implications of including an SJT in the screening stage for the pool of applicants who are invited to interview (analysis 2). METHOD: The authors ran the analyses using data from New York Medical College School of Medicine applicants from the 2015-2016 admissions cycle. For analysis 1, effect sizes (Cohen d) were calculated for GPA, old MCAT, MCAT 2015, CASPer (an online SJT), and MMI. Comparisons were made across gender, race, ethnicity (African American, Hispanic/Latino), and socioeconomic status (SES). For analysis 2, a series of simulations were conducted to estimate the number of underrepresented in medicine (UIM) applicants who would have been invited to interview with different weightings of GPA, MCAT, and CASPer scores. RESULTS: A total of 9,096 applicants were included in analysis 1. Group differences were significantly smaller or reversed for CASPer and MMI compared with the academic assessments (MCAT, GPA) across nearly all demographic variables/indicators. The simulations suggested that a higher weighting of CASPer may help increase gender, racial, and ethnic diversity in the interview pool; results for low-SES applicants were mixed. CONCLUSIONS: The inclusion of an SJT in the admissions process has the potential to widen access to medical education for a number of UIM groups.
PURPOSE: To examine the magnitudes of score differences across different demographic groups for three academic (grade point average [GPA], old Medical College Admission Test [MCAT], and MCAT 2015) and one nonacademic (situational judgment test [SJT]) screening measures and one nonacademic (multiple mini-interview [MMI]) interview measure (analysis 1), and the demographic implications of including an SJT in the screening stage for the pool of applicants who are invited to interview (analysis 2). METHOD: The authors ran the analyses using data from New York Medical College School of Medicine applicants from the 2015-2016 admissions cycle. For analysis 1, effect sizes (Cohen d) were calculated for GPA, old MCAT, MCAT 2015, CASPer (an online SJT), and MMI. Comparisons were made across gender, race, ethnicity (African American, Hispanic/Latino), and socioeconomic status (SES). For analysis 2, a series of simulations were conducted to estimate the number of underrepresented in medicine (UIM) applicants who would have been invited to interview with different weightings of GPA, MCAT, and CASPer scores. RESULTS: A total of 9,096 applicants were included in analysis 1. Group differences were significantly smaller or reversed for CASPer and MMI compared with the academic assessments (MCAT, GPA) across nearly all demographic variables/indicators. The simulations suggested that a higher weighting of CASPer may help increase gender, racial, and ethnic diversity in the interview pool; results for low-SES applicants were mixed. CONCLUSIONS: The inclusion of an SJT in the admissions process has the potential to widen access to medical education for a number of UIM groups.