Chelsea Towaij1, Nada Gawad2, Kameela Alibhai3, Danielle Doan4, Isabelle Raîche5. 1. is a Postgraduate Year 5 Resident, Division of General Surgery, Department of Surgery, Faculty of Medicine, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada. 2. is a Surgical Fellow, Division of General Surgery, Department of Surgery, Faculty of Medicine, Department of Innovation in Medical Education (DIME), University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada. 3. is a Third-Year Medical Student, Division of General Surgery, Department of Surgery, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada. 4. is a Program Administrator, Division of General Surgery, Department of Surgery, Faculty of Medicine, Eric Poulin Office of Education, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada. 5. is an Assistant Professor of Surgery, Division of General Surgery, Department of Surgery, Faculty of Medicine, DIME, University of Ottawa, The Ottawa Hospital, Ottawa, ON, Canada.
Abstract
Background: Residency selection integrates objective and subjective data sources. Interviews help assess characteristics like insight and communication but have the potential for bias. Structured multiple mini-interviews may mitigate some elements of bias; however, a halo effect is described in assessments of medical trainees, and degree of familiarity with applicants may remain a source of bias in interviews. Objective: To investigate the extent of interviewer bias that results from pre-interview knowledge of the applicant by comparing file review and interview scores for known versus unknown applicants. Methods: File review and interview scores of applicants to the University of Ottawa General Surgery Residency Training Program from 2019 to 2021 were gathered retrospectively. Applicants were categorized as "home" if from the institution, "known" if they completed an elective at the institution, or "unknown." The Kruskal-Wallis H test was used to compare median interview scores between groups and Spearman's rank-order correlation (rs) to determine the correlation between file review and interview scores. Results: Over a 3-year period, 169 applicants were interviewed; 62% were unknown, 31% were known, and 6% were home applicants. There was a statistically significant difference (P=.01) between the median interview scores of home, known, and unknown applicants. Comparison of groups demonstrated higher positive correlations between file review and interview scores (rs=0.15 vs 0.36 vs 0.55 in unknown, known, and home applicants) with increasing applicant familiarity. Conclusions: There is an increased positive correlation between file review and interview scores with applicant familiarity. The interview process may carry inherent bias insufficiently mitigated by the current structure.
Background: Residency selection integrates objective and subjective data sources. Interviews help assess characteristics like insight and communication but have the potential for bias. Structured multiple mini-interviews may mitigate some elements of bias; however, a halo effect is described in assessments of medical trainees, and degree of familiarity with applicants may remain a source of bias in interviews. Objective: To investigate the extent of interviewer bias that results from pre-interview knowledge of the applicant by comparing file review and interview scores for known versus unknown applicants. Methods: File review and interview scores of applicants to the University of Ottawa General Surgery Residency Training Program from 2019 to 2021 were gathered retrospectively. Applicants were categorized as "home" if from the institution, "known" if they completed an elective at the institution, or "unknown." The Kruskal-Wallis H test was used to compare median interview scores between groups and Spearman's rank-order correlation (rs) to determine the correlation between file review and interview scores. Results: Over a 3-year period, 169 applicants were interviewed; 62% were unknown, 31% were known, and 6% were home applicants. There was a statistically significant difference (P=.01) between the median interview scores of home, known, and unknown applicants. Comparison of groups demonstrated higher positive correlations between file review and interview scores (rs=0.15 vs 0.36 vs 0.55 in unknown, known, and home applicants) with increasing applicant familiarity. Conclusions: There is an increased positive correlation between file review and interview scores with applicant familiarity. The interview process may carry inherent bias insufficiently mitigated by the current structure.
Authors: Kevan Sternberg; Jaime Jordan; Mary R C Haas; Shuhan He; Nicole M Deiorio; Lalena M Yarris; Teresa M Chan Journal: J Grad Med Educ Date: 2020-10
Authors: Charles M Maxfield; Matthew P Thorpe; Terry S Desser; Darel Heitkamp; Nathan C Hull; Karen S Johnson; Nicholas A Koontz; Gary W Mlady; Timothy J Welch; Lars J Grimm Journal: Med Educ Date: 2020-04-17 Impact factor: 6.251
Authors: Brian C Drolet; Jonathan P Brower; Scott D Lifchez; Jeffrey E Janis; Paul Y Liu Journal: Plast Reconstr Surg Date: 2016-04 Impact factor: 4.730