Abbas Husain1, Ida Li1, Brahim Ardolic1, Michael C Bond2, Jan Shoenberger3, Kaushal H Shah4, Arlene S Chung4,5, Jeffrey Van Dermark6, Jonathan M Bronner7, Melissa White8, Todd Taylor8, Lukasz Cygan1, William Caputo1, Matthew Silver9, William C Krauss9, Daniel J Egan10,11, Moshe Weizberg1. 1. Department of Emergency Medicine Staten Island University Hospital-Northwell Health Staten Island NY. 2. Department of Emergency Medicine University of Maryland School of Medicine Baltimore MD. 3. Keck School of Medicine of the University of Southern California Los Angeles CA. 4. Department of Emergency Medicine Icahn School of Medicine at Mount Sinai New York NY. 5. Department of Emergency Medicine Maimonides Medical Center Brooklyn NY. 6. Department of Emergency Medicine UT Southwestern Medical Center Dallas TX. 7. Department of Emergency Medicine University of Kentucky Lexington KY. 8. Department of Emergency Medicine Emory University School of Medicine Atlanta GA. 9. Department of Emergency Medicine Southern California Permanente Medical Group San Diego CA. 10. Department of Emergency Medicine Mount Sinai St. Luke's Roosevelt, New York NY. 11. Columbia University Vagelos College of Physicians and Surgeons New York NY.
Abstract
BACKGROUND: The Association of American Medical Colleges instituted a standardized video interview (SVI) for all applicants to emergency medicine (EM). It is unclear how the SVI affects a faculty reviewer's decision on likelihood to invite an applicant (LTI) for an interview. OBJECTIVES: The objective was to determine whether the SVI affects the LTI. METHODS: Nine Accreditation Council of Graduate Medication Education (ACGME)-accredited EM residency programs participated in this prospective, observational study. LTI was defined on a 5-point Likert scale as follows: 1 = definitely not invite, 2 = likely not invite, 3 = might invite, 4 = probably invite, 5 = definitely invite. LTI was recorded at three instances during each review: 1) after typical screening (blinded to the SVI), 2) after unblinding to the SVI score, and 3) after viewing the SVI video. RESULTS: Seventeen reviewers at nine ACGME-accredited residency programs participated. We reviewed 2,219 applications representing 1,424 unique applicants. After unblinding the SVI score, LTI did not change in 2,065 (93.1%), increased in 85 (3.8%) and decreased in 69 (3.1%; p = 0.22). In subgroup analyses, the effect of the SVI on LTI was unchanged by United States Medical Licensing Examination score. However, when examining subgroups of SVI scores, the percentage of applicants in whom the SVI score changed the LTI was significantly different in those that scored in the lower and upper subgroups (p < 0.0001). The SVI video was viewed in 816 (36.8%) applications. Watching the video did not change the LTI in 631 (77.3%); LTI increased in 106 (13.0%) and decreased in 79 (9.7%) applications (p = 0.04). CONCLUSIONS: The SVI score changed the LTI in 7% of applications. In this group, the score was equally likely to increase or decrease the LTI. Lower SVI scores were more likely to decrease the LTI than higher scores were to increase the LTI. Watching the SVI video was more likely to increase the LTI than to decrease it.
BACKGROUND: The Association of American Medical Colleges instituted a standardized video interview (SVI) for all applicants to emergency medicine (EM). It is unclear how the SVI affects a faculty reviewer's decision on likelihood to invite an applicant (LTI) for an interview. OBJECTIVES: The objective was to determine whether the SVI affects the LTI. METHODS: Nine Accreditation Council of Graduate Medication Education (ACGME)-accredited EM residency programs participated in this prospective, observational study. LTI was defined on a 5-point Likert scale as follows: 1 = definitely not invite, 2 = likely not invite, 3 = might invite, 4 = probably invite, 5 = definitely invite. LTI was recorded at three instances during each review: 1) after typical screening (blinded to the SVI), 2) after unblinding to the SVI score, and 3) after viewing the SVI video. RESULTS: Seventeen reviewers at nine ACGME-accredited residency programs participated. We reviewed 2,219 applications representing 1,424 unique applicants. After unblinding the SVI score, LTI did not change in 2,065 (93.1%), increased in 85 (3.8%) and decreased in 69 (3.1%; p = 0.22). In subgroup analyses, the effect of the SVI on LTI was unchanged by United States Medical Licensing Examination score. However, when examining subgroups of SVI scores, the percentage of applicants in whom the SVI score changed the LTI was significantly different in those that scored in the lower and upper subgroups (p < 0.0001). The SVI video was viewed in 816 (36.8%) applications. Watching the video did not change the LTI in 631 (77.3%); LTI increased in 106 (13.0%) and decreased in 79 (9.7%) applications (p = 0.04). CONCLUSIONS: The SVI score changed the LTI in 7% of applications. In this group, the score was equally likely to increase or decrease the LTI. Lower SVI scores were more likely to decrease the LTI than higher scores were to increase the LTI. Watching the SVI video was more likely to increase the LTI than to decrease it.
Authors: Daniel J Egan; Abbas Husain; Michael C Bond; William Caputo; Lukasz Cygan; Jeff Van Dermark; Jan M Shoenberger; Ida Li; William Krauss; Jonathan Bronner; Melissa White; Arlene S Chung; Kaushal H Shah; Todd Taylor; Matthew Silver; Brahim Ardolic; Moshe Weizberg Journal: West J Emerg Med Date: 2018-12-12
Authors: Terra N Thimm; Christopher S Kiefer; Mara S Aloi; Moira Davenport; Jared Kilpatrick; Jeffrey S Bush; Lindsey Jennings; Stephen M Davis; Kimberly Quedado; Erica B Shaver Journal: West J Emerg Med Date: 2021-08-21
Authors: Elaine R Cohen; Joshua L Goldstein; Clara J Schroedl; Nancy Parlapiano; William C McGaghie; Diane B Wayne Journal: J Grad Med Educ Date: 2020-08