Gabriel T Bosslet1, W Graham Carlos1, David J Tybor2, Jennifer McCallister3, Candace Huebert4, Ashley Henderson5, Matthew C Miles6, Homer Twigg1, Catherine R Sears1, Cynthia Brown1, Mark O Farber1, Tim Lahm1, John D Buckley1. 1. 1 Division of Pulmonary, Critical Care, Sleep and Occupational Medicine, Indiana University School of Medicine, Indianapolis, Indiana. 2. 2 Tufts University School of Medicine, Boston, Massachusetts. 3. 3 Division of Pulmonary, Critical Care, and Sleep Medicine, The Ohio State University Wexner Medical Center, Columbus, Ohio. 4. 4 Division of Pulmonary, Critical Care, Sleep, and Allergy, University of Nebraska Medical Center, Omaha, Nebraska. 5. 5 Division of Pulmonary and Critical Care, Marsico Lung Institute, University of North Carolina Healthcare, Chapel Hill, North Carolina; and. 6. 6 Division of Pulmonary, Critical Care, Allergy, and Immunologic Disease, Wake Forest School of Medicine, Winston-Salem, North Carolina.
Abstract
RATIONALE: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. OBJECTIVES: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. METHODS: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: the ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. RESULTS: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). CONCLUSIONS: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.
RATIONALE: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. OBJECTIVES: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. METHODS: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: the ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. RESULTS: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). CONCLUSIONS: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.
Keywords:
education; internship and residency; job application