Robert Naples1, Judith C French2, Jeremy M Lipman2. 1. Department of General Surgery, Cleveland Clinic, Cleveland, Ohio; Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio. Electronic address: naplesr2@ccf.org. 2. Department of General Surgery, Cleveland Clinic, Cleveland, Ohio; Cleveland Clinic Lerner College of Medicine of Case Western Reserve University, Cleveland, Ohio.
Abstract
OBJECTIVE: Performance inflation is rampant in applications to general surgery residency. The medical student performance evaluation, transcript, and letters of recommendation (LOR) have all been shown significantly biased in the applicants' favor. This study sought to determine best practices for LOR to improve transparency and alignment of applicant and program characteristics. DESIGN: Two 1-hour focus groups were conducted using semi-structured interviews. Participants were asked to discuss the value and role of LOR characteristics, including standardized LOR, and provide recommendations for best practices. The transcribed discussions were coded by two educators using grounded theory and an inductive approach utilizing NVivo 12. Codes were then reviewed and revised to achieve consensus and recommendations. SETTING: Focus groups were held during the annual Surgical Education Week meeting in April 2019. PARTICIPANTS: General Surgery Program Directors from 10 institutions and Surgery Clerkship Directors from 11 other medical schools participated, with each group meeting independently from the other. RESULTS: Individually, 18 codes were identified by the authors, with consensus agreed on ten. These were grouped into 4 themes: author factors, letter content, bias, and standardized letters. Overall, a checkbox and short-answer standardized LOR was not recommended, favoring a template of items to include and exclude. Ideal letter writers were felt to be surgeons who best know the applicant, and the Chair's letter, when they have no working knowledge of the applicant, was perceived to add little value. Use of specific examples to demonstrate applicant characteristics were favored, and descriptors for coded language should be included to aid in interpretation. CONCLUSION: The focus groups identified best practices to guide writing LOR in support of applicants to general surgery residency. A template of content is provided to improve the efficiency, transparency, and accuracy of these letters for the benefit of students, medical schools, and residency programs.
OBJECTIVE: Performance inflation is rampant in applications to general surgery residency. The medical student performance evaluation, transcript, and letters of recommendation (LOR) have all been shown significantly biased in the applicants' favor. This study sought to determine best practices for LOR to improve transparency and alignment of applicant and program characteristics. DESIGN: Two 1-hour focus groups were conducted using semi-structured interviews. Participants were asked to discuss the value and role of LOR characteristics, including standardized LOR, and provide recommendations for best practices. The transcribed discussions were coded by two educators using grounded theory and an inductive approach utilizing NVivo 12. Codes were then reviewed and revised to achieve consensus and recommendations. SETTING: Focus groups were held during the annual Surgical Education Week meeting in April 2019. PARTICIPANTS: General Surgery Program Directors from 10 institutions and Surgery Clerkship Directors from 11 other medical schools participated, with each group meeting independently from the other. RESULTS: Individually, 18 codes were identified by the authors, with consensus agreed on ten. These were grouped into 4 themes: author factors, letter content, bias, and standardized letters. Overall, a checkbox and short-answer standardized LOR was not recommended, favoring a template of items to include and exclude. Ideal letter writers were felt to be surgeons who best know the applicant, and the Chair's letter, when they have no working knowledge of the applicant, was perceived to add little value. Use of specific examples to demonstrate applicant characteristics were favored, and descriptors for coded language should be included to aid in interpretation. CONCLUSION: The focus groups identified best practices to guide writing LOR in support of applicants to general surgery residency. A template of content is provided to improve the efficiency, transparency, and accuracy of these letters for the benefit of students, medical schools, and residency programs.