BACKGROUND: Letters of recommendation (LORs) are an important part of applications for residency and fellowship programs. Despite anecdotal use of a "code" in LORs, research on program director (PD) perceptions of the value of these documents is sparse. OBJECTIVE: We analyzed PD interpretations of LOR components and discriminated between perceived levels of applicant recommendations. METHODS: We conducted a cross-sectional, descriptive study of pediatrics residency and fellowship PDs. We developed a survey asking PDs to rate 3 aspects of LORs: 13 letter features, 10 applicant abilities, and 11 commonly used phrases, using a 5-point Likert scale. The 11 phrases were grouped using principal component analysis. Mean scores of components were analyzed with repeated-measures analysis of variance. Median Likert score differences between groups were analyzed with Mann-Whitney U tests. RESULTS: Our survey had a 43% response rate (468 of 1079). "I give my highest recommendation" was rated the most positive phrase, while "showed improvement" was rated the most negative. Principal component analysis generated 3 groups of phrases with moderate to strong correlation with each other. The mean Likert score for each group from the PD rating was calculated. Positive phrases had a mean (SD) of 4.4 (0.4), neutral phrases 3.4 (0.5), and negative phrases 2.6 (0.6). There was a significant difference among all 3 pairs of mean scores (all P < .001). CONCLUSIONS: Commonly used phrases in LORs were interpreted consistently by PDs and influenced their impressions of candidates. Key elements of LORs include distinct phrases depicting different degrees of endorsement.
BACKGROUND: Letters of recommendation (LORs) are an important part of applications for residency and fellowship programs. Despite anecdotal use of a "code" in LORs, research on program director (PD) perceptions of the value of these documents is sparse. OBJECTIVE: We analyzed PD interpretations of LOR components and discriminated between perceived levels of applicant recommendations. METHODS: We conducted a cross-sectional, descriptive study of pediatrics residency and fellowship PDs. We developed a survey asking PDs to rate 3 aspects of LORs: 13 letter features, 10 applicant abilities, and 11 commonly used phrases, using a 5-point Likert scale. The 11 phrases were grouped using principal component analysis. Mean scores of components were analyzed with repeated-measures analysis of variance. Median Likert score differences between groups were analyzed with Mann-Whitney U tests. RESULTS: Our survey had a 43% response rate (468 of 1079). "I give my highest recommendation" was rated the most positive phrase, while "showed improvement" was rated the most negative. Principal component analysis generated 3 groups of phrases with moderate to strong correlation with each other. The mean Likert score for each group from the PD rating was calculated. Positive phrases had a mean (SD) of 4.4 (0.4), neutral phrases 3.4 (0.5), and negative phrases 2.6 (0.6). There was a significant difference among all 3 pairs of mean scores (all P < .001). CONCLUSIONS: Commonly used phrases in LORs were interpreted consistently by PDs and influenced their impressions of candidates. Key elements of LORs include distinct phrases depicting different degrees of endorsement.
Authors: Daniel L Beskind; Katherine M Hiller; Uwe Stolz; Hans Bradshaw; Matthew Berkman; Lisa R Stoneking; Albert Fiorello; Alice Min; Chad Viscusi; Kristi J H Grall Journal: J Emerg Med Date: 2013-10-07 Impact factor: 1.484
Authors: Jeffrey N Love; Nicole M Deiorio; Sarah Ronan-Bentle; John M Howell; Christopher I Doty; David R Lane; Cullen Hegarty Journal: Acad Emerg Med Date: 2013-09 Impact factor: 3.451
Authors: Cullen B Hegarty; David R Lane; Jeffrey N Love; Christopher I Doty; Nicole M DeIorio; Sarah Ronan-Bentle; John Howell Journal: J Grad Med Educ Date: 2014-06
Authors: Kris Saudek; Robert Treat; Amanda Rogers; Danita Hahn; Sara Lauck; David Saudek; Michael Weisgerber Journal: PLoS One Date: 2020-12-16 Impact factor: 3.240
Authors: Deepti Chopra; Mala Joneja; Gurjit Sandhu; Christopher A Smith; Catherine M Spagnuolo; Lawrence Hookey Journal: BMC Med Educ Date: 2020-10-07 Impact factor: 2.463