Rachel Yudkowsky1, Richard Elliott, Alan Schwartz. 1. Department of Mmedical Education, University of Illinois at Chicago College of Medicine, Chicago, IL 60612, USA. rachely@uic.edu
Abstract
PURPOSE: To determine whether psychiatry program directors and residents agree on the characteristics most important in determining the quality of a residency program. METHOD: The authors carried out factor analyses of the results of two national surveys that asked participants to rate the importance of 41 items in determining the quality of residency programs: a 1997 survey completed by 180 psychiatry residents and a 1998 survey completed by 234 psychiatry program directors and rotation heads. RESULTS: Residents' factors determining program quality were the interpersonal culture in the program, the curriculum, academic resources and opportunities, clinical resources and opportunities, and outcomes. Program directors' factors were program administration, curriculum and clinical resources, the quality of the institution, the supportiveness of the program, and individual preferences. CONCLUSIONS: Program directors and residents focus on different indicators of the quality of residency programs, differences that can be conceptualized as those between the "producer" and the "consumer" of the program. Four domains appear to underlie the results of the resident and faculty factor analyses: the context, content, culture, and consequences of the program. Multidimensional evaluations by multiple stakeholders may be the most appropriate way to evaluate the quality of residency programs. These results also strongly suggest that the interpersonal culture of a program should be assessed as part of its evaluation process.
PURPOSE: To determine whether psychiatry program directors and residents agree on the characteristics most important in determining the quality of a residency program. METHOD: The authors carried out factor analyses of the results of two national surveys that asked participants to rate the importance of 41 items in determining the quality of residency programs: a 1997 survey completed by 180 psychiatry residents and a 1998 survey completed by 234 psychiatry program directors and rotation heads. RESULTS: Residents' factors determining program quality were the interpersonal culture in the program, the curriculum, academic resources and opportunities, clinical resources and opportunities, and outcomes. Program directors' factors were program administration, curriculum and clinical resources, the quality of the institution, the supportiveness of the program, and individual preferences. CONCLUSIONS: Program directors and residents focus on different indicators of the quality of residency programs, differences that can be conceptualized as those between the "producer" and the "consumer" of the program. Four domains appear to underlie the results of the resident and faculty factor analyses: the context, content, culture, and consequences of the program. Multidimensional evaluations by multiple stakeholders may be the most appropriate way to evaluate the quality of residency programs. These results also strongly suggest that the interpersonal culture of a program should be assessed as part of its evaluation process.