BACKGROUND: Most existing residency evaluation tools were constructed to evaluate the Accreditation Council for Graduate Medical Education (ACGME) competencies. METHODS: Before ACGME's six competency based assessment requirements for resident performance were developed, we created a residency evaluation tool with 5 domains important to successful surgical resident performance. Reliability was determined after 6 months of use. Factor analysis assessed whether the evaluation tool was a construct-valid measure of the ACGME competencies. RESULTS: Three hundred forty-three evaluations for 36 surgical residents were tested. The original evaluation tool was highly reliable with an overall reliability of 0.97. Factor analysis defined 4 new combinations of questions analogous to 4 of the ACGME competencies: professionalism (reliability 0.95), patient care (reliability 0.93), medical knowledge (reliability 0.92), and communication (reliability 0.92). The new competency clusters were correlated with each other to a moderate degree. CONCLUSIONS: Our locally developed tool demonstrated high reliability and construct validity for 4 of 6 ACGME competencies. The correlation between factors suggests overlap between competencies.
BACKGROUND: Most existing residency evaluation tools were constructed to evaluate the Accreditation Council for Graduate Medical Education (ACGME) competencies. METHODS: Before ACGME's six competency based assessment requirements for resident performance were developed, we created a residency evaluation tool with 5 domains important to successful surgical resident performance. Reliability was determined after 6 months of use. Factor analysis assessed whether the evaluation tool was a construct-valid measure of the ACGME competencies. RESULTS: Three hundred forty-three evaluations for 36 surgical residents were tested. The original evaluation tool was highly reliable with an overall reliability of 0.97. Factor analysis defined 4 new combinations of questions analogous to 4 of the ACGME competencies: professionalism (reliability 0.95), patient care (reliability 0.93), medical knowledge (reliability 0.92), and communication (reliability 0.92). The new competency clusters were correlated with each other to a moderate degree. CONCLUSIONS: Our locally developed tool demonstrated high reliability and construct validity for 4 of 6 ACGME competencies. The correlation between factors suggests overlap between competencies.
Authors: Mohammad U Malik; David A Diaz Voss Varela; Charles M Stewart; Kulsoom Laeeq; Gayane Yenokyan; Howard W Francis; Nasir I Bhatti Journal: J Grad Med Educ Date: 2012-12
Authors: Geoffrey M Fleming; Richard B Mink; Christoph Hornik; Amanda R Emke; Michael L Green; Katherine Mason; Toni Petrillo; Jennifer Schuette; M Hossein Tcharmtchi; Margaret Winkler; David A Turner Journal: J Grad Med Educ Date: 2016-07
Authors: Sarah E Peyre; Christian G Peyre; Jeffrey A Hagen; Maura E Sullivan; John C Lipham; Steven R Demeester; Jeffrey H Peters; Tom R Demeester Journal: Surg Endosc Date: 2008-12-05 Impact factor: 4.584