BACKGROUND: The educational milestones were designed as a criterion-based framework for assessing resident progression on the 6 Accreditation Council for Graduate Medical Education competencies. OBJECTIVE: We obtained feedback on, and assessed the construct validity and perceived feasibility and utility of, draft Internal Medicine Milestones for Patient Care and Systems-Based Practice. METHODS: All participants in our mixed-methods study were members of competency committees in internal medicine residency programs. An initial survey assessed participant and program demographics; focus groups obtained feedback on the draft milestones and explored their perceived utility in resident assessment, and an exit survey elicited input on the value of the draft milestones in resident assessment. Surveys were tabulated using descriptive statistics. Conventional content analysis method was used to assess the focus group data. RESULTS: Thirty-four participants from 17 programs completed surveys and participated in 1 of 6 focus groups. Overall, the milestones were perceived as useful in formative and summative assessment of residents. Participants raised concerns about the length and complexity of some draft milestones and suggested specific changes. The focus groups also identified a need for faculty development. In the exit survey, most participants agreed that the Patient Care and Systems-Based Practice Milestones would help competency committees assess trainee progress toward independent practice. CONCLUSIONS: Draft reporting milestones for 2 competencies demonstrated significant construct validity in both the content and response process and the perceived utility for the assessment of resident performance. To ensure success, additional feedback from the internal medicine community and faculty development will be necessary.
BACKGROUND: The educational milestones were designed as a criterion-based framework for assessing resident progression on the 6 Accreditation Council for Graduate Medical Education competencies. OBJECTIVE: We obtained feedback on, and assessed the construct validity and perceived feasibility and utility of, draft Internal Medicine Milestones for Patient Care and Systems-Based Practice. METHODS: All participants in our mixed-methods study were members of competency committees in internal medicine residency programs. An initial survey assessed participant and program demographics; focus groups obtained feedback on the draft milestones and explored their perceived utility in resident assessment, and an exit survey elicited input on the value of the draft milestones in resident assessment. Surveys were tabulated using descriptive statistics. Conventional content analysis method was used to assess the focus group data. RESULTS: Thirty-four participants from 17 programs completed surveys and participated in 1 of 6 focus groups. Overall, the milestones were perceived as useful in formative and summative assessment of residents. Participants raised concerns about the length and complexity of some draft milestones and suggested specific changes. The focus groups also identified a need for faculty development. In the exit survey, most participants agreed that the Patient Care and Systems-Based Practice Milestones would help competency committees assess trainee progress toward independent practice. CONCLUSIONS: Draft reporting milestones for 2 competencies demonstrated significant construct validity in both the content and response process and the perceived utility for the assessment of resident performance. To ensure success, additional feedback from the internal medicine community and faculty development will be necessary.
Authors: Michael L Green; Eva M Aagaard; Kelly J Caverzagie; Davoren A Chick; Eric Holmboe; Gregory Kane; Cynthia D Smith; William Iobst Journal: J Grad Med Educ Date: 2009-09
Authors: William F Iobst; Jonathan Sherbino; Olle Ten Cate; Denyse L Richardson; Deepak Dath; Susan R Swing; Peter Harris; Rani Mungroo; Eric S Holmboe; Jason R Frank Journal: Med Teach Date: 2010 Impact factor: 3.650
Authors: Kelly J Caverzagie; William F Iobst; Eva M Aagaard; Sarah Hood; Davoren A Chick; Gregory C Kane; Timothy P Brigham; Susan R Swing; Lauren B Meade; Hasan Bazari; Roger W Bush; Lynne M Kirk; Michael L Green; Kevin T Hinchey; Cynthia D Smith Journal: Ann Intern Med Date: 2013-04-02 Impact factor: 25.391
Authors: Eric S Holmboe; Kenji Yamazaki; Laura Edgar; Lisa Conforti; Nicholas Yaghmour; Rebecca S Miller; Stanley J Hamstra Journal: J Grad Med Educ Date: 2015-09
Authors: Halle G Sobel; Rachel Swigris; Karen M Chacko; Alison Landrey; Monica McNulty; Kaitlyn Vennard; Susan Michelle Nikels; Kathleen Suddarth; Edward N Murphy; Eva Aagaard Journal: J Grad Med Educ Date: 2017-08
Authors: Taylor Sawyer; Megan Gray; Shilpi Chabra; Lindsay C Johnston; Melissa M Carbajal; Maria Gillam-Krakauer; Jennifer M Brady; Heather French Journal: J Grad Med Educ Date: 2021-06-14