BACKGROUND: While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts. OBJECTIVE: We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership. METHODS: We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for identification of clinical leadership behaviors. We presented these to leadership experts who defined essential behaviors through a modified Delphi approach. In May 2014 we tested the resulting 29-item tool among residents in the internal medicine and pediatrics departments at 2 academic medical centers. We analyzed instrument performance using Cronbach's alpha, interrater reliability using intraclass correlation coefficients (ICCs), and item performance using linear-by-linear test comparisons of responses by postgraduate year, site, and specialty. RESULTS: A total of 377 (of 526, 72%) team members completed the LOFT for 95 (of 519, 18%) residents. Overall ratings were high-only 14% scored at the novice level. Cronbach's alpha was 0.79, and the ICC ranged from 0.20 to 0.79. Linear-by-linear test comparisons revealed significant differences between postgraduate year groups for some items, but no significant differences by site or specialty. Acceptability and usefulness ratings by respondents were high. CONCLUSIONS: Despite a rigorous approach to instrument design, we were unable to collect convincing validity evidence for our instrument. The tool may still have some usefulness for providing formative feedback to residents on their clinical leadership skills.
BACKGROUND: While leadership training is increasingly incorporated into residency education, existing assessment tools to provide feedback on leadership skills are only applicable in limited contexts. OBJECTIVE: We developed an instrument, the Leadership Observation and Feedback Tool (LOFT), for assessing clinical leadership. METHODS: We used an iterative process to develop the tool, beginning with adapting the Leadership Practices Inventory to create an open-ended survey for identification of clinical leadership behaviors. We presented these to leadership experts who defined essential behaviors through a modified Delphi approach. In May 2014 we tested the resulting 29-item tool among residents in the internal medicine and pediatrics departments at 2 academic medical centers. We analyzed instrument performance using Cronbach's alpha, interrater reliability using intraclass correlation coefficients (ICCs), and item performance using linear-by-linear test comparisons of responses by postgraduate year, site, and specialty. RESULTS: A total of 377 (of 526, 72%) team members completed the LOFT for 95 (of 519, 18%) residents. Overall ratings were high-only 14% scored at the novice level. Cronbach's alpha was 0.79, and the ICC ranged from 0.20 to 0.79. Linear-by-linear test comparisons revealed significant differences between postgraduate year groups for some items, but no significant differences by site or specialty. Acceptability and usefulness ratings by respondents were high. CONCLUSIONS: Despite a rigorous approach to instrument design, we were unable to collect convincing validity evidence for our instrument. The tool may still have some usefulness for providing formative feedback to residents on their clinical leadership skills.
Authors: Estée C Grant; Vincent J Grant; Farhan Bhanji; Jonathan P Duff; Adam Cheng; Jocelyn M Lockyer Journal: Resuscitation Date: 2012-01-28 Impact factor: 5.262
Authors: Leigh V Evans; James L Morse; Cara J Hamann; Michael Osborne; Zhenqiu Lin; Gail D'Onofrio Journal: Acad Med Date: 2009-08 Impact factor: 6.893
Authors: James F Malec; Laurence C Torsher; William F Dunn; Douglas A Wiegmann; Jacqueline J Arnold; Dwight A Brown; Vaishali Phatak Journal: Simul Healthc Date: 2007 Impact factor: 1.929
Authors: M J B Govaerts; L W T Schuwirth; C P M Van der Vleuten; A M M Muijtjens Journal: Adv Health Sci Educ Theory Pract Date: 2010-09-30 Impact factor: 3.853
Authors: Daniel N Ricotta; Brittany L Ranchoff; Christine P Beltran; Andrew J Hale; Jason A Freed; Grace C Huang Journal: J Gen Intern Med Date: 2020-01-02 Impact factor: 5.128