Jesse M Ehrenfeld1, Matthew D McEvoy, William R Furman, Dylan Snyder, Warren S Sandberg. 1. From the Department of Anesthesiology, Vanderbilt University School of Medicine, Nashville, Tennessee (M.D.M., W.R.F., and D.S.); and Departments of Anesthesiology, Surgery, and Biomedical Informatics Vanderbilt University School of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee (J.M.E. and W.S.S.).
Abstract
BACKGROUND: Anesthesiology residencies are developing trainee assessment tools to evaluate 25 milestones that map to the six core competencies. The effort will be facilitated by development of automated methods to capture, assess, and report trainee performance to program directors, the Accreditation Council for Graduate Medical Education and the trainees themselves. METHODS: The authors leveraged a perioperative information management system to develop an automated, near-real-time performance capture and feedback tool that provides objective data on clinical performance and requires minimal administrative effort. Before development, the authors surveyed trainees about satisfaction with clinical performance feedback and about preferences for future feedback. RESULTS: Resident performance on 24,154 completed cases has been incorporated into the authors' automated dashboard, and trainees now have access to their own performance data. Eighty percent (48 of 60) of the residents responded to the feedback survey. Overall, residents "agreed/strongly agreed" that they desire frequent updates on their clinical performance on defined quality metrics and that they desired to see how they compared with the residency as a whole. Before deployment of the new tool, they "disagreed" that they were receiving feedback in a timely manner. Survey results were used to guide the format of the feedback tool that has been implemented. CONCLUSION: The authors demonstrate the implementation of a system that provides near-real-time feedback concerning resident performance on an extensible series of quality metrics, and which is responsive to requests arising from resident feedback about desired reporting mechanisms.
BACKGROUND: Anesthesiology residencies are developing trainee assessment tools to evaluate 25 milestones that map to the six core competencies. The effort will be facilitated by development of automated methods to capture, assess, and report trainee performance to program directors, the Accreditation Council for Graduate Medical Education and the trainees themselves. METHODS: The authors leveraged a perioperative information management system to develop an automated, near-real-time performance capture and feedback tool that provides objective data on clinical performance and requires minimal administrative effort. Before development, the authors surveyed trainees about satisfaction with clinical performance feedback and about preferences for future feedback. RESULTS: Resident performance on 24,154 completed cases has been incorporated into the authors' automated dashboard, and trainees now have access to their own performance data. Eighty percent (48 of 60) of the residents responded to the feedback survey. Overall, residents "agreed/strongly agreed" that they desire frequent updates on their clinical performance on defined quality metrics and that they desired to see how they compared with the residency as a whole. Before deployment of the new tool, they "disagreed" that they were receiving feedback in a timely manner. Survey results were used to guide the format of the feedback tool that has been implemented. CONCLUSION: The authors demonstrate the implementation of a system that provides near-real-time feedback concerning resident performance on an extensible series of quality metrics, and which is responsive to requests arising from resident feedback about desired reporting mechanisms.
Authors: Thomas S Seufert; Patricia M Mitchell; Allison R Wilcox; Julia E Rubin-Smith; Laura F White; Kerry K McCabe; Jeffrey I Schneider Journal: Acad Emerg Med Date: 2011-10 Impact factor: 3.451
Authors: Diane B Wayne; Monica J Fudala; John Butter; Viva J Siddall; Joe Feinglass; Leonard D Wade; William C McGaghie Journal: Acad Med Date: 2005-10 Impact factor: 6.893
Authors: Eric S Holmboe; Thomas P Meehan; Lorna Lynn; Paula Doyle; Tierney Sherwin; F Daniel Duffy Journal: J Contin Educ Health Prof Date: 2006 Impact factor: 1.355
Authors: Rebecca S Lipner; Weifeng Weng; Kelly J Caverzagie; Brian J Hess Journal: Adv Health Sci Educ Theory Pract Date: 2013-02-16 Impact factor: 3.853
Authors: Jesse M Ehrenfeld; Richard H Epstein; Stephen Bader; Sachin Kheterpal; Warren S Sandberg Journal: Anesth Analg Date: 2011-03-17 Impact factor: 5.108
Authors: Joseph R Starnes; Matthew D McEvoy; Jesse M Ehrenfeld; Warren S Sandberg; Jonathan P Wanderer Journal: J Med Syst Date: 2015-08-30 Impact factor: 4.460
Authors: Raymond J Malapero; Rodney A Gabriel; Robert Gimlich; Jesse M Ehrenfeld; Beverly K Philip; David W Bates; Richard D Urman Journal: J Med Syst Date: 2015-03-03 Impact factor: 4.460
Authors: Joseph A Hyder; Jonathan Niconchuk; Laurent G Glance; Mark D Neuman; Robert R Cima; Richard P Dutton; Louis L Nguyen; Lee A Fleisher; Angela M Bader Journal: Anesth Analg Date: 2015-02 Impact factor: 5.108
Authors: Sirisha Narayana; Alvin Rajkomar; James D Harrison; Victoria Valencia; Gurpreet Dhaliwal; Sumant R Ranji Journal: J Grad Med Educ Date: 2017-10