R Le Grand Rogers1, Yizza Narvaez1, Arjun K Venkatesh2, William Fleischman3, M Kennedy Hall1, R Andrew Taylor1, Denise Hersey4, Lynn Sette4, Edward R Melnick1. 1. Department of Emergency Medicine, Yale School of Medicine, New Haven, CT. 2. Department of Emergency Medicine, Yale School of Medicine, New Haven, CT; Center for Outcomes Research and Evaluation, Yale School of Medicine, New Haven, CT. 3. Department of Emergency Medicine, Yale School of Medicine, New Haven, CT; Robert Wood Johnson Clinical Scholar Program, Yale School of Medicine, New Haven, CT. 4. Harvey Cushing/John Hay Whitney Medical Library, Yale School of Medicine, New Haven, CT.
Abstract
BACKGROUND: Audit and feedback can decrease variation and improve the quality of care in a variety of health care settings. There is a growing literature on audit and feedback in the emergency department (ED) setting. Because most studies have been small and not focused on a single clinical process, systematic assessment could determine the effectiveness of audit and feedback interventions in the ED and which specific characteristics improve the quality of emergency care. OBJECTIVE: The objective of the study is to assess the effect of audit and feedback on emergency physician performance and identify features critical to success. METHODS: We adhered to the PRISMA statement to conduct a systematic review of the literature from January 1994 to January 2014 related to audit and feedback of physicians in the ED. We searched Medline, EMBASE, PsycINFO, and PubMed databases. We included studies that were conducted in the ED and reported quantitative outcomes with interventions using both audit and feedback. For included studies, 2 reviewers independently assessed methodological quality using the validated Downs and Black checklist for nonrandomized studies. Treatment effect and heterogeneity were to be reported via meta-analysis and the I2 inconsistency index. RESULTS: The search yielded 4332 articles, all of which underwent title review; 780 abstracts and 131 full-text articles were reviewed. Of these, 24 studies met inclusion criteria with an average Downs and Black score of 15.6 of 30 (range, 6-22). Improved performance was reported in 23 of the 24 studies. Six studies reported sufficient outcome data to conduct summary analysis. Pooled data from studies that included 41,124 patients yielded an average treatment effect among physicians of 36% (SD, 16%) with high heterogeneity (I2=83%). CONCLUSION: The literature on audit and feedback in the ED reports positive results for interventions across numerous clinical conditions but without standardized reporting sufficient for meta-analysis. Characteristics of audit and feedback interventions that were used in a majority of studies were feedback that targeted errors of omission and that was explicit with measurable instruction and a plan for change delivered in the clinical setting greater than 1 week after the audited performance using a combination of media and types at both the individual and group levels. Future work should use standardized reporting to identify the specific aspects of audit or feedback that drive effectiveness in the ED.
BACKGROUND: Audit and feedback can decrease variation and improve the quality of care in a variety of health care settings. There is a growing literature on audit and feedback in the emergency department (ED) setting. Because most studies have been small and not focused on a single clinical process, systematic assessment could determine the effectiveness of audit and feedback interventions in the ED and which specific characteristics improve the quality of emergency care. OBJECTIVE: The objective of the study is to assess the effect of audit and feedback on emergency physician performance and identify features critical to success. METHODS: We adhered to the PRISMA statement to conduct a systematic review of the literature from January 1994 to January 2014 related to audit and feedback of physicians in the ED. We searched Medline, EMBASE, PsycINFO, and PubMed databases. We included studies that were conducted in the ED and reported quantitative outcomes with interventions using both audit and feedback. For included studies, 2 reviewers independently assessed methodological quality using the validated Downs and Black checklist for nonrandomized studies. Treatment effect and heterogeneity were to be reported via meta-analysis and the I2 inconsistency index. RESULTS: The search yielded 4332 articles, all of which underwent title review; 780 abstracts and 131 full-text articles were reviewed. Of these, 24 studies met inclusion criteria with an average Downs and Black score of 15.6 of 30 (range, 6-22). Improved performance was reported in 23 of the 24 studies. Six studies reported sufficient outcome data to conduct summary analysis. Pooled data from studies that included 41,124 patients yielded an average treatment effect among physicians of 36% (SD, 16%) with high heterogeneity (I2=83%). CONCLUSION: The literature on audit and feedback in the ED reports positive results for interventions across numerous clinical conditions but without standardized reporting sufficient for meta-analysis. Characteristics of audit and feedback interventions that were used in a majority of studies were feedback that targeted errors of omission and that was explicit with measurable instruction and a plan for change delivered in the clinical setting greater than 1 week after the audited performance using a combination of media and types at both the individual and group levels. Future work should use standardized reporting to identify the specific aspects of audit or feedback that drive effectiveness in the ED.
Authors: Adam L Sharp; Brian Z Huang; Tania Tang; Ernest Shen; Edward R Melnick; Arjun K Venkatesh; Michael H Kanter; Michael K Gould Journal: Ann Emerg Med Date: 2017-07-21 Impact factor: 5.721
Authors: William L Scheving; Joseph M Ebersole; Michael Froehler; Donald Moore; Kiersten Brown-Espaillat; James Closser; Wesley H Self; Michael J Ward Journal: Am J Emerg Med Date: 2019-07-11 Impact factor: 2.469
Authors: Dustin W Ballard; Ridhima Vemula; Uli K Chettipally; Mamata V Kene; Dustin G Mark; Andrew K Elms; James S Lin; Mary E Reed; Jie Huang; Adina S Rauchwerger; David R Vinson Journal: Appl Clin Inform Date: 2016-09-21 Impact factor: 2.342
Authors: Arjun K Venkatesh; Jean Elizabeth Scofi; Craig Rothenberg; Carl T Berdahl; Nalani Tarrant; Dhruv Sharma; Pawan Goyal; Randy Pilgrim; Kevin Klauer; Jeremiah D Schuur Journal: Am J Emerg Med Date: 2020-01-17 Impact factor: 2.469
Authors: Jason Robert Vanstone; Shivani Patel; Michelle L Degelman; Ibrahim W Abubakari; Shawn McCann; Robert Parker; Terry Ross Journal: Emerg Med J Date: 2021-05-12 Impact factor: 3.814
Authors: Ali S Raja; Arjun K Venkatesh; Nathan Mick; Cristopher P Zabbo; Kohei Hasegawa; Janice A Espinola; Jane C Bittner; Carlos A Camargo Journal: West J Emerg Med Date: 2017-03-08