Jennifer P Stevens1, Bartlomiej Kachniarz, Sharon B Wright, Jean Gillis, Daniel Talmor, Peter Clardy, Michael D Howell. 1. 1Department of Medicine, Division of Pulmonary, Critical Care, and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA. 2Center for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, MA. 3Harvard Medical School, Boston, MA. 4Department of Medicine, Division of Infectious Diseases, Beth Israel Deaconess Medical Center, Boston, MA. 5Department of Anesthesia, Critical Care and Pain Medicine, Beth Israel Deaconess Medical Center, Boston, MA. 6Section of Pulmonary and Critical Care, Department of Medicine, University of Chicago, Chicago, IL.
Abstract
OBJECTIVE: The Centers for Disease Control has recently proposed a major change in how ventilator-associated pneumonia is defined. This has profound implications for public reporting, reimbursement, and accountability measures for ICUs. We sought to provide evidence for or against this change by quantifying limitations of the national definition of ventilator-associated pneumonia that was in place until January 2013, particularly with regard to comparisons between, and ranking of, hospitals and ICUs. DESIGN: A prospective survey of a nationally representative group of 43 hospitals, randomly selected from the American Hospital Association Guide (2009). Subjects classified six standardized vignettes of possible cases of ventilator-associated pneumonia as pneumonia or no pneumonia. SUBJECTS: Individuals responsible for ventilator-associated pneumonia surveillance at 43 U.S. hospitals. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We measured the proportion of standardized cases classified as ventilator-associated pneumonia. Of 138 hospitals consented, 61 partially completed the survey and 43 fully completed the survey (response rate 44% and 31%, respectively). Agreement among hospitals about classification of cases as ventilator-associated pneumonia/not ventilator-associated pneumonia was nearly random (Fleiss κ 0.13). Some hospitals rated 0% of cases as having pneumonia; others classified 100% as having pneumonia (median, 50%; interquartile range, 33-66%). Although region of the country did not predict case assignment, respondents who described their region as "rural" were more likely to judge a case to be pneumonia than respondents elsewhere (relative risk, 1.25, Kruskal-Wallis chi-square, p = 0.03). CONCLUSIONS: In this nationally representative study of hospitals, assignment of ventilator-associated pneumonia is extremely variable, enough to render comparisons between hospitals worthless, even when standardized cases eliminate variability in clinical data abstraction. The magnitude of this variability highlights the limitations of using poorly performing surveillance definitions as methods of hospital evaluation and comparison, and our study provides very strong support for moving to a more objective definition of ventilator-associated complications.
OBJECTIVE: The Centers for Disease Control has recently proposed a major change in how ventilator-associated pneumonia is defined. This has profound implications for public reporting, reimbursement, and accountability measures for ICUs. We sought to provide evidence for or against this change by quantifying limitations of the national definition of ventilator-associated pneumonia that was in place until January 2013, particularly with regard to comparisons between, and ranking of, hospitals and ICUs. DESIGN: A prospective survey of a nationally representative group of 43 hospitals, randomly selected from the American Hospital Association Guide (2009). Subjects classified six standardized vignettes of possible cases of ventilator-associated pneumonia as pneumonia or no pneumonia. SUBJECTS: Individuals responsible for ventilator-associated pneumonia surveillance at 43 U.S. hospitals. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We measured the proportion of standardized cases classified as ventilator-associated pneumonia. Of 138 hospitals consented, 61 partially completed the survey and 43 fully completed the survey (response rate 44% and 31%, respectively). Agreement among hospitals about classification of cases as ventilator-associated pneumonia/not ventilator-associated pneumonia was nearly random (Fleiss κ 0.13). Some hospitals rated 0% of cases as having pneumonia; others classified 100% as having pneumonia (median, 50%; interquartile range, 33-66%). Although region of the country did not predict case assignment, respondents who described their region as "rural" were more likely to judge a case to be pneumonia than respondents elsewhere (relative risk, 1.25, Kruskal-Wallis chi-square, p = 0.03). CONCLUSIONS: In this nationally representative study of hospitals, assignment of ventilator-associated pneumonia is extremely variable, enough to render comparisons between hospitals worthless, even when standardized cases eliminate variability in clinical data abstraction. The magnitude of this variability highlights the limitations of using poorly performing surveillance definitions as methods of hospital evaluation and comparison, and our study provides very strong support for moving to a more objective definition of ventilator-associated complications.
Authors: Carolyn T A Herzig; Julie Reagan; Monika Pogorzelska-Maziarz; Divya Srinath; Patricia W Stone Journal: Am J Med Qual Date: 2014-06-20 Impact factor: 1.852
Authors: Meghan M Cirulis; Mitchell T Hamele; Chris R Stockmann; Tellen D Bennett; Susan L Bratton Journal: Pediatr Crit Care Med Date: 2016-02 Impact factor: 3.624
Authors: Chanu Rhee; Sarah R Brown; Travis M Jones; Cara O'Brien; Anupam Pande; Yasir Hamad; Amy L Bulger; Kathleen A Tobin; Anthony F Massaro; Deverick J Anderson; David K Warren; Michael Klompas Journal: Infect Control Hosp Epidemiol Date: 2018-06-22 Impact factor: 3.254
Authors: Michael Klompas; Deverick Anderson; William Trick; Hilary Babcock; Meeta Prasad Kerlin; Lingling Li; Ronda Sinkowitz-Cochran; E Wesley Ely; John Jernigan; Shelley Magill; Rosie Lyles; Caroline O'Neil; Barrett T Kitch; Ellen Arrington; Michele C Balas; Ken Kleinman; Christina Bruce; Julie Lankiewicz; Michael V Murphy; Christopher E Cox; Ebbing Lautenbach; Daniel Sexton; Victoria Fraser; Robert A Weinstein; Richard Platt Journal: Am J Respir Crit Care Med Date: 2015-02-01 Impact factor: 30.528