OBJECTIVE: The Agency for Healthcare Research and Quality (AHRQ) developed 20 patient safety indicators (PSIs) to identify potentially preventable complications of acute inpatient care based on administrative data. The objective of this patient safety performance study was to assess the impact of cases flagged by each PSI for diagnoses that were actually present on admission on unadjusted PSI rates. METHODS: The latest AHRQ PSI software, which allows users to produce 14 of the 20 PSIs for adult inpatients both without and with a "present on admission" (PoA) variable, was applied to administrative data for adult patients discharged from the University of Michigan Health System (UMHS) in 2006. The impact of the PoA values on unadjusted PSI rates was evaluated. Because of concerns about the accuracy of PoA values, results were compared with those of a prior analysis at UMHS that was similar but based on a review of medical records. FINDINGS: Thirteen PSIs had at least 1 case in the numerator. Rates for all but 1 of the 13 were lower using the PoA values and the reduction was statistically significant for 5 PSIs: decubitus ulcer (P < 0.001), foreign body left in (P = 0.033), selected infections due to medical care (P < 0.001), postoperative physiologic and metabolic derangement (P = 0.039), and postoperative pulmonary embolism or deep vein thrombosis (P < 0.001). Results were consistent with those of the analysis of medical records. CONCLUSIONS: Unadjusted PSI rates at UMHS are substantially overstated, because the PSIs do not differentiate preexisting conditions from complications and therefore include false positive cases. Because of these findings and the lack of a broader study of the validity of the indicators, PSIs should not be used to profile hospital performance.
OBJECTIVE: The Agency for Healthcare Research and Quality (AHRQ) developed 20 patient safety indicators (PSIs) to identify potentially preventable complications of acute inpatient care based on administrative data. The objective of this patient safety performance study was to assess the impact of cases flagged by each PSI for diagnoses that were actually present on admission on unadjusted PSI rates. METHODS: The latest AHRQ PSI software, which allows users to produce 14 of the 20 PSIs for adult inpatients both without and with a "present on admission" (PoA) variable, was applied to administrative data for adult patients discharged from the University of Michigan Health System (UMHS) in 2006. The impact of the PoA values on unadjusted PSI rates was evaluated. Because of concerns about the accuracy of PoA values, results were compared with those of a prior analysis at UMHS that was similar but based on a review of medical records. FINDINGS: Thirteen PSIs had at least 1 case in the numerator. Rates for all but 1 of the 13 were lower using the PoA values and the reduction was statistically significant for 5 PSIs: decubitus ulcer (P < 0.001), foreign body left in (P = 0.033), selected infections due to medical care (P < 0.001), postoperative physiologic and metabolic derangement (P = 0.039), and postoperative pulmonary embolism or deep vein thrombosis (P < 0.001). Results were consistent with those of the analysis of medical records. CONCLUSIONS: Unadjusted PSI rates at UMHS are substantially overstated, because the PSIs do not differentiate preexisting conditions from complications and therefore include false positive cases. Because of these findings and the lack of a broader study of the validity of the indicators, PSIs should not be used to profile hospital performance.
Authors: Richard E Nelson; Scott D Grosse; Norman J Waitzman; Junji Lin; Scott L DuVall; Olga Patterson; James Tsai; Nimia Reyes Journal: Thromb Res Date: 2015-01-26 Impact factor: 3.944
Authors: V Sundararajan; P S Romano; H Quan; B Burnand; S E Drösler; S Brien; H A Pincus; W A Ghali Journal: Int J Qual Health Care Date: 2015-06-04 Impact factor: 2.038
Authors: Tina Hernandez-Boussard; Kathryn M McDonald; John M Morton; Ronald L Dalman; Fritz R Bech Journal: J Am Coll Surg Date: 2012-03-15 Impact factor: 6.113
Authors: Lee Squitieri; David A Ganz; Carol M Mangione; Jack Needleman; Patrick S Romano; Debra Saliba; Clifford Y Ko; Daniel A Waxman Journal: BMJ Qual Saf Date: 2017-07-28 Impact factor: 7.035
Authors: Lee Squitieri; Daniel A Waxman; Carol M Mangione; Debra Saliba; Clifford Y Ko; Jack Needleman; David A Ganz Journal: Health Serv Res Date: 2018-01-25 Impact factor: 3.402
Authors: Patrick S Romano; Hillary J Mull; Peter E Rivard; Shibei Zhao; William G Henderson; Susan Loveland; Dennis Tsilimingras; Cindy L Christiansen; Amy K Rosen Journal: Health Serv Res Date: 2008-09-17 Impact factor: 3.402