Katherine R Courtright1, Scott D Halpern, Brian Bayes, Michael O Harhay, Eli Raneses, Patricia Kipnis, Gabriel J Escobar, Meeta Prasad Kerlin. 1. 1Division of Pulmonary, Allergy, & Critical Care Medicine, Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 2Leonard Davis Institute of Health Economics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 3Center for Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA. 4F. Edward Hébert School of Medicine, Uniform Services University of the Health Sciences, Bethesda, MD. 5Division of Research, Kaiser Permanente Northern California, Oakland, CA.
Abstract
OBJECTIVES: Without widely available physiologic data, a need exists for ICU risk adjustment methods that can be applied to administrative data. We sought to expand the generalizability of the Acute Organ Failure Score by adapting it to a commonly used administrative database. DESIGN: Retrospective cohort study. SETTING: One hundred fifty-one hospitals in Pennsylvania. PATIENTS: A total of 90,733 ICU admissions among 77,040 unique patients between January 1, 2009, and December 1, 2009, in the Medicare Provider Analysis and Review database. MEASUREMENTS AND MAIN RESULTS: We used multivariable logistic regression on a random split cohort to predict 30-day mortality, and to examine the impact of using different comorbidity measures in the model and adding historical claims data. Overall 30-day mortality was 17.6%. In the validation cohort, using the original Acute Organ Failure Score model's β coefficients resulted in poor discrimination (C-statistic, 0.644; 95% CI, 0.639-0.649). The model's C-statistic improved to 0.721 (95% CI, 0.711-0.730) when the Medicare cohort was used to recalibrate the β coefficients. Model discrimination improved further when comorbidity was expressed as the COmorbidity Point Score 2 (C-statistic, 0.737; 95% CI, 0.728-0.747; p < 0.001) or the Elixhauser index (C-statistic, 0.748; 95% CI, 0.739-0.757) instead of the Charlson index. Adding historical claims data increased the number of comorbidities identified, but did not enhance model performance. CONCLUSIONS: Modification of the Acute Organ Failure Score resulted in good model discrimination among a diverse population regardless of comorbidity measure used. This study expands the use of the Acute Organ Failure Score for risk adjustment in ICU research and outcomes reporting using standard administrative data.
OBJECTIVES: Without widely available physiologic data, a need exists for ICU risk adjustment methods that can be applied to administrative data. We sought to expand the generalizability of the Acute Organ Failure Score by adapting it to a commonly used administrative database. DESIGN: Retrospective cohort study. SETTING: One hundred fifty-one hospitals in Pennsylvania. PATIENTS: A total of 90,733 ICU admissions among 77,040 unique patients between January 1, 2009, and December 1, 2009, in the Medicare Provider Analysis and Review database. MEASUREMENTS AND MAIN RESULTS: We used multivariable logistic regression on a random split cohort to predict 30-day mortality, and to examine the impact of using different comorbidity measures in the model and adding historical claims data. Overall 30-day mortality was 17.6%. In the validation cohort, using the original Acute Organ Failure Score model's β coefficients resulted in poor discrimination (C-statistic, 0.644; 95% CI, 0.639-0.649). The model's C-statistic improved to 0.721 (95% CI, 0.711-0.730) when the Medicare cohort was used to recalibrate the β coefficients. Model discrimination improved further when comorbidity was expressed as the COmorbidity Point Score 2 (C-statistic, 0.737; 95% CI, 0.728-0.747; p < 0.001) or the Elixhauser index (C-statistic, 0.748; 95% CI, 0.739-0.757) instead of the Charlson index. Adding historical claims data increased the number of comorbidities identified, but did not enhance model performance. CONCLUSIONS: Modification of the Acute Organ Failure Score resulted in good model discrimination among a diverse population regardless of comorbidity measure used. This study expands the use of the Acute Organ Failure Score for risk adjustment in ICU research and outcomes reporting using standard administrative data.
Authors: Anuj B Mehta; Allan J Walkey; Douglas Curran-Everett; Daniel Matlock; Ivor S Douglas Journal: Crit Care Med Date: 2019-03 Impact factor: 7.598
Authors: Sameer S Kadri; Cumhur Y Demirkale; Junfeng Sun; Lindsay M Busch; Jeffrey R Strich; Ning Rosenthal; Sarah Warner Journal: Open Forum Infect Dis Date: 2020-12-15 Impact factor: 3.835