Morgan E Grams1, Sushrut S Waikar, Blaithin MacMahon, Seamus Whelton, Shoshana H Ballew, Josef Coresh. 1. Division of Nephrology and, §Division of General Internal Medicine, Department of Medicine, Johns Hopkins University, Baltimore, Maryland;, †Renal Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, ‡Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland.
Abstract
BACKGROUND AND OBJECTIVES: Billing codes are frequently used to identify AKI events in epidemiologic research. The goals of this study were to validate billing code-identified AKI against the current AKI consensus definition and to ascertain whether sensitivity and specificity vary by patient characteristic or over time. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: The study population included 10,056 Atherosclerosis Risk in Communities study participants hospitalized between 1996 and 2008. Billing code-identified AKI was compared with the 2012 Kidney Disease Improving Global Outcomes (KDIGO) creatinine-based criteria (AKIcr) and an approximation of the 2012 KDIGO creatinine- and urine output-based criteria (AKIcr_uop) in a subset with available outpatient data. Sensitivity and specificity of billing code-identified AKI were evaluated over time and according to patient age, race, sex, diabetes status, and CKD status in 546 charts selected for review, with estimates adjusted for sampling technique. RESULTS: A total of 34,179 hospitalizations were identified; 1353 had a billing code for AKI. The sensitivity of billing code-identified AKI was 17.2% (95% confidence interval [95% CI], 13.2% to 21.2%) compared with AKIcr (n=1970 hospitalizations) and 11.7% (95% CI, 8.8% to 14.5%) compared with AKIcr_uop (n=1839 hospitalizations). Specificity was >98% in both cases. Sensitivity was significantly higher in the more recent time period (2002-2008) and among participants aged 65 years and older. Billing code-identified AKI captured a more severe spectrum of disease than did AKIcr and AKIcr_uop, with a larger proportion of patients with stage 3 AKI (34.9%, 19.7%, and 11.5%, respectively) and higher in-hospital mortality (41.2%, 18.7%, and 12.8%, respectively). CONCLUSIONS: The use of billing codes to identify AKI has low sensitivity compared with the current KDIGO consensus definition, especially when the urine output criterion is included, and results in the identification of a more severe phenotype. Epidemiologic studies using billing codes may benefit from a high specificity, but the variation in sensitivity may result in bias, particularly when trends over time are the outcome of interest.
BACKGROUND AND OBJECTIVES: Billing codes are frequently used to identify AKI events in epidemiologic research. The goals of this study were to validate billing code-identified AKI against the current AKI consensus definition and to ascertain whether sensitivity and specificity vary by patient characteristic or over time. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: The study population included 10,056 Atherosclerosis Risk in Communities study participants hospitalized between 1996 and 2008. Billing code-identified AKI was compared with the 2012 Kidney Disease Improving Global Outcomes (KDIGO) creatinine-based criteria (AKIcr) and an approximation of the 2012 KDIGO creatinine- and urine output-based criteria (AKIcr_uop) in a subset with available outpatient data. Sensitivity and specificity of billing code-identified AKI were evaluated over time and according to patient age, race, sex, diabetes status, and CKD status in 546 charts selected for review, with estimates adjusted for sampling technique. RESULTS: A total of 34,179 hospitalizations were identified; 1353 had a billing code for AKI. The sensitivity of billing code-identified AKI was 17.2% (95% confidence interval [95% CI], 13.2% to 21.2%) compared with AKIcr (n=1970 hospitalizations) and 11.7% (95% CI, 8.8% to 14.5%) compared with AKIcr_uop (n=1839 hospitalizations). Specificity was >98% in both cases. Sensitivity was significantly higher in the more recent time period (2002-2008) and among participants aged 65 years and older. Billing code-identified AKI captured a more severe spectrum of disease than did AKIcr and AKIcr_uop, with a larger proportion of patients with stage 3 AKI (34.9%, 19.7%, and 11.5%, respectively) and higher in-hospital mortality (41.2%, 18.7%, and 12.8%, respectively). CONCLUSIONS: The use of billing codes to identify AKI has low sensitivity compared with the current KDIGO consensus definition, especially when the urine output criterion is included, and results in the identification of a more severe phenotype. Epidemiologic studies using billing codes may benefit from a high specificity, but the variation in sensitivity may result in bias, particularly when trends over time are the outcome of interest.
Authors: Wolfgang C Winkelmayer; Sebastian Schneeweiss; Helen Mogun; Amanda R Patrick; Jerry Avorn; Daniel H Solomon Journal: Am J Kidney Dis Date: 2005-08 Impact factor: 8.860
Authors: M B Hamel; R S Phillips; R B Davis; N Desbiens; A F Connors; J M Teno; N Wenger; J Lynn; A W Wu; W Fulkerson; J Tsevat Journal: Ann Intern Med Date: 1997-08-01 Impact factor: 25.391
Authors: Michael J Fischer; Bradley B Brimhall; Dennis C Lezotte; Judith E Glazner; Chirag R Parikh Journal: Am J Kidney Dis Date: 2005-12 Impact factor: 8.860
Authors: Hude Quan; Vijaya Sundararajan; Patricia Halfon; Andrew Fong; Bernard Burnand; Jean-Christophe Luthi; L Duncan Saunders; Cynthia A Beck; Thomas E Feasby; William A Ghali Journal: Med Care Date: 2005-11 Impact factor: 2.983
Authors: Elizabeth F O Kern; Miriam Maney; Donald R Miller; Chin-Lin Tseng; Anjali Tiwari; Mangala Rajan; David Aron; Leonard Pogach Journal: Health Serv Res Date: 2006-04 Impact factor: 3.402
Authors: Jay L Xue; Frank Daniels; Robert A Star; Paul L Kimmel; Paul W Eggers; Bruce A Molitoris; Jonathan Himmelfarb; Allan J Collins Journal: J Am Soc Nephrol Date: 2006-02-22 Impact factor: 10.121
Authors: Wei-Qi Wei; Pedro L Teixeira; Huan Mo; Robert M Cronin; Jeremy L Warner; Joshua C Denny Journal: J Am Med Inform Assoc Date: 2015-09-02 Impact factor: 4.497
Authors: Chi-Yuan Hsu; Raymond K Hsu; Kathleen D Liu; Jingrong Yang; Amanda Anderson; Jing Chen; Vernon M Chinchilli; Harold I Feldman; Amit X Garg; Lee Hamm; Jonathan Himmelfarb; James S Kaufman; John W Kusek; Chirag R Parikh; Ana C Ricardo; Sylvia E Rosas; Georges Saab; Daohang Sha; Edward D Siew; James Sondheimer; Jonathan J Taliercio; Wei Yang; Alan S Go Journal: J Am Soc Nephrol Date: 2019-06-24 Impact factor: 10.121
Authors: Jeremiah R Brown; Michael E Rezaee; William M Hisey; Kevin C Cox; Michael E Matheny; Mark J Sarnak Journal: Am J Nephrol Date: 2016-04-29 Impact factor: 3.754
Authors: Benjamin Lazarus; Yuan Chen; Francis P Wilson; Yingying Sang; Alex R Chang; Josef Coresh; Morgan E Grams Journal: JAMA Intern Med Date: 2016-02 Impact factor: 21.873