Monica A Konerman1, Yiwei Zhang1, Ji Zhu1, Peter D R Higgins1, Anna S F Lok1, Akbar K Waljee1,2. 1. Division of Gastroenterology, Department of Internal Medicine, University of Michigan Health System, Ann Arbor, MI. 2. VA Ann Arbor Health Services Research and Development Center of Clinical Management Research, Ann Arbor, MI.
Abstract
UNLABELLED: Existing predictive models of risk of disease progression in chronic hepatitis C have limited accuracy. The aim of this study was to improve upon existing models by applying novel statistical methods that incorporate longitudinal data. Patients in the Hepatitis C Antiviral Long-term Treatment Against Cirrhosis trial were analyzed. Outcomes of interest were (1) fibrosis progression (increase of two or more Ishak stages) and (2) liver-related clinical outcomes (liver-related death, hepatic decompensation, hepatocellular carcinoma, liver transplant, or increase in Child-Turcotte-Pugh score to ≥7). Predictors included longitudinal clinical, laboratory, and histologic data. Models were constructed using logistic regression and two machine learning methods (random forest and boosting) to predict an outcome in the next 12 months. The control arm was used as the training data set (n = 349 clinical, n = 184 fibrosis) and the interferon arm, for internal validation. The area under the receiver operating characteristic curve for longitudinal models of fibrosis progression was 0.78 (95% confidence interval [CI] 0.74-0.83) using logistic regression, 0.79 (95% CI 0.77-0.81) using random forest, and 0.79 (95% CI 0.77-0.82) using boosting. The area under the receiver operating characteristic curve for longitudinal models of clinical progression was 0.79 (95% CI 0.77-0.82) using logistic regression, 0.86 (95% CI 0.85-0.87) using random forest, and 0.84 (95% CI 0.82-0.86) using boosting. Longitudinal models outperformed baseline models for both outcomes (P < 0.0001). Longitudinal machine learning models had negative predictive values of 94% for both outcomes. CONCLUSIONS: Prediction models that incorporate longitudinal data can capture nonlinear disease progression in chronic hepatitis C and thus outperform baseline models. Machine learning methods can capture complex relationships between predictors and outcomes, yielding more accurate predictions; our models can help target costly therapies to patients with the most urgent need, guide the intensity of clinical monitoring required, and provide prognostic information to patients.
UNLABELLED: Existing predictive models of risk of disease progression in chronic hepatitis C have limited accuracy. The aim of this study was to improve upon existing models by applying novel statistical methods that incorporate longitudinal data. Patients in the Hepatitis C Antiviral Long-term Treatment Against Cirrhosis trial were analyzed. Outcomes of interest were (1) fibrosis progression (increase of two or more Ishak stages) and (2) liver-related clinical outcomes (liver-related death, hepatic decompensation, hepatocellular carcinoma, liver transplant, or increase in Child-Turcotte-Pugh score to ≥7). Predictors included longitudinal clinical, laboratory, and histologic data. Models were constructed using logistic regression and two machine learning methods (random forest and boosting) to predict an outcome in the next 12 months. The control arm was used as the training data set (n = 349 clinical, n = 184 fibrosis) and the interferon arm, for internal validation. The area under the receiver operating characteristic curve for longitudinal models of fibrosis progression was 0.78 (95% confidence interval [CI] 0.74-0.83) using logistic regression, 0.79 (95% CI 0.77-0.81) using random forest, and 0.79 (95% CI 0.77-0.82) using boosting. The area under the receiver operating characteristic curve for longitudinal models of clinical progression was 0.79 (95% CI 0.77-0.82) using logistic regression, 0.86 (95% CI 0.85-0.87) using random forest, and 0.84 (95% CI 0.82-0.86) using boosting. Longitudinal models outperformed baseline models for both outcomes (P < 0.0001). Longitudinal machine learning models had negative predictive values of 94% for both outcomes. CONCLUSIONS: Prediction models that incorporate longitudinal data can capture nonlinear disease progression in chronic hepatitis C and thus outperform baseline models. Machine learning methods can capture complex relationships between predictors and outcomes, yielding more accurate predictions; our models can help target costly therapies to patients with the most urgent need, guide the intensity of clinical monitoring required, and provide prognostic information to patients.
Authors: Robert J Fontana; Jules L Dienstag; Herbert L Bonkovsky; Richard K Sterling; Deepa Naishadham; Zachary D Goodman; Anna S F Lok; Elizabeth C Wright; Grace L Su Journal: Gut Date: 2010-07-30 Impact factor: 23.059
Authors: B Baran; M Gulluoglu; O M Soyer; A C Ormeci; S Gokturk; S Evirgen; S Yesil; F Akyuz; C Karaca; K Demir; S Kaymakoglu; F Besisik Journal: J Viral Hepat Date: 2013-08-27 Impact factor: 3.728
Authors: Bryce D Smith; Rebecca L Morgan; Geoff A Beckett; Yngve Falck-Ytter; Deborah Holtzman; Chong-Gee Teo; Amy Jewett; Brittney Baack; David B Rein; Nita Patel; Miriam Alter; Anthony Yartel; John W Ward Journal: MMWR Recomm Rep Date: 2012-08-17
Authors: Akbar K Waljee; Joel C Joyce; Sijian Wang; Aditi Saxena; Margaret Hart; Ji Zhu; Peter D R Higgins Journal: Clin Gastroenterol Hepatol Date: 2009-10-14 Impact factor: 11.382
Authors: Eric Lawitz; Alessandra Mangia; David Wyles; Maribel Rodriguez-Torres; Tarek Hassanein; Stuart C Gordon; Michael Schultz; Mitchell N Davis; Zeid Kayali; K Rajender Reddy; Ira M Jacobson; Kris V Kowdley; Lisa Nyberg; G Mani Subramanian; Robert H Hyland; Sarah Arterburn; Deyuan Jiang; John McNally; Diana Brainard; William T Symonds; John G McHutchison; Aasim M Sheikh; Zobair Younossi; Edward J Gane Journal: N Engl J Med Date: 2013-04-23 Impact factor: 91.245
Authors: William M Lee; Jules L Dienstag; Karen L Lindsay; Anna S Lok; Herbert L Bonkovsky; Mitchell L Shiffman; Gregory T Everson; Adrian M Di Bisceglie; Timothy R Morgan; Marc G Ghany; Chihiro Morishima; Elizabeth C Wright; James E Everhart Journal: Control Clin Trials Date: 2004-10
Authors: Marc G Ghany; David E Kleiner; Harvey Alter; Edward Doo; Farooq Khokar; Kittichai Promrat; David Herion; Yoon Park; T Jake Liang; Jay H Hoofnagle Journal: Gastroenterology Date: 2003-01 Impact factor: 22.682
Authors: Jian Xing; Philip R Spradling; Anne C Moorman; Scott D Holmberg; Eyasu H Teshale; Loralee B Rupp; Stuart C Gordon; Mei Lu; Joseph A Boscarino; Mark A Schmidt; Connie M Trinacty; Fujie Xu Journal: Dig Dis Sci Date: 2017-09-30 Impact factor: 3.199
Authors: Akbar K Waljee; Kay Sauder; Anand Patel; Sandeep Segar; Boang Liu; Yiwei Zhang; Ji Zhu; Ryan W Stidham; Ulysses Balis; Peter D R Higgins Journal: J Crohns Colitis Date: 2017-07-01 Impact factor: 9.071
Authors: Hendrikus J A van Os; Lucas A Ramos; Adam Hilbert; Matthijs van Leeuwen; Marianne A A van Walderveen; Nyika D Kruyt; Diederik W J Dippel; Ewout W Steyerberg; Irene C van der Schaaf; Hester F Lingsma; Wouter J Schonewille; Charles B L M Majoie; Silvia D Olabarriaga; Koos H Zwinderman; Esmee Venema; Henk A Marquering; Marieke J H Wermer Journal: Front Neurol Date: 2018-09-25 Impact factor: 4.003
Authors: Monica A Konerman; Dongxia Lu; Yiwei Zhang; Mary Thomson; Ji Zhu; Aashesh Verma; Boang Liu; Nizar Talaat; Ulysses Balis; Peter D R Higgins; Anna S F Lok; Akbar K Waljee Journal: PLoS One Date: 2017-11-06 Impact factor: 3.240