Bon San Koo1, Seongho Eun2, Kichul Shin3, Hyemin Yoon4, Chaelin Hong4, Do-Hoon Kim5, Seokchan Hong6, Yong-Gil Kim6, Chang-Keun Lee6, Bin Yoo6, Ji Seon Oh7. 1. Department of Internal Medicine, Inje University Seoul Paik Hospital, Inje University College of Medicine, Seoul, Korea. 2. Department of Management Engineering, College of Business, KAIST, Seoul, Korea. 3. Division of Rheumatology, Seoul Metropolitan Government-Seoul National University Hospital Boramae Medical Center, Seoul, Korea. 4. Big Data Research Center, Asan Institute of Life Sciences, Asan Medical Center, Seoul, Korea. 5. Department of Information Medicine, Asan Medical Center, 88, Olympic-ro 43-gil, Songpa-gu, Seoul, Korea. 6. Division of Rheumatology, Department of Internal Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea. 7. Department of Information Medicine, Asan Medical Center, 88, Olympic-ro 43-gil, Songpa-gu, Seoul, Korea. doogie55@naver.com.
Abstract
BACKGROUND: We developed a model to predict remissions in patients treated with biologic disease-modifying anti-rheumatic drugs (bDMARDs) and to identify important clinical features associated with remission using explainable artificial intelligence (XAI). METHODS: We gathered the follow-up data of 1204 patients treated with bDMARDs (etanercept, adalimumab, golimumab, infliximab, abatacept, and tocilizumab) from the Korean College of Rheumatology Biologics and Targeted Therapy Registry. Remission was predicted at 1-year follow-up using baseline clinical data obtained at the time of enrollment. Machine learning methods (e.g., lasso, ridge, support vector machine, random forest, and XGBoost) were used for the predictions. The Shapley additive explanation (SHAP) value was used for interpretability of the predictions. RESULTS: The ranges for accuracy and area under the receiver operating characteristic of the newly developed machine learning model for predicting remission were 52.8-72.9% and 0.511-0.694, respectively. The Shapley plot in XAI showed that the impacts of the variables on predicting remission differed for each bDMARD. The most important features were age for adalimumab, rheumatoid factor for etanercept, erythrocyte sedimentation rate for infliximab and golimumab, disease duration for abatacept, and C-reactive protein for tocilizumab, with mean SHAP values of - 0.250, - 0.234, - 0.514, - 0.227, - 0.804, and 0.135, respectively. CONCLUSIONS: Our proposed machine learning model successfully identified clinical features that were predictive of remission in each of the bDMARDs. This approach may be useful for improving treatment outcomes by identifying clinical information related to remissions in patients with rheumatoid arthritis.
BACKGROUND: We developed a model to predict remissions in patients treated with biologic disease-modifying anti-rheumatic drugs (bDMARDs) and to identify important clinical features associated with remission using explainable artificial intelligence (XAI). METHODS: We gathered the follow-up data of 1204 patients treated with bDMARDs (etanercept, adalimumab, golimumab, infliximab, abatacept, and tocilizumab) from the Korean College of Rheumatology Biologics and Targeted Therapy Registry. Remission was predicted at 1-year follow-up using baseline clinical data obtained at the time of enrollment. Machine learning methods (e.g., lasso, ridge, support vector machine, random forest, and XGBoost) were used for the predictions. The Shapley additive explanation (SHAP) value was used for interpretability of the predictions. RESULTS: The ranges for accuracy and area under the receiver operating characteristic of the newly developed machine learning model for predicting remission were 52.8-72.9% and 0.511-0.694, respectively. The Shapley plot in XAI showed that the impacts of the variables on predicting remission differed for each bDMARD. The most important features were age for adalimumab, rheumatoid factor for etanercept, erythrocyte sedimentation rate for infliximab and golimumab, disease duration for abatacept, and C-reactive protein for tocilizumab, with mean SHAP values of - 0.250, - 0.234, - 0.514, - 0.227, - 0.804, and 0.135, respectively. CONCLUSIONS: Our proposed machine learning model successfully identified clinical features that were predictive of remission in each of the bDMARDs. This approach may be useful for improving treatment outcomes by identifying clinical information related to remissions in patients with rheumatoid arthritis.
Authors: Yuanfang Guan; Hongjiu Zhang; Daniel Quang; Ziyan Wang; Stephen C J Parker; Dimitrios A Pappas; Joel M Kremer; Fan Zhu Journal: Arthritis Rheumatol Date: 2019-11-04 Impact factor: 10.995
Authors: Edward C Keystone; Arthur F Kavanaugh; John T Sharp; Hyman Tannenbaum; Ye Hua; Leah S Teoh; Steven A Fischkoff; Elliot K Chartash Journal: Arthritis Rheum Date: 2004-05
Authors: W Kievit; E M Adang; J Fransen; H H Kuper; M A F J van de Laar; T L Jansen; C M A De Gendt; D-J R A M De Rooij; H L M Brus; P C M Van Oijen; P C L M Van Riel Journal: Ann Rheum Dis Date: 2008-01-03 Impact factor: 19.103
Authors: M E Weinblatt; J M Kremer; A D Bankhurst; K J Bulpitt; R M Fleischmann; R I Fox; C G Jackson; M Lange; D J Burge Journal: N Engl J Med Date: 1999-01-28 Impact factor: 91.245
Authors: Josef S Smolen; Robert B M Landewé; Johannes W J Bijlsma; Gerd R Burmester; Maxime Dougados; Andreas Kerschbaumer; Iain B McInnes; Alexandre Sepriano; Ronald F van Vollenhoven; Maarten de Wit; Daniel Aletaha; Martin Aringer; John Askling; Alejandro Balsa; Maarten Boers; Alfons A den Broeder; Maya H Buch; Frank Buttgereit; Roberto Caporali; Mario Humberto Cardiel; Diederik De Cock; Catalin Codreanu; Maurizio Cutolo; Christopher John Edwards; Yvonne van Eijk-Hustings; Paul Emery; Axel Finckh; Laure Gossec; Jacques-Eric Gottenberg; Merete Lund Hetland; Tom W J Huizinga; Marios Koloumas; Zhanguo Li; Xavier Mariette; Ulf Müller-Ladner; Eduardo F Mysler; Jose A P da Silva; Gyula Poór; Janet E Pope; Andrea Rubbert-Roth; Adeline Ruyssen-Witrand; Kenneth G Saag; Anja Strangfeld; Tsutomu Takeuchi; Marieke Voshaar; René Westhovens; Désirée van der Heijde Journal: Ann Rheum Dis Date: 2020-01-22 Impact factor: 19.103
Authors: Jasvinder A Singh; Kenneth G Saag; S Louis Bridges; Elie A Akl; Raveendhara R Bannuru; Matthew C Sullivan; Elizaveta Vaysbrot; Christine McNaughton; Mikala Osani; Robert H Shmerling; Jeffrey R Curtis; Daniel E Furst; Deborah Parks; Arthur Kavanaugh; James O'Dell; Charles King; Amye Leong; Eric L Matteson; John T Schousboe; Barbara Drevlow; Seth Ginsberg; James Grober; E William St Clair; Elizabeth Tindall; Amy S Miller; Timothy McAlindon Journal: Arthritis Rheumatol Date: 2015-11-06 Impact factor: 10.995
Authors: Ian R White; Sarah E Kleinstein; Christophe Praet; Chris Chamberlain; Duncan McHale; Jessica M Maia; Pingxing Xie; David B Goldstein; Thomas J Urban; Patrick R Shea Journal: PLoS One Date: 2022-04-12 Impact factor: 3.240
Authors: Vincent Bouget; Julien Duquesne; Signe Hassler; Paul-Henry Cournède; Bruno Fautrel; Francis Guillemin; Marc Pallardy; Philippe Broët; Xavier Mariette; Samuel Bitoun Journal: RMD Open Date: 2022-08