Maria Kalweit1, Ulrich A Walker2, Axel Finckh3, Rüdiger Müller4, Gabriel Kalweit1, Almut Scherer5, Joschka Boedecker1, Thomas Hügle6. 1. Department of Computer Science, University of Freiburg, Freiburg Im Breisgau, Germany. 2. Department of Rheumatology, University Hospital Basel, Basel, Switzerland. 3. Division of Rheumatology, University Hospital Geneva, Geneva, Switzerland. 4. Department of Rheumatology, Kantonsspital Aarau, Switzerland. 5. SCQM Foundation, Zürich, Switzerland. 6. Department of Rheumatology, Lausanne University Hospital (CHUV) and University of Lausanne, Lausanne, Switzerland.
Abstract
BACKGROUND: Deep neural networks learn from former experiences on a large scale and can be used to predict future disease activity as potential clinical decision support. AdaptiveNet is a novel adaptive recurrent neural network optimized to deal with heterogeneous and missing clinical data. OBJECTIVE: We investigate AdaptiveNet for the prediction of individual disease activity in patients from a rheumatoid arthritis (RA) registry. METHODS: Demographic and disease characteristics from over 9500 patients and 65.000 visits from the Swiss Quality Management (SCQM) database were used to train and evaluate the network. Patient characteristics, clinical and patient reported outcomes, laboratory values and medication were used as input features. DAS28-BSR served as a target to predict active RA and future numeric individual disease activity by classification and regression. RESULTS: AdaptiveNet predicted active disease defined as DAS28-BSR >2.6 at the next visit with an overall accuracy of 75.6% (SD +- 0.7%) and a sensitivity and specificity of 84.2% (SD +- 1.6%) and 61.5% (SD +- 3.6%), respectively. Prediction performance was significantly higher in patients with a disease duration >3 years and positive rheumatoid factor. Regression allowed forecasting individual DAS28-BSR values with a mean squared error (MSE) of 0.9 (SD +- 0.05). This corresponds to a 8% deviation between estimated and real DAS28-BSR values. Compared to linear regression, random forest and support vector machines, AdaptiveNet showed an increased performance of over 7% in MSE. Medication played a minor role in the prediction of RA disease activity. CONCLUSION: AdaptiveNet has a superior capacity to predict numeric RA disease activity compared to classical machine learning architectures. All investigated models had limitations in low specificity.
BACKGROUND: Deep neural networks learn from former experiences on a large scale and can be used to predict future disease activity as potential clinical decision support. AdaptiveNet is a novel adaptive recurrent neural network optimized to deal with heterogeneous and missing clinical data. OBJECTIVE: We investigate AdaptiveNet for the prediction of individual disease activity in patients from a rheumatoid arthritis (RA) registry. METHODS: Demographic and disease characteristics from over 9500 patients and 65.000 visits from the Swiss Quality Management (SCQM) database were used to train and evaluate the network. Patient characteristics, clinical and patient reported outcomes, laboratory values and medication were used as input features. DAS28-BSR served as a target to predict active RA and future numeric individual disease activity by classification and regression. RESULTS: AdaptiveNet predicted active disease defined as DAS28-BSR >2.6 at the next visit with an overall accuracy of 75.6% (SD +- 0.7%) and a sensitivity and specificity of 84.2% (SD +- 1.6%) and 61.5% (SD +- 3.6%), respectively. Prediction performance was significantly higher in patients with a disease duration >3 years and positive rheumatoid factor. Regression allowed forecasting individual DAS28-BSR values with a mean squared error (MSE) of 0.9 (SD +- 0.05). This corresponds to a 8% deviation between estimated and real DAS28-BSR values. Compared to linear regression, random forest and support vector machines, AdaptiveNet showed an increased performance of over 7% in MSE. Medication played a minor role in the prediction of RA disease activity. CONCLUSION: AdaptiveNet has a superior capacity to predict numeric RA disease activity compared to classical machine learning architectures. All investigated models had limitations in low specificity.