| Literature DB >> 36237521 |
Woocheol Jang1,2, Changwon Jeong3, KyungA Kwon4,5, Tae In Yoon6, Onvox Yi6, Kyung Won Kim7, Seoung-Oh Yang4, Jinseok Lee1.
Abstract
We developed an artificial intelligence (AI) model that can predict five-year survival in patients with stage IV metastatic breast cancer, mainly based on host factors and sarcopenia. From a prospectively built breast cancer registry, a total of 210 metastatic breast cancer patients were selected in a consecutive manner using inclusion/exclusion criteria. The patients' data were divided into two categories: a group that survived for more than 5 years and a group that did not survive for 5 years. For the AI model input, 11 features were considered, including age, body mass index, skeletal muscle area (SMA), height-relative SMA (H-SMI), height square-relative SMA (H2-SMA), weight-relative SMA (W-SMA), muscle mass, anticancer chemotherapy, radiation therapy, and comorbid diseases such as hypertension and mellitus. For the feature importance analysis, we compared classifiers using six different machine learning algorithms and found that extreme gradient boosting (XGBoost) provided the best accuracy. Subsequently, we performed the feature importance analysis based on XGBoost and proposed a 4-layer deep neural network, which considered the top 10 ranked features. Our proposed 4-layer deep neural network provided high sensitivity (75.00%), specificity (78.94%), accuracy (78.57%), balanced accuracy (76.97%), and an area under receiver operating characteristics of 0.90. We generated a web application for anyone to easily access and use this AI model to predict five-year survival. We expect this web application to be helpful for patients to understand the importance of host factors and sarcopenia and achieve survival gain.Entities:
Keywords: artificial intelligence; breast cancer; feature importance; five-year survival; sarcopenia
Year: 2022 PMID: 36237521 PMCID: PMC9551304 DOI: 10.3389/fphys.2022.977189
Source DB: PubMed Journal: Front Physiol ISSN: 1664-042X Impact factor: 4.755
Variables from patients’ data.
| Data | Type | Description | |
|---|---|---|---|
| 1 | ID | Number | Anonymous |
| 2 | Age | Number | age |
| 3 | Weight | Number | Weight (unit = kg) |
| 4 | Height | Number | Height (unit = cm) |
| 5 | BMI | Number | BMI |
| 6 | SMA | Number | SMA |
| 7 | H-SMA | Number | SMA divided by the height |
| 8 | H2-SMA | Number | SMA divided by the square of the height |
| 9 | W-SMA | Number | SMA divided by the weight |
| 10 | Muscle mass | Number | Muscle mass measured by CT |
| 11 | Anticancer chemotherapy | 2 categories | 0) No, 1) Yes |
| 12 | Radiation therapy | 2 categories | 0) No, 1) Yes |
| 13 | Comorbidity (hypertension) | 2 categories | 0) No, 1) Yes |
| 14 | Comorbidity (diabetes mellitus) | 2 categories | 0) No, 1) Yes |
| 15 | Date of diagnosis | 2 categories | 0) No, 1) Yes |
| 16 | Date of death | Number | Date (0 being alive) |
| 17 | Survival period | Number | Weeks (0 being alive) |
ID, identity document; BMI, body mass index; SMA, skeletal muscle area; H, height; W, weight; CT, computed tomography.
Statistical summary of clinical features from the survival group (n = 20, 9.52%) and death group (n = 190, 90.47%).
| No | Data | deceased group ( | survived group ( |
|
|---|---|---|---|---|
| 1 | Age | 54.32 ± 9.76 | 57.75 ± 6.86 | 0.124 |
| 2 | BMI | 23.37 ± 3.40 | 23.55 ± 3.20 | 0.768 |
| 3 | Muscle mass | 6.14 ± 0.90 | 6.02 ± 0.68 | 0.369 |
| 4 | Anticancer chemotherapy | 183/190 (96%) | 19/20 (95%) | 0.947 |
| 5 | Radiation therapy | 145/190 (76%) | 12/20 (60%) | 0.077 |
| 6 | SMA | 114.94 ± 16396 | 120.80 ± 17.70 | 0.659 |
| 7 | H-SMA | 73.22 ± 10.46 | 76.24 ± 10.80 | 0.404 |
| 8 | H2-SMA | 46.74 ± 6.85 | 48.16 ± 6.94 | 0.459 |
| 9 | W-SMA | 2.01 ± 0.21 | 2.05 ± 0.22 | 0.893 |
| 10 | Hypertension | 27/190 (14%) | 6/20 (30%) | 0.072 |
| 11 | Diabetes mellitus | 19/190 (10%) | 0/20 (0%) | 0.036 |
ID, identity document; BMI, body mass index; SMA, skeletal muscle area; H, height; W, weight; CT, computed tomography.
Summary of training, validation, and testing datasets.
| Deceased group | Survived group | Total | |
|---|---|---|---|
| Training data | 152 | 16 | 168 |
| Testing data | 38 | 4 | 42 |
| Total | 190 | 20 | 210 |
FIGURE 1Overall strategy and architecture to build our proposed 4-layer DNN model: given the cross-validation accuracy analysis from the best classifier, XGBoost, we modeled with a 4-layer DNN using the top 10 features providing the best cross-validation accuracy. Results of feature importance analysis from XGBoost: SMA is with the highest importance.
Cross-validation results from six different machine learning algorithms (mean ± standard deviation).
| Cross-validation results | |||||
|---|---|---|---|---|---|
| Model | Sensitivity | Specificity | Accuracy | Balanced accuracy | AUROC |
| LR | 0.29 ± 0.26 | 0.62 ± 0.10 | 0.59 ± 0.08 | 0.46 ± 0.12 | 0.51 ± 0.15 |
| SVM | 0.45 ± 0.34 | 0.72 ± 0.13 | 0.69 ± 0.11 | 0.58 ± 0.16 | 0.52 ± 0.21 |
| KNN | 0.53 ± 0.33 | 0.61 ± 0.10 | 0.60 ± 0.08 | 0.57 ± 0.15 | 0.56 ± 0.20 |
| RF | 0.40 ± 0.38 | 0.71 ± 0.05 | 0.67 ± 0.04 | 0.55 ± 0.18 | 0.53 ± 0.20 |
| AdaBoost | 0.31 ± 0.21 | 0.83 ± 0.02 | 0.78 ± 0.04 | 0.57 ± 0.11 | 0.56 ± 0.08 |
| XGBoost | 0.45 ± 0.17 | 0.88 ± 0.07 | 0.83 ± 0.07 | 0.66 ± 0.10 | 0.69 ± 0.16 |
LR, logistic regression; SVM, support vector machine; KNN, K-Nearest Neighbor algorithm; RF, random forest; AdaBoost, adaptive boosting; XGBoost, extreme gradient boosting.
FIGURE 2Results of feature importance analysis from XGBoost: SMA is with the highest importance value, followed by diabetes mellitus, H2-SMA, radiation therapy, age, anticancer chemotherapy, W-SMA, muscle mass, H-SMA, hypertension, and BMI.
FIGURE 3The influence of the ranked features on cross-validation accuracy metrics: the values of balanced accuracy and AUROC according to the number of top features.
Cross-validation results from DNN according to the number of top features (mean ± standard deviation).
| Cross-validation results ( | |||||
|---|---|---|---|---|---|
| The number of features | Sensitivity | Specificity | Accuracy | Balanced accuracy | AUROC |
| 1 | 0.73 ± 0.24 | 0.22 ± 0.09 | 0.27 ± 0.06 | 0.47 ± 0.09 | 0.45 ± 0.15 |
| 2 | 0.73 ± 0.32 | 0.27 ± 0.10 | 0.32 ± 0.05 | 0.50 ± 0.11 | 0.52 ± 0.13 |
| 3 | 0.53 ± 0.40 | 0.45 ± 0.06 | 0.46 ± 0.03 | 0.49 ± 0.17 | 0.47 ± 0.16 |
| 4 | 0.66 ± 0.36 | 0.56 ± 0.08 | 0.57 ± 0.06 | 0.61 ± 0.17 | 0.60 ± 0.19 |
| 5 | 0.59 ± 0.24 | 0.76 ± 0.11 | 0.75 ± 0.08 | 0.68 ± 0.08 | 0.77 ± 0.09 |
| 6 | 0.53 ± 0.33 | 0.72 ± 0.07 | 0.70 ± 0.06 | 0.62 ± 0.15 | 0.71 ± 0.16 |
| 7 | 0.46 ± 0.33 | 0.83 ± 0.10 | 0.78 ± 0.08 | 0.63 ± 0.15 | 0.71 ± 0.20 |
| 8 | 0.49 ± 0.14 | 0.74 ± 0.10 | 0.72 ± 0.09 | 0.62 ± 0.09 | 0.71 ± 0.15 |
| 9 | 0.49 ± 0.13 | 0.77 ± 0.07 | 0.74 ± 0.09 | 0.63 ± 0.05 | 0.69 ± 0.09 |
| 10 | 0.64 ± 0.31 | 0.79 ± 0.09 | 0.77 ± 0.07 | 0.72 ± 0.13 | 0.76 ± 0.12 |
| 11 | 0.24 ± 0.24 | 0.78 ± 0.05 | 0.73 ± 0.04 | 0.51 ± 0.10 | 0.66 ± 0.14 |
Testing data results.
| Model | TP | TN | FP | FN | Sensitivity | Specificity | Accuracy | Balanced accuracy | AUROC |
|---|---|---|---|---|---|---|---|---|---|
| 4-layer DNN (Proposed) | 3 | 30 | 8 | 1 | 0.75 | 0.7894 | 0.7857 | 0.7697 | 0.90 |
| LR | 2 | 21 | 17 | 2 | 0.5 | 0.4473 | 0.4523 | 0.4736 | 0.47 |
| SVM | 2 | 24 | 14 | 2 | 0.5 | 0.6315 | 0.6190 | 0.5657 | 0.55 |
| KNN | 2 | 37 | 7 | 2 | 0.5 | 0.8157 | 0.7857 | 0.6578 | 0.65 |
| RF | 2 | 27 | 11 | 2 | 0.5 | 0.7105 | 0.6904 | 0.6052 | 0.55 |
| AdaBoost | 1 | 33 | 5 | 3 | 0.25 | 0.8684 | 0.8095 | 0.5592 | 0.58 |
| XGBoost | 2 | 33 | 5 | 2 | 0.5 | 0.8684 | 0.8139 | 0.6842 | 0.67 |
TP, true positives; TN, true negatives; FP, false positives; FN, false negatives; AUROC, area under receiver operating characteristics; DNN, deep neural network; DT, decision tree; SVM, support vector machine; KNN, K-Nearest Neighbor algorithm; RF, random forest; AdaBoost, adaptive boosting; XGBoost, extreme gradient boosting.
FIGURE 4Our deployed web application: (A) input windows where the user inputs the patient’s data and (B) the predicted five-year survival results after entering the patient’s data.