CONUT Score or/and Peripheral Blood CD4+/CD8+ Ratio-Based Web Dynamic Nomograms to Predict the Individualized Survival of Patients with Advanced Osteosarcoma.

BACKGROUND: Nutritional and immune status is paramount for the overall survival (OS) of patients with advanced osteosarcoma. Comprehensive prognostic predictors based on the two indices are scarce. This study aimed to construct and validate individualized web dynamic nomograms based on CONUT score or/and peripheral blood CD4+/CD8+ ratio for OS in patients with advanced osteosarcoma.
MATERIALS AND METHODS: The clinical data of 376 advanced osteosarcoma patients from January 2000 to December 2019 were retrospectively collected. Data from the 301 patients (diagnosed in the first 15 years) were used as the development set and data from the remaining 75 patients were assigned as the validation set. Multivariate Cox regression analyses were conducted and three prediction models were constructed, namely, CD4+/CD8+ ratio univariate model (model 1), CONUT score univariate model (model 2), and CD4+/CD8+ ratio plus CONUT score (model 3). These models were visualized by conventional nomograms and individualized web dynamic nomograms, and their performances were further evaluated by C-index, calibration curve, receiver operating characteristic (ROC) curve, and decision curve analysis (DCA), respectively.
RESULTS: In multivariate Cox analysis, age, metastasis, ALP, CD4+/CD8+ ratio, chemotherapy, and CONUT score were identified as independent prognostic factors for OS. The calibration curves of the three models all showed good agreement between the actual observation and nomogram prediction for 1-year overall survival. In the development set, the C-index and area under the curve (AUC) of model 3 (0.837, 0.848) were higher than that of model 1 (0.765, 0.773) and model 2 (0.712, 0.749). Similar trends were observed in the validation set. The net benefits of model 3 were better than the other two models within the threshold probability of 36-80% in DCA.
CONCLUSION: CONUT score and peripheral CD4+/CD8+ ratio are easily available, reliable, and economical prognostic predictors for survival prediction and stratification in patients with advanced osteosarcoma, but the two predictors combined can establish a better prognosis prediction model.

Introduction

Osteosarcoma is a highly malignant mesenchymal tumor that primarily occurred in bone and characterized by adolescent onset, obvious disease heterogeneity, and high susceptibility of early lung metastasis.1 The development and utilization of modern multidisciplinary therapy (MDT) have significantly improved the prognosis of osteosarcoma, and the 5-year overall survival (OS) rate has significantly increased from less than 20% to approximately 70% in patients with non-metastatic disease.2,3 However, regarding patients with metastatic osteosarcoma, not all the patients can benefit from MDT due to the heterogeneity of the disease, and the prognosis was still dismal, with the 5-year survival rate being less than 30%.4 One of the primary obstacles for this failure was the lack of effective and reliable prognostic predictive biomarkers to guide pre-treatment risk stratification and treatment protocol selection.

A series of factors have revealed their predictive or prognostic values in multiple malignancies and they can be roughly categorized into two types: traditionally established prognostic factors and newly-identified predictive factors. Clinicopathologic features, inflammatory indices, nutritional indices, immune indices, and metabolic indices were the most commonly used and conventionally established prognostic indicators.5–10 In contrast, some differentially expressed and tissue-specific proteins, micro-RNAs (miRNAs), long non-coding RNAs (lncRNAs), and circular RNAs (circRNAs) can also serve as reliable prognosticators in various neoplasms.11–14 It is undoubtedly that all these predictors inherently and ineluctably harbor their merits and drawbacks. Generally, traditionally established predictors are more accessible and affordable than the newly-identified prognosticators, but they cannot rival the latter in predictive specificity and accuracy. Therefore, how to identify an ideal prognostic predictor is a hard nut pending to be conquered. An economic and pragmatic approach to circumvent such dilemma is to establish new prognostic predictors with the currently identified prognosticators.

For patients with advanced malignant diseases, nutritional and immune status is the most pivotal prognostic factors for survival.15,16 A favorable nutritional condition is the prerequisite to perform any therapeutic regimen, such as chemotherapy, radiotherapy, or targeted therapy. Malnourished patients usually cannot withstand these treatments and thus are more prone to obtain worse outcomes. Actually, malnutrition or undernourishment is an already identified prognosticator for unfavorable outcomes in various malignancies, including osteosarcoma.17–20 The Controlling Nutritional Status (CONUT) score, calculated from serum albumin, total cholesterol, and total lymphocyte counts (TLC), is an objective nutrition scoring system that has been extensively utilized to assess nutritional status in various malignant diseases, such as renal cell carcinoma, hepatocellular carcinoma, and gastric cancer.21–24 A notable advantage of this scoring system is that all the data for its constituent parameters can be readily calculated from routine biochemical or blood tests, and their dynamic changes can be easily monitored by clinicians. Unfortunately, although CONUT score is a reliable prognosticator for various cancers, its prognostic and predictive significance in osteosarcoma remains undetermined.

Immune function, another vital prognosticator for advanced neoplasms, participates in multiple biological processes of tumors, including tumorigenesis, progression, and metastasis. Numerous immune predictors have exhibited their prognostic values in cancers, including absolute lymphocyte count (ALC), platelet–lymphocyte ratio (PLR), lymphocyte–monocyte ratio (LMR), neutrophil–lymphocyte ratio (NLR), peripheral blood lymphocyte subsets analysis (PBLSA), tumor-infiltrating lymphocytes (TILs), tumor-associated macrophages (TAMs), and other immune infiltrations in the tumor microenvironment (TME).25–34 Regarding osteosarcoma, higher NLR or PLR, and lower LMR or ALC were significantly associated with inferior outcomes.25–27 Besides, pre-treatment intratumoral CD8+/FOXP3+-ratio ≤ 3.08, decreased circulating CD8+ T cells to T-regulatory cells (Tregs) (CD8+/Tregs) ratio, or increased percentage of peripheral blood CD4+CXCR5+ T cells usually portend unfavorable survival or metastasis, while early recovery of peripheral blood lymphocytes during chemotherapy is associated with better prognosis in osteosarcoma.1,28,35 Among all these immune prognostic predictors, PBLSA is the most convenient and pragmatic prognosticator for tumors. Especially, CD4+/CD8+ ratio, a commonly used parameter of PBLSA, has already revealed its prognostic values in various tumors, including laryngeal cancer, renal cell carcinoma, melanoma, and breast cancer.36–39 However, similar to CONUT score, the clinical significance of CD4+/CD8+ ratio in osteosarcoma also remains uncertain.

Given the paramount role of immunity and nutrition, as well as the potent prognostic values of CONUT score and CD4+/CD8+ ratio in other malignancies, it is reasonable to speculate that prognostic systems based on them may harvest optimal and reliable predictive performances in osteosarcoma. Therefore, our study aimed to study the predictive and prognostic values of CONUT score or/and peripheral blood CD4+/CD8+ ratio-based prediction models in patients with advanced osteosarcoma.

Patients and Methods

Patient Selection and Study Design

This retrospective observational study was scrutinized and approved by the ethical committee of Cancer Hospital of China Medical University (also named Liaoning Cancer Hospital and Institute). The requirement for informed consent was waived in this study due to the nature of retrospective design and anonymization of the data. By reviewing the electronic medical records, the clinical data of 376 advanced osteosarcoma patients admitted to the department of bone and soft tissue surgery from January 2000 to December 2019 were retrospectively collected. Inclusion criteria of participants were as follows: (i) pathologically confirmed as osteosarcoma; (ii) the existence of at least one metastatic lesion beyond the primary tumor site determined by the image examination or with late stage disease; and (iii) with detailed and completed extractable medical data and were not lost to follow-up. Patients who met the following criteria were excluded from the study: (i) any history of other malignancies; (ii) pulmonary nodules or metastatic lesions derived from other malignant diseases; and (iii) incomplete or unextractable medical data and laboratory results.

In this study, 301 patients from January 2000 to December 2014 were utilized as the development set, while the remaining 75 patients from January 2014 to December 2019 were assigned as the validation set.

CONUT Score Definition and Peripheral Blood Lymphocyte Subsets Analysis

CONUT score is a comprehensive nutritional and immune index calculated from serum albumin, serum total cholesterol concentration, and peripheral TLC, as previously reported.40 The three constituent parameters of CONUT score were scored based on the cut-off values reported in previous studies,41–43 and the sum of the score was the CONUT score. Patients were stratified into four groups according to the CONUT score listed in Table 1.

Table 1

The Details of CONUT Score

Parameters	Range (Score)
Serum albumin (g/dL)	≥3.5 (1)	3.0–3.49 (2)	2.5–2.9 (4)	<2.5 (6)
Serum total cholesterol (mg/dL)	≥180 (0)	140–180 (1)	100–139 (2)	<100 (3)
Lymphocyte count (/mm3)	≥1600 (0)	1200–1599 (1)	800–1199 (2)	<800 (3)
CONUT score	0–1	2–4	5–8	9–12
Nutrition stratification	Normal	Mild	Moderate	Severe

Abbreviation: CONUT score, controlling nutritional status score.

Peripheral whole blood samples were taken before breakfast in the morning and collected into heparinized tubes for PBLSA. Before the conduction of flow cytometric analysis, a series of treatments for heparinized blood were performed, including mixed with fluorescence-labeled monoclonal antibodies, incubated for 30 minutes, washed by phosphate-buffered saline (PBS), centrifuged at 1500 rpm for 5 minutes, discarded the supernatant and resuspended the remaining pellet. Finally, an eligible sample was obtained for flow cytometric analysis. The examinations for each patient were performed three times and the average of the three outcomes was used for final statistical analysis. The detailed steps for PBLSA can refer to the descriptions in relevant literature.44–46

Data Collection

The baseline demographics and variables listed below were obtained at diagnosis, including age, gender, NLR, PLR, metastasis, primary tumor site, tumor size, alkaline phosphatase (ALP), anti-angiogenesis therapy, peripheral blood CD4+/CD8+ ratio, chemotherapy, and CONUT score.

Follow-Up

The follow-up started when the patients were diagnosed with advanced, late stage, or metastatic disease, and it ended until death or December 2019. The end-point for this study was overall survival (OS), which can be calculated from the date of the initial diagnosis of advanced or metastatic disease to death (event) from any cause or the last date of follow-up (censored).

Statistical Analyses

Patient Characteristics and Continuous Variable Grouping

The Shapiro–Wilk test was conducted to determine the normality of the measurement data. The continuous variables were presented as median (interquartile range) while the categorical variables were presented as frequencies (percentages).

Comparisons of clinical characteristics between the development set and validation set were conducted by Fisher’s exact test or chi-squared test for categorical data, and Wilcoxon’s rank-sum test for measurement data.

For the continuous variables of age, NLR, PLR, ALP and CD4+/CD8+ ratio, their optimal cut-off points were identified by the method of the receiver operating characteristic (ROC) curve analyses based on the maximal Youden’s index. These variables were then dichotomized into two groups based on the optimal cut-off points. The survival differences between groups for the variables of CD4+/CD8+ ratio and CONUT score were examined by the Kaplan–Meier survival curve and Log-rank test.

Model Construction and Visualization

The Cox proportional hazards model and the stepwise selection method based on minimal Akaike information criterion (AIC) were used to determine the final predictors from the potential variables. The Schoenfeld residual plots and variance inflation factor (VIF) were also performed to examine the Cox proportional hazards model assumption and multicollinearity of variables, respectively. Based on the results from Cox analyses, three predictive models (Model 1–3) and nomograms to predict median survival time (MST), 1-year survival probability, and 3-year survival probability were constructed. Furthermore, the three predictive models were visualized in two ways, including conventional nomograms and the newly developed interactive web dynamic nomograms.

Model Evaluation

After the establishment of the nomograms, their predictive performances were evaluated, including discrimination and calibration. Discrimination represents the ability to distinguish survivors from non-survivors at specific time nodes, which is often evaluated by plotting the ROC curve and then calculating and comparing its related parameters, such as the area under curve (AUC). Therefore, we firstly drew three ROC curves at the time point of 1-year overall survival and then calculated its related evaluating indices of the three models in the development and validation cohort, including AUC, sensitivity (Sen), specificity (Spe), positive predictive value (PV+), negative predictive value (PV-), positive likelihood ratio (LR+), and negative likelihood ratio (LR-). Moreover, the Harrell’s concordance index (C-index) was also calculated and compared among the three models in both sets.

The calibration curves were also plotted to assess the concordance between the predicted survival and observed survival. Furthermore, decision curve analysis (DCA) was utilized to compare the performance and superiority of the three predictive models. Besides, survival differences in the entire cohort based on quartile groupings of the total predictive scores calculated from the three established prediction models were also compared.

Software

All statistical analysis was performed by R software (version 3.6.0) with the assistance of several essential R packages, including rms, foreign, nomogramEx, stdca.R, survival, survminer, survivalROC, pROC, dplyr, pec, devtools, DynNom, shiny, rsconnect, and ggplot2 package. A two-tailed P-value lower than 0.05 was considered as statistically significant.

Results

Patient Characteristics

The ROC curves for variables of age, NLR, PLR, ALP, CD4+/CD8+ ratio, and CONUT score are presented in Figure 1. The optimal cut-off points for the first five continuous variables were 20, 3.4, 171, 154, and 3.27, respectively. The clinical characteristics of the development and validation set are presented in Table 2. A total of 376 advanced osteosarcoma patients were finally enrolled in this study, including 301 patients in the development set and 75 patients in the validation set. In the development set, the median follow-up time was 8.9 months (range: 0.5–90.1 months) and the median survival time was 8.1 months (95% CI: 6.1–10.7 months). In the validation set, the median follow-up time and the median survival time were 8.6 months (range: 0.5–88.7 months) and 8.2 months (95% CI: 5.7–11.6 months), respectively. No significant differences were found among all the variables between the development set and validation set (all P>0.05).

Figure 1

The receiver operating characteristic (ROC) curve analyses for (A) age, NLR, PLR, ALP, CD4+/CD8+ ratio, and (B) CONUT score.

Abbreviations: NLR, neutrophil to lymphocyte ratio; PLR, platelet to lymphocyte ratio; ALP, alkaline phosphatase; CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Table 2

Baseline Characteristics of the Development Set and Validation Set

Variables	Total(n=376)	Development Set (n=301)	Validation Set (n=75)	Statistics	P value
Age				0.016	0.899
<20 years	173(46.0%)	138(45.8%)	35(46.7%)
≥20 years	203(54.0%)	163(54.2%)	40(53.3%)
Gender				0.674	0.412
Male	236(62.8%)	192(63.8%)	44(58.7%)
Female	140(37.2%)	109(36.2%)	31(41.3%)
NLR				0.326	0.568
<3.4	120(31.9%)	94(31.2%)	26(34.7%)
≥3.4	256(68.1%)	207(68.8%)	49(65.3%)
PLR				1.777	0.182
<171	369(98.1%)	294(97.7%)	75(100.0%)
≥171	7(1.9%)	7(2.3%)	0(0.0%)
Metastasis				0.032	0.858
Lung only	152(40.4%)	121(40.2%)	31(41.3%)
Lung and other sites	224(59.6%)	180(59.8%)	44(58.7%)
Tumor site				1.906	0.167
Axial skeleton	217(57.7%)	179(59.5%)	38(50.7%)
Extremity	159(42.3%)	122(40.5%)	37(49.3%)
Tumor size (median/interquartile range, cm)	18.0(5.4–28.8)	18.3(5.4–28.8)	17.1(5.7–28.2)	0.000	0.996
ALP				0.983	0.321
Normal (<154 IU/L)	315(83.8%)	255(84.7%)	60(80.0%)
Elevated (≥154 IU/L)	61(16.2%)	46(15.3%)	15(20.0%)
Anti-angiogenesis therapy				1.154	0.283
No	334(88.8%)	270(89.7%)	64(85.3%)
Yes	42(11.2%)	31(10.3%)	11(14.7%)
CD4+/CD8+ ratio				1.230	0.267
High (≥3.27)	315(83.8%)	249(82.7%)	66(88.0%)
Low (<3.27)	61(16.2%)	52(17.3%)	9(12.0%)
Chemotherapy				0.965	0.326
≥6 cycles	70(18.6%)	59(19.6%)	11(14.7%)
<6 cycles	306(81.4%)	242(80.4%)	64(85.3%)
CONUT score				0.065	0.968
Normal	17(4.5%)	14(4.7%)	3(4.0%)
Mild+moderate	233(62.0%)	186(61.8%)	47(62.7%)
Severe	126(33.5%)	101(33.6%)	25(33.3%)

Abbreviations: NLR, neutrophil to lymphocyte ratio; PLR, platelet to lymphocyte ratio; ALP, alkaline phosphatase; CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Identification of Prognostic Factors, Construction, and Visualization of Predictive Models

The results of univariate and multivariate Cox regression analysis for overall survival are shown in Table 3. In the univariate Cox regression analyses, variables of age (P=0.022), gender (P=0.027), NLR (P=0.033), metastasis (P=0.000), ALP (P=0.000), anti-angiogenesis therapy (P=0.000), CD4+/CD8+ ratio (P=0.000), chemotherapy (P=0.000) and CONUT score (P=0.002) were significantly associated with OS in the development set. The Kaplan–Meier analyses and Log-rank tests for CD4+/CD8+ ratio and CONUT score also confirmed the results from univariate Cox analysis. The survival curves of the two variables are shown in Figure 2. Regarding multivariate Cox regression analyses, age (P=0.000), metastasis (P=0.000), ALP (P=0.004), CD4+/CD8+ ratio (P=0.000), chemotherapy (P=0.001) and CONUT score (P=0.000) were confirmed as independent prognostic factors for OS.

Table 3

Univariate and Multivariate Cox Regression Analyses for Overall Survival in the Development Set

Variables	Univariate Analysis			Multivariate Analysis
	HR	95% CI	P value	HR	95% CI	P value
Age	1.258	1.037–1.592	0.022	1.523	1.217–1.907	0.000
Gender	0.781	0.627–0.973	0.027	0.930	1.205–1.509	0.768
NLR	1.283	1.021–1.611	0.033	1.219	0.732–2.030	0.446
PLR	0.809	0.334–1.957	0.638	0.793	0.319–1.973	0.618
Metastasis	2.184	1.749–2.728	0.000	2.537	2.002–3.214	0.000
Tumor site	0.903	0.729–1.120	0.354	0.917	0.727–1.158	0.469
Tumor size	1.006	0.985–1.028	0.561	1.020	0.998–1.042	0.082
ALP	1.950	1.465–2.594	0.000	1.787	1.200–2.662	0.004
Anti-angiogenesis therapy	2.260	1.619–3.154	0.000	1.103	0.696–1.748	0.675
CD4+/CD8+ ratio	3.132	2.347–4.178	0.000	3.008	2.218–4.080	0.000
Chemotherapy	1.734	1.308–2.299	0.000	1.661	1.245–2.216	0.001
CONUT score			0.002			0.000
Normal	Ref	Ref		Ref	Ref
Mild+moderate	1.186	0.722–1.950	0.501	1.657	0.994–2.761	0.053
Severe	1.788	1.068–2.994	0.027	2.597	1.527–4.417	0.000

Abbreviations: NLR, neutrophil to lymphocyte ratio; PLR, platelet to lymphocyte ratio; ALP, alkaline phosphatase; CD, cluster of differentiation; HR, hazard ratio; Ref, reference; CONUT Score, controlling nutritional status score.

Figure 2

Kaplan–Meier survival curves for overall survival based on (A) CD4+/CD8+ ratio and (B) CONUT score stratification.

Abbreviations: CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Three prediction models were established to predict the MST, 1-year, and 3-year survival probability in patients with advanced osteosarcoma. The details of the parameters of the three models are presented in Table 4, and the detailed point for each predictor included in the prediction models is shown in Table 5. Furthermore, the variables used to establish prediction models together with websites for web dynamic nomograms are presented in Table 6. In this study, two methods were used to visualize the three predictive models, including conventional nomograms and the newly developed interactive web dynamic nomograms. The conventional nomograms are presented in Figure 3, and the websites for interactive web dynamic nomograms are shown in Table 6.

Table 4

Parameters of Each Variable Selected for the Three Models

Variables	Model 1			Model 2			Model 3
	Coef.	HR(95% CI)	P value	Coef.	HR(95% CI)	P value	Coef.	HR(95% CI)	P value
Age	0.380	1.463(1.146–1.868)	0.002	0.355	1.427(1.116–1.825)	0.004	0.391	1.479(1.157–1.890)	0.001
Metastasis	0.821	2.274(1.769–2.922)	0.000	0.832	2.299(1.788–2.957)	0.000	0.861	2.367(1.839–3.048)	0.000
ALP	0.612	1.844(1.330–2.557)	0.000	0.576	1.779(1.280–2.473)	0.000	0.594	1.812(1.303–2.519)	0.000
Chemotherapy	0.489	1.632(1.199–2.222)	0.001	0.529	1.698(1.248–2.309)	0.000	0.444	1.559(1.142–2.126)	0.005
CD4+/CD8+ ratio	1.279	3.596(2.601–4.972)	0.000	–	–	–	1.273	3.574(2.581–4.948)	0.000
CONUT score
Mild+moderate	–	–	–	0.385	1.471(0.844–2.563)	0.173	0.481	1.619(0.928–2.824)	0.089
Severe	–	–	–	0.785	2.193(1.230–3.909)	0.007	0.827	2.287(1.284–4.075)	0.004
AIC	2524.100			2561.900			2516.7

Abbreviations: Coef, coefficient; HR, hazard ratio; CD, cluster of differentiation; ALP, alkaline phosphatase; AIC, Akaike information criterion; CONUT score, controlling nutritional status score.

Table 5

Detailed Point of Each Predictor in the Three Established Nomograms

Variables	Model 1	Model 2	Model 3
Age
<20 years	0	0	0
≥20 years	29.744	42.707	30.735
Metastasis
Lung only	0	0	0
Lung+other sites	64.180	100.000	67.666
ALP
Low	0	0	0
High	47.821	69.207	46.690
CD4+/CD8+ ratio
High (≥3.27)	0	–	0
Low (<3.27)	100.000	–	100.000
Chemotherapy
≥6 cycles	0	0	0
<6 cycles	38.265	63.577	34.861
CONUT score
Normal	–	0	0
Mild+moderate	–	46.334	37.831
Severe	–	94.315	64.963

Abbreviations: ALP, alkaline phosphatase; CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Table 6

Variables Included in the Prediction Models and Websites for the Individualized Dynamic Nomograms

Model	Variables	Websites
Model 1	(Overall survival, Survival status) ~ Age + Metastasis + ALP + Chemotherapy + CD4+/CD8+ Ratio	https://conquerera.shinyapps.io/DynNomapp1/
Model 2	(Overall survival, Survival status) ~ Age + Metastasis + ALP + Chemotherapy + CONUT Score	https://conquerera.shinyapps.io/DynNomapp2/
Model 3	(Overall survival, Survival status) ~ Age + Metastasis + ALP + Chemotherapy + CD4+/CD8+ Ratio + CONUT Score	https://conquerera.shinyapps.io/DynNomapp3/

Abbreviations: ALP, alkaline phosphatase; CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Figure 3

Nomograms of the established three prediction models to predict median survival time, 1-, and 3-year survival probabilities. (A) CD4+/CD8+ ratio model (model 1); (B) CONUT score model (model 2); (C) combined model of CD4+/CD8+ ratio and CONUT score (model 3).

Abbreviations: ALP, alkaline phosphatase; CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Prediction Model Validation and Performance Assessment

Calibration curves to predict the 1-year OS probability in both sets are plotted and shown in Figure 4. All calibration curves showed good consistency between the actual survival and nomogram predicted survival. ROC curves and its related parameters were also performed to further validate the discrimination ability of three prediction models at the time point of 1-year OS. The ROC curves are shown in Figure 5 and the parameters reflecting the accuracy of ROC curves are presented in Table 7.

Figure 4

The calibration plots of the established three prediction models to predict 1-year survival in the (A) development set and (B) validation set. The X-axis represents the predicted survival from the established prognostic models and the Y-axis reflects the actual survival in the real world. The color curve closest to the 45° tilting solid line symbolizes the most accurate prediction model and behave the best in predictive performance.

Abbreviations: CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Figure 5

The receiver operating characteristic (ROC) curve analyses of the three prediction models for 1-year survival in the (A) development set and (B) validation set.

Abbreviations: CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Table 7

Accuracy of the Three Models to Predict 1-Year Survival Probability in Advanced Osteosarcoma Patients

Variable	Model 1		Model 2		Model 3
	Development Set	Validation Set	Development Set	Validation Set	Development Set	Validation Set
Cut-off point	77.564	102.445	158.247	209.911	119.382	140.357
AUC	0.773	0.780	0.749	0.700	0.848	0.835
Sen (%)	0.927	0.818	0.683	0.613	0.707	0.779
Spe (%)	0.526	0.689	0.807	0.714	0.895	0.756
PV+ (%)	94.565	93.548	93.401	93.333	93.627	94.118
PV- (%)	11.965	15.909	10.577	15.556	11.340	17.073
LR+	1.956	2.630	3.539	2.143	6.733	3.193
LR-	0.139	0.264	0.393	0.542	0.327	0.292

Abbreviations: AUC, area under curve; Sen, sensitivity; Spe, specificity; PV+, positive predictive value; PV-, negative predictive value; LR+, positive likelihood ratio; LR-, negative likelihood ratio.

In the development set, the C-indexes of model 1, model 2 and model 3 were 0.765 [95% CI, 0.712–0.828], 0.712 [95% CI, 0.738–0.908] and 0.837 [95% CI, 0.735–0.908], respectively, and significant differences were found among the three models (model 1 vs model 2, P=0.043; model 3 vs model 1, P=0.015; model 3 vs model 2, P=0.003). In the validation set, the C-indexes of the three models were 0.771 [95% CI, 0.654–0.827], 0.723 [95% CI, 0.667–0.876] and 0.841 [95% CI, 0.766–0.927], respectively. Similar trends in the differences of C-indexes were also found for the three models (model 1 vs model 2, P=0.047; model 3 vs model 1, P=0.023; model 3 vs model 2, P=0.004).

Decision Curve Analysis

Figure 6 illustrates the decision curve analyses of three prediction models to discriminate survivors and non-survivors at the time point of 1-year OS. All models remained effective and reliable between the threshold probabilities of 36–80%, and the net benefit for model 3 was better than that of the other two models within the same threshold probabilities.

Figure 6

Decision curve analysis of the three prediction models in the (A) development set and (B) validation set.

Abbreviations: CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Kaplan–Meier Survival Analysis Based on Risk Stratification

The entire cohort was categorized into four groups based on the quartiles of total prognostic scores calculated from the three predicting models. The Kaplan–Meier analyses and Log-rank tests were performed to compare the differences in OS among the four groups. Figure 7 presents the Kaplan–Meier survival curves for the three models based on quartile groupings. Significant differences in survival were found among the four subgroups in the three models (all P<0.001). However, survival curves of model 3 separate more significantly than those from the other two models, indicating a better discrimination ability.

Figure 7

Kaplan–Meier survival curves of the entire cohort stratified by the quartiles of the calculated total prognostic scores from the three prediction models. (A) CD4+/CD8+ ratio model (model 1); (B) CONUT score model (model 2); (C) combined model of CD4+/CD8+ ratio and CONUT score (model 3).

Abbreviations: CD, cluster of differentiation; CONUT score, controlling nutritional status score.

Discussion

The present study is the first to elucidate the relationship between CONUT score and peripheral blood CD4+/CD8+ ratio and survival in patients with advanced osteosarcoma. We found that higher CONUT score and lower peripheral blood CD4+/CD8+ ratio was associated with shorter OS and increased risks of death. Both of the two indices can serve as prognostic predictors for OS, but the combined use of them can obtain better predictive performances. Especially, the most paramount prognosticators for advanced osteosarcoma at present were integrated by a novel tool of interactive web dynamic nomogram, making it a more representative and reflective predictor for survival prediction. Simultaneously, compared with previously identified prognostic predictors for osteosarcoma, the features of easy availability, high predictive performances, and conveniences in dynamic monitoring of the two predictive indicators have fully exhibited their superiorities as pragmatic and cost-effective biomarkers for survival stratification in osteosarcoma.

Nutritional and immune status has been proven to correlate with therapeutic effects and long-term prognosis in various tumors, including osteosarcoma.5,6,20,47 A series of nutrition- and immune-based indices or scoring systems were developed and utilized as prognostic predictors,6,48-51 with the CONUT score being the most commonly used one among them. As an immune-nutritional marker, CONUT score has included the information of serum levels of albumin, cholesterol, and TLC. Albumin, reflecting the protein synthesis ability of liver and forming a large proportion of all plasma protein, is the most abundant blood plasma protein. Serum albumin level is the most fundamental factor to evaluate a patient’s nutritional status, and it has been proven to significantly associate with the survival of multiple malignancies.52–55 Cholesterol, another vital component of CONUT score, is also a major indicator of nutritional status and represents the lipid metabolism ability as well as a patient’s caloric reserves.56 By integrating into the specialized lipid-protein membrane micro-domains, cholesterol forms the signaling transduction machinery and participates in various biological processes of tumor cells, including cytoskeleton alteration, cell polarity, and angiogenesis.57–60 Similar to hypoalbuminemia, hypocholesterolemia is also associated with undesirable outcomes in numerous cancers, such as renal cell carcinoma, lung cancer, hematologic malignancies, etc.61–64 Furthermore, hypocholesterolemia can cripple the functions of immune cells by disturbing the normal operation of cell membrane fluidity and obstructing cell surface receptors mobility.65 It is noteworthy that cholesterol is the main difference between CONUT score and other prognostic markers. It is undeniable that albumin is the most prominent indicator for nutrition, but one obvious drawback for albumin is that its serum concentration can be easily influenced by inadequate nutrients intake, inflammation factor-induced exhaustion, and changes of body fluid volume. By contrast, serum cholesterol circumvents such weaknesses and remains much more stable. Therefore, the inclusion of cholesterol into CONUT score can achieve optimization of this scoring system. The last important constituent parameter of CONUT score is TLC, which is an indicator of a patient’s immunocompetence and also a paramount player in anti-tumor immune response. TLC consists of numerous cell subsets, including CD4+ T cell, CD8+ T cell, NK cells, γδ T cells, B cells, Tregs, etc. TLC has been reported to be closely related to tumor activities and prognosis. Generally, quantity change or disproportionality of lymphocytes in peripheral blood or TME is a potent predictor for impaired tumor immunity. For example, reduced ratio of CD4+/CD8+ in TME,66 low densities of tumor-associated plasma cells,67 low ratio of FOXP3+/CD4+ TILs,68 and decreased ratio of intratumoral FOXP+ Tregs are all indicative of unfavorable prognosis in patients with neoplasms.69 Considering the strong associations between albumin, cholesterol, and TLC and the prognosis in various tumors, it may be reasonable for us to speculate that a multidimensional prognosticator based on these predictors would also obtain optimal performances in survival prediction. Consistent with our anticipation, our study suggested that CONUT score was an independent risk factor for OS and a higher CONUT score was significantly correlated with shorter OS. Furthermore, a prediction model based on CONUT score also obtained favorable predictive performances, including a desirable C-index of 0.712 (95% CI: 0.738–0.908) and 0.723 (95% CI: 0.667–0.876) in the development and validation set, as well as good consistency between nomogram predicted survival and actual observed survival in both sets.

Scarce information can be found in previous studies that focused on elucidating the prognostic values of peripheral blood or intratumoral lymphocyte subsets in sarcomas. Our study was the first to uncover the prognostic significance of peripheral blood CD4+/CD8+ ratio in osteosarcoma. In summary, the prognostic values of lymphocyte subsets for tumors mainly display in three aspects: quantitative changes, disturbance of proportions, and aberrant gene expression profile. Usually, increased circulating or intratumoral immunosuppressive immune cells or decreased immunity-boosting lymphocytes are more prone to result in undesirable OS. Similarly, a ratio of two specific lymphocyte subsets within which anti-tumor lymphocytes predominate over pro-tumor lymphocytes is also more likely to obtain a shorter OS. For example, elevated intratumoral CD163+ M2-type TAM,31 lower intratumoral CD8+ cytotoxic lymphocytes,32 intratumoral CD8+/FOXP3+-ratio <3.08,1 delayed peripheral lymphocyte recovery,28 decreased CD8+/Tregs ratio,35 M1/M2 polarized-macrophages tilt to M2 subtype,34 low CD4+/CD8+ ratio,38 and decreased pre-treatment TLC70 all forebode worse prognosis. In our study, we found that lower peripheral CD4+/CD8+ ratio was indicative of poorer prognosis, and prediction model based on CD4+/CD8+ ratio and clinical features has revealed good predictive performances for patients with advanced osteosarcoma. Noteworthily, although CONUT score has taken TLC into consideration to reflect a patient’s immune status, the information obtained from TLC is rather rough, inadequate, and imprecise for the reason that TLC is composed of various cell subsets. Given this, the information from the overall change of TLC provided by CONUT score is rather limited. To guide clinical decisions, more elaborate information about the dynamic variations of lymphocyte subsets is thus needed. In this context, we attempt to integrate CONUT score and peripheral CD4+/CD8+ ratio together to establish a new prognostic prediction model. Fortunately, the combined model (model 3) of CONUT score, peripheral CD4+/CD8+ ratio, and clinical parameters behaves better in prediction performances than prediction models based on CONUT score or peripheral CD4+/CD8+ ratio only, which can be deduced from the following facts. Firstly, the combined model gets admirable accuracy in calibration plots when compared with that from the other two prediction models. Secondly, the combined model has reached higher AUCs of 0.848 and 0.835 in the development set and validation set as opposed to relatively lower AUCs of 0.773 and 0.780 in model 1, and 0.749 and 0.700 in model 2, respectively. Thirdly, the combined model has shown better ability in risk stratification based on the quartiles of total prediction scores calculated from the established prediction models. Finally, model 3 obtains better net benefit than the other two models within the same threshold probabilities of 36–80%. All these facts mentioned above suggested that CONUT score combined with peripheral CD4+/CD8+ ratio was an ideal prognostic biomarker for survival prediction in patients with advanced osteosarcoma.

The precise mechanisms for the negative correlation of lower CD4+/CD8+ ratio and unfavorable OS in osteosarcoma remain uncertain, but preclinical and clinical evidences from other malignancies may account for this phenomenon. Generally, except for the engagement of tumor neo-antigen and T-cell receptor, the initial activation of CD8+ cytotoxic lymphocytes induced anti-tumor immune response is also highly depended on the co-stimulatory signaling from CD4+ type 1 helper T cells (Th1). In other words, CD4+ T-cell help initiates and amplifies signals for primary CD8+ T-cell immunity via multiple ways, such as secretion of interleukin-2, expression of co-stimulating molecules B7, production of interleukin-12 and interferon-γ, and so on.71 Therefore, peripheral and intratumoral ratio of CD4+/CD8+ T cells, as a surrogate marker of immunosenescence, may independently predict OS in patients with malignant diseases. Depletion or decrease of peripheral and intratumoral CD4+ T cells is more prone to inactivate the anti-tumor response and lead to deterioration and progression of the disease. Actually, various previous studies have already elucidated and verified that CD4+/CD8+ ratio can serve as independent prognostic predictors in multiple cancers, including laryngeal squamous cell carcinoma,45 renal cell cancer,72 nasopharyngeal carcinoma,46 gastric cancer,73 cervical cancer,74 etc. Similarly, our study also demonstrated that CD4+/CD8+ ratio is a reliable and accurate prognostic predictor for patients with advanced osteosarcoma.

Our study also exists several limitations. Firstly, due to the nature of retrospective analysis and single-institution study, a kind of selection bias may be inevitable. So, prospective and larger studies to further verify the generalizability of the established prognostic models in this study are necessarily needed. Secondly, although the relationship between peripheral blood CD4+/CD8+ ratio and survival in osteosarcoma has been clarified in this study, the association of intratumoral CD4+/CD8+ ratio and survival still remains unclear. Thirdly, despite the advantages of easy availability and convenience in dynamic monitoring for CONUT score and peripheral CD4+/CD8+ ratio, it is undeniable that the two predictors are all non-specific predictive factors for osteosarcoma, which may unavoidably lose a partial of specificity in survival prediction. One possible way to improve the specificity is to incorporate some newly-identified specific biomarkers into these prognostic prediction models, such as tissue-specific mark proteins, miRNAs, lncRNAs, or circRNAs, but the feasibility still needs further verification.

In conclusion, CONUT score and peripheral CD4+/CD8+ ratio are easily available, reliable, and economical prognostic predictors for survival prediction and stratification in patients with advanced osteosarcoma, but the two predictors combined can establish a better prognosis prediction model. Simultaneously, the newly developed interactive web dynamic nomogram based on CONUT score and peripheral CD4+/CD8+ ratio is a more convenient and practical tool for clinicians to perform individualized treatment decision-making and evaluate survival at the initial diagnosis.