Clinical utility of a composite scoring system including Charlson Comorbidity Index score in patients with interstitial lung disease.

BACKGROUND: Prognostic factors have yet to be established for patients with interstitial lung disease (ILD). We aimed to clarify whether the Charlson Comorbidity Index score (CCIS) could help predict disease prognosis in patients with ILD.
METHODS: Among ILD patients treated between April 2013 and April 2017, we retrospectively assessed the relationship between baseline clinical parameters including age, sex, CCIS, ILD diagnosis, pulmonary function test results, and 3-year ILD-related events including cause-specific death and first acute exacerbation (AE).
RESULTS: We assessed 180 patients (mean age, 74 years), all of whom underwent pulmonary function testing including percentage predicted diffusion capacity for carbon monoxide (%DLco). Underlying pathologies included idiopathic pulmonary fibrosis (IPF) in 57 cases, idiopathic nonspecific interstitial pneumonia (iNSIP) and collagen vascular disease-related interstitial pneumonia in 117 cases, and chronic hypersensitivity pneumonia (CHP) in 6 cases. A composite scoring system comprising IPF diagnosis, CCIS, and %DLco provided a favorable C-index (0.825) for predicting 3-year ILD-related events. The nomogram for 3-year prognosis revealed the largest contributions from CCIS, %DLco and IPF diagnosis.
CONCLUSIONS: This composite scoring system accounting for IPF diagnosis, CCIS, and %DLco could provide a useful tool for predicting prognosis in relatively mild ILD patients tolerated to pulmonary diffusion capacity testing. 2020 Journal of Thoracic Disease. All rights reserved.

Introduction

Clinical biomarkers for predicting the prognosis of interstitial lung disease (ILD) have not been established. An official the American Thoracic Society/the European Respiratory Society/the Japanese Respiratory Society/the Latin American Thoracic Association (ATS/ERS/JRS/ALAT) statement proposed various clinical parameters associated with an increased risk of mortality among patients with idiopathic pulmonary fibrosis (IPF) (1). Although these parameters include the severity of dyspnea, pulmonary function decline, existence of pulmonary hypertension, desaturation during the 6-min walk test, and the extent of pulmonary involvement on high-resolution computed tomography (HRCT), predicting prognosis using a single parameter appears difficult (2). Actually, prediction of prognosis using composite scoring systems such as GAP [gender (sex) (G), age (A), percentage predicted forced vital capacity (%FVC) and percentage predicted diffusion capacity of lung for carbon monoxide (%DLco) (P)] or ILD-GAP has been considered useful in clinical settings (3,4). However, because the parameters used for the GAP or ILD-GAP models are age, sex, ILD diagnosis, and pulmonary function test results, which are based on clinical information derived from only pulmonary involvements, assessment of the presence and severity of comorbidities is also very important for predicting the prognosis of ILD patients (5).

The Charlson Comorbidity Index score (CCIS) is a summed score of 19 comorbidities weighted according to severity (6). The CCIS was developed to assess risk of death from comorbidities and has been widely applied as a prognostic indicator for patients with colorectal cancer, advanced non-small cell lung carcinoma and acute myocardial infarction (7-9). In our previous report on CCIS, serum lactate dehydrogenase (LDH) and sex were useful for predicting the prognosis of patients with acute exacerbation (AE) of ILD (10). However, whether these characteristics are useful for predicting prognosis in patients with ILD in a stable condition remains unclear.

The present study retrospectively investigated clinical parameters (including sex, age, ILD diagnosis, pulmonary function test, and CCIS) that could help predict prognosis in patients with ILD in a stable condition. We also attempted to construct a scoring system and to construct a nomogram from that scoring system that could predict 3-year ILD-related events, including cause-specific death or first AE.

Methods

This retrospective, observational study was performed using data from patients treated at Yokohama City University Hospital between April 2013 and April 2017. The medical records of all patients with ILD who met the following inclusion criteria were reviewed: stable ILD cases including IPF, idiopathic nonspecific interstitial pneumonia (iNSIP), chronic hypersensitivity pneumonia (CHP), or collagen vascular diseases-related interstitial pneumonia (CVD-IP); and availability of pulmonary function test results including DLco (). We defined the stable ILD cases as patients who required only follow-up without specific treatments including oral corticosteroid or anti-fibrotic agents and had not experienced acute respiratory deterioration including AE previously. Other ILD patients including pulmonary sarcoidosis, cryptogenic organizing pneumonia, drug or radiation induced lung injuries, and other unclassified ILDs were excluded. We assessed the relationship between baseline clinical parameters including age, sex, CCIS, ILD diagnosis, pulmonary function test results, and 3-year ILD-related events including cause-specific death or first AE. We collected 3-year ILD-related events mainly from medical records. For patients who did not die in our hospital, the disease outcomes were confirmed by telephone. In addition, only one patient (0.5%) transferred to another hospital for the purpose of best supportive case due to severe deterioration of respiratory status was lost of follow-up, therefore we decided the transfer date as the decision date of disease outcome.

Figure 1

Flowchart of the participants selection process.

A diagnosis of idiopathic interstitial pneumonia (IIP) was confirmed by physical findings, serological testing, findings from HRCT, and lung biopsy specimens, based on the official statement for IIP (1,11). However, patients from whom a lung biopsy could not be obtained were diagnosed based on the radiological classification (1,11). The diagnosis of CVD-IP was confirmed by physical findings, serological testing, and HRCT findings consistent with ILD. Histological evaluation of lung biopsy specimens was undertaken to exclude other specific diseases. The event of AE of ILD was defined as: unexplained worsening of dyspnea; hypoxemia or severely impaired gas exchange; new alveolar infiltrates on radiography; and absence of an alternative explanation such as infection, pulmonary embolism, pneumothorax, or heart failure (12-14).

Statistical analysis

Data were statistically analyzed using JMP12 (SAS Institute, Cary, NC, USA) and R software, version 3.5.1 (The R Foundation for Statistical Computing, Vienna, Austria), and are expressed as mean ± standard deviation. Groups were compared using Wilcoxon rank-sum tests. Optimal parameter cut-off values were determined by Youden index for receiver operator characteristics curves. Predictors of 3-year ILD-related events were investigated by backward stepwise algorithm, forcing the diagnosis of IPF (which has a significant impact on clinical prognosis) into the predictors, and using 5-fold cross-validated Uno’s concordance index (C-index) (15). C-indices are reported as the mean value calculated from 100,000 bootstrap samples. A nomogram was established based on the scoring systems to predict 3-year ILD-related events. When comparing 3-year ILD-related events including cause-specific death or first AE among groups depending on the scoring system, Kaplan-Meier curves and adjusted survival curves were employed. Log-rank and stratified log-rank testing were also performed with strata based on the identified predictors. Values of P<0.05 were considered significant.

Ethics approval

The institutional review board at Yokohama City University Hospital approved this study (approval number B190300005). In all patients, we waived informed consent based on the retrospective design and provided information on the opt-out process (https://www.yokohama-cu.ac.jp/amedrc/ethics/ethical/fuzoku_optout.html). The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).

Results

Patient characteristics

shows the clinical characteristics of the 180 patients evaluated, including 57 patients with IPF and 123 patients with non-IPF (idiopathic NSIP and CVD-IP, n=117; CHP, n=6). CVD-IP included rheumatoid arthritis, anti-neutrophil cytoplasmic antibody-associated vasculitis, polymyositis/dermatomyositis, and Sjögren syndrome. No significant differences were identified in clinical parameters other than sex or %DLco.

Table 1

Patient’s characteristics

Characteristics	Overall cases	IPF	CVD-IP/iNSIP	CHP	P value
Total number, n (%)	180	57 [32]	117 [65]	6 [3]
Age, years	71.9±9.2	73.3±7.2	71.4±9.2	67.8±21.3	0.425
Male sex, n (%)	119 [66]	49 [86]	66 [56]	4 [67]	<0.001
CCIS	2.5±2.2	2.6±2.0	2.5±2.2	1.5±1.2	0.418
Pulmonary function tests
FVC, %predicted	93.9±18.7	93.5±18.5	94.1±19.2	92.8±10.8	0.993
DLco, %predicted	91.7±30.2	80.5±28.2	97.6±30.2	83.1±17.6	0.002
Outcome
Follow-up, days	687±337	649±327	701±344	775±294	0.514
Incidence of events, n (%)	20 [11]	10 [18]	10 [9]	0 [0]	0.141

Incidence of events included ILD-related death or first acute exacerbation of ILD. CCIS, Charlson Comorbidity Index; CHP, chronic hypersensitivity pneumonia; CVD-IP, collagen vascular disease-related interstitial pneumonia; DLco, lung diffusing capacity for carbon monoxide; FVC, forced vital capacity; iNSIP, idiopathic nonspecific interstitial pneumonia; ILD, interstitial lung disease; IPF, idiopathic pulmonary fibrosis.

Accuracy of composite parameters in predicting 3-year ILD-related events

To investigate the accuracy of the scoring system for 3-year ILD-related events, we calculated C-index for the combination of various clinical parameters including age, sex, CCIS, IPF diagnosis, and pulmonary function test results. The composite scoring system including IPF diagnosis, CCIS, and %DLco offered a higher C-index than single predictors or any other combination of predictors (). The three independent risk factors were selected according to appellate statistical criteria. We prepared a nomogram based on these variables (). Each selected indicator was assigned a corresponding score according to its own value on the nomogram. The calculated total score provided a predicted 3-year ILD-related event-free survival rate. By determining the interval in which the total score is located, the 3-year ILD-related event-free survival probability can be obtained more simply.

Table 2

Accuracy of scoring system for predicting 3-year events including ILD-related death or first acute exacerbation of ILD

Variable	C-index
CCIS	0.747
IPF + CCIS + FVC	0.799
IPF + CCIS + DLco	0.825
IPF + Age + Sex + CCIS + DLco	0.792
IPF + Age + Sex + CCIS + FVC	0.778
IPF + Age + Sex + FVC + DLco	0.671
IPF + Age + Sex + CCIS + FVC + DLco	0.788

C-indices are reported as the mean value calculated from 100,000 bootstrap samples. CCIS, Charlson Comorbidity Index score; DLco, lung diffusing capacity for carbon monoxide; FVC, forced vital capacity; ILD, interstitial lung disease; IPF, idiopathic pulmonary fibrosis.

Figure 2

The nomogram for predicting 3-year ILD-related events. Draw a line perpendicular from the corresponding axis of each risk factor until it reaches the top line labeled “Points”. Total the number of points for all risk factors, then draw a line descending vertically from the axis labeled “Total score” until it intercepts the survival axis to determine the 3-year event-free survival. For binary variables, 0= no and 1= yes. CCIS, Charlson Comorbidity Index score; IPF, idiopathic pulmonary fibrosis; DLco, diffusion capacity for carbon monoxide.

Composite scoring system for predicting 3-year ILD-related events

The composite scoring system including IPF diagnosis, CCIS, and %DLco represents the global score (ranging between 0 and 6) calculated from the three clinical parameters: CCIS (0–1, 1; 2–3, 2; 4–5, 3; ≥6, 4); IPF diagnosis (non-IPF, 0; IPF, 1); and %DLco (≥75.1, 0; ≤75.1, 1) (). We compared patients with ILD according to the composite scoring system (score ≤2 vs. ≥3 or score ≤2 vs. =3 vs. ≥4) (). Both log-rank and stratified log-rank tests showed that Kaplan-Meier survival curves of these groups differed significantly (P<0.001).

Table 3

Scoring system including IPF diagnosis, CCIS, DLco

Predictors	Details	Score
The diagnosis	IPF	1
	Not IPF	0
CCIS	≥6	4
	4–5	3
	2–3	2
	0–1	1
DLco, %predicted	<75.1	1
	≥75.1	0

CCIS, Charlson Comorbidity Index score; D, lung diffusion capacity for carbon monoxide; IPF, idiopathic pulmonary fibrosis.

Figure 3

Comparison of patients with ILD according to the composite scoring system including ILD diagnosis, CCIS, and %DLco (score ≤2 vs. ≥3). The composite score is the global score (ranging between 0 and 6) calculated from the three parameters: CCIS (0–1, 1; 2–3, 2; 4–5; 3; ≥6, 4); ILD diagnosis (non-IPF, 0; IPF, 1); and %DLco (≥75.1, 0; <75.1, 1). Patients are categorized into two groups based on composite score: score ≤2 vs. ≥3. Three-year ILD-related event-free survival rates are significantly better in the former group (n=137) than latter group (n=43; P<0.001) (A: log-rank test; B: stratified log-rank test). CCIS, Charlson Comorbidity Index score; ILD, interstitial lung disease; IPF, idiopathic pulmonary fibrosis; DLco, diffusion capacity for carbon monoxide.

Figure 4

Comparison of patients with ILD according to the composite scoring system including ILD diagnosis, CCIS, and %DLco (score ≤2 vs. =3 vs. ≥4). We categorized the patients having the composite score (≥3; the latter group in ) into two groups: score =3 vs. ≥4. Then we compared three-year ILD-related event-free survival rates between three groups: score ≤2 (n=137) vs. =3 (n=29) vs. ≥4 (n=14). Both log-rank and stratified log-rank tests showed that Kaplan-Meier survival curves of these groups differed significantly (P<0.001) (A: log-rank test; B: stratified log-rank test). CCIS, Charlson Comorbidity Index score; ILD, interstitial lung disease; DLco, diffusion capacity for carbon monoxide.

Relationship between CCIS and incidence of 3-year ILD-related events

shows the relationship between CCIS and 3-year ILD-related event. The frequency of 3-year ILD-related events tended to increase with increasing CCIS, and this tendency was more pronounced with higher composite scores (≥3).

Figure 5

Relationship between CCIS and incidence of 3-year ILD-related events. Frequency of 3-year ILD-related events increases with increasing CCIS, with a more pronounced tendency for higher composite scores (≥3). Dashed lines indicate 95% confidence intervals. CCIS, Charlson Comorbidity Index score; ILD, interstitial lung disease.

Discussion

In patients with ILD, for which the clinical course varies considerably in severity and rate of progression, prognosis is difficult to predict using established single biomarkers, such as age, level of dyspnea, DLco, oxygen desaturation during the 6-min walk test, extent of honeycombing on HRCT images, and pulmonary hypertension >25 mmHg at rest (1). Composite approaches have been developed using peripheral blood parameters, physiological parameters, and radiographic parameters to provide more accurate prognostic information. We have recently applied prognostic modeling using the GAP scoring system in patients with IPF, and the ILD-GAP scoring system in patients with fibrosing ILD (3,4). However, Lee et al. reported that prognosis in IPF patients with a GAP score of 3 differed significantly from that in other stage I groups and stage II groups of Asian patients (16). Furthermore, the high frequencies of comorbidities including gastro-esophageal reflex disease, heart failure, coronary artery disease, stroke, and cancer are increasingly being recognized as impacting prognosis in patients with ILD (5). Therefore, the present research established a prognostic scoring system and a nomogram to predict 3-year survival by adding CCIS, which is not directly related to lung involvement, as well as ILD diagnosis, age, sex, and pulmonary function test results.

Pulmonary function test results have been proposed as a major prognostic determinant in patients with ILD (3,4,17). Six-month changes in FVC provide a significant predictor of survival in patients with fibrotic interstitial pneumonia, while baseline FVC is of unclear predictive value (18). Recent evidence-based guidelines for the management of IPF state that an absolute decline in FVC ≥10% over time is an acceptable marker of disease progression and can be used to estimate risk of future mortality in patients with IPF (19). DLco is more reliably predictive of survival at baseline, and a threshold of approximately 35% has been associated with increased risk of mortality (20). Mortality was also substantially higher in those with significant (i.e., >15%) deterioration in gas transfer on follow-up at 12 months (21). In the present research, C-index derived from the combination of DLco and other parameters was higher than that from %FVC or other parameters. Given the above, baseline %DLco was expected to be more important than %FVC in predicting 3-year ILD-related events.

Evaluation of comorbidities appears important in determining the prognosis of ILD. Kreuter et al. reported significant negative impacts of arteriosclerosis, other cardiovascular diseases (mainly valvular heart disease, cardiac arrhythmias, and dilated cardiomyopathy), and lung cancer comorbidities on survival among patients with IPF (5). In addition, other reports have identified cardiovascular disease, congestive heart failure, and lung cancer as significant predictors for AE onset and prognosis (22). In a cohort study that included 1,285 patients with ILD conducted by The CAnadian REgistry for Pulmonary Fibrosis (CARE-PF), CCIS was similar across ILDs and ranged from a mean of 1.2±0.9 in non-IPF IIPs to 2.1±1.0 in CVD-IP (23). In the present research, we found that similar to previous cohort studies, CCIS did not differ significantly across ILDs and could represent a strong prognostic predictor in patients with ILDs. Interestingly, the frequency of 3-year ILD-related events tended to increase with increasing CCIS, and this tendency was more pronounced with higher composite scores (≥3). This result suggested that our composite scoring including CCIS could accurately predict 3-year ILD-related events. A further study is needed to prove if the management of comorbidities improves the prognosis of ILD.

This retrospective study of a small number of patients from only one institution has some limitations. To verify the utility and reproducibility of this composite scoring system, large-scale, multi-institutional prospective collaborative research is essential. The majority of patients enrolled in this study were not so severely ill that pulmonary function tests including DLco could be tolerated, so this point suggested a possible source of bias for this study. Therefore, the results in this study should be applied to the mild ILD patients excluding severe cases who are not tolerant to pulmonary diffusion capacity testing. On the other hand, as with the C-index of IPF+CCIS+%DLco, that of IPF+CCIS+%FVC was relatively acceptable. Actually, it was found that the higher the composite scoring system using ILD diagnosis, CCIS, and %FVC, the higher the frequency of 3-year ILD-related events (, ). In severe cases that are not well tolerated, it may be more practical to evaluate with %FVC, which can be performed more easily, however the future validation targeting all ILD patients ranging from mild to severe cases is necessary.

Table S1

Scoring system including IPF diagnosis, CCIS, FVC

Predictors	Details	Score
The diagnosis	IPF	1
	Not IPF	0
CCIS	≥6	4
	4–5	3
	2–3	2
	0–1	1
FVC, %predicted	<70.0	1
	≥70.0	0

CCIS, Charlson Comorbidity Index score; FVC, forced vital capacity; IPF, idiopathic pulmonary fibrosis.

Figure S1

Comparison of patients with ILD according to composite scoring system using ILD diagnosis, CCIS, and %FVC (score ≤2 vs. ≥3). The composite score is the global score (ranging between 0 and 6) calculated from the three parameters: CCIS (0–1, 1; 2–3, 2; 4–5; 3; ≥6, 4); ILD diagnosis (non-IPF, 0; IPF, 1); and %FVC (≥70.0, 0; <70.0, 1). Patients are categorized into two groups based on composite score: score ≤2 vs. ≥3. Three-year ILD-related event-free survival rates are significantly better in the former group (n=143) than latter group (n=37; P<0.001) (A: log-rank test; B: stratified log-rank test). CCIS, Charlson Comorbidity Index score; ILD, interstitial lung disease; IPF, idiopathic pulmonary fibrosis; FVC, forced vital capacity.

Figure S2

Comparison of patients with ILD according to composite scoring system using ILD diagnosis, CCIS, and %FVC (score ≤2 vs. =3 vs. ≥4). We categorized the patients having the composite score (≥3; the latter group in ) into two groups: score =3 vs. ≥4. Then we compared three-year ILD-related event-free survival rates between three groups: score ≤2 (n=143) vs. =3 (n=27) vs. ≥4 (n=10). Both log-rank and stratified log-rank tests showed that Kaplan-Meier survival curves of these groups differed significantly (P<0.001) (A: log-rank test; B: stratified log-rank test). CCIS, Charlson Comorbidity Index score; ILD, interstitial lung disease; FVC, forced vital capacity.

In conclusion, we found that CCIS, %DLco, and IPF diagnosis offer significant predictors of ILD events among patients with stable ILD.

The article’s supplementary files as