Propensity score-weighted analysis of chemotherapy after PD-1 inhibitors versus chemotherapy alone in patients with non-small cell lung cancer (WJOG10217L).

BACKGROUND: Studies have suggested that chemotherapy after immune checkpoint inhibitors may confer an improved response for non-small cell lung cancer (NSCLC). However, potential selection bias in such studies has not been addressed. We therefore applied propensity score analysis to investigate the efficacy of chemotherapy after PD-1 inhibitor treatment (CAP) compared with chemotherapy alone.
METHODS: We conducted a retrospective observational cohort study for patients treated at 47 institutions across Japan between April 1, 2014 and July 31, 2017. Eligible patients had advanced or recurrent NSCLC who have undergone chemotherapy. Patients subsequently treated with chemotherapy (docetaxel with or without ramucirumab, S-1 or pemetrexed) either after PD-1 inhibitor therapy (CAP cohort) or alone (control cohort) were included. The primary end point was objective response rate (ORR). Inverse probability weighting (IPW) was applied to adjust for potential confounding factors.
RESULTS: A total of 1439 patients (243 and 1196 in the CAP and control cohorts, respectively) was available for unadjusted analysis. Several baseline characteristics-including age, histology, EGFR or ALK genetic alterations, and brain metastasis-differed significantly between the two cohorts. After adjustment for patient characteristics with the IPW method, ORR was 18.9% for the CAP cohort and 11.0% for the control cohort (ORR ratio 1.71; 95% CI 1.19 to 2.46; p=0.004). IPW-adjusted Kaplan-Meier curves showed that median progression-free survival (PFS) for the CAP and control cohorts was 2.8 and 2.7 months (IPW-adjusted HR 0.95; 95% CI 0.80 to 1.12; p=0.55), and median overall survival (OS) was 9.2 and 10.4 months (IPW-adjusted HR 1.05; 95% CI 0.86 to 1.28; p=0.63), respectively.
CONCLUSIONS: After accounting for selection bias by propensity score analysis, CAP showed a significantly higher ORR compared with chemotherapy alone, with the primary end point of ORR being achieved. However, these results did not translate into a PFS or OS advantage, suggesting that prior administration of PD-1 inhibitors may result in a synergistic antitumor effect with subsequent chemotherapy, but that such an effect is transient. CAP therefore does not appear to achieve durable tumor control or confer a lasting survival benefit. © Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Background

The development of immune checkpoint inhibitors (ICIs) has led to a major shift in the treatment of advanced non–small cell lung cancer (NSCLC). Phase III studies of patients with advanced NSCLC who experienced disease progression during or after platinum-based chemotherapy found that the programmed cell death–1 (PD-1) inhibitors nivolumab and pembrolizumab, as well as the programmed cell death–ligand 1 (PD-L1) inhibitor atezolizumab, had durable antitumor activity and significantly prolonged overall survival (OS) compared with docetaxel.1–4 However, most patients eventually experience disease progression during ICI treatment.

Randomized controlled trials (RCTs) have demonstrated the efficacy of docetaxel, pemetrexed or docetaxel plus ramucirumab in the second-line setting for patients with advanced NSCLC who have undergone prior chemotherapy.5–8 In addition, a phase III trial showed the non-inferiority of S-1 relative to docetaxel for East Asian patients with previously treated advanced NSCLC.9 These chemotherapy regimens are therefore frequently administered in routine clinical practice for patients who experience disease progression during ICI therapy.

Retrospective studies of patients with NSCLC have recently suggested that the objective response rate (ORR) for salvage chemotherapy after ICIs is higher relative to historical data or to the last chemotherapy regimen administered before ICIs.10 11 However, despite the highly selected populations of patients who received sequential ICIs and chemotherapy, no study has addressed potential selection bias. Although a prospective RCT would be the gold standard for verification of these findings with minimal systematic bias, such a trial is not feasible because the administration of an ICI alone or in combination with chemotherapy is now widely recognized as a standard first-line treatment for patients with advanced NSCLC.12–14

Propensity score analysis was designed to eliminate selection bias due to measured patient characteristics that affect both treatment and outcomes in observational studies.15–17 A treatment effect estimated from observational databases can provide complementary evidence to support the results of RCTs, given that patients enrolled in RCTs are often highly selected and at low risk, yielding results not generalizable to all real-world clinical settings.16 17

We have therefore now performed a multicenter retrospective observational cohort study to evaluate with the use of propensity score analysis whether chemotherapy after PD-1 inhibitor treatment (CAP) has a greater antitumor effect compared with chemotherapy alone.

Methods

Study design and patients

We performed a search of electronic medical records for patients with advanced or recurrent NSCLC treated at 47 affiliated institutions of West Japan Oncology Group (WJOG). Eligible patients had histologically or cytologically confirmed advanced NSCLC who received cytotoxic chemotherapy as a first-line treatment. Patients with recurrent disease who had received curative surgery or chemoradiotherapy were included. The following regimens were not counted as a line of therapy: preoperative or postoperative adjuvant chemotherapy, chemotherapy associated with curative radiotherapy, epidermal growth factor receptor (EGFR) tyrosine kinase inhibitors (TKIs) for EGFR mutation–positive patients and anaplastic lymphoma kinase (ALK) TKIs for ALK rearrangement–positive patients. Patients who were treated with nivolumab or pembrolizumab in the second-line setting and subsequently with S-1, with pemetrexed, or with docetaxel with or without ramucirumab as the third-line treatment between December 1, 2015 and July 31, 2017 were included in the CAP cohort (see online supplementary figure S1). The clinical outcomes for the CAP cohort were compared with those for a control cohort of patients treated with second-line cytotoxic chemotherapy including either S-1, pemetrexed or docetaxel with or without ramucirumab—without preceding ICI therapy—between April 1, 2014 and July 31, 2017. The patients in the control cohort were included from April 1, 2014 in order to collect data on such chemotherapy because nivolumab and pembrolizumab became practically available in Japan from December 2015 and December 2016, respectively, and were then widely used as a second-line treatment. Patient eligibility was confirmed by the WJOG data center.

Outcomes

The primary end point of the study was ORR. The secondary end points were progression-free survival (PFS) from the first day of treatment with S-1, pemetrexed or docetaxel with or without ramucirumab until disease progression or death due to any cause, OS from the first day of such treatment until death due to any cause, and safety. ORR was assessed by the investigators according to Response Evaluation Criteria in Solid Tumors (V.1.1) and was calculated only for patients with measurable lesions. Safety evaluations included assessment of treatment-related select adverse events (AEs), which were defined as AEs with a potential immunologic basis.18 AEs were graded according to the National Cancer Institute Common Terminology Criteria for Adverse Events (V.4.0).

Statistical analysis

Comparisons between the two cohorts were performed with Fisher’s exact test for categorical variables and with the Wilcoxon test for continuous variables. Given that we assumed that imbalances in patient characteristics between the two cohorts might exist, we applied propensity score analysis with the inverse probability weighting (IPW) method to minimize the bias due to measured confounders.19 The propensity score for each patient was calculated as a probability from a logistic regression model that included all covariates deemed likely to have affected treatment decisions and response—including age, sex, smoking status, Eastern Cooperative Oncology Group performance status, histology, EGFR or ALK genetic alterations, brain metastasis, history of curative radiotherapy and type of chemotherapy (docetaxel with or without ramucirumab, S-1 or pemetrexed). Stabilized weights were calculated for each patient on the basis of the estimated propensity score.19 When weighted regression analyses were performed, a robust sandwich variance was used to account for the weighted nature of the sample.19

Survival curves for the two cohorts were created with IPW-adjusted Kaplan-Meier plots, and IPW-adjusted HR was calculated with IPW-weighted Cox’s proportional hazard models.

We conducted subgroup analysis based on each chemotherapy regimen for the two cohorts. For subgroup analysis of efficacy, the propensity score was calculated by excluding the covariates of histology and history of curative radiotherapy for patients with EGFR or ALK genetic alterations, and by excluding performance status and EGFR or ALK genetic alterations for those with history of curative radiotherapy. We adopted this approach because the logistic regression model used to yield propensity scores was unstable when these covariates were included in the explanatory variables.

All p values <0.05 were considered statistically significant. Clinical data were managed by the WJOG data center. Statistical analysis was performed by an outside contract research organization (EPS, Tokyo, Japan) with SAS (V.9.4) software.

Results

Patient characteristics

A total of 1626 patients at 47 institutions was assessed for study eligibility (figure 1). Of these patients, we excluded 187 (12%) individuals who did not meet the inclusion criteria. The remaining 1439 patients were included in the unadjusted analysis. The CAP cohort consisted of 243 patients, with 105 (43%) having received docetaxel, 77 (32%) docetaxel plus ramucirumab, 49 (20%) S-1 and 12 (5%) pemetrexed, whereas the control cohort consisted of 1196 patients, with 778 (65%) having received docetaxel, 94 (8%) docetaxel plus ramucirumab, 174 (15%) S-1 and 150 (13%) pemetrexed. The median follow-up time was 8.1 months (95% CI 7.5 to 9.4 months) in the CAP cohort and 9.3 months (95% CI 8.7 to 9.9 months) in the control cohort. Unadjusted patient characteristics and comparisons between the two cohorts are shown in table 1 and online supplementary table S1. The two cohorts differed significantly with respect to age, histology, EGFR or ALK genetic alterations, PD-L1 tumor proportion score (TPS), brain metastasis and type of chemotherapy. To correct for potential imbalances, we performed propensity score analysis. The distribution of propensity score in each cohort is shown in online supplementary figure S2. We evaluated covariate balance with the use of standardized difference.20 A standardized difference <0.1 would indicate good balance. After IPW adjustment, the covariates were well balanced between the CAP and control cohorts (see online supplementary table S2). Treatment data for first-line chemotherapy, PD-1 inhibitor treatment after first-line chemotherapy and poststudy systemic therapy are provided in online supplementary tables S3 and S4.

Figure 1

CONSORT diagram. CAP, chemotherapy after PD-1 inhibitor treatment; IPW, inverse probability weighting; OS, overall survival; PFS, progression-free survival.

Table 1

Unadjusted patient characteristics for the chemotherapy after PD-1 inhibitor treatment (CAP) and control cohorts

Characteristic	CAP cohort(n=243)	Control cohort(n=1196)	P value*
Age, years†‡
Median (range)	68 (38–86)	69 (30–87)	0.01
<70	150 (61.7)	655 (54.8)	0.06
≥70	93 (38.3)	539 (45.1)
Sex
Male	169 (69.5)	867 (72.5)	0.35
Female	74 (30.5)	329 (27.5)
Smoking status§
Never	60 (24.7)	278 (23.2)	0.78
Past	102 (42.0)	487 (40.7)
Current	81 (33.3)	423 (35.4)
Unknown	0 (0.0)	8 (0.7)
Histology
Adenocarcinoma	161 (66.3)	859 (71.8)	0.02
Squamous cell carcinoma	73 (30.0)	263 (22.0)
Other	9 (3.7)	74 (6.2)
EGFR mutation status
Positive	28 (11.5)	201 (16.8)	0.04¶
Negative	177 (72.8)	839 (70.2)
Unknown	38 (15.6)	156 (13.0)
ALK rearrangement status
Positive	8 (3.3)	13 (1.1)	0.02¶
Negative	177 (72.8)	837 (70.0)
Unknown	58 (23.9)	346 (28.9)
PD-L1 TPS**
≥50%	23 (9.5)	33 (2.8)	0.008
1%–49%	41 (16.9)	76 (6.4)
<1%	32 (13.2)	115 (9.6)
Unknown	147 (60.5)	972 (81.3)
ECOG PS†††
0–1	197 (81.1)	1038 (86.8)	0.054‡‡
≥2	34 (14.0)	111 (9.3)
Unknown	12 (4.9)	46 (3.8)
Stage§§
III	31 (12.8)	156 (13.0)	0.94
IV	170 (70.0)	812 (67.9)
Recurrence after surgery	33 (13.6)	175 (14.6)
Recurrence after CRT	9 (3.7)	53 (4.4)
Brain metastasis†
Yes	65 (26.7)	247 (20.7)	0.04
No	178 (73.3)	949 (79.3)
Type of chemotherapy
Docetaxel	105 (43.2)	778 (65.1)	<0.001
Docetaxel+ramucirumab	77 (31.7)	94 (7.9)
S-1	49 (20.2)	174 (14.5)
Pemetrexed	12 (4.9)	150 (12.5)

Data are presented as n (%) with the exception of median age.

*P values were determined with the Wilcoxon test or Fisher’s exact test as appropriate.

†At the time of initiation of docetaxel with or without ramucirumab, S-1 or pemetrexed.

‡Two patients in the control cohort had missing data.

§Never smokers were defined as individuals who had smoked <100 cigarettes; past smokers as those who had smoked ≥100 cigarettes but had quit >1 year prior to diagnosis; and current smokers as those who had smoked ≥100 cigarettes including at least one within the year prior to diagnosis.

¶P values are for comparison between patients positive for EGFR or ALK alterations and those negative or of unknown status.

**Data for PD-L1 expression in tumor cells were obtained by immunohistochemistry according to the standard practice of each center.

††One patient in the control cohort had missing data.

‡‡P value is for comparison between PS of 0–1 and PS of 2–4 or unknown.

§§All patients were classified on the basis of clinical stage according to the seventh edition of the TNM classification.

CRT, chemoradiotherapy; ECOG PS, Eastern Cooperative Oncology Group performance status; TPS, tumor proportion score.

Efficacy

With the IPW method, the ORR for the CAP and control cohorts was found to be 18.9% and 11.0%, respectively, with the ORR for the CAP cohort being significantly higher than that for the control cohort (ORR ratio 1.71 with 95% CI 1.19 to 2.46, p=0.004) (table 2). IPW-adjusted subgroup analysis according to chemotherapy regimen revealed the ORR for the CAP and control cohorts to be 17.6% and 11.4%, respectively, for patients treated with docetaxel, and 20.9% and 18.3%, respectively, for those treated with docetaxel plus ramucirumab. Patients treated with docetaxel or docetaxel plus ramucirumab in the CAP cohort thus had a numerically higher ORR compared with those in the control cohort.

Table 2

Objective response by inverse probability weighting–adjusted analysis for all patients and according to chemotherapy regimen

	All		Docetaxel		Docetaxel+Ramucirumab		S-1		Pemetrexed
	CAP	Control	CAP	Control	CAP	Control	CAP	Control	CAP	Control
No. of patients	228	1130	101	734	61	84	46	151	12	122
ORR (%)	18.9	11.0	17.6	11.4	20.9	18.3	6.0	6.0	53.6	9.8
ORR ratio (95% CI), p value*	1.71 (1.19 to 2.46), 0.004		1.55 (0.95 to 2.51), 0.08		1.14 (0.58 to 2.26), 0.70		1.01 (0.26 to 3.90), 0.987		5.47 (2.32 to 12.91), <0.001

*The relative risk (95% CI) is shown for the ORR ratio. The control cohort was the reference cohort for calculation of relative risk, with a relative risk >1 thus favoring the CAP cohort.

CAP, chemotherapy after PD-1 inhibitor treatment; ORR, objective response rate.

With regard to the results of IPW-adjusted survival analysis, the median PFS for the CAP and control cohorts was 2.8 and 2.7 months, respectively. PFS thus did not differ significantly between the CAP and control cohorts (IPW-adjusted HR 0.95 with 95% CI 0.80 to 1.12, p=0.55) (figure 2). IPW-adjusted Kaplan-Meier curves showed that the median OS for the CAP and control cohorts was 9.2 and 10.4 months, respectively. There was thus no difference in OS between the CAP and control cohorts (IPW-adjusted HR 1.05 with 95% CI 0.86 to 1.28, p=0.63) (figure 3).

Figure 2

Inverse probability weighting (IPW)–adjusted Kaplan-Meier analysis of progression-free survival (PFS) for the chemotherapy after PD-1 inhibitor treatment (CAP) cohort versus the control cohort. Comparisons are shown for all patients (A) as well as for those treated with docetaxel (B), with docetaxel plus ramucirumab (C), with S-1 (D) or with pemetrexed (E). Vertical lines on the curves denote censoring. mo, month(s).

Figure 3

Inverse probability weighting (IPW)–adjusted Kaplan-Meier analysis of overall survival (OS) for the chemotherapy after PD-1 inhibitor treatment (CAP) cohort versus the control cohort. Comparisons are shown for all patients (A) as well as for those treated with docetaxel (B), with docetaxel plus ramucirumab (C), with S-1 (D) or with pemetrexed (E). Vertical lines on the curves denote censoring. NR, not reached.

In the unadjusted analysis, ORR was 17.9% for the CAP cohort and 10.8% for the control cohort (ORR ratio 1.66 with 95% CI 1.21 to 2.28, p=0.003) (see online supplementary table S5). Unadjusted Kaplan-Meier curves showed that median PFS was 3.2 and 2.7 months (unadjusted HR 0.93 with 95% CI 0.81 to 1.08, p=0.36) (see online supplementary figure S3) and that median OS was 9.5 and 10.4 months (unadjusted HR 1.08 with 95% CI of 0.91 to –1.28, p=0.40) (see online supplementary figure S4) for the CAP and control cohorts, respectively.

We performed sensitivity analysis with the use of alternative approaches to evaluate robustness with our findings regarding estimated treatment effect. Multivariable analyses were conducted with a log-linear regression model for response and Cox’s proportional hazard model for survival, and with the same covariates as used in the IPW method being included as the explanatory variables. These approaches yielded similar results with those for IPW adjustment (see online supplementary table S6).

Further efficacy analysis in the CAP cohort

We further evaluated efficacy in the CAP cohort with regard to several factors that potentially could have influenced the response to chemotherapy after ICI treatment (table 3). Data on PD-L1 expression in tumor cells were available for 39.5% (96 of 243) of patients in the CAP cohort. Of these 96 patients, 23 (24.0%) individuals had a TPS for PD-L1 ≥50%, 41 (42.7%) had a TPS of 1%–49% and 32 (33.3%) had a TPS <1%. The ORR and PFS did not differ between patients with a PD-L1 TPS ≥50% and those with a TPS <1%. Patients with a PD-L1 TPS of 1%–49% had a lower ORR than did those with a TPS <1%, whereas PFS did not differ between these two subgroups. There was no significant difference in ORR or PFS between subgroups of the CAP cohort classified according to duration of PD-1 inhibitor treatment, type of response to PD-1 inhibitor treatment, the interval between the last dose of PD-1 inhibitor and the start of subsequent chemotherapy, EGFR or ALK alteration status or history of curative radiotherapy.

Table 3

Efficacy analysis according to various factors in the CAP cohort

Factor	n	Objective response rate		Progression-free survival			Overall survival
		% (95% CI)	P value*	Median (95% CI), months	HR (95% CI)†	P value†	Median (95% CI), months	HR (95% CI)†	P value†
PD-L1 TPS
≥50%	23	17.4 (4.95 to 38.78)	0.53‡	1.94 (1.41 to 4.60)	1.225 (0.685 to 2.190)	0.49	10.41 (5.85 to 13.93)	1.997 (0.955 to 4.178)	0.07
1%–49%	41	7.3 (1.54 to 19.92)	0.047§	3.75 (2.07 to 6.44)	0.692 (0.410 to 1.170)	0.17	9.72 (6.80 to 12.39)	1.824 (0.975 to 3.412)	0.06
<1%	32	25.8 (11.86 to 44.61)		3.88 (2.99 to 5.36)	1.00 (reference)		14.72 (9.49 to NR)	1.00 (reference)
Duration of PD-1 inhibitor treatment
≥12 weeks	83	20.0 (11.89 to 30.44)	0.59	3.94 (2.53 to 4.63)	0.773 (0.580 to 1.028)	0.08	11.79 (8.02 to 13.60)	0.753 (0.534 to 1.062)	0.11
<12 weeks	160	16.9 (11.43 to 23.59)		2.76 (2.27 to 3.88)	1.00 (reference)		9.00 (7.33 to 10.58)	1.00 (reference)
Objective response for PD-1 inhibitor
CR or PR	35	23.5 (10.75 to 41.17)	0.34	3.29 (1.84 to 5.52)	0.909 (0.605 to 1.363)	0.64	10.18 (7.20 to NR)	0.882 (0.550 to 1.414)	0.60
SD or PD	203	16.9 (12.01 to 22.83)		3.22 (2.53 to 4.04)	1.00 (reference)		9.59 (8.02 to 11.66)	1.00 (reference)
Interval from last dose of PD-1 inhibitor to start of subsequent chemotherapy
≥4 weeks	124	18.7 (12.24 to 26.72)	0.87	2.96 (2.10 to 3.91)	1.023 (0.780 to 1.341)	0.87	8.54 (7.29 to 10.58)	1.140 (0.831 to 1.563)	0.42
<4 weeks	119	17.1 (10.77 to 25.16)		3.75 (2.53 to 4.37)	1.00 (reference)		10.78 (7.85 to 12.65)	1.00 (reference)
EGFR or ALK alteration status
Positive	32	21.9 (9.28 to 39.97)	0.62	4.60 (2.50 to 6.83)	0.879 (0.582 to 1.328)	0.54	13.11 (9.59 to NR)	0.595 (0.354 to 0.999)	0.0496
Negative or unknown	211	17.3 (12.43 to 23.15)		2.96 (2.40 to 3.88)	1.00 (reference)		8.67 (7.49 to 10.78)	1.00 (reference)
History of curative radiotherapy
Yes	17	18.8 (4.05 to 45.65)	>0.99	2.40 (1.74 to 6.90)	1.030 (0.586 to 1.809)	0.92	13.47 (6.34 to NR)	0.656 (0.322 to 1.337)	0.25
No	226	17.9 (13.07 to 23.51)		3.29 (2.53 to 3.98)	1.00 (reference)		9.10 (7.89 to 10.84)	1.00 (reference)

*P values were determined with Fisher’s exact test.

†HRs with 95% CI and p values were calculated with the Cox proportional hazards regression model.

‡P value is for comparison between ≥50% and<1%.

§P value is for comparison between 1%–49% and <1%.

CAP, chemotherapy after PD-1 inhibitor treatment; CR, complete response; NR, not reached; PD, progressive disease; PR, partial response; SD, stable disease; TPS, tumor proportion score.

Safety

Finally, we examined whether the CAP cohort experienced increased toxicity, given that small series of patients with melanoma or NSCLC were previously found to experience severe systemic toxicities during treatment with TKIs subsequent to that with ICIs.21–23 Treatment-related select AEs for chemotherapy, PD-1 inhibitors and each chemotherapy regimen separately are listed in table 4 and online supplementary tables S7–11. AEs of any grade for chemotherapy that showed a significantly higher incidence in the CAP cohort than in the control cohort included stomatitis (14.4% vs 8.8%, p=0.009) and hypothyroidism (1.2% vs 0%, p=0.005). Subgroup analysis according to chemotherapy regimen revealed no significant differences in the incidence of any-grade stomatitis or hypothyroidism between the CAP and control cohorts, whereas the incidence of an increase in total bilirubin level of any grade in patients treated with docetaxel or of hyperglycemia and increases in aspartate aminotransferase (AST) and alanine aminotransferase (ALT) levels of any grade in those treated with S-1 was significantly higher in the CAP cohort than in the control cohort. All treatment-related deaths were due to pneumonitis: one patient (0.4%) in the CAP cohort and seven patients (0.6%) in the control cohort.

Table 4

Treatment-related select adverse events for chemotherapy

Event	CAP cohort(n=243)			Control cohort(n=1196)			P value*
	Any grade	Grade 1–2	Grade 3–5	Any grade	Grade 1–2	Grade 3–5
Rash	27 (11.0)	25 (10.2)	2 (0.8)	110 (9.2)	103 (8.6)	7 (0.6)	0.34
Pruritus	10 (4.1)	10 (4.1)	0 (0.0)	40 (3.4)	37 (3.1)	3 (0.3)	0.56
Stomatitis	35 (14.4)	29 (11.9)	6 (2.5)	105 (8.8)	87 (7.3)	18 (1.5)	0.009
Diarrhea	30 (12.3)	26 (10.7)	4 (1.6)	104 (8.7)	90 (7.5)	14 (1.2)	0.09
Colitis	3 (1.2)	1 (0.4)	2 (0.8)	6 (0.6)	3 (0.3)	3 (0.3)	0.18
Hypothyroidism	3 (1.2)	3 (1.2)	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)	0.005
Hyperthyroidism	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)
Hypophysitis	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)	0 (0.0)
Hyperglycemia	6 (2.4)	4 (1.6)	2 (0.8)	21 (1.8)	20 (1.7)	1 (0.1)	0.44
AST increase	41 (16.9)	37 (15.3)	4 (1.6)	165 (13.8)	159 (13.3)	6 (0.5)	0.23
ALT increase	37 (15.2)	30 (12.3)	7 (2.9)	136 (11.4)	129 (10.8)	7 (0.6)	0.10
Total bilirubin increase	9 (3.7)	7 (2.9)	2 (0.8)	21 (1.8)	20 (1.7)	1 (0.1)	0.08
Creatinine increase	14 (5.8)	14 (5.8)	0 (0.0)	67 (5.6)	65 (5.4)	2 (0.2)	0.88
Pneumonitis	17 (7.0)	8 (3.3)	9 (3.7)†	88 (7.3)	45 (3.7)	43 (3.6)‡	>0.99

Data are presented as n (%).

*P values were determined by Fisher’s exact test and are for between-cohort comparisons of rates of any-grade adverse events.

†Data include one patient with treatment-related pneumonitis of grade 5.

‡Data include seven patients with treatment-related pneumonitis of grade 5.

CAP, chemotherapy after PD-1 inhibitor treatment; AST, aspartate aminotransferase; ALT, alanine aminotransferase.

Discussion

In this multicenter retrospective cohort study for advanced NSCLC based on propensity score analysis with the IPW method, we found that CAP was associated with a higher ORR, but no PFS or OS benefit, compared with chemotherapy alone.

The choice of treatment in real-world clinical practice can be influenced by patient characteristics.16 Indeed, in our study, many important baseline characteristics differed significantly between the CAP and control cohorts. The presence of such an imbalance can lead to a biased estimate of treatment effect.15 We therefore applied the propensity score to balance the distribution of these measured covariates between the cohorts.24 To our knowledge, our study is the only one to date to describe clinical outcomes of patients treated sequentially with PD-1 inhibitors and chemotherapy with the use of the propensity score to address this bias.

Several different propensity score–based methods have been developed.15–17 19 The most common method is propensity score matching, in which patients with similar propensity scores in the treatment and control groups are matched.15 17 One disadvantage of such matching, however, is that unmatched patients are excluded from the analysis, leading to a reduced generalizability and accuracy of the results.15 This disadvantage is overcome with the IPW method, which generates a weight based on the propensity score. This method can include all patients in the analysis and generates a pseudopopulation in which the measured confounding variables are balanced between the groups.16 We thus applied the IPW method in the present study.

The primary end point of ORR was met in our study, providing support for previous suggestions that chemotherapy after ICI exposure confers an improved response in patients with NSCLC.10 11 However, this result did not translate into a PFS or OS advantage, indicating that CAP does not confer a durable antitumor response. These findings are consistent with those of a previous study in which chemotherapy after ICIs did not show a PFS benefit despite an increased ORR.10 Although the difference in treatment line between the CAP (third line) and control (second line) cohorts might have influenced the PFS and OS results, one possible explanation for this lack of a sustained survival benefit is suggested by pharmacokinetics data for patients with advanced NSCLC showing that binding of nivolumab to T cells remained apparent for >2 months after the last infusion regardless of subsequent treatment and that the percentage binding decreased in a time-dependent manner.25 26 Such prolonged binding of PD-1 inhibitors after their discontinuation may thus give rise to a transient synergism in antitumor effect with subsequent chemotherapy, with this synergism decreasing as the percentage binding of the inhibitors to T cells declines.

An important question that follows from the results of recent randomized studies is whether combinations of ICIs and chemotherapy have greater efficacy when administered concurrently than when given sequentially ICIs followed by chemotherapy in previously untreated patients with metastatic NSCLC, especially in those with a PD-L1 TPS ≥50%.12 13 27 28 The concurrent administration of an ICI and cytotoxic chemotherapy is now widely adopted as a first-line treatment for advanced NSCLC.13 28 Moreover, phase III studies have demonstrated a survival benefit for pembrolizumab monotherapy relative to platinum-based chemotherapy and support the use of pembrolizumab monotherapy as a first-line treatment for advanced NSCLC in patients with a PD-L1 TPS ≥1%.12 14 Approximately 40% of patients received chemotherapy after disease progression during pembrolizumab monotherapy in one of these studies.14 Given that more and more patients receive an ICI alone or in combination with chemotherapy as a first-line treatment, the efficacy and safety of chemotherapy after the preceding administration of ICI treatment are key factors, and our findings now provide important information for such patients. In the present study, the CAP cohort did not show a durable clinical benefit—and, in particular, the treatment did not show a higher efficacy in patients with a PD-L1 TPS ≥50% than in those with a TPS <1%. On the basis of these findings and the pharmacokinetics data described above, concurrent administration of ICIs and chemotherapy might be a more promising therapeutic approach than the sequential strategy for maximizing the synergistic clinical activities of ICIs and chemotherapy. A phase III study to investigate whether the concurrent or sequential strategy in the first-line setting is more efficacious for NSCLC is currently ongoing (ClinicalTrials.gov identifier NCT03793179).

We observed a significantly higher incidence of stomatitis in the CAP cohort than in the control cohort, likely reflecting the higher proportion of patients who received docetaxel plus ramucirumab in the former than in the latter cohort. Previous studies have shown that stomatitis occurs at a higher frequency in patients treated with docetaxel plus ramucirumab than in those receiving docetaxel alone.8 29 Subgroup analysis according to chemotherapy regimen did not reveal any significant differences in the occurrence of stomatitis between the two cohorts. On the other hand, we detected significantly higher rates of hepatotoxicity, including elevation of total bilirubin, AST and ALT levels, in the CAP cohort than in the control cohort among patients treated with docetaxel or S-1. Consistent with previous findings, these results suggest that careful monitoring for hepatotoxicity may be warranted in patients treated with chemotherapy after PD-1 inhibitors.22

Our study has several limitations. First, our findings are based on a retrospective cohort analysis performed with electronic medical records, with their inherent variability in accuracy and data availability. In particular, the interval for imaging was highly variable, representing a bias for PFS assessment. However, comparison of the efficacy of chemotherapy with or without prior ICI treatment is possible only with such a retrospective design. Second, we did not account for PD-L1 expression as a confounder. PD-L1 testing currently provides important information for selection of patients most likely to benefit from ICI therapy, although there was previously little evidence that PD-L1 status was associated with ICI efficacy in NSCLC. Nivolumab was widely administered as a second-line treatment regardless of PD-L1 expression level until 2017, given that no diagnostic kits had been commercially available in Japan. PD-L1 TPS thus did not critically affect treatment decisions for most patients in the CAP cohort treated between December 1, 2015 and July 31, 2017, and we therefore did not include it as a covariate in our study. Third, the fact that the present study inherently compares second-line chemotherapy (control cohort) with third-line chemotherapy (CAP cohort) might have influenced the PFS and OS results.

Conclusions

After adjustment for selection bias by propensity score analysis according to the IPW method, our study has shown that CAP was associated with a higher ORR compared with chemotherapy alone, with the primary end point of ORR thus being achieved. However, PFS and OS did not differ between the two cohorts. Our findings indicate that the preceding administration of PD-1 inhibitors may give rise to a synergistic antitumor effect with chemotherapy, but that this effect is likely not persistent. CAP therefore does not appear to give rise to durable tumor control and a consequent survival benefit.