Literature DB >> 34104542

Soluble immune checkpoints and T-cell subsets in blood as biomarkers for resistance to immunotherapy in melanoma patients.

Devayani Machiraju1, Melanie Wiecken1,2,3, Nina Lang1, Ingrid Hülsmeyer1, Jasmin Roth1, Timo E Schank1, Rosa Eurich4, Niels Halama4, Alexander Enk1, Jessica C Hassel1.   

Abstract

Different mechanisms lead to immune checkpoint inhibitor (ICI) resistance. Identifying clinically useful biomarkers might improve drug selection and patients' therapy. We analyzed the soluble immune checkpoints sPD1, sPDL1, sLAG3, and sTIM3 using ELISA and their expression on circulating T cells using FACS in pre- and on-treatment blood samples of ICI treated melanoma patients. In addition, pre-treatment melanoma metastases were stained for TIM3 and LAG3 expression by IHC. Results were correlated with treatment response and progression-free survival (PFS). Resistance to anti-PD1 treatment (n = 48) was associated with high pre-treatment serum levels of sLAG3 (DCR: p = .009; PFS: p = .018; ROC cutoff >148 pg/ml) but not sPD1, sPDL1 or sTIM3. In contrast, resistance to ipilimumab plus nivolumab (n = 42) was associated with high levels of sPD1 (DCR: p = .019, PFS: p = .046; ROC cutoff >167 pg/ml) but not sPDL1, sLAG3 or sTIM3. Both treatment regimens shared a profound increase of sPD1 serum levels with treatment (p < .0001). FACS analysis revealed reduced frequencies of CD3CD8+ PD1 + T cells (p = .028) in anti-PD1-resistant patients, whereas increased frequencies of CD3CD4LAG3 + T cells characterized patients resistant to ipilimumab plus nivolumab (p = .033). Unlike anti-PD1 monotherapy, combination blockade significantly increased proliferating T cells (CD3CD8+ Ki67 + T cells; p < .0001) and eosinophils (p = .001). In melanoma metastases, an increased infiltration with TIM3+ or LAG3 + T cells in the tumor microenvironment correlated with a shorter PFS under anti-PD1 treatment (TIM3: p = .019, LAG3: p = .07). Different soluble immune checkpoints characterized checkpoint inhibitor-resistant melanoma. Measuring these serum markers may have the potential to be used in clinical routine.
© 2021 The Author(s). Published with license by Taylor & Francis Group, LLC.

Entities:  

Keywords:  Melanoma; immune checkpoints; immunotherapy; t lymphocytes

Year:  2021        PMID: 34104542      PMCID: PMC8158029          DOI: 10.1080/2162402X.2021.1926762

Source DB:  PubMed          Journal:  Oncoimmunology        ISSN: 2162-4011            Impact factor:   8.110


Introduction

Immunotherapy with immune checkpoint inhibitors (ICIs), such as anti-programmed cell death 1 (anti-PD1) antibodies pembrolizumab or nivolumab alone or in combination with anti-cytotoxic T-lymphocyte-associated antigen-4 (anti-CTLA4) antibody ipilimumab plus nivolumab, has the potential to induce durable responses and increased overall survival in several tumor entities but especially advanced melanoma.[1-5] T cells are the main effector cells of ICI treatment as they express the immune checkpoints CTLA4 and PD1 upon activation which lead to T-cell exhaustion and energy. Blockage of these immune checkpoints thereby restores T-cell activation. However, only about one-third of advanced melanoma patients benefit long term from ICI treatment, most patients eventually progress. Identifying biomarkers to indicate ICI treatment resistance in advance would help to select patients and guide treatment decisions and save patients valuable time for alternative therapies. Moreover, the distinct mechanism of action of anti-CTLA4 and anti-PD1 treatment[6] demands treatment-specific biomarkers. Multiple mechanisms of ICI resistance are postulated and explored, including the expression of alternative immune checkpoints, such as T cell immunoglobulin and mucin domain-containing molecule-3 (TIM3) and lymphocyte-activation gene 3 (LAG3).[7-9] In melanoma metastases, transcriptome analysis revealed an increase in LAG3 expression 2–4 weeks after initiation of PD1 monotherapy (SITC, 2017).[10] Johnson et al. have shown that tumors acquire immunosuppressive signals through alternative checkpoints that antagonize MHC-II expression, such as LAG3.[9] Together, these data suggest the role of TIM3 and LAG3 expression in resistance to ICI treatment and thus analyzing their expression in melanoma patient samples may help to predict treatment outcome. In the peripheral blood, PD1 + T cells are among the tumor-related T-cell clones[11,12] and the majority of melanoma patients exhibit an increase in circulating Ki67+ PD1+ CD8 + T cells under anti-PD1 treatment.[13] Here, a high fold change adjusted for baseline tumor burden correlated with longer progression-free survival (PFS). However, in another investigation, the average frequency of PD1+ CD4+ and TIM3CD8+ circulating T cells monitored over the period of anti-PD1 treatment was significantly higher in nonresponders compared to responders.[14] In a mouse model, upon CTLA-4 treatment a suppressive ICOS+LAG3CD4 + T-cell subset was reduced with a concomitant rise in IL-2-producing T effector cells.[15] However, significant findings were only detected under treatment, limiting their usefulness as a predictive biomarker for the clinical routine testing. Interestingly, immune checkpoint proteins, known to be released by immune or cancer cells can be found in the blood as soluble forms.[16-20] Besides the well-studied membrane-bound immune checkpoints, the role of soluble immune checkpoints is actively being explored. Elevated serum concentrations of soluble programmed death-ligand-1 (sPDL1) and soluble PD1 (sPD1) at baseline are linked to an increased risk of disease progression upon treatment with immune checkpoint inhibitors in patients with melanoma.[17,21] In a cooperative work, an increase in soluble interleukin-2 and soluble LAG3 (sLAG3) after only one cycle of ipilimumab was detected.[15] In this study, we aimed to investigate the soluble immune checkpoints sPD1, sPDL1, sLAG3, and sTIM3 as potential biomarkers for immunotherapy resistance and determine their kinetics in the blood of melanoma patients under ICI treatment with either PD1 monotherapy or ipilimumab plus nivolumab combination therapy. In addition, the expression of these immune checkpoints on circulating T-cell subsets and the infiltration of LAG3+ and TIM3 + T cells in melanoma metastases was studied.

Materials and methods

Patient selection

Patients with advanced melanoma who received treatment with anti-PD1 and/or anti-CTLA4 therapy between 2011 and 2018 were identified from routine patient documentation of the Section of Dermatooncology, Department of Dermatology and NCT Heidelberg. Patients who agreed to biobanking of samples were identified. Cohort I consists of patients with serum samples before and about 6 weeks in median (range 3–16 weeks) on ICI treatment for the analysis of soluble immune checkpoints. If available, PBMCs were used for FACS analyses of the T cell subsets. Cohort II consists of patients with archived formalin-fixed tissue samples from melanoma metastases before ICI treatment start. Patient characteristics and the analytical information of routine clinical blood parameters were extracted from the medical records retrospectively. Five patients with overall survival less than 3 months after ICI treatment initiation were excluded. Biobanking of patient material and the retrospective analysis of patient data were approved by the Ethical Committee of the Medical Faculty of Heidelberg (S-207/2005, S-091/2011, S-454/2015).

Definition of response and survival

We used the following treatment response categories defined by the response evaluation criteria in solid tumors (RECIST v1.1) criteria: complete response (CR), partial response (PR), stable disease (SD), and progressive disease (PD). Patients with PD were classified as nonresponders and patients with CR, PR, or SD as patients with the disease control (DCR) as best response. Progression-free survival (PFS) was measured from the start of treatment to documented evidence of PD or death; patients without an event were censored at the last contact date.

Collection of serum and peripheral blood mononuclear cells

Pre- and on-treatment peripheral blood samples were collected and processed according to the standard NCT biobank protocols. The blood samples were centrifuged at 2,500 × g for 10 min for serum separation, divided into 200–300 uL aliquots, and stored at –80°C. For PBMC isolation, peripheral blood samples were collected in EDTA-coated tubes and carefully layered on top of a Ficoll-Hypaque density gradient solution (Biocoll, Biochrom). After centrifugation, the ring of PBMCs was collected, washed twice, resuspended in PBS, counted, resuspended in freezing medium (70% FCS, 20% X–vivo20, 10% DMSO), and frozen at −80°C before subsequent storage in liquid nitrogen until analysis.

Immunophenotyping via flow cytometry

Cells washed in PBS with 2% FCS (FACS buffer) were incubated with a human Fc receptor blocking reagent (KIOVIG, 100 mg/ml infusion solution, normal human immunoglobulin, Baxter). Live/Dead cell viability dye (Thermo Fisher Scientific) was used to be able to distinguish live and dead cells. Cells were then stained with the following extracellular fluorescent-labeled antibodies (BD Biosciences) according to a T cell panel (staining CD3, CD4, CD8, Ki67, LAG3, PD1, TIM3) or a Treg panel (staining CD3, CD4, CD25, CD127, PD1, FoxP3, Ki67): anti-CD3-FITC (UCHT1), anti-CD4-APC-H7 (RPA-T4), anti-CD8-PerCP-Cy™5.5 (RPA-T8), anti-LAG3-BV421 (T47-530), anti-PD1-PE (T cell panel)/-PE-Cy™7 (Treg panel) (EH12.1), anti-TIM3-Alexa Fluor® 647 (7D3), anti-CD25-APC (M-A251), anti-CD127-PerCP-Cy™5.5 (HIL-7 R-M-21). After staining for cell surface markers, cells were washed twice with FACS buffer and incubated with fixation/permeabilization buffer (Invitrogen) at 4°C for 45 min. After two washes with permeabilization wash buffer, cells were intracellularly stained for FoxP3 (anti-FoxP3-PE (236A/E7), BD Biosciences) and/or Ki67 (anti-Ki67-PE-Cy ™7 (T cell panel)/-BV421 (Treg panel) (B56), BD Biosciences) for 30 min at 4°C. After washing, the cells were analyzed on a BD FACS Canto II (BD Biosciences) with single-stained antibody-capturing beads used for compensation (CompBeads, BD Biosciences). Data were analyzed using FlowJo software version 10 (Tree Star, Ashland, OR, USA). T cells (live, single cells, lymphocytes, CD3+ cells) were divided into CD4+ or CD8+ populations and further gated according to the expression of Ki67, PD1, LAG3, TIM3 for the T cell panel, and CD4CD25CD127- cells were further divided according to the expression of PD1, FoxP3 or Ki67 for the Treg panel.

ELISA

Serum concentrations of soluble immune checkpoint proteins were measured using commercially available ELISA kits according to the manufacturer’s instructions (PD1 kit (#LS-F470-1, LS Bio), PDL1 kit (#ab214565, Abcam), TIM3 kit (#ab231932, Abcam), LAG3 kit (#ab193707, Abcam). The intra- and inter-assay coefficient of variation was within 8% and 18%.

Immunohistochemistry

Archived FFPE tissue sections were cut (2–3 μm thick), and immunohistochemistry (IHC) was performed using an automated stainer (Leica BOND-MAXTM, Leica Microsystems). The antigens were retrieved by heating the samples for 20 min at 100°C in citrate buffer (pH 6.0). Sections were incubated with rabbit polyclonal anti‐TIM3 antibody (1: 500; #ab185703, Abcam) or rabbit monoclonal anti‐LAG3 antibody (1:500; #ab180187, Abcam) at 37°C for 30 min. The IHC reaction was detected using a Polymer Refine detection kit (#DS9800, Leica Biosystems) and diaminobenzidine was used as a chromogen. Sections were faintly counterstained with hematoxylin. Stained whole slide tissue sections were digitized into high-resolution images using a scanner. The digital images were then marked and the IHC staining of TIM3 and LAG3 in the TME was evaluated as the density of cells, defined as the number of positive cells/mm2 in the tumor region using Visiomorph automated programming tool. The average score of all the areas within the tumor region for each marker was assessed, and the final scores were later categorized based on the median into high or low for statistical analysis.

Statistical analysis

Differences between the different variables in the groups and ICI treatment response were assessed by Mann–Whitney U (MWU) or chi-square test. Differences between pre- and on-treatment samples were analyzed using the Wilcoxon-rank test (WCR). Cutoff values for all significant biomarker variables were determined by ROC curve analysis using response as an event. Kaplan–Meier Analysis and the Log-rank test were used for survival analysis and the hazard ratio (HR) was determined through a Cox proportional hazard regression model. Multivariable regressions were performed to adjust for potential confounders based on univariable regression analysis. Only baseline variables that achieved a significance level of p < .05 were included in the multivariable model. The correlations between continuous variables were determined by Pearson’s coefficient. All statistical analyses were performed using SPSS version 24 (IBM), and the graphs for data presentation was created using GraphPad Prism version 8 (GraphPad Software, Inc., La Jolla, CA, USA). The bars and lines in the column graphs represent median values and 95% CI. All reported p-values are two-sided, and p < .05 was considered to indicate a statistically significant difference.

Results

sLAG3 and sPD1 indicate resistance to anti-PD1 and combined anti-CTLA4 plus anti-PD1 treatment, respectively

Using ELISA, we measured the soluble immune checkpoints sPD1, sPDL1, sLAG3, and sTIM3 in serum samples before and about 6 weeks after the initiation of ICI therapy. Paired serum samples were available from 113 patients with metastasized stage IV melanoma (cohort 1) who were treated with a PD1 antibody and/or ipilimumab at the Section for Dermatooncology, Department of Dermatology and National Center for Tumor Diseases, University Hospital Heidelberg. Patient characteristics are summarized in Table 1. Of 113 patients, 48 (43%) patients received anti-PD1 monotherapy (47 pembrolizumab, 1 nivolumab), 42 (37%) ipilimumab plus nivolumab, and 23 (20%) ipilimumab monotherapy. The median follow-up of patients was 14 months.
Table 1.

Patient characteristics by treatment group (Cohort 1)

 
ICI Treatment Group
CharacteristicsAnti-CTLA4(n = 23)Anti-PD1(n = 48)Anti-CTLA4 plus Anti-PD1(n = 42)
Age [years]   
Median (range)59 (30–86)70 (37–90)56 (22–77)
 n (%)n (%)n (%)
Sex   
Male16 (70)31 (65)21 (50)
Female7 (30)17 (35)21 (50)
Braf Status   
Mutation11 (48)16 (33)18 (43)
Wild Type11 (48)30 (63)19 (45)
Missing1 (4)2 (4)5 (12)
Serum LDH   
Elevated11 (48)13 (27)18 (43)
Normal10 (43)35 (73)24 (57)
Missing2 (9)  
Prior Systemic Treatment   
No12 (52)21 (44)23 (55)
Yes*11 (48)27 (56)19 (45)
Tumor Stage   
M0, M1a, M1b9 (39)15 (31)13 (31)
M1c, M1d14 (61)33 (69)29 (69)
Liver Metastases   
Yes4 (17)8 (17)17 (40)
No19 (83)40 (83)25 (60)
Brain Metastases   
Yes8 (35)21 (44)14 (33)
No15 (65)27 (56)28 (67)
Response   
CR0 (0)2 (4)3 (7)
PR5 (22)12 (25)13 (31)
SD5 (22)14 (29)10 (24)
PD13 (56)20 (42)16 (38)
RR (PR+CR)5 (22)14 (29)16 (38)
DCR (SD+PR+CR)10 (44)28 (58)26 (62)
PFS [months]   
Median (range)3 (0–37)7 (1–56)6 (1–35)
Follow up [months]   
Median (range)15 (4–90)15 (3–56)13,5 (3–37)

*Prior Systemic therapy was mainly chemotherapy for the anti-CTLA4 group, anti-CTLA4 for the anti-PD1 group, and anti-PD1 for the anti-CTLA4 plus anti-PD1 group.

Patient characteristics by treatment group (Cohort 1) *Prior Systemic therapy was mainly chemotherapy for the anti-CTLA4 group, anti-CTLA4 for the anti-PD1 group, and anti-PD1 for the anti-CTLA4 plus anti-PD1 group. In patients treated with PD1 monotherapy increased concentrations of sLAG3 in pre-treatment samples were observed in patients resistant to the treatment (PD vs DCR, p = .032) with a median value of 186 pg/ml in nonresponding patients and 85 pg/ml in patients with at least stable disease (DCR, Figure 1a). Univariate Cox regression and Kaplan–Meier analysis revealed that patients with sLAG3 concentrations above 148 pg/ml (ROC cutoff: Figure 1b) experienced significantly shorter progression-free survival (p = .018; HR: 0.40; 95%CI: 0.19–0.85; log-rank test: p = 0,007) (Table 2; Figure 1c) under anti-PD1 therapy. Apart from sLAG3, serum lactate dehydrogenase (LDH) levels and absolute monocytes in pre-treatment samples of the peripheral blood were found to be significantly associated with the clinical outcome of anti-PD1 treatment (Table 2; Supplemental text; Supplemental Figure S1). However, sLAG3 remains a significant predictive factor for the response (p = .014) and PFS (0.016) when adjusted to LDH and absolute monocyte count (Table 2).
Figure 1.

sLAG3 indicates resistance to anti-PD1 treatment

Table 2.

Univariable and multivariable regression analysis of response and PFS to anti-PD1 treatment

Best Response (DCR)
ParametersUnivariable Logistic RegressionMultivariable Logistic Regression
 HR (95% CI)pHR (95% CI)p
Age*(<69.5 Vs > 69.5 Years)2.87 (0.87–9.44)0.083  
Gender(Male Vs Female)1.03 (0.31–3.42)0.959  
Braf(Braf wt Vs Braf mt)1.27 (0.36–4.41)0.702  
Prior Systemic Therapy (No Vs Yes)0.53 (0.16–1.75)0.304  
Tumor Stage(M0, M1a, M1b Vs M1c, M1d)0.60 (0.16–2.14)0.432  
Liver Metastases(No Vs Yes)1.23 (0.25–5.87)0.794  
Brain Metastses(No Vs Yes)1.3 (0.40–4.15)0.658  
LDH(Normal Vs Elevated)0.20 (0.05–0.80)0.0240.17 (0.03–0.89)0.036
Monocytes*(<0.4 Vs > 0.4/nl)3.66 (1.07–12.51)0.0385.18 (1.14–23.44)0.033
sLAG3*(<148 Vs >148 pg/ml)0.18 (0.05–0.66)0.0090.15 (0.03–0.68)0.014
Progression-Free Survival (PFS)
ParametersUnivariable Cox RegressionMultivariable Cox Regression
 HR (95% CI)pHR (95% CI)p
Age*(<69.5 Vs > 69.5 Years)1.67 (0.79–3.51)0.176  
Gender(Male Vs Female)0.85 (0.40–1.82)0.691  
Braf(Braf wt Vs Braf mt)1.34 (0.58–3.07)0.483  
Prior Systemic Therapy (No Vs Yes)0.65 (0.29–1.41)0.275  
Tumor Stage(M0, M1a, M1b Vs M1c, M1d)0.95 (0.43–2.10)0.902  
Liver Metastases(No Vs Yes)0.97 (0.37–2.57)0.962  
Brain Metastses(No Vs Yes)1.31 (0.62–2.76)0.474  
LDH(Normal Vs Elevated)0.41 (0.19–0.90)0.0260.41 (0.18–0.91)0.030
Monocytes*(<0.4 Vs > 0.4/nl)1.72 (0.82–3.59)0.148  
sLAG3*(<148 Vs >148 pg/ml)0.40 (0.19–0.85)0.0180.39 (0.18–0.84)0.016

*Age, monocytes, and sLAG3 were dichotomized for regression analysis based on ROC cutoff values with the response as an event

Univariable and multivariable regression analysis of response and PFS to anti-PD1 treatment *Age, monocytes, and sLAG3 were dichotomized for regression analysis based on ROC cutoff values with the response as an event sLAG3 indicates resistance to anti-PD1 treatment However, no such association between sLAG3 and response to combination treatment with ipilimumab and nivolumab (p = .499) or ipilimumab monotherapy (p = .277) (Supplemental Figure S2) was observed. The sLAG3 concentrations increased in patient serum samples upon all the three immune checkpoint regimens within approximately 6 weeks (Figure 1d). In a similar fashion to the pre-treatment concentrations of sLAG3, a trend of increased sLAG3 under PD1 treatment was observed in nonresponders (p = .135; Supplemental Figure S2). In addition, the concentration of sLAG3 positively correlated with the frequencies of CD3CD4CD25CD127- regulatory T cells (p = .001; r = 0.6) in the peripheral blood (Figure 1e). A significant difference in the pre-treatment concentration of sPD1 with response was observed in patients treated with ipilimumab plus nivolumab combination treatment (p = .012) in which the patients who were at least stable under treatment (DCR) had a median sPD1 concentration of 149 pg/ml compared to a median concentration of 459 pg/ml in patients who were primarily resistant (PD, Figure 2a). Univariate Cox regression and Kaplan–Meier analysis revealed that patients with a concentration of sPD1 above 167 pg/ml in pre-treatment samples (ROC cutoff: Figure 2b) experienced significantly shorter PFS (p = .046; HR: 0.44; 95%CI: 0.20–0.98; log-rank test: p = .029) (Table 3; Figure 2c). Apart from sPD1, LDH and hemoglobin levels in pre-treatment blood samples were found to be significantly associated with response to ipilimumab plus nivolumab combination treatment (Table 3; Supplemental text; Supplemental Figure S1). Again, when adjusted to baseline LDH and hemoglobin concentration in the blood, sPD1 remained a significant predictor of response (p = .036) and PFS (p = .038) for the combination treatment (Table 3).
Figure 2.

sPD1 indicates resistance to anti-CTLA4 plus anti-PD1 combination treatment

Table 3.

Univariable and multivariable regression analysis of response and PFS to Anti-CTLA4 plus anti-PD1 combination treatment

Best Response (DCR)
Parameters Univariable Logistic Regression Multivariable Logistic Regression
  HR (95% CI)p HR (95% CI)p
Age*(<55 Vs > 55 Years) 0.28 (0.07–1.12)0.073   
Gender(Male Vs Female) 0.44 (0.12–1.57)0.208   
Braf(Braf wt Vs Braf mt) 1.45 (0.38–5.54)0.583   
Prior Systemic Therapy (No Vs Yes) 0.48 (0.13–1.72)0.264   
Tumor Stage(M0, M1a, M1b Vs M1c, M1d) 0.63 (0.15–2.52)0.514   
Liver Metastases(No Vs Yes) 0.80 (0.22–2.84)0.735   
Brain Metastses(No Vs Yes) 1.87 (0.47–7.45)0.372   
LDH(Normal Vs Elevated) 0.26 (0.07–0.98)0.048 0.28 (0.05–1.43)0.126
Hemoglobin*(<12.6 Vs > 12.6 g/dl) 8.14 (1.95–33.86)0.004 5.50 (1.14–26.45)0.033
sPD1*(<167 Vs >167 pg/ml) 0.18 (0.04–0.75)0.019 0.17 (0.03–0.88)0.036
Progression-Free Survival (PFS)
Parameters Univariable Cox Regression Multivariable Cox Regression
  HR (95% CI)p HR (95% CI)p
Age(<55 Vs > 55 Years) 0.78 (0.36–1.70)0.541   
Gender(Male Vs Female) 0.53 (0.24–1.16)0.114   
Braf(Braf wt Vs Braf mt) 0.77 (0.35–1.71)0.530   
Prior Systemic Therapy (No Vs Yes) 0.63 (0.29–1.34)0.231   
Tumor Stage(M0, M1a, M1b Vs M1c, M1d) 1.04 (0.46–2.33)0.915   
Liver Metastases(No Vs Yes) 0.76 (0.35–1.64)0.497   
Brain Metastses(No Vs Yes) 1.55 (0.65–3.68)0.315   
LDH(Normal Vs Elevated) 0.84 (0.39–1.83)0.675   
Hemoglobin(<12.6 Vs > 12.6 g/dl) 2.27 (1.05–4.90)0.036 2.24 (1.02–4.89)0.043
sPD1(<167 Vs >167 pg/ml) 0.44 (0.20–0.98)0.046 0.43 (0.19–0.95)0.038

*Age, hemoglobin, and sLAG3 were dichotomized for regression analysis based on ROC cutoff values with the response as an event

Univariable and multivariable regression analysis of response and PFS to Anti-CTLA4 plus anti-PD1 combination treatment *Age, hemoglobin, and sLAG3 were dichotomized for regression analysis based on ROC cutoff values with the response as an event sPD1 indicates resistance to anti-CTLA4 plus anti-PD1 combination treatment However, following the treatment with anti-PD1 or combination treatment, a dramatic increase of sPD1 concentrations in the blood was observed (p < .0001), compared to patients treated with anti-CTLA4 alone (p = .001) (Figure 2d). Correlation with circulating immune cells and T cell subsets revealed that pre-treatment concentrations of sPD1 negatively correlated with the absolute lymphocyte count (p = .017; r = −0.2; Figure 2e) and the PD1 expression on CD4+ and CD8 + T cells (Supplemental Figure S3), and positively correlated with the expression of the alternative immune checkpoints LAG3 and TIM3 on CD4+ and CD8 + T cells and proliferating Tregs (p < .05; Supplemental Figure S3). In this study, we did not find any strong associations between sPDL1 and sTIM3 concentrations and the clinical outcome of ICI treated patients. However, there were significant treatment-specific dynamics of these markers and correlations with other variables in the peripheral blood such as a significant increase in sPDL1 upon combination treatment and a positive correlation between sPDL1 and sTIM3 (supplemental text)

Peripheral T cell subsets indicate response and display differential dynamics upon anti-PD1 and anti-CTLA4 plus anti-PD1 combination treatment

Circulating T cells are targets for ICIs. Therefore, we monitored in a subset of patients from cohort 1 with available samples, the T cell phenotypes in patient blood samples and correlated them with the response to anti-PD1 (pembrolizumab (n = 23) and anti-CTLA4 plus anti-PD1 combination treatment (ipilimumab plus nivolumab (n = 25). The frequencies of CD3 + T lymphocytes from flow cytometry analysis positively correlated with the absolute lymphocyte count analyzed in the clinical routine blood film (p = .001; r = 0.5) (Supplemental Figure S4). A trend of a higher frequency of CD3CD4 + T cells was observed in responders to anti-PD1 (p = .053) and combination therapy (p = .183) pre-treatment compared to nonresponders (Supplemental Figure S5). Interestingly, this was not true for CD8 + T cells where nonresponders had intendancy more peripheral CD8+ circulating T cells than responders before treatment (anti-PD1: p = .138; anti-CTLA4+ anti-PD1: p = .13) (Supplemental Figure S6). However, PD1 expression on CD3CD8 + T cells (p = .028) or proliferating CD3CD8+ Ki67 + T cells (p = .033) pre-treatment was significantly and positively associated with response to anti-PD1 monotherapy (Figure 3a, b). Patients with greater than 9% frequency (ROC cutoff; Supplemental Figure S7A) of CD3CD8+ PD1 + T cells or CD3CD8+ Ki67+ PD1 + T cells in the blood were more likely to experience longer PFS (p = .001 or p = .005; Figure 3c). Similarly, even though no statistical significance was found, the same trend could be seen in patients responding to the combination treatment (p = .250 or p = .169; Supplemental Figure S6). Furthermore, upon both anti-PD1 mono and combination therapy, we found a significant decrease in PD1 expression on all T cell compartments (Supplemental Figure S8,9). However, these data have to be interpreted with care as the therapeutic anti-PD1 administration may hamper the detection of PD1 expression by the EH12.1 commercial antibody used in our study. Compared to PD1 (median: 9%), the expression of TIM3 (median: 1.8%) and LAG3 (median 0.18%) on circulating CD3 + T cells is limited to very few cell populations. Nevertheless, with such low frequencies, we found significantly increased numbers of CD3CD4LAG3 + T cells (p = .027) in nonresponding patients treated with combination treatment (Figure 3d) but not in patients treated with anti-PD1 monotherapy (supplemental Figure S5). Moreover, the numbers of CD3CD4TIM3 + T cells (p = .097) and CD3CD8TIM3 + T cells (p = .010) increased in patients’ blood upon combination treatment, but the same was not found in patients treated with anti-PD1 monotherapy (Supplemental Figure S8,9).
Figure 3.

Different T cell subsets in the blood associated with anti-PD1 and anti-CTLA4 plus anti-PD1 combination treatment response

Different T cell subsets in the blood associated with anti-PD1 and anti-CTLA4 plus anti-PD1 combination treatment response Furthermore, we observed a significant increase in Ki67 expression on CD3CD8 + T cells (p < .0001) upon anti-CTLA4 plus anti-PD1 combination treatment but not on anti-PD1 treatment alone (p = .170). Of note, apart from one patient, the Ki67 marker was increased on CD3CD8 + T cells of all the patients who received combination treatment (Figure 4a, b). The same was observed in CD3CD4 + T cells upon combination treatment (p = .019) but not upon anti-PD1 treatment (p = .616). Similarly, we found an increase in the absolute eosinophils in blood upon combination treatment (p = .001) but not upon anti-PD1 treatment (p = .559) (Figure 4c). Notably, we did not find any increase in absolute lymphocytes from the clinical blood variables upon combination treatment (Figure 4d).
Figure 4.

Systemic immune activation upon combination treatment unlike anti-PD1 treatment

Systemic immune activation upon combination treatment unlike anti-PD1 treatment

Tumor infiltration of TIM3+ and LAG3 + T cells correlated with a shorter PFS but did not Indicate response to ICI treatment

To determine if the presence of alternative immune checkpoints, i.e. that is, TIM3 and LAG3 in the tumor microenvironment indicates resistance to ICI treatment, we then quantified the immunohistochemical expression of TIM3 and LAG3 on T Lymphocytes in pre-treatment tumor sections using a predefined algorithm in a partially overlapping cohort. The patient characteristics of this cohort are given in Supplemental Table 1. We found that neither TIM3 nor LAG3 expression in the TME was associated with clinical response to any ICI treatment in the study. However, patients with increased infiltration of TIM3 + T cells (median >152 cells/mm2) and LAG3 + T cells (median >624 cells/mm2) in the TME experienced shorter PFS upon anti-PD1 therapy (p = .019 and p = .070) suggesting that their increased infiltration might contribute to treatment resistance (Figure 5a, b). In contrast, patients with increased TIM3 + T cell infiltration in the TME (median >62 cells/mm2) experienced longer PFS under Ipilimumab (p = .035; Figure 5b) and a similar trend was observed in terms of response to combination treatment (p = .149; Figure 5b).
Figure 5.

LAG3 and TIM3 expression in TME correlates with PFS under anti-PD1 treatment

LAG3 and TIM3 expression in TME correlates with PFS under anti-PD1 treatment

Discussion

We evaluated the association between soluble immune checkpoints and peripheral T cell subsets with the response to anti-PD1 or anti-CTLA4 plus anti-PD1 ICI treatments in patients with metastasized melanoma. We show that different biomarkers are associated with the response to the different ICI treatments. Increased serum concentrations of sLAG3, reduced absolute monocytes, and low frequencies of PD1 expressing CD8 + T cell subsets pre-treatment identify nonresponders to anti-PD1 treatment, whereas increased serum concentrations of sPD1, low hemoglobin levels, and high frequencies of LAG3 expressing CD4 + T cells pre-treatment identify nonresponders to anti-CTLA4 plus anti-PD1 combination treatment. Furthermore, the on-treatment analysis of blood samples revealed a common increase of serum soluble immune checkpoints but different T cell activation dynamics upon treatment with anti-PD1 or anti-CTLA4 plus anti-PD1 treatment, e.g. for example, ipilimumab plus nivolumab treatment induced significant proliferation of effector T cells (CD3CD8+ Ki67+). The role of soluble immune checkpoints is an active area of research. The major sources of sLAG3 in the blood are dendritic cells and B cells.[22] In vitro, sLAG3 enhances the expansion of melanoma-specific CD8 + T lymphocytes[23] and, in contrast, is known to impair monocyte differentiation resulting in reduced immunostimulatory capacities.[24] In MHC II expressing melanoma cells, the addition of sLAG3 protects tumor cells from FAS mediated and drug-induced apoptosis.[25] In line with this observation, we found increased sLAG3 concentrations in nonresponding patients to anti-PD1 therapy. However, we observed a positive association of sLAG3 with the number of regulatory T cells (CD3CD4CD25CD127-) in the peripheral blood. The mechanism through which sLAG3 is involved in resistance to anti-PD1 therapy particularly remains unclear. It might influence the interaction between MHC class II expressing dendritic cells and T cell activation. Unlike sLAG3, the increased presence of sPD1 in the blood may directly limit the efficacy of the therapeutic anti-PD1 antibody by competing with its binding to membrane-bound PD1 on immune cells. However, in our study, increased sPD1 concentrations in melanoma patients indicated resistance to ipilimumab plus nivolumab combination treatment but not anti-PD1 monotherapy. The structural difference between the two anti-PD1 therapeutic antibodies, Pembrolizumab and Nivolumab was previously studied and, the two antibodies may have different binding capacities for circulating sPD1[26] which might contribute to the resistance for combination treatment with ipilimumab plus nivolumab but not for anti-PD1 therapy as apart from one patient all patients received pembrolizumab in our study. In a recent report elevated sPD1 and sPDL1 were found to be associated with a poor clinical outcome in patients treated with anti-PD1 ± anti-CTLA4 therapy.[21] In this study, it is not clear if this result might be mainly influenced by the combination treatment and even though more patients received anti-PD1 monotherapy majority of them received nivolumab. In another recent study, no predictive value of sPD1 serum concentrations for the response to the PD1 monotherapy with pembrolizumab was detected[27] – matching our results here. Furthermore, on-treatment samples revealed that the sPD1 concentrations drastically increase upon anti-PD1 and combination therapy compared to anti-CTLA4 monotherapy. A similar finding of increased sPD1 concentrations upon anti-PD1 treatment was reported recently while profiling plasma proteomics in cutaneous melanoma patients.[28] Although the sources of sPD1 in the blood are still unknown, we found a significant negative correlation between the serum concentrations of sPD1 and PD1 expression on T cell subsets. Interestingly, we also noticed a positive correlation between sPD1 and the frequencies of LAG3 and TIM3 positive T cells analyzed at the same time points. In vitro, the coculturing of dendritic cells with T cells and sPD1 resulted in inhibition of T cell proliferation.[29] Increased sPD1 levels in plasma are associated with poor immune infiltration in the TME in Braf wild-type melanoma patients treated with anti-PD1 therapy.[30] Together, these reports suggest that sPD1 might have a direct role in hampering anti-tumor immunity. Further studies need to explore the therapeutic resistance mechanisms of sPD1. Previously, sPDL1 was shown to be associated with response to ipilimumab in melanoma patients, and in 35 patients who received anti-PD1 treatment, two out of four patients with high sPDL1 at pre-treatment had experienced progressive disease.[17] However, in our study, we did not observe any significant association between pre-treatment concentrations sPDL1 and response to anti-PD1 or combination treatment. Meanwhile, the limited sample size of the ipilimumab cohort in our study and the variation in sPDL1 concentration cutoffs may result in such differences and make it hard to conclude. Anti-PD1 therapy directly targets PD1 expressing T cells. Increased frequencies of CD8+ PD1hi CTLA4hi infiltrating T cells in the tumor microenvironment of melanoma patients are linked to better response to anti-PD1 treatment.[31] CD8+ PD1 + T cells are known to be tumor-related T cell clones and found in the peripheral blood of melanoma patients.[11-13] Accordingly, melanoma patients with low frequencies of CD8+ PD1+ Ki67 + T cells indicate poor survival, and the clinical outcome of anti-PD1 treatment in melanoma patients was shown to be dependent on the ratio of the fold change of CD8+ PD1+ Ki67 + T cells to tumor burden.[13] Recently, it was shown that melanoma patients who were responding to anti-PD1 treatment revealed a significant reduction of PD1+ Tregs after one cycle of treatment.[32] In contrast, in a recent study, mass spectrometry phenotyping of PD1 expression on T cells analyzed at different time points under therapy showed no difference with the response to anti-PD1 treatment in melanoma patients.[33] Our flow cytometric results demonstrate that the low frequencies of PD1 expressing CD8 + T cell subsets in the pre-treatment blood samples may be useful to identify patients resistant to anti-PD1 treatment. Although the same trend for PD1 expressing CD8 + T cells was observed in nonresponding patients to combination treatment, the difference was not as prominent as in the anti-PD1 cohort, which might be partly due to the dual action of anti-CTLA4 along with anti-PD1. Moreover, unlike previous report, we did not observe a relation between on-treatment frequencies of PD1+ Tregs and ICI response. However, our on-treatment samples analyzed were collected upon 6 weeks on ICI treatment instead of after the first cycle of treatment like in the previous report.[32] The different technological methods, time points and patient cohorts in these studies may account for such differences. However, further studies with larger patient numbers are warranted. The expression of alternative immune checkpoints such as LAG3 and TIM3 is limited to a small T cell population in the peripheral blood. In our study, we observed that patients resistant to the combination treatment had increased frequencies of CD3CD4LAG3 + T cells in the peripheral blood. However, the low frequencies of LAG3 + T cells in blood might be challenging to use peripheral LAG3 + T cells as a biomarker in the clinical setting. Moreover, the increased infiltration of LAG3+ and TIM3 + T cells in the TME indicated a shorter PFS upon anti-PD1 treatment in our study. In contrast, in a recent publication, increased LAG3 mRNA expression in melanoma was associated with better overall survival and progression-free survival under ICI treatment.[34] However, in the latter study, the LAG3 mRNA might originate from tumor cells. Under PD1 treatment an increase in LAG3 mRNA level was detected. However, it is not known yet if that is a general phenomenon under therapy or correlated with response or resistance.[10] Targeting next generation immune checkpoints such as LAG3 has demonstrated the ability to enhance the efficacy of PD-1 blockade in many models, including a phase 1/2 clinical trial in solid tumors (ESMO 2017).[35] Our study results suggest that high circulating sLAG3 in patients might impair effectiveness to anti-PD1 Abs, theoretically these patients might therefore benefit from the combination with a LAG3 inhibitor. Accordingly, nonresponding patients to ipilimumab plus nivolumab combination treatment also had a detectable amount of LAG3 on circulating T cells, which further supports the use of combinational treatment with LAG3 inhibitors for maximum clinical benefit in these patients. However, the impact of neutralizing sLAG3 with LAG3 inhibitors should be further investigated to understand the functional role of sLAG3 in anti-PD1 resistant patients. Treatment with anti-CTLA4 was previously shown to expand Ki67+ CD4+ and CD8 + T cells in the peripheral blood after 3–6 months of treatment in melanoma patients.[36,37] In a recent study, increased proliferation of CD8 + T cells upon anti-PD1 treatment was limited to PD1 expressing T cells, whereas anti-CTLA4 plus anti-PD1 combination treatment induced proliferation of CD8 + T cells irrespective of PD1 expression.[6] In line with these reports, our analysis demonstrates that anti-CTLA4 plus anti-PD1 combination treatment results in increased frequencies of proliferating CD4+ Ki67+ and CD8+ Ki67 + T cells, unlike anti-PD1 monotherapy. A similar phenomenon was observed with absolute eosinophils in the blood as we found an increased number of eosinophils upon treatment with combination treatment and upon anti-CTLA4 treatment but not anti-PD1 monotherapy. Together, these data demonstrate that combination treatment results in a profound T cell proliferation compared to monotherapy with anti-PD1.

Limitations

Although the data provide a unique insight into peripheral blood biomarkers and their differential dynamics associated with different ICI treatment regimens, there are several potential limitations associated with this study. First, the retrospective design of the study and the heterogeneity of patients poses a challenge that can only be partially compensated by multivariate analyses including prognostic factors such as LDH as a known marker for tumor load. Second, there was a lack of a sufficient sample size to be able to split the cohorts into discovery and validation cohorts. Hence, these findings need to be verified in a preferably treatment-naive patient cohort to confirm the predictive nature of these markers with ICI treatment outcomes. And finally, further analyses are needed to explore the functional connections between soluble immune checkpoints and the expression of them on T cells, other immune cells, and even tumor cells.

Conclusion

Monitoring soluble immune checkpoints and T cell subsets in melanoma patients’ blood before the treatment might be useful to predict response to anti-PD1 or anti-CTLA4 plus anti-PD1 combination treatment in advance. Hence, further studies including a large number of patients are warranted to validate these biomarkers for clinical use. Besides, anti-CTLA4 plus anti-PD1 treatment display partially different dynamics of serum and immune cell markers in blood compared to anti-PD1 treatment alone. Click here for additional data file.
  35 in total

1.  Contribution of the PD-1 ligands/PD-1 signaling pathway to dendritic cell-mediated CD4+ T cell activation.

Authors:  Harmjan Kuipers; Femke Muskens; Monique Willart; Daniëlle Hijdra; Friso B J van Assema; Anthony J Coyle; Henk C Hoogsteden; Bart N Lambrecht
Journal:  Eur J Immunol       Date:  2006-09       Impact factor: 5.532

2.  Serum PD-1 Is Elevated after Pembrolizumab Treatment but Has No Predictive Value.

Authors:  Milena Music; Marco A J Iafolla; Annie He Ren; Antoninus Soosaipillai; Ioannis Prassas; Eleftherios P Diamandis
Journal:  Mol Cancer Ther       Date:  2019-07-30       Impact factor: 6.261

3.  Prospective identification of neoantigen-specific lymphocytes in the peripheral blood of melanoma patients.

Authors:  Alena Gros; Maria R Parkhurst; Eric Tran; Anna Pasetto; Paul F Robbins; Sadia Ilyas; Todd D Prickett; Jared J Gartner; Jessica S Crystal; Ilana M Roberts; Kasia Trebska-McGowan; John R Wunderlich; James C Yang; Steven A Rosenberg
Journal:  Nat Med       Date:  2016-02-22       Impact factor: 53.440

4.  Metalloproteases regulate T-cell proliferation and effector function via LAG-3.

Authors:  Nianyu Li; Yao Wang; Karen Forbes; Kate M Vignali; Bret S Heale; Paul Saftig; Dieter Hartmann; Roy A Black; John J Rossi; Carl P Blobel; Peter J Dempsey; Creg J Workman; Dario A A Vignali
Journal:  EMBO J       Date:  2007-01-24       Impact factor: 11.598

5.  Biochemical analysis of the regulatory T cell protein lymphocyte activation gene-3 (LAG-3; CD223).

Authors:  Nianyu Li; Creg J Workman; Stefani M Martin; Dario A A Vignali
Journal:  J Immunol       Date:  2004-12-01       Impact factor: 5.422

6.  Soluble T cell immunoglobulin mucin domain 3 is shed from CD8+ T cells by the sheddase ADAM10, is increased in plasma during untreated HIV infection, and correlates with HIV disease progression.

Authors:  Kiera L Clayton; Matthew B Douglas-Vail; A K M Nur-ur Rahman; Karyn E Medcalf; Irene Y Xie; Glen M Chew; Ravi Tandon; Marion C Lanteri; Philip J Norris; Steven G Deeks; Lishomwa C Ndhlovu; Mario A Ostrowski
Journal:  J Virol       Date:  2015-01-21       Impact factor: 5.103

7.  Molecular, clinicopathological, and immune correlates of LAG3 promoter DNA methylation in melanoma.

Authors:  Anne Fröhlich; Judith Sirokay; Simon Fietz; Timo J Vogt; Jörn Dietrich; Romina Zarbl; Mike Florin; Pia Kuster; Gonzalo Saavedra; Susana Ramírez Valladolid; Friederike Hoffmann; Lukas Flatz; Sandra S Ring; Carsten Golletz; Torsten Pietsch; Sebastian Strieth; Peter Brossart; Gerrit H Gielen; Glen Kristiansen; Friedrich Bootz; Jennifer Landsberg; Dimo Dietrich
Journal:  EBioMedicine       Date:  2020-08-30       Impact factor: 8.143

8.  LAG-3 regulates plasmacytoid dendritic cell homeostasis.

Authors:  Creg J Workman; Yao Wang; Karim C El Kasmi; Drew M Pardoll; Peter J Murray; Charles G Drake; Dario A A Vignali
Journal:  J Immunol       Date:  2009-02-15       Impact factor: 5.422

9.  Biomarkers on melanoma patient T cells associated with ipilimumab treatment.

Authors:  Wenshi Wang; Daohai Yu; Amod A Sarnaik; Bin Yu; Maclean Hall; Dawn Morelli; Yonghong Zhang; Xiuhua Zhao; Jeffrey S Weber
Journal:  J Transl Med       Date:  2012-07-12       Impact factor: 5.531

10.  Can the plasma PD-1 levels predict the presence and efficiency of tumor-infiltrating lymphocytes in patients with metastatic melanoma?

Authors:  Lorena Incorvaia; Giuseppe Badalamenti; Gaetana Rinaldi; Juan Lucio Iovanna; Daniel Olive; Mirna Swayden; Lidia Terruso; Bruno Vincenzi; Fabio Fulfaro; Viviana Bazan; Antonio Russo; Daniele Fanale
Journal:  Ther Adv Med Oncol       Date:  2019-05-13       Impact factor: 8.168

View more
  10 in total

Review 1.  Emerging micro-nanotechnologies for extracellular vesicles in immuno-oncology: from target specific isolations to immunomodulation.

Authors:  Nna-Emeka Onukwugha; Yoon-Tae Kang; Sunitha Nagrath
Journal:  Lab Chip       Date:  2022-09-13       Impact factor: 7.517

Review 2.  Mechanisms of Immunotherapy Resistance in Cutaneous Melanoma: Recognizing a Shapeshifter.

Authors:  Jessica Thornton; Gagan Chhabra; Chandra K Singh; Glorimar Guzmán-Pérez; Carl A Shirley; Nihal Ahmad
Journal:  Front Oncol       Date:  2022-04-19       Impact factor: 5.738

3.  Concurrent Chemoradiotherapy Increases the Levels of Soluble Immune Checkpoint Proteins in Patients with Locally Advanced Cervical Cancer.

Authors:  Chao Liu; Xiaohui Li; Aijie Li; Wenxue Zou; Rui Huang; Xiaoyu Hu; Jinming Yu; Xiaoling Zhang; Jinbo Yue
Journal:  J Immunol Res       Date:  2022-04-04       Impact factor: 4.818

4.  Circulating immune profile can predict survival of metastatic uveal melanoma patients: results of an exploratory study.

Authors:  Ernesto Rossi; Ilaria Grazia Zizzari; Alessandra Di Filippo; Anna Acampora; Monica Maria Pagliara; Maria Grazia Sammarco; Maurizio Simmaco; Luana Lionetto; Andrea Botticelli; Emilio Bria; Paolo Marchetti; Maria Antonietta Blasi; Giampaolo Tortora; Giovanni Schinzari; Marianna Nuti
Journal:  Hum Vaccin Immunother       Date:  2022-03-08       Impact factor: 4.526

5.  Predicting response to immunotherapy in gastric cancer via multi-dimensional analyses of the tumour immune microenvironment.

Authors:  Yang Chen; Keren Jia; Yu Sun; Cheng Zhang; Yilin Li; Li Zhang; Zifan Chen; Jiangdong Zhang; Yajie Hu; Jiajia Yuan; Xingwang Zhao; Yanyan Li; Jifang Gong; Bin Dong; Xiaotian Zhang; Jian Li; Lin Shen
Journal:  Nat Commun       Date:  2022-08-18       Impact factor: 17.694

6.  Increased Soluble PD-1 Predicts Response to Nivolumab plus Ipilimumab in Melanoma.

Authors:  Jesper Geert Pedersen; Mateo Sokac; Boe Sandahl Sørensen; Adam Andrzej Luczak; Ninna Aggerholm-Pedersen; Nicolai Juul Birkbak; Trine Heide Øllegaard; Martin Roelsgaard Jakobsen
Journal:  Cancers (Basel)       Date:  2022-07-09       Impact factor: 6.575

7.  Human Immunocompetent Model of Neuroendocrine Liver Metastases Recapitulates Patient-Specific Tumour Microenvironment.

Authors:  Ewald Jan Doornebal; Nicola Harris; Antonio Riva; Ravi Jagatia; Michail Pizanias; Andreas Prachalias; Krishna Menon; Melissa Preziosi; Ane Zamalloa; Rosa Miquel; Yoh Zen; Michael Robert Orford; Simon Eaton; Nigel Heaton; John Ramage; Elena Palma; Rajaventhan Srirajaskanthan; Shilpa Chokshi
Journal:  Front Endocrinol (Lausanne)       Date:  2022-07-13       Impact factor: 6.055

Review 8.  LAG-3 as a Potent Target for Novel Anticancer Therapies of a Wide Range of Tumors.

Authors:  Natalia Sauer; Wojciech Szlasa; Laura Jonderko; Małgorzata Oślizło; Dominika Kunachowicz; Julita Kulbacka; Katarzyna Karłowicz-Bodalska
Journal:  Int J Mol Sci       Date:  2022-09-01       Impact factor: 6.208

9.  Circulating extracellular vesicles expressing PD1 and PD-L1 predict response and mediate resistance to checkpoint inhibitors immunotherapy in metastatic melanoma.

Authors:  Simona Serratì; Michele Guida; Letizia Porcelli; Amalia Azzariti; Roberta Di Fonte; Simona De Summa; Sabino Strippoli; Rosa Maria Iacobazzi; Alessandra Quarta; Ivana De Risi; Gabriella Guida; Angelo Paradiso
Journal:  Mol Cancer       Date:  2022-01-18       Impact factor: 27.401

Review 10.  Immune Cell-Derived Extracellular Vesicles - New Strategies in Cancer Immunotherapy.

Authors:  Pengxiang Yang; Yong Peng; Yuan Feng; Zhuoying Xu; Panfeng Feng; Jie Cao; Ying Chen; Xiang Chen; Xingjian Cao; Yumin Yang; Jing Jie
Journal:  Front Immunol       Date:  2021-12-08       Impact factor: 7.561

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.