Literature DB >> 23481183

Using macrophage activation to augment immunotherapy of established tumours.

Z G Fridlender1, A Jassar, I Mishalian, L-Cs Wang, V Kapoor, G Cheng, J Sun, S Singhal, L Levy, S M Albelda.   

Abstract

BACKGROUND: Successful immunotherapy will require alteration of the tumour microenvironment and/or decreased immune suppression. Tumour-associated macrophages (TAMs) are one major factor affecting tumour microenvironment. We hypothesised that altering TAM phenotype would augment the efficacy of immunotherapy.
METHODS: We and others have reported that 5,6-Dimethylxanthenone-4-acetic-acid (DMXAA, Vadimezan) has the ability to change TAM phenotypes, inducing a tumour microenvironment conducive to antitumour immune responses. We therefore combined DMXAA with active immunotherapies, and evaluated anti-tumour efficacy, immune cell phenotypes (flow cytometry), and tumour microenvironment (RT-PCR).
RESULTS: In several different murine models of immunotherapy for lung cancer, DMXAA-induced macrophage activation significantly augmented the therapeutic effects of immunotherapy. By increasing influx of neutrophils and anti-tumour (M1) macrophages to the tumour, DMXAA altered myeloid cell phenotypes, thus changing the intratumoural M2/non-M2 TAM immunoinhibitory ratio. It also altered the tumour microenvironment to be more pro-inflammatory. Modulating macrophages during immunotherapy resulted in increased numbers, activity, and antigen-specificity of intratumoural CD8(+) T cells. Macrophage depletion reduced the effect of combining immunotherapy with macrophage activation, supporting the importance of TAMs in the combined effect.
CONCLUSION: Modulating intratumoural macrophages dramatically augmented the effect of immunotherapy. Our observations suggest that addition of agents that activate TAMs to immunotherapy should be considered in future trials.

Entities:  

Mesh:

Substances:

Year:  2013        PMID: 23481183      PMCID: PMC3619255          DOI: 10.1038/bjc.2013.93

Source DB:  PubMed          Journal:  Br J Cancer        ISSN: 0007-0920            Impact factor:   7.640


Current immunotherapies are primarily aimed at initiating or boosting T-cell responses to tumours and their antigens. Recent success has been seen in clinical trials with vaccines (Kantoff ), adoptive T-cell transfer (Porter ), and T cell-activating antibodies (Hodi ). However, it is now also being increasingly realized that an immunosuppressive environment exists within tumours, induced by both cancer and immune cells, that inhibits the effect of cytotoxic T lymphocytes (Finn, 2008). As the effectiveness of immunotherapy may be limited by systemic and local tumour-induced immunosuppression, it is becoming more widely accepted that successful treatments will require a second agent to alter the tumour microenvironment and/or decrease immune suppression (Pardoll and Drake, 2012). One of the major immune cells affecting the tumour microenvironment are tumour-associated macrophages (TAMs) (Mantovani ). In early tumours, TAMs appear to have an inflammatory, tumouricidal (M1 or ‘classically activated') phenotype. These TAMs are phagocytic, present antigens well, produce Th1-type cytokines, and are cytotoxic (Biswas ). They may also indirectly promote cytotoxicity by activating other cells of the immune system, such as NK cells and T cells (Gabrilovich ). However, as the tumour becomes established, macrophages polarise towards an ‘alternatively activated' or M2-like phenotype, differing from M1 TAMs in receptor expression, antigen-presenting ability, function (e.g., arginine metabolism) ,and cytokine production. These M2-like TAMs are accepted to have pro-tumour, angiogenic, and immunoinhibitory effects (Sica ; Gabrilovich ). The TAM phenotype is thus an important factor in tumour immunology (Biswas ) and could have a role in the success or failure of immunotherapy. The idea of targeting TAM as an antitumour approach was proposed many decades ago using extracts from bacterial walls (Killion and Fidler, 1994). Some successes were achieved in animal models, but the clinical trials were disappointing. Since then, a variety of anti-TAM therapies have been proposed and tested in preclinical models, including TAM depletion, differentiation, reprogramming, and activation (Sica ). These approaches seem to have some efficacy, but rarely induce cures. Our group has conducted studies of TAM activation using a compound called 5,6-Dimethylxanthenone-4-acetic acid (DMXAA, Vadimezan), which is a small flavanoid-like compound that was originally developed as a vascular-disrupting agent (Zwi ). Although endothelial cells may be directly affected, we and others found that DMXAA has powerful effects on the tumour microenvironment in mouse tumour models (Ching ; Jassar ; Roberts ; Wallace ). We have shown that DMXAA administered as monotherapy was able to induce inflammatory cytokine and chemokine secretion from TAMs that then stimulated antitumour CD8 responses and led to partial antitumour responses (Jassar ). Given the importance of TAMs in creating an inhibitory tumour microenvironment and our observation that DMXAA could change TAMs in mice towards a less immunosuppressive phenotype, we used this compound to test the hypothesis that combining macrophage activation with immunotherapy would augment efficacy. We thus evaluated the effect of DMXAA alone and in combination with immunotherapy in several murine cancer models. Our results showed that combination therapy resulted in increased antitumour effects. This appeared to be because of changes in the tumour microenvironment that resulted in increased CD8 T-cell migration and activation. This study supports the use of macrophage activation in combination with immunotherapy.

Materials and methods

Animals

Female C57BL/6 and BALB/C mice (6–8 weeks old, 20–25 g) were purchased from Charles River Laboratories (Wilmington, MA, USA). Protocols were approved by the Animal Use Committees of the University of Pennsylvania and of the Hebrew University in compliance with the Guide for the Care and Use of Laboratory Animals.

Cell lines

The TC1 cells were derived from mouse lung epithelial cells of a C57B6 mouse, immortalised with HPV-16 E6 and E7, and transformed with the c-Ha-ras oncogene (Lin ). The murine bronchoalveolar carcinoma cell line L1C2 and the LLC (Lewis lung cell carcinoma) cells were obtained from the American Type Culture Collection (Rockville, MD, USA). Cell lines were regularly tested and maintained negative for mycoplasma spp.

5,6-Dimethylxanthenone-4 acetic-acid

5,6-Dimethylxanthenone-4 acetic-acid (Vadimezan) was purchased from Sigma (St Louis, MO, USA). It was dissolved in sterile, distilled, and deionized water, and administered once by intraperitoneal (i.p.) injections at a dose of 18 mg kg−1 in 200 μl water.

Immunotherapy models

We used several different immunotherapy models: An E1/E3-deleted type 5 adenovirus expressing the HPV-E7 protein under control of a cytomegalovirus promoter as previously described (Ad.E7) (Haas ). Animals bearing TC1 tumours were vaccinated subcutaneously (s.q.), contralateral to the tumour with 1 × 109 plaque-forming units (PFUs) of Ad.E7 vector. At 7 days after the initial vaccination, mice received a booster vaccine of 1 × 109 PFUs of Ad.E7. A modified, live attenuated Listeria monocytogenes vector expressing the HPV-E7 protein (Lm.E7) was kindly provided by Dr Yvonne Paterson (Peng ). Animals bearing TC1 tumours were vaccinated i.p. with 0.1 LD50 of Lm.E7 (106 colony-forming units (CFUs)) of Lm.E7 vector. At 10 days after the initial vaccination, mice received a booster vaccine at the same dose. Adenovirus expressing murine interferon-β (Ad.IFNβ) was constructed as previously described (Wilderma). Animals bearing LLC or L1C2 tumours were vaccinated subcutaneously (s.q.), contra-lateral to the tumour with 1 × 109 PFUs of Ad.IFNβ vector. With the TC1 cell line we also used a construct of adenovirus expressing murine interferon-γ (Ad.IFNγ).

Animal flank tumour models

Mice were injected on the right flank with 1 × 106 TC1, LLC, or L1C2 tumour cells in the appropriate mouse strain. The flank tumours were allowed to reach an average size of 200–250 mm3 (∼12–15 days). Mice were treated in one of the four groups: (1) control untreated, (2) DMXAA, (3) immunotherapy alone, or (4) a combination of immunotherapy and DMXAA. In some of the experiments, the control and DMXAA groups (groups 1 and 2) received an adenoviral vector encoding β-galactosidase (Ad.LacZ) (Wilderman ) as control for the adenoviral constructs. All experiments had at least five mice per group and were repeated at least once. When needed for analysis (i.e., for FACS, RNA, cell subset isolation, and so on), flank tumours were harvested from the mice, and digested with 2 mg ml−1 DNase I (Sigma) and 4 mg ml−1 collagenase type IV (Sigma) at 37 °C for 1 h. This was done 3 days following the administration of DMXAA.

Flow cytometric analysis of tumours and spleens

Splenocytes, lymph nodes, and tumour cells were studied by FACS analysis as previously described (Haas ). All fluorescently labelled antibodies used were purchased from BD Biosciences (San Jose, CA, USA) except for: CD206-PE, obtained from Serotec (Oxford, UK); 4-1BB (CD137)-PE, obtained from Abcam (Cambridge, UK); and GR-1-FITC, obtained from eBioscience (San Diego, CA, USA). Flow cytometry was performed using a Becton Dickinson FACS Calibur flow cytometer (San Jose, CA, USA). Data analysis was done using FlowJo software (Ashland, OR, USA). The allophycocyanin-labelled H-2Db tetramer loaded with E7 peptide (RAHYNIVTF) was obtained from the National Institute of Allergy and Infectious Diseases tetramer core (Atlanta, GA, USA).

RNA isolation and real-time, reverse transcription-PCR

Tumours from mice treated with one of the four treatments detailed above were removed 2 days after the Ad.E7 boost vaccine, flash frozen, and the RNA from each tumour isolated. For each treatment condition, a pool of RNA was created by adding the same amount of RNA from each of the tumours within the group. Complementary DNA was made from each pool, RNA levels were normalised to β-actin levels, and quantification of tumour mRNA levels was performed as previously described (Fridlender ). Relative levels of expression of each of the selected genes (fold change versus control) were determined. Each sample was run in quadruplicate and the experiment was repeated at least once. Primer sequences will be given upon request.

Macrophage depletion experiments

For the evaluation of the effect of macrophage depletion, we used Clodronate and control PBS liposomes purchased from Clodronate Liposomes Organisation (http://www.clodronateliposomes.org, Vrije Universiteit, The Netherlands). Liposomes were prepared at the concentration of 1 mg ml−1 as previously described (van Rooijen and van Kesteren-Hendrikx, 2003). Systemic and local macrophage depletion was achieved by injection of Clodronate liposomes concomitantly intraperitoneally (200 μl) and intratumourally (100 μl). The percentage of macrophages in the spleen following use of liposomes was reduced by ∼90%, and in the tumours by 50–60%. The C57Bl/6 mice were injected on the right flank with 1–2 × 106 TC1 tumour cells. The flank tumours were allowed to reach an average size of 200–250 mm3 (∼10 days). Mice were treated in one of the four groups: (1) control untreated, (2) Clodronate liposomes, (3) DMXAA+immunotherapy (Ad.E7)+PBS Liposomes, or (4) DMXAA+Ad.E7+Clodronate Liposomes, and tumour growth was followed. Clodronate liposomes were injected 1 day after the first Ad.E7 vaccination and twice a week thereafter.

Statistical analyses

For the RT–PCR, FACS studies, and flank tumour studies comparing differences between two groups, we used unpaired Student's t-tests. For FACS and flank tumour studies comparing more than two groups, we used ANOVA with appropriate post hoc testing. Differences were considered significant when P<0.05. Data are presented as mean±s.e.m.

Results

DMXXA significantly augments the effect of immunotherapy

We have previously shown that DMXAA induces a two-stage antitumour immune response in murine models of mesothelioma and lung cancer: an early, innate immune phase involving TAM activation, and a second, acquired immune phase involving CD8+ T cells (Jassar ). We have also shown that DMXAA directly activates dendritic cells enhancing antitumour-acquired immunity (Wallace ). Given these activities, we tested the hypothesis that adding DMXAA to different models of lung cancer immunotherapy would enhance efficacy. Figure 1 shows data evaluating the effect of combining DMXAA with two different vaccines directed against the human papilloma virus E7 antigen (HPV-E7) that is expressed in the TC1 murine lung cancer cell line. In both cases, mice with relatively large established tumours were treated with either: (1) saline control, (2) DMXAA alone, (3) two doses of an adenovirus expressing HPV-E7 (Ad.E7) (Figure 1A) or a modified listeria vector expressing HPV-E7 (Lm-E7) (Figure 1B), or (4) a combination of vaccine and DMXAA. The DMXAA was delivered close to the time of the second vaccine dose.
Figure 1

5,6-Dimethylxanthenone-4-acetic-acid (DMXAA) significantly augments tumour immunotherapy. Mice bearing large flank tumours were treated in one of the four ways: (1) no treatment (control), (2) i.p. DMXAA (single dose), (3) immunotherapy, and (4) a combination of immunotherapy and DMXAA (Combo). In all models presented, combination therapies led to clear tumour regression compared with each treatment alone. The following combinations of immunotherapy and DMXAA in murine lung cancer cell lines are shown: (A) the TC1 cell line with adenovirus expressing HPV-E7 (Ad.E7). (B) The TC1 cell line with a modified listeria vector expressing HPV-E7 (Lm-E7). (C) The TC1 cell line with adenovirus expressing interferon-β (Ad.IFNβ). (D) The L1C2 cell line with adenovirus expressing interferon-β (Ad.IFNβ). (E) The LLC cell line with adenovirus expressing interferon-β (Ad.IFNβ). (F) The TC1 cell line with adenovirus expressing interferon-γ (Ad.IFNγ). *P<0.05 in combination therapy versus immunotherapy alone.

In the Ad.E7 studies (Figure 1A), both the vaccine and DMXAA had significant (P<0.05) but relatively modest effects on tumour growth. In contrast, when given in combination, there was clear tumour regression with a number of cures (30–40% of animals in three independent experiments). These cured mice were followed for up to 50 days, with no recurrence. Furthermore, they were re-challenged with a second injection of TC-1 tumour cells that were rejected, with no tumour growth. In the Listeria E7 studies (Figure 1B), DMXAA was not added until the tumours were very large (>1000 mm3). In this case, the vaccine had only a small temporary effect (P=0.07) and there was no effect seen after DMXAA. This is consistent with our previous studies However, despite the presence of very large tumours, the combination therapy was significantly better than any of the individual treatments and actually induced tumour regressions (P<0.05 compared with each of the other groups). We also combined DMXAA with another type of immunogene therapy; intratumoural injection with an adenovirus expressing mouse interferon-β (Ad.IFN-β). This vector, expressing the human form of interferon-β, has been tested in clinical trials (Sterman ). In this model, we again saw the expected effects of Ad.IFNβ alone or DMXAA alone, but found augmented significant effects of the combination treatment in all three NSCLC cell lines tested, TC1, LLC, and L1C2 (Figure 1C–E). The TC1 was also combined with an injection with an adenovirus expressing mouse interferon-γ (Ad.IFN-γ), with similar results (Figure 1F). We have previously shown that using a sham adenoviral virus (Ad.LacZ) instead of active immunotherapy has no effect on tumour growth compared with adenovirus therapies (e.g., Ad.E7) (Wilderman ). We further evaluated the combination of DMXAA with Ad.LacZ in both TC1 and LLC, and found no additional effect compared with DMXAA alone (see also Supplementary Figure 2). The data presented above suggest that macrophage activation at the time when immunotherapy-induced antitumour CD8 T cells are present can augment efficacy. Given the dramatic effects in the TC1 model and our ability to track antigen-specific T cells in this system, we used this model for mechanistic studies. We examined the effects on both the innate and acquired immune responses.

DMXAA treatment alters the myeloid cell phenotypes by increasing the influx of neutrophils and antitumour (M1) macrophages to the tumour, thus changing the intratumoural M2/non-M2 TAM immunoinhibitory ratio

Given previous studies that have shown that DMXAA induced the intratumoural influx of macrophages and neutrophils (Jassar ; Wang ), we next examined the phenotype of tumour-associated myeloid cells, including TAMs, tumour-associated neutrophils (TANs), and dendritic cells (DCs) in tumours treated with immunotherapy, and harvested 3 days after DMXAA. At this time the immediate effects of DMXAA would be resolved, but the tumours in each group were relatively similar in size, allowing the most useful comparisons. As a first way of evaluating this issue, we took tumour extracts from this time point and performed RT–PCR with primers that identified myeloid cells (CD11b), neutrophils (Ly6G), and protein mRNAs associated with M1 macrophages (iNOS) or M2 macrophages (CD206 or the macrophage mannose receptor-2 (MMR2)) and compared untreated tumours, tumours treated with Ad.E7 alone, DMXAA alone, or the combination. As shown in Table 1, at this time point, we saw relatively few changes in the DMXAA-treated tumours. In mice treated only with Ad.E7, the message of CD8 was increased, and that of Ly6G decreased. However, when we compared combination treatment with Ad.E7, we noted significant increases in CD11b, Ly6G, and iNOS, with a significant decrease in the MMR, suggesting a change in the tumour microenvironment.
Table 1

Real-time RT–PCR level in whole tumours

PCRControlDMXAAAdE7AdE7+DMXAAP-value (Ad.E7 versus combination)
TNFα
1
1.6
1.2
3.9
<0.01
CCL5 (RANTES)
1
1.4
3
4.3
0.01
IFNγ
1
2.2
3.5
4.4
0.11
TGFβ
1
0.9
1.9
1.5
0.08
ICAM-1
1
1
1
1.6
0.04
CXCL-10 (IP-10)
1
1
2.8
2.8
NS
CCL2 (MCP-1)
1
1
2.4
2.8
NS
VEGF
1
1
0.9
1
NS
MMR
1
0.8
0.7
0.4
<0.01
iNOS
1
1
0.6
1.6
<0.01
CD8
1
1.8
4.7
12.9
<0.01
CD11b
1
0.9
1.2
3.1
<0.01
Ly6G10.60.41.8<0.01

Abbreviations: CCL2=chemokine (C-C motif) ligand 2; CCL5=chemokine (C-C motif) ligand 5; CXCL-10=chemokine (C-X-C motif) ligand 10; DMXAA=5,6-Dimethylxanthenone-4-acetic-acid; ICAM-1=intercellular adhesion molecule 1; iNOS=inducible nitric oxide synthase; IFNγ=interferon-γ; IP-10=interferon-γ-induced protein 10; MCP-1=monocyte chemotactic protein-1; MMR=macrophage mannose receptor; NS=not significant; RANTES=regulated and normal T cell expressed and secreted; RT–PCR=reverse transcription-PCR; TGFβ=transforming growth factor-β; TNFα=tumor necrosis factor-α; VEGF=vascular endothelial growth factor.

Mice (n=4–5 for each group) bearing large (average size of 200–250 mm3) TC1 tumours were treated in one of the four ways: (1) control, no treatment (Control); (2) intraperitoneal (i.p.) DMXAA; (3) subcutaneous (s.q.) vaccine with Ad.E7, and a booster vaccine after a week (Ad.E7); and (4) a combination of Ad.E7 and DMXAA given 1 day before the second Ad.E7 injection (Combo). At 2 days after the second (booster) Ad.E7 vaccine, tumours were harvested, digested, and RNA was extracted. Equal amounts of RNA from each tumour in each group were pooled, complementary DNA (cDNA) generated, and subjected to real-time RT–PCR analysis. RNA was normalised using glyceraldehyde 3-phosphate dehydrogenase (GAPDH) levels. Each assay was run in at least quadruplicate. Fold change with each treatment compared with control is shown. Major changes between immunotherapy alone and the combination with DMXAA are in bold.

To more precisely evaluate specific cell types, tumours were digested and subjected to FACS. Figure 2A shows that DMXAA, Ad.E7, and combo therapy all mildly but significantly (P<0.05) increased macrophages (defined as CD11b+/CD11c−/Ly6G−) and DCs (defined as CD11b+/CD11c+/Ly6G−) to a similar same extent compared with control tumours, with cell percentages increasing by ∼30–70%. In contrast, the increase in neutrophils (CD11b+/CD11c−/Ly6G+) was much more impressive in the combination group (P<0.05) compared with control or either treatment alone.
Figure 2

5,6-Dimethylxanthenone-4-acetic-acid (DMXAA) alters the myeloid cell phenotypes induced by immunotherapy. Mice (n=4–6 for each group) bearing large TC-1 or LLC tumours were treated in one of the four ways: (1) no treatment (Control), (2) i.p. DMXAA, (3) s.q. vaccine with Ad.E7 in the TC1 cell line (Ad.E7) or Ad.IFNβ in the LLC cell line, and (4) combination of Ad.E7/Ad.IFNβ and DMXAA. At 3 days after the injection of DMXAA, tumours were harvested. (A) The percentage of different myeloid cells out of all tumour cells in the TC1 cell line model is summarised. Combo therapy, DMXAA, and Ad.E7 all significantly (P<0.05) increased macrophages (defined as CD11b+/CD11c-/Ly6G−) and DCs (defined as CD11b+/CD11c+/Ly6G−) compared with control tumours to a similar extent. Neutrophils (defined as CD11b+/CD11c−/Ly6G+) were increased in the combination group (*P<0.05) compared with control or either treatment alone. (B) The percentage of classically and alternatively activated macrophages (defined as CD11b+/F480+ and CD206− or CD206+, respectively) is summarised. The DMXAA significantly increased the percentage of the classically activated ‘M1' macrophages by approximately two-fold compared with vaccine alone (&P<0.05 between Combo and either control or Ad.E7) without changing the alternatively activated ‘M2' macrophages. The left panel shows TC1/Ad.E7 model and the right panel shows LLC/Ad.IFNβ model. (C) Representative FACS tracings of F4/80 versus CD206 in macrophages in each group in the TC1/Ad.E7 model are shown. The numbers in each quadrant are the percentages of M1 (F4/80+/CD206−) and M2 (F4/80+/CD206+) macrophages. (D) The calculated ‘immuno-stimulation ratio', that is, the ratio of non-M2 TAMs (antitumour) to M2 TAMs (protumour), is shown. The top panel shows TC1/Ad.E7 model and the bottom panel shows LLC/Ad.IFNβ model. Following combined treatment, this ratio increased markedly (*P<0.05 compared with all other treatments in both models).

We then evaluated for major changes in the phenotypes of TAMs, defined as CD11b+/CD11c−/Ly6G− (Figure 2B–D). There were no significant differences in the percentage of alternatively activated, tumour-promoting, M2 macrophages (defined as CD11b+/F4/80+/CD206+) out of total tumour cells with either treatment alone or by combining DMXAA and the vaccine (Figure 2B). In contrast, in both combination models we evaluated, the TC1 cell line with Ad.E7 (left panel) and LLC cell line with Ad.IFNβ (right panel), DMXAA significantly increased the percentage of the classically activated, tumour-inhibitory ‘M1' macrophages (defined as CD11b+/F4-80+/CD206−) by approximately two-fold compared with vaccine alone (P<0.05). These data were consistent with our RT–PCR data showing increases in mRNA of iNOS and TNFα, known to be M1 TAM markers (Table 1). We further evaluated using flow cytometry several known markers of M1/M2 macrophages (Sica ). We found that adding DMXAA to immunotherapy increased the expression of two known markers of M1 macrophages, CCR-7 and CD127, and reduced the level of intracellular IL-10, a known M2 macrophage marker (Supplementary Figure 1). The percentage of the immature/undifferentiated ‘M0' macrophages (defined as CD11b+/F4-80−/Ly6G−) was also significantly increased in the combination group (Figure 2B). Representative FACS traces of TAMs are shown in Figure 2C, showing the relative proportion of M2 and M1 within the macrophage population. To quantify the impact of these changes in the phenotype of macrophages, we calculated an ‘immunostimulation ratio', that is, the ratio of the non-M2 TAM (antitumour) cells to the M2 TAM (protumour) cells. In control tumours, this ratio is ∼1, suggesting an immunoinhibitory environment. After treatment with either DMXAA or Ad.E7, this ratio increases somewhat in both immunotherapy systems evaluated. However, following combined treatment, this ratio increased markedly in the TC-1Ad.E7 model up to 19 : 1 (Figure 2D, top panel, P<0.05 compared with all other treatments). In the LLC-Ad.IFNβ model, the ratio in the combination treatment was also significantly increased when compared with DMXAA alone (Figure 2D, bottom panel, P<0.05). In summary, combination treatment markedly shifted the tumour-associated myeloid population towards a more antitumour phenotype.

DMXAA changes the tumour microenvironment to be more pro-inflammatory

Given our previous data showing that DMXAA alone altered the tumour microenvironment, we characterised the effect of DMXAA alone and in combination with Ad.E7 on the tumour microenvironment. We aimed to show how these changes in the phenotype of myeloid cells using DMXAA added to the changes in tumour inflammatory milieu previously noted with immunotherapy. We used real-time RT–PCR of tumour extracts harvested 3 days after DMXAA to profile a set of relevant cytokines, chemokines, and cell adhesion molecules (Table 1). As previously reported, DMXAA alone modestly increased the mRNA levels of TNFα, CCL5, and IFNγ. The mRNA expression levels of these cytokines were also elevated by the vaccine alone, along with those of CXCL10, CCL2, TGFβ. However, the expression levels of TNFα, IFNγ, and CCL5, were ∼1.5- to 2-fold higher in the combination group compared with the Ad.E7 alone group (P<0.05 for each except for IFNγ). In addition, ICAM-1 was significantly increased only in the combination therapy group (P=0.04).

DMXAA in mice treated with immunotherapy increases the number, the activation state, and the antigen specificity of intratumoural CD8+ T cells

As we have previously shown that DMXAA induces an influx of CD8+ CTLs into the tumour (Jassar ), we next evaluated the total numbers of CD8+ cells infiltrating the tumours in animals treated with DMXAA with and without immunotherapy. We again studied the tumours 2 or 3 days following the boost vaccination with Ad.E7, a time point at which there was no significant change in tumour size, making comparisons more equitable. At this time point, in the TC1Ad.E7 model, DMXAA as monotherapy increased the number of intratumoural CD8+ cells by approximately five-fold (Figure 3A, P<0.05). The Ad.E7 vaccine induced a significant influx of CD8+ cells into the tumour as well, increasing the percentage of CD8+ cells by three-fold compared with control (Figure 3A, P<0.05). However, the combination of vaccine with DMXXA more than doubled the percentage of intratumoural CD8+ cells compared with vaccine alone, as seen by flow cytometry (Figure 3A and representative FACS traces in Figure 3C, P<0.05). In the LLC-IFNβ model, the number of intratumoural CD8+ cells was not changed with either treatment alone. The combined treatment, however, approximately doubled their number compared with any of the treatments alone (Figure 3B, P<0.05 compared with all groups). These findings were corroborated by similar increases in the expression levels of CD8 mRNA in the treated tumours using real-time RT–PCR (Table 1).
Figure 3

5,6-Dimethylxanthenone-4-acetic-acid (DMXAA) in mice treated with immunotherapy increases the number of intratumoural CD8+ T cells. Mice (n=4–6 for each group) bearing large TC-1 or LLC tumours were treated as in Figure 2. At 3 days after the injection of DMXAA, tumours were harvested. (A and B) The percentage of intratumoural CD8+ cells of total tumour by flow cytometry in the TC1/Ad.E7 model (A) and the LLC/Ad.IFNβ model (B). In both models, DMXAA combined with the vaccine more than doubled the percentage of intratumoural CD8+ cells compared with vaccine alone (*P<0.05). (C) Representative FACS tracings of CD45+ versus CD8+ cells in the TC1/Ad.E7 model are shown. The number in each upper-right quadrant is the percentage of CD8+ cells out of all tumour cells.

To assess the effect of the combination therapy on CD8+ T-cell activation, we measured the expression of the surface activation markers 4-1BB (CD137) (Dawicki and Tania, 2004; Kim ) and CD25 in CD8+ cells. The percentage of activated intratumoural CD8+ T cells, defined as CD8+/4-1BB+ (Figure 4A) or CD8+/CD25+ (Figure 4B), generally followed the same pattern as the percentage of total intratumoural CD8+ cells in both models evaluated. CD8+ cell activation was increased in all treatment groups compared with control. The percentage of activated CD8+ cells was increased in the combination treatment compared with Ad.E7 alone. However, this difference in the TC1Ad.E7 model did not quite reach statistical significance (P=0.06).
Figure 4

5,6-Dimethylxanthenone-4-acetic-acid (DMXAA) in mice treated with immunotherapy increases the activity and specificity of intratumoural CD8+ T cells. Mice (n=4–6 for each group) bearing large TC-1 or LLC tumours were treated as in Figure 2. At 3 days after the injection of DMXAA, tumours were harvested. (A and B) The percentage of activated intratumoural CD8+ T cells defined by expression of the activation markers 41BB (A) and CD25 (B). In the TC1/Ad.E7 model (A, left and B, left), CD8+ cell activation was increased in all treatment groups compared with control (*P<0.05). The percentage of activated CD8+ cells was increased in the combination treatment compared with Ad.E7 alone (&P=0.06). In the LLC/Ad.IFNβ model (A, right and B, right), CD8+ cell activation was increased in the combination group compared with all other treatments (*P<0.05). (C) The percentage of intratumoural E7-specific CD8+ cells (Tet+). Combining DMXAA with Ad.E7 vaccine increased the percentage of tetramer-positive CD8+ cells by four-fold compared with control (**P<0.01) and two-fold compared with vaccine alone (*P<0.05) and DMXAA alone (P=0.057).

Finally, we studied the infiltration of antigen-specific CD8+ T cells. The murine NSCLC line TC1, which expresses the HPV-E7 peptide, enabled us to directly evaluate the reactivity of CD8+ T cells to a specific tumour antigen (HPV-E7) by flow cytometry using tetramers (Haas ). Both immunotherapy and DMXAA alone increased the percentage of intratumoural E7-specific CD8+ cells by approximately two-fold as shown by tetramer staining (Figure 4C); however, this increase was not statistically significant. In contrast, combining DMXAA with Ad.E7 vaccine increased the percentage of tetramer-positive CD8+ cells by four-fold compared with control (P<0.01) and two-fold compared with vaccine alone (P<0.05) and DMXAA alone (P=0.057).

Depletion of macrophages reduces the effect of combining immunotherapy with DMXAA

In order to demonstrate the importance of macrophages in the additive effect of DMXAA and immunotherapy, we used Clodronate liposomes to deplete tumour macrophages, as previously described (van Rooijen and van Kesteren-Hendrikx, 2003). Mice with TC1 tumours were treated with the combination of Ad.E7 and DMXAA, either with or without treatment with Clodronate liposomes and tumour size compared (Figure 5). As can be seen in the two left columns of Figure 5, and consistent with previous work, treatment with Clodronate liposomes alone significantly reduced tumour size compared with control mice treated with unloaded liposomes (P=0.05), demonstrating the known pro-tumour role of untreated TAMs (Mantovani ). When mice were treated with the combination of immunotherapy and DMXAA, tumour size was markedly and significantly reduced, with 6 out of 8 cured at 1 week after the second injection of AdE7 (Figure 5, third column). Consistent with our phenotypic data, depletion of ‘activated' TAMs with clodronate liposome treatment given concomitantly with Ad.E7 plus DMXAA inhibited therapeutic efficacy, resulting in significantly larger tumours and no cures (Figure 5, right column).
Figure 5

Depletion of macrophages reduces the effect of combining immunotherapy with DMXAA. Mice bearing large TC1 flank tumours were treated in one of the four ways: (1) ‘empty' liposomes (control), (2) i.p. and intratumoural (i.t.) Clodronate liposomes (Clodr.), (3) combination of Ad.E7 vaccine+DMXAA with empty liposomes (Ad.E7+DMXAA), and (4) combination of Ad.E7 vaccine+DMXAA with Clodronate liposomes (Ad.E7+DMXAA+Clodr.). Treatment with Clodronate liposomes reduced tumour size compared with mice treated with unloaded liposomes (*P=0.05). As previously shown, treatment with the combination of Ad.E7 and DMXAA markedly reduced tumour size, with 6 out of 8 cured. Addition of Clodronate liposomes inhibited the therapeutic efficacy of combination therapy (*P<0.05). Each dot represents one mouse.

Combining DMXAA with immunotherapy does not change systemic (splenic) CD8+ T cells

We next studied the systemic effects of combination therapy by evaluating splenocytes. We found no significant changes in the percentage of myeloid-derived suppressor cells (CD11b+/GR1+), B cells, CD8+ cells, CD4/CD25+ (T regulatory) cells, or CD4/CD25- cells (data not shown). In the evaluation of CD8+ T cells, DMXAA, by itself, did not change the percentage of HPV-E7-specific CD8+ cells in the spleen compared with control tumour-bearing mice. As expected, Ad.E7 immunotherapy increased the percentage of splenic E7-specific CD8+ cells by almost four-fold. Addition of DMXAA to Ad.E7 increased the percentage of E7-reactive CD8+ cells by 50%, but this did not reach statistical significance (data not shown). The percentage of CD8+ T cells from spleens harvested from mice 2 days after the boost Ad.E7 vaccine expressing the activation marker 4-1BB in mice treated with the combination of DMXAA and Ad.E7 was not increased compared with either treatment alone. Similar results were obtained using the activation marker CD25 (data not shown).

Discussion

It is becoming increasingly apparent that in addition to the generation of CTLs, successful immunotherapy will require a second approach to decrease tumour-induced immune suppression, that is, ‘inhibiting the inhibitors' (Pardoll and Drake, 2012). We and others have shown that blockade of formation or action of key immune inhibitory mediators such as prostaglandin E2 (using COX-2 inhibitors) (Jassar ) or blocking TGF-β (using kinase inhibitors or blocking antibodies) (Kim ; Wallace ; Llopiz ) are effective in enhancing immunotherapy. Given the importance of TAMs in producing and sustaining an inhibitory tumour microenvironment, these cells represent an attractive target for anticancer therapy. Even before the concept of immunosuppressive TAM was formally popularised, investigators used lipopolysaccharide (LPS) and LPS analogues to try to activate TAM (Klimp ). Although effective in this regard, LPS was quite toxic with adverse systemic effects. The concept was next moved forward by using bacterial wall components with similar properties, but less toxicity, namely muramyl peptidoglycans (Kleinerman ). More modern variations of this approach have used agents such as Toll-like receptor agonists (i.e., CPG oligonucleotides, imiquimod, CCL-34, and so on) (Meyer and Stockfleth, 2008). In general, all these compounds have been hampered by toxicity or delivery issues. Another approach that has been used to activate macrophages has been the use of cytokines such as interferon-γ, GM-CSF, and M-CSF (Klimp ). None has yet been successful. The major problems with this approach have been the short half-life of these agents and the considerable systemic toxicity that they induce. Furthermore, the specificity of these approaches towards TAM is unclear. Finally, there has been recent interest in blocking the trafficking of monocytes into tumours, thus reducing the final number of TAMs. There is enthusiasm in using inhibitors of CCL2 (Fridlender ) or the CSF-1/CSF-1 receptor axis (Aharinejad ) from preclinical studies, and early clinical trials are beginning. In contrast to the previously studied TAM activators, DMXAA is highly soluble, easily administered, well tolerated, and can potently activate TAMs in mouse tumour models (Ching ; Jassar ; Wang ). We therefore used this compound as our ‘proof-of-principal' macrophage-activating compound. Using a variety of immunotherapy models, including classic vaccines and intratumoural cytokine delivery in multiple cell lines (Figure 1), we clearly show that combining immunotherapy with DMXAA increases antitumour efficacy compared with each treatment alone. This was most dramatically shown using an Ad.E7 vaccine directed against the HPV-E7 antigen expressed on TC1 cells (Figures 1A and 5). In this study, treatment of relatively large, established tumours with vaccine or DMXAA alone only resulted in a mild slowing of tumour growth. In contrast, combination treatment resulted in clear tumour regression and a number of cures. The combination of DMXAA with TC-1, as a model of HPV vaccination, has been recently evaluated (Peng ; Zeng ). Both these studies nicely showed that the combined treatment has a better clinical effect than either one of them alone. Our study in multiple models of immunotherapy supports these reports on the combined effect. In our work, we use DMXAA as a macrophage activator, focussing on this effect, which was not shown or discussed in these reports. As can be seen in Figure 5, depletion of macrophages largely decreased the effect of DMXAA on immunotherapy, suggesting, as we have previously shown (Jassar ), that TAMs are a major component in this effect. As DMXAA does not solely affect macrophages, we carried out a series of studies to study the phenotype of the TAM and CD8 T cells in order to confirm the mechanisms of this effect. We chose to study the time point that was 2 to 3 days after DMXAA administration as this was enough time for changes in the tumour microenvironment to occur, but the tumours were still similar in size to legitimise comparisons. As shown in Figure 2, and as we and others have reported, DMXAA (whether alone or in combination) did not cause a large change in TAM number, but did alter the phenotype of the TAMs away from the M2 phenotype, with increases in M1 or M0 type TAMs. This was evidenced by downregulation of the classic M2 TAM surface marker, the MMR2, or CD206 (Gallina ; Roca ), as well as changes in other known M1 and M2 markers (Supplementary Figure 1). The changes in cytokine mRNA (Table 1), which is the relative increase in the levels of M1 markers such as TNFα, CCL5, and INFγ, are consistent with this. Again, similar to our previous work (Jassar ), these changes were associated with increased numbers of tumour-infiltrating CD8 T cells (Figure 3), which were more activated (Figure 4) than in control tumours, especially in the LLC–Ad.IFNβ model. However, despite increased numbers of T cells, we postulate that one limitation of DMXAA in this context is that the antitumour activity of these CD8+ T cells in otherwise untreated animals is low and restricted, at least initially, to whatever endogenous antitumour response existed. The addition of immunotherapy, either intratumour or using specific tumour antigens, focusses the adaptive immune system towards the tumour. Also, as we have previously shown (Haas ), and might be expected, the primary effect of the Ad.E7 vaccine is to generate antigen-specific CD8 T cells, particularly in the spleen. By itself, the vaccine results in only a small increase in the total number of CD8 T cells within the tumour (Figure 3A). Despite the ability to generate antitumour T cells systemically, a major limitation of the vaccine (as with most vaccines) is the suboptimal ability of the antigen-specific T cells to traffic into the tumour (Figures 3 and 4C). It is interesting that even though the T cells face a somewhat ‘hostile' environment, their presence does seem to result in a more immunostimulatory environment (Table 1). Our mechanistic data show how the limitations of each approach can be complemented by the other: macrophage activation induces enhanced trafficking and reduced inactivation of the antigen-specific antitumour T cells induced by the vaccine. Thus, when compared with each therapy alone, combination therapy results in: (1) a more immunostimulatory tumour microenvironment (Figure 2 and Table 1) (2) more CD8 T cells within the tumours (Figure 3) and more antigen-specific T cells within the tumours (Figure 4). Surprisingly, Matthews ) found that DMXAA did not synergize with adoptive transfer of CD8+ T cells. A possible explanation for that apparent contradiction to our findings lies in the described temporal actions of DMXAA in tumours (Baguley and Siemann, 2010). Specifically, if the vascular ‘shut down' effects of DMXAA occur at the time of adoptive T-cell transfer, little increase in efficacy might be observed. The broader time window afforded by vaccine therapies may circumvent this potential timing problem. There are some caveats to our study that should be considered. First, DMXAA is not a ‘pure' macrophage activation agent but also has effects on other stromal components such as DCs (Wallace ) and endothelial cells (Henare ). It is possible that these other effects of DMXAA may have contributed to the combination effect. However, we believe that the TAM effect was highly important for two reasons: (1) we clearly show that the TAM phenotype was changed during therapy and (2) our macrophage depletion studies (using Clodronate liposomes) showed that loss of TAM significantly reduced the efficacy of combination therapy (Figure 5). The second caveat relates to the observation that although DMXAA has highly potent stromal activation properties in mouse, in our hands (Fridlender et al, unpublished) and in other studies, it has much less activity in human cells (Wang ; Henare ). We believe that this is the reason that two recent clinical trials run by Novartis using DMXAA (Vadimezan) in combination with chemotherapy for lung cancer were recently halted for lack of efficacy (Lara ). A number of groups are trying to develop analogues of DMXAA with similar human activity as is seen in mouse. Obviously, a better understanding of the way that DMXAA activates mouse leukocytes would be helpful in this regard. Although it has been established that DMXAA can activate macrophages through a number of key inflammatory pathways including the NF-κB (Ching ), type 1 interferon (Roberts ), NOD2 (Cheng ), and MAP kinase (Sun ) pathways, the DMXAA ‘receptor' had not been identified. Excitingly, Prantner ) provided strong evidence that DMXAA binds to and specifically activates the ‘stimulator of interferon gene' (STING). This finding opens up new possibilities for the identification of human homologues to DMXAA that might interact efficiently with human STING and thus succeed better in the treatment of human cancer. Our data suggest that if and when these analogues with enhanced human leukocyte-activating activity are identified, they could be highly useful immunotherapy-enhancing agents. In summary, we demonstrated that modulating the phenotype of intratumoural macrophages dramatically augmented the effect of immunotherapy for NSCLC. Although it would not be advisable to use DMXAA (Vadimezan) in future human clinical trials, the principal of using tumour macrophage (stromal) activation (perhaps with an analogue with higher activity in human cells) or depletion in combination with immunotherapy holds great promise. As more effective approaches to develop antitumour T cells and to selectively alter the tumor microenvironment are developed, rapid combination of the two strategies should be encouraged in future immunotherapy trials.
  43 in total

Review 1.  Cancer immunology.

Authors:  Olivera J Finn
Journal:  N Engl J Med       Date:  2008-06-19       Impact factor: 91.245

2.  Improved survival with ipilimumab in patients with metastatic melanoma.

Authors:  F Stephen Hodi; Steven J O'Day; David F McDermott; Robert W Weber; Jeffrey A Sosman; John B Haanen; Rene Gonzalez; Caroline Robert; Dirk Schadendorf; Jessica C Hassel; Wallace Akerley; Alfons J M van den Eertwegh; Jose Lutzky; Paul Lorigan; Julia M Vaubel; Gerald P Linette; David Hogg; Christian H Ottensmeier; Celeste Lebbé; Christian Peschel; Ian Quirt; Joseph I Clark; Jedd D Wolchok; Jeffrey S Weber; Jason Tian; Michael J Yellin; Geoffrey M Nichol; Axel Hoos; Walter J Urba
Journal:  N Engl J Med       Date:  2010-06-05       Impact factor: 91.245

3.  Sipuleucel-T immunotherapy for castration-resistant prostate cancer.

Authors:  Philip W Kantoff; Celestia S Higano; Neal D Shore; E Roy Berger; Eric J Small; David F Penson; Charles H Redfern; Anna C Ferrari; Robert Dreicer; Robert B Sims; Yi Xu; Mark W Frohlich; Paul F Schellhammer
Journal:  N Engl J Med       Date:  2010-07-29       Impact factor: 91.245

4.  Activation of the nucleotide oligomerization domain signaling pathway by the non-bacterially derived xanthone drug 5'6-dimethylxanthenone-4-acetic acid (Vadimezan).

Authors:  Guanjun Cheng; Jing Sun; Zvi G Fridlender; Liang-Chuan S Wang; Lai-Ming Ching; Steven M Albelda
Journal:  J Biol Chem       Date:  2010-01-29       Impact factor: 5.157

5.  CCL2 blockade augments cancer immunotherapy.

Authors:  Zvi G Fridlender; George Buchlis; Veena Kapoor; Guanjun Cheng; Jing Sun; Sunil Singhal; M Cecilia Crisanti; Cecilia Crisanti; Liang-Chuan S Wang; Daniel Heitjan; Linda A Snyder; Steven M Albelda
Journal:  Cancer Res       Date:  2009-12-22       Impact factor: 12.701

6.  CCL2 and interleukin-6 promote survival of human CD11b+ peripheral blood mononuclear cells and induce M2-type macrophage polarization.

Authors:  Hernan Roca; Zachary S Varsos; Sudha Sud; Matthew J Craig; Chi Ying; Kenneth J Pienta
Journal:  J Biol Chem       Date:  2009-10-15       Impact factor: 5.157

7.  Peptide inhibitors of transforming growth factor-beta enhance the efficacy of antitumor immunotherapy.

Authors:  Diana Llopiz; Javier Dotor; Noelia Casares; Jaione Bezunartea; Nancy Díaz-Valdés; Marta Ruiz; Fernando Aranda; Pedro Berraondo; Jesús Prieto; Juan José Lasarte; Francisco Borrás-Cuesta; Pablo Sarobe
Journal:  Int J Cancer       Date:  2009-12-01       Impact factor: 7.396

8.  Neutrophil influx and chemokine production during the early phases of the antitumor response to the vascular disrupting agent DMXAA (ASA404).

Authors:  Liang-Chuan S Wang; Lotte Thomsen; Rachel Sutherland; Charu B Reddy; Sofian M Tijono; Chun-Jen J Chen; Catherine E Angel; P Rod Dunbar; Lai-Ming Ching
Journal:  Neoplasia       Date:  2009-08       Impact factor: 5.715

9.  A phase I trial of repeated intrapleural adenoviral-mediated interferon-beta gene transfer for mesothelioma and metastatic pleural effusions.

Authors:  Daniel H Sterman; Adri Recio; Andrew R Haas; Anil Vachani; Sharyn I Katz; Colin T Gillespie; Guanjun Cheng; Jing Sun; Edmund Moon; Luana Pereira; Xinzhong Wang; Daniel F Heitjan; Leslie Litzky; Carl H June; Robert H Vonderheide; Richard G Carroll; Steven M Albelda
Journal:  Mol Ther       Date:  2010-01-12       Impact factor: 11.454

Review 10.  Macrophage polarization in tumour progression.

Authors:  Antonio Sica; Paola Larghi; Alessandra Mancino; Luca Rubino; Chiara Porta; Maria Grazia Totaro; Monica Rimoldi; Subhra Kumar Biswas; Paola Allavena; Alberto Mantovani
Journal:  Semin Cancer Biol       Date:  2008-03-26       Impact factor: 15.707

View more
  27 in total

Review 1.  Macrophages: An Inflammatory Link Between Angiogenesis and Lymphangiogenesis.

Authors:  Bruce A Corliss; Mohammad S Azimi; Jennifer M Munson; Shayn M Peirce; Walter L Murfee
Journal:  Microcirculation       Date:  2016-02       Impact factor: 2.628

Review 2.  Switching off malignant pleural effusion formation-fantasy or future?

Authors:  Magda Spella; Anastasios D Giannou; Georgios T Stathopoulos
Journal:  J Thorac Dis       Date:  2015-06       Impact factor: 2.895

Review 3.  The role of the immune system in non-small cell lung carcinoma and potential for therapeutic intervention.

Authors:  Joanna Domagala-Kulawik
Journal:  Transl Lung Cancer Res       Date:  2015-04

Review 4.  Rationale, progress and development of vaccines utilizing STING-activating cyclic dinucleotide adjuvants.

Authors:  Thomas W Dubensky; David B Kanne; Meredith L Leong
Journal:  Ther Adv Vaccines       Date:  2013-11

5.  FGL2 as a Multimodality Regulator of Tumor-Mediated Immune Suppression and Therapeutic Target in Gliomas.

Authors:  Jun Yan; Ling-Yuan Kong; Jiemiao Hu; Konrad Gabrusiewicz; Denada Dibra; Xueqing Xia; Amy B Heimberger; Shulin Li
Journal:  J Natl Cancer Inst       Date:  2015-05-13       Impact factor: 13.506

6.  Effective innate and adaptive antimelanoma immunity through localized TLR7/8 activation.

Authors:  Manisha Singh; Hiep Khong; Zhimin Dai; Xue-Fei Huang; Jennifer A Wargo; Zachary A Cooper; John P Vasilakos; Patrick Hwu; Willem W Overwijk
Journal:  J Immunol       Date:  2014-09-24       Impact factor: 5.422

7.  High salt induces anti-inflammatory MΦ2-like phenotype in peripheral macrophages.

Authors:  Suneetha Amara; Margaret Whalen; Venkataswarup Tiriveedhi
Journal:  Biochem Biophys Rep       Date:  2016-09

8.  Splenectomy inhibits non-small cell lung cancer growth by modulating anti-tumor adaptive and innate immune response.

Authors:  Liran Levy; Inbal Mishalian; Rachel Bayuch; Lida Zolotarov; Janna Michaeli; Zvi G Fridlender
Journal:  Oncoimmunology       Date:  2015-01-22       Impact factor: 8.110

9.  STING Activation Reverses Lymphoma-Mediated Resistance to Antibody Immunotherapy.

Authors:  Lekh N Dahal; Lang Dou; Khiyam Hussain; Rena Liu; Alexander Earley; Kerry L Cox; Salome Murinello; Ian Tracy; Francesco Forconi; Andrew J Steele; Patrick J Duriez; Diego Gomez-Nicola; Jessica L Teeling; Martin J Glennie; Mark S Cragg; Stephen A Beers
Journal:  Cancer Res       Date:  2017-05-16       Impact factor: 12.701

10.  Tumor-associated neutrophils stimulate T cell responses in early-stage human lung cancer.

Authors:  Evgeniy B Eruslanov; Pratik S Bhojnagarwala; Jon G Quatromoni; Tom Li Stephen; Anjana Ranganathan; Charuhas Deshpande; Tatiana Akimova; Anil Vachani; Leslie Litzky; Wayne W Hancock; José R Conejo-Garcia; Michael Feldman; Steven M Albelda; Sunil Singhal
Journal:  J Clin Invest       Date:  2014-11-10       Impact factor: 14.808

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.