Literature DB >> 29198824

Inhibition of Farnesyltransferase Potentiates NOTCH-Targeted Therapy against Glioblastoma Stem Cells.

Yufang Ma1, Zhixiang Cheng2, Jing Liu3, Luke Torre-Healy4, Justin D Lathia4, Ichiro Nakano5, Yan Guo6, Reid C Thompson7, Michael L Freeman8, Jialiang Wang9.   

Abstract

Accumulating evidence suggests that cancer cells with stem cell-like phenotypes drive disease progression and therapeutic resistance in glioblastoma (GBM). NOTCH regulates self-renewal and resistance to chemoradiotherapy in GBM stem cells. However, NOTCH-targeted γ-secretase inhibitors (GSIs) exhibited limited efficacy in GBM patients. We found that farnesyltransferase inhibitors (FTIs) significantly improved sensitivity to GSIs. This combination showed significant antineoplastic and radiosensitizing activities in GBM stem cells, whereas non-stem GBM cells were resistant. These combinatorial effects were mediated, at least partially, through inhibition of AKT and cell-cycle progression. Using subcutaneous and orthotopic GBM models, we showed that the combination of FTIs and GSIs, but not either agent alone, significantly reduced tumor growth. With concurrent radiation, this combination induced a durable response in a subset of orthotopic tumors. These findings collectively suggest that the combination of FTIs and GSIs is a promising therapeutic strategy for GBM through selectively targeting the cancer stem cell subpopulation.
Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Notch; farnesyltransferase inhibitors; glioblastoma stem cells; γ-secretase inhibitors

Mesh:

Substances:

Year:  2017        PMID: 29198824      PMCID: PMC5785731          DOI: 10.1016/j.stemcr.2017.10.028

Source DB:  PubMed          Journal:  Stem Cell Reports        ISSN: 2213-6711            Impact factor:   7.765


Introduction

Glioblastoma (GBM) is one of the most lethal human malignancies. Despite aggressive surgical resection and chemoradiotherapy, tumor recurrence is nearly universal (Stupp et al., 2005, Wen and Kesari, 2008). It has been increasingly recognized that GBM recurrence is driven by a subset of cells with stem cell-like phenotypes, such as unrestricted self-renewal and the ability to restore cellular heterogeneity (Lathia et al., 2015). These cells are termed as GBM stem cells, but also known as GBM tumor-initiating cells or tumor-propagating cells. The rest of the cellular subpopulation is thought to be the progenies of GBM stem cells and has limited tumorigenic potential. While the identity and plasticity of GBM stem cells remains a subject of debate, these cells appear to be refractory to the current standard of care, including radiation and temozolomide (Bao et al., 2006, Eramo et al., 2006, Pistollato et al., 2010). The abilities of GBM stem cells to evade therapies and to effectively repopulate tumor masses highlight their roles in therapeutic resistance. Hence, these cells are crucial therapeutic targets to achieve prolonged tumor response (Zhu et al., 2014). There is growing evidence that developmental pathways central to normal stem cell biology, such as those regulated by NOTCH, WNT, and HEDGEHOG, are frequently activated in their malignant counterparts, cancer stem cells (CSCs) (Takebe et al., 2011). Targeting these pathways can be appealing strategies to compromise the CSC subpopulation and improve therapeutic response. The NOTCH signaling pathway has profound indications in development and cancer (Bolos et al., 2007). The canonical NOTCH pathway is mediated through coordinated crosstalk among four NOTCH receptors (NOTCH1–4) and five ligands (Jagged1/2 and DLL1/3/4). Ligand binding induces conformational changes of NOTCH receptors and through a two-step proteolytic cleavage, resulting in nuclear accumulation of the intracellular domains of NOTCH (NICDs) and activation of NOTCH-dependent transcription. The significance of NOTCH activities has been reported in the cancer stem cell subpopulation of GBM and a variety of other cancers (Abel et al., 2014, Fan et al., 2006, Fan et al., 2010, Liau et al., 2017, Saito et al., 2014). Our laboratory has previously demonstrated that NOTCH signaling protects GBM stem cells from radiation (Wang et al., 2010a). Results from other groups also agree that NOTCH signaling may promote resistance to temozolomide and radiation in GBM stem cells (Gilbert et al., 2010, Yahyanejad et al., 2016). NOTCH activity is also implicated in the crosstalk between GBM stem cells and the tumor microenvironment, as expression of NOTCH ligands in endothelial cells within the tumor vasculature supports GBM stem cells (Zhu et al., 2011). In particular, NOTCH activity is required for GBM stem cells to generate endothelial cell-like cells that contribute to tumor angiogenesis (Wang et al., 2010b). Based on these reasons, there has been increasing interest in targeting NOTCH signaling for the treatment of GBM. The most clinically advanced agents targeting NOTCH are small-molecule inhibitors of γ-secretase (GSIs), which catalyze the second step of releasing NICDs. Based on promising preclinical activities, several GSIs have been examined in clinical trials for cancer patients as monotherapies or in combination with other regimens (Andersson and Lendahl, 2014, Takebe et al., 2015). In a phase I study of MK-0752, a subset of patients with advanced glioma (24%) had prolonged stable disease and there was one case of complete response (Krop et al., 2012). Modest clinical benefits have been shown with other GSIs, such as PF-03084014 and LY900009 (Locatelli et al., 2017, Messersmith et al., 2015, Pant et al., 2016). RO4929097 has been the most widely tested GSI to date. Objective response has been identified in patients with advanced glioma treated with RO4929097 and bevacizumab (Pan et al., 2016). In another clinical study, RO4929097 in combination with the standard chemoradiotherapy reduced the CD133+ fraction of GBM cells and impaired the ability of cancer cells to generate spheres (Xu et al., 2016). However, clinical benefits of GSIs in general are modest at best in patients with advanced glioma or other solid malignancies. Combinations with conventional chemoradiotherapy or other targeted agents to date have offered limited improvement. Farnesyltransferase inhibitors (FTIs) were originally developed as anti-RAS agents, because farnesylation at the C terminus regulates membrane anchorage of RAS proteins (Appels et al., 2005). While HRAS is strictly dependent on farnesyltransferase, KRAS and NRAS remain functional in the presence of FTIs through geranylgeranylation, an alternative form of prenylation (Sebti and Der, 2003). As such, the exact mechanisms of action of FTIs are still unclear. At least two FTIs, tipifarnib and lonafarnib, have been assessed in patients with GBM, showing modest activities in a small subset of patients (Cloughesy et al., 2006, Haas-Kogan et al., 2011, Lustig et al., 2008, Nghiemphu et al., 2011, Yust-Katz et al., 2013). In the current study, we demonstrated that inhibition of farnesyltransferase significantly improved the efficacy of GSIs in subcutaneous and intracranial GBM models. The combination of FTIs and GSIs made GBM stem cells more sensitive to radiation. Durable response of intracranial tumors in recipient mice was observed following administration of the combination therapy with concurrent radiation.

Results

GSIs as Monotherapy Have Limited Activities in GBM Stem Cells

We have previously demonstrated that targeting NOTCH in GBM stem cells with GSIs, such as DAPT and L685,458, induced only modest growth inhibition (Wang et al., 2010a). To improve NOTCH-based therapy for GBM, we investigated the therapeutic potential of a highly potent and brain-penetrating GSI, RO4929097. GBM stem cells were isolated from patient-derived xenograft (PDX) models and enriched by magnetic sorting for the CD133 cell surface marker. These CD133+ cells expressed higher levels of stem cell markers, such as MYC, and lower levels of differentiation markers, such as GFAP, compared with matched CD133− cells (Figure S1A). Cleaved NOTCH1 was higher in CD133+ cells, suggesting that NOTCH was preferentially activated in this subpopulation (Figure 1A). Consistently, CD133+ cells also expressed higher levels of canonical NOTCH target genes, HES1 and HES2 (Figure S1B). In addition, NOTCH1 and NOTCH2 mRNA levels were higher in CD133+ cells (Figure S1B). Despite preferential activation of NOTCH signaling in CD133+ cells, RO4929097 had only modest impact on the viability of these cells (Figures 1B and S1C). In contrast, matched CD133− cells were essentially unresponsive to RO4929097 (Figures 1B and S1C). Although the impact on proliferation was limited, RO4929097 significantly undermined tumor sphere formation (Figure 1C), suggesting specific functions of NOTCH in the regulation of self-renewal in GBM stem cells. Measured by limiting dilution assays, RO4929097 significantly reduced the frequency of self-renewing cells in the CD133+ subpopulation (Figures 1D–1F). However, these results suggest that blockade of NOTCH signaling alone may not be sufficient to effectively kill GBM stem cells.
Figure 1

GBM Stem Cells and Non-stem Tumor Cells Exhibit Differential NOTCH Activation and Sensitivity to GSIs

(A) Immunoblotting of cleaved NOTCH1 and total NOTCH1 in matched CD133+ cells and CD133− cells. Actin was used as the loading control.

(B) T4302 CD133+ and CD133− cells cultured in 96-well plates were treated with RO4929097 for 5 days following a 12-point 3-fold serial dilution. Dose-response curves were determined using a three-parameter non-linear regression method.

(C) T4302 CD133+ cells were plated at 100 cells per well in 24-well plates and treated with RO4929097 at indicated concentrations. Tumor spheres were counted 10 days after plating. ∗p < 0.05 by Student's t test.

(D) The percentage of self-renewing cells in the T4105 and T4302 CD133+ subpopulations treated with 20, 100, or 500 nM RO4929097 (RO) calculated following the extreme limiting dilution analysis method. ∗p < 0.0.5 by Student's t test, treated versus vehicle.

(E) Representative limiting dilution assay plots for T4302 CD133+ cells and (F) T4105 CD133+ cells.

See also Figure S1.

GBM Stem Cells and Non-stem Tumor Cells Exhibit Differential NOTCH Activation and Sensitivity to GSIs (A) Immunoblotting of cleaved NOTCH1 and total NOTCH1 in matched CD133+ cells and CD133− cells. Actin was used as the loading control. (B) T4302 CD133+ and CD133− cells cultured in 96-well plates were treated with RO4929097 for 5 days following a 12-point 3-fold serial dilution. Dose-response curves were determined using a three-parameter non-linear regression method. (C) T4302 CD133+ cells were plated at 100 cells per well in 24-well plates and treated with RO4929097 at indicated concentrations. Tumor spheres were counted 10 days after plating. ∗p < 0.05 by Student's t test. (D) The percentage of self-renewing cells in the T4105 and T4302 CD133+ subpopulations treated with 20, 100, or 500 nM RO4929097 (RO) calculated following the extreme limiting dilution analysis method. ∗p < 0.0.5 by Student's t test, treated versus vehicle. (E) Representative limiting dilution assay plots for T4302 CD133+ cells and (F) T4105 CD133+ cells. See also Figure S1.

FTIs Synergistically Augment Cytotoxicity of GSIs In Vitro

To identify agents that might potentiate the toxicity of GSIs against GBM stem cells, we tested a set of targeted agents that had been previously evaluated in GBM patients (Wang et al., 2015). Our results showed that RO4929097 significantly reduced the LC50 values, defined as the concentrations causing loss of 50% cell viability, for a farnesyltransferase inhibitor, tipifarnib, and two other compounds targeting the EGFR family receptors (Table S1). Tipifarnib was selected for further study as it induced significant cell death in the presence of RO4929097. Our data showed that both tipifarnib and RO4929097 alone at physiologically relevant concentrations significantly reduced CD133+ cells growth and induced modest apoptotic cell death (Figures 2A–2C), whereas the combination showed stronger anti-proliferative effects and cytotoxicity compared with single agents (Figures 2A–2C and S2A). In contrast, CD133− cells were largely resistant to tipifarnib and RO4929097, either alone or in combination (Figures 2C, 2D, S2A, and S2B).
Figure 2

Inhibition of Farnesyltransferase Augments the Cytotoxicity of GSIs

(A and B) T4302 (A) or T4105 (B) CD133+ cells were treated with 100 nM RO4929097 ± 100 nM tipifarnib. Cell growth was determined by the Promega CellTiter-Glo assay kit and normalized to 1 μM ATP tested parallelly. ∗p < 0.05 treated versus vehicle; and #p < 0.05 combination versus single agents, by Student's t test.

(C) T4302 cells were treated with 100 nM RO4929097 ± 100 nM tipifarnib for 3 days. Caspase 3/7 activities were determined using the Promega Caspase3/7-Glo kit and normalized to cell titer readings of the corresponding groups. ∗p < 0.05, treated versus vehicle. #p < 0.05, combination versus single agent, by Student's t test.

(D) Growth of T4302 CD133-cells were determined as described above.

See also Figure S2.

Inhibition of Farnesyltransferase Augments the Cytotoxicity of GSIs (A and B) T4302 (A) or T4105 (B) CD133+ cells were treated with 100 nM RO4929097 ± 100 nM tipifarnib. Cell growth was determined by the Promega CellTiter-Glo assay kit and normalized to 1 μM ATP tested parallelly. ∗p < 0.05 treated versus vehicle; and #p < 0.05 combination versus single agents, by Student's t test. (C) T4302 cells were treated with 100 nM RO4929097 ± 100 nM tipifarnib for 3 days. Caspase 3/7 activities were determined using the Promega Caspase3/7-Glo kit and normalized to cell titer readings of the corresponding groups. ∗p < 0.05, treated versus vehicle. #p < 0.05, combination versus single agent, by Student's t test. (D) Growth of T4302 CD133-cells were determined as described above. See also Figure S2. We next asked whether the interaction between tipifarnib and RO4929097 was synergistic. To calculate the drug synergy, T4302 CD133+ cells were treated with tipifarnib, RO4929097, or the combination of these two compounds mixed at an equal molar ratio following a 3-fold serial dilution. The LC50 value for tipifarnib in T4302 CD133+ cells was 32 nM when combined with RO4929097 compared with 194 nM as a monotherapy (Figure 3A). The loss of cell viability induced by RO4929097 alone was not greater than 50%. On the basis of cell viability data, drug synergy was calculated across a wide range of concentrations using the Chou-Talalay statistical method (Chou, 2010). The combination index (CI) values were markedly lower than 1 at drug concentrations above 1 nM, indicating strong drug synergy (Figure 3B). In contrast, T4302 CD133− cells were refractory to tipifarnib and RO4929097, either alone or combined (Figure 3C). Similar synergistic response was shown in T4105 CD133+ cells as well as spheroid cultures derived from low-passage GBM PDX models, but not T4105 CD133− cells (Figures 3D, 3E, S3A, and S3B). In line with these findings, additional FTIs and GSIs, such as L744,832 and DAPT, also exhibited synergistic interactions (Figure S3C). Conversely, the synergism between tipifarnib and RO4929097 was absent in normal human neural progenitor (NHNP) cells (Figure S3D). Not all GBM stem cells were sensitive to this combination therapy. Examination of additional GBM stem cell lines generated in vitro showed that only one proneural subtype line was sensitive (Wang et al., 2017), while the other three lines were not (Figures S3E–S3H). Limiting dilution assays showed that the combination therapy had a profound impact on the self-renewal capacity of GBM stem cells. While approximately 1 out of 2 T4302 CD133+ cells had self-renewal capacity (Figures 3F and 3G), exposure to 100 nM tipifarnib or RO4929097 reduced the frequency of self-renewing cells to 1 out of 8.57 or 3.84, respectively, while the combination reduced the ratio of self-renewing cells to 1 out of 31.02. Similar observations were made in T4105 CD133+ cells (Figures 3F and 3H). Taken together, our results suggest that inhibition of farnesyltransferase synergistically and selectively enhances the efficacy of GSIs in a subset of GBM stem cells.
Figure 3

The Interaction between Tipifarnib and RO4929097 Is Synergistic

(A) T4302 CD133+ cells were treated with RO4929097, tipifarnib, or the combination of both compounds mixed at a 1:1 ratio. Dose-response curves were determined as described in Figure 1B.

(B) Combination index values for tipifarnib and RO4929097 were calculated using the Chou-Talalay method for T4105 and T4302 CD133+ cells.

(C) Dose-response curves of RO4929097, tipifarnib, or the combination in T4302 CD133− cells. LC50 values were 475 nM for tipifarnib and 429 nM for the combination.

(D and E) Dose-response curves in T4105 CD133+ (D) and CD133− (E) cells. In CD133+ cells, LC50 values were 132 nM for tipifarnib and 29.8 nM for the combination. In CD133− cells, LC50 values were 895 nM for tipifarnib and 1.22 μM for the combination.

(F) The percentage of self-renewing cells in the T4105 and T4302 CD133+ subpopulations treated with 100 nM RO4929097 ± 100 nM tipifarnib. ∗p < 0.05, treated versus vehicle; #p < 0.05, combination versus single agent, by Student's t test.

(G and H) Representative limiting dilution assay plots for (G) T4105 and (H) T4302 CD133+ cells.

See also Figure S3.

The Interaction between Tipifarnib and RO4929097 Is Synergistic (A) T4302 CD133+ cells were treated with RO4929097, tipifarnib, or the combination of both compounds mixed at a 1:1 ratio. Dose-response curves were determined as described in Figure 1B. (B) Combination index values for tipifarnib and RO4929097 were calculated using the Chou-Talalay method for T4105 and T4302 CD133+ cells. (C) Dose-response curves of RO4929097, tipifarnib, or the combination in T4302 CD133− cells. LC50 values were 475 nM for tipifarnib and 429 nM for the combination. (D and E) Dose-response curves in T4105 CD133+ (D) and CD133− (E) cells. In CD133+ cells, LC50 values were 132 nM for tipifarnib and 29.8 nM for the combination. In CD133− cells, LC50 values were 895 nM for tipifarnib and 1.22 μM for the combination. (F) The percentage of self-renewing cells in the T4105 and T4302 CD133+ subpopulations treated with 100 nM RO4929097 ± 100 nM tipifarnib. ∗p < 0.05, treated versus vehicle; #p < 0.05, combination versus single agent, by Student's t test. (G and H) Representative limiting dilution assay plots for (G) T4105 and (H) T4302 CD133+ cells. See also Figure S3.

The Combination of Tipifarnib and RO4929097 Suppresses Key Signal Transduction Pathways and Cell-Cycle Regulators

NOTCH signaling is known to crosstalk with a wide range of signal transduction pathways that result in tumor-promoting or tumor-suppressive activities in a context-dependent manner (Ranganathan et al., 2011). Inhibition of farnesyltransferase also affects many pathways through modulation of farnesylation of crucial signaling molecules, including the RAS family of GTPases (Sebti and Der, 2003). To interrogate the mechanisms mediating the cytotoxicity of the combination of tipifarnib and RO4929097, we first tested the impact on the PI3K/AKT pathway and the MAPK pathway in GBM stem cells. Although the patterns of changes in these two pathways were not identical in GBM stem cells derived from different PDX models, the combination was more effective to reduce the phosphorylation levels of AKT and ERK than either agent alone (Figure 4A). Overexpression of a constitutively active myristoylation signal-linked AKT1 (Myr-AKT1) increased the LC50 of the combination therapy from 101 nM to 330 nM (Figure 4B). Of note, tipifarnib induced a modest upregulation of cleaved NOTCH1, suggesting that NOTCH activation may be implicated in resistance to FTIs. Consistent with this hypothesis, ectopic expression of a constitutively active intracellular domain of NOTCH1 (NICD1) reduced tipifarnib-induced caspase activation (Figure 4C).
Figure 4

The Combination of RO4929097 and Tipifarnib Represses Key Signaling Pathways and Cell-Cycle Progression

(A) Immunoblotting of T4105 and T4302 CD133+ cells treated with 100 nM tipifarnib, 100 nM RO490997, or the combination for 24 hr.

(B) T4105 CD133+ cells were infected with lentivirus directing expression of Myr-AKT1 and selected with puromycin. Cells were then treated with the combination of RO4929097 and tipifarnib mixed at an equal molar ratio as described in Figure 3A.

(C) Relative caspase-3/-7 activities in control cells and cells expressing NICD1 treated with 100 nM tipifarnib for 72 hr.

(D) qRT-PCR for selective cell-cycle regulators in T4105 CD133+ cells treated as described above. ∗p < 0.05 by Student’s t test, treated versus vehicle.

(E) Cell-cycle distribution of T4105 CD133+ cells following 24-hr treatment with 100 nM RO4929097 (RO) ± 100 nM tipifarnib (Tip). ∗p < 0.05 by Student’s t test, S phase, treated versus control.

(F and G) Dose-response curves of (F) palbociclib or (G) barasertib in T4105 CD133+ cells with or without 100 nM RO4929097. LC50 values for palbociclib were 3.74 μM without RO4929097 and 103 nM with RO4929097. LC50 values for barasertib were not reached without RO4929097 and 106 nM with RO4929097.

See also Figures S4 and S5.

The Combination of RO4929097 and Tipifarnib Represses Key Signaling Pathways and Cell-Cycle Progression (A) Immunoblotting of T4105 and T4302 CD133+ cells treated with 100 nM tipifarnib, 100 nM RO490997, or the combination for 24 hr. (B) T4105 CD133+ cells were infected with lentivirus directing expression of Myr-AKT1 and selected with puromycin. Cells were then treated with the combination of RO4929097 and tipifarnib mixed at an equal molar ratio as described in Figure 3A. (C) Relative caspase-3/-7 activities in control cells and cells expressing NICD1 treated with 100 nM tipifarnib for 72 hr. (D) qRT-PCR for selective cell-cycle regulators in T4105 CD133+ cells treated as described above. ∗p < 0.05 by Student’s t test, treated versus vehicle. (E) Cell-cycle distribution of T4105 CD133+ cells following 24-hr treatment with 100 nM RO4929097 (RO) ± 100 nM tipifarnib (Tip). ∗p < 0.05 by Student’s t test, S phase, treated versus control. (F and G) Dose-response curves of (F) palbociclib or (G) barasertib in T4105 CD133+ cells with or without 100 nM RO4929097. LC50 values for palbociclib were 3.74 μM without RO4929097 and 103 nM with RO4929097. LC50 values for barasertib were not reached without RO4929097 and 106 nM with RO4929097. See also Figures S4 and S5. To interpret the global impact of this combination therapy, we employed microarray to assess changes in gene expression profiles induced by the combination of tipifarnib and RO4929097. Gene set enrichment analysis (GSEA) showed that several gene signatures implicated in cell-cycle regulation were consistently downregulated by the combination of tipifarnib and RO4929097 (Figure S4A). The combination also suppressed gene sets dependent on the E2F family transcription factors (Figure S4B), which include many genes implicated in cell-cycle regulation. Quantitative real-time PCR (qRT-PCR) was used to validate the changes in selected cell-cycle regulatory genes, including Aurora kinase A/B (AURKA and AURKB), CDC25C, and BUB1. These genes were significantly downregulated by tipifarnib in T4105 and T4302 CD133+ cells (Figures 4D and S5A). However, RO4929097 did not significantly affect expression of these targets. Consistently, tipifarnib reduced the fraction of cells in S phase and increased the subpopulation of cells in G1 phase, while RO4929097 had limited impact on cell-cycle progression (Figures 4E and S5B). To determine the role of cell-cycle progression in mediating the drug synergy, we asked if RO4929097 affected the responsiveness of CD133+ cells to compounds that impaired cell-cycle progression. Our data showed that RO4929097 made both T4105 and T4302+ CD133+ cells more sensitive to the CDK4/6 inhibitor, palbociclib, or the AURKB inhibitor, barasertib (Figures 4F, 4G, S5C, and S5D). These results suggest that the ability of FTIs to compromise cell-cycle progression is critically implicated in the synergistic interaction with GSIs. A recent study suggested that NOTCH signaling might antagonize neuronal differentiation in a subset of GBM stem cells through suppressing expression of ASCL1, a transcription factor promoting neurogenesis (Park et al., 2017). Our data showed that RO4929097, either alone or combined with tipifarnib, did not induce expression of ASCL1 or neuronal markers, such as TUBB3 and MAP2 (Figure S5E), suggesting that an ASCL1-dependent transcription program may not be the target of this combination therapy in our model systems.

Tipifarnib Augments the In Vivo Activities of RO4929097

The in vivo activities of tipifarnib, RO4929097, and the combination were first assessed in subcutaneous GBM tumors. Either tipifarnib or RO4929097 alone had limited impact on tumor growth. Conversely, the combination significantly reduced the growth of T4105 xenograft tumors (Figure 5A). Two weeks following treatment, the median size of T4105 tumors in the combination group was approximately 24% of the vehicle group (Figure 5A). Because both tipifarnib and RO4929097 penetrate the blood-brain barrier (Nghiemphu et al., 2011, Xu et al., 2016), we further evaluated their combinatorial effects in orthotopic GBM models. At the doses used in our experiments, tipifarnib induced significant accumulation of PRELAMIN A (Figure S6A), a marker of farnesyltransferase inhibition. RO4929097 reduced the levels of cleaved NOTCH1 (Figure S6B), indicating blockade of NOTCH signaling. The median survival of mice carrying intracranial T4302 tumors was marginally increased by either tipifarnib or RO4929097 (Figure 5B). In contrast, the combination of these two compounds extended the median survival by 25% compared with the group treated with vehicle (40 versus 32 days, p = 0.018 by the log rank test) (Figure 5B). No significant weight loss was associated with administration of tipifarnib, RO4929097 or the combination (Figure S6C). However, intracranial tumor burdens induced weight loss at the late stage of the experiments. These findings indicate that combining inhibitors of farnesyltransferase and γ-secretase may produce more potent therapeutic activities in GBM than monotherapies.
Figure 5

Tipifarnib Improves GBM Xenograft Tumor Response to RO4929097

(A) Athymic nude mice bearing subcutaneous T4105 tumors were treated with 30 mg/kg RO4929097 daily ± 50 mg/kg tipifarnib twice per day (n = 5) for 14 days. Data presented are median tumor sizes ± interquartile range. ∗p = 0.013, combination versus vehicle, by Student's t test.

(B) Kaplan-Meier survival curves for mice bearing intracranial T4302 tumors, which were treated from day 11 to day 30 after tumor inoculation with RO4929097, tipifarnib, or the combination (n = 7) as described above. The hashed rectangle indicates the time frame of drug administration.

See also Figure S6.

Tipifarnib Improves GBM Xenograft Tumor Response to RO4929097 (A) Athymic nude mice bearing subcutaneous T4105 tumors were treated with 30 mg/kg RO4929097 daily ± 50 mg/kg tipifarnib twice per day (n = 5) for 14 days. Data presented are median tumor sizes ± interquartile range. ∗p = 0.013, combination versus vehicle, by Student's t test. (B) Kaplan-Meier survival curves for mice bearing intracranial T4302 tumors, which were treated from day 11 to day 30 after tumor inoculation with RO4929097, tipifarnib, or the combination (n = 7) as described above. The hashed rectangle indicates the time frame of drug administration. See also Figure S6.

Concurrent Inhibition of Farnesyltransferase and γ-Secretase Improves Radiosensitivity

We have previously reported that inhibition of NOTCH using GSIs or RNAi improved radiosensitivity of GBM stem cells (Wang et al., 2010a). Several other preclinical studies also showed that GSIs made GBM more sensitive to standard chemotherapy and radiation (Dantas-Barbosa et al., 2015, Gilbert et al., 2010, Yahyanejad et al., 2016). In addition, the fraction of tumor cells positively stained for NOTCH1 was higher in recurrent GBM samples compared with matched primary tumors (Saito et al., 2015). Radiosensitizing activities have also been reported for FTIs in preclinical models, including tipifarnib (Appels et al., 2005). Therefore, we asked whether targeting both farnesyltransferase and γ-secretase would further improve sensitivity to radiation in GBM stem cells. While both tipifarnib and RO4929097 significantly decreased the viability of irradiated CD133+ cells, the combination of two compounds resulted in nearly complete eradiation of CD133+ cells with concurrent radiation (Figure 6A and S7A). A 3-Gy ionizing radiation reduced the LC50 values of the combination from 90.6 nM to 33.2 nM in T4105 CD133+ cells and from 33.1 nM to 11.2 nM in T4302 CD133+ cells (Figures 6B and S7B–S7D). The CI values in irradiated T4302 CD133+ cells were also substantially lower than those in cells that were not irradiated (Figure 6C).
Figure 6

The Combination of GSIs and FTIs Improves Radiosensitivity in GBM

(A) T4302 CD133+ cells were treated with 100 nM tipifarnib ± 100 nM RO4929097, and also irradiated at 3 Gy, 4 hr after adding drugs. Cell viability was determined 5 days later. ∗p < 0.05, treated versus vehicle; #p < 0.05; combination versus single agent, by Student's t test.

(B) T4302 CD133+ cells were treated with tipifarnib ± RO4929097 following a 3-fold serial dilution and irradiated at 3 Gy in 4 hr. LC50 values were 227 nM for tipifarnib, 386 nM for RO4929097, and 11.2 nM for the combination.

(C) CI values for the combination of tipifarnib and RO4929097 in T4105 CD133+ cells with or without concurrent radiation. ∗p < 0.05 by Student’s t test, 3 Gy versus 0 Gy.

(D) Nude mice bearing intracranial T4302 tumors (n = 7) were treated from day 11 to day 40 after tumor inoculation using the same doses as described in Figure 5. For the first 2 days of the treatment, all mice received 4-Gy radiation 4 hr after drug administration. The hashed rectangle indicates the time frame of drug administration.

See also Figures S6 and S7.

The Combination of GSIs and FTIs Improves Radiosensitivity in GBM (A) T4302 CD133+ cells were treated with 100 nM tipifarnib ± 100 nM RO4929097, and also irradiated at 3 Gy, 4 hr after adding drugs. Cell viability was determined 5 days later. ∗p < 0.05, treated versus vehicle; #p < 0.05; combination versus single agent, by Student's t test. (B) T4302 CD133+ cells were treated with tipifarnib ± RO4929097 following a 3-fold serial dilution and irradiated at 3 Gy in 4 hr. LC50 values were 227 nM for tipifarnib, 386 nM for RO4929097, and 11.2 nM for the combination. (C) CI values for the combination of tipifarnib and RO4929097 in T4105 CD133+ cells with or without concurrent radiation. ∗p < 0.05 by Student’s t test, 3 Gy versus 0 Gy. (D) Nude mice bearing intracranial T4302 tumors (n = 7) were treated from day 11 to day 40 after tumor inoculation using the same doses as described in Figure 5. For the first 2 days of the treatment, all mice received 4-Gy radiation 4 hr after drug administration. The hashed rectangle indicates the time frame of drug administration. See also Figures S6 and S7. The in vivo radiosensitizing effects of the combination therapy were examined using orthotopic GBM models. Mice bearing intracranial T4302 tumors were irradiated 4 hr after the first dose of tipifarnib, RO4929097, or the combination. This treatment was repeated once on the next day. Subsequently, mice were treated daily with tipifarnib and/or RO4929097 until those in the control group exhibited significant neurological signs. Tipifarnib did not extend the survival of tumor-bearing mice following radiation, while RO4929097 increased the median survival by approximately 10% (45 days versus 41 days, p = 0.012) (Figure 6D). Interestingly, one mouse in the RO4929097 arm remained healthy at the end of the experiment and showed no signs of tumor burden in the brain. The combination of tipifarnib and RO4929097 extended the median survival by approximately 22% (50 versus 41 days, p = 0.004). In this group, one mouse lived for 97 days after tumor implantation prior to developing severe neurological signs. Another mouse was also disease free at the end of the experimental endpoint (120 days). Weight loss at the end of treatment was likely associated with disease progression (Figure S6C). Taken together, these results suggest that the combination of FTIs and GSIs may improve the response to radiotherapy in GBM and induce durable tumor response, potentially through targeting the cancer stem cell subpopulation.

Discussions

GSIs have been assessed in a wide variety of cancers either as a monotherapy or in combination with conventional chemoradiotherapy. Monoclonal antibodies targeting NOTCH receptors or ligands are also in development (Takebe et al., 2015). However, the overall clinical benefits of NOTCH-targeted therapies appear to be modest and transient. Combination approaches hold the promise to improve the outcomes of NOTCH-targeted agents. For example, targeting both EGFR and NOTCH generated synergistic toxicity and reduced the fraction of CSCs in breast cancer and lung cancer models (Dong et al., 2010, Hu et al., 2017). Synergism between GSIs and CDK inhibitors has been reported in acute lymphoblastic leukemia (Rao et al., 2009). NOTCH activity played a critical role to protect GBM stem cells following exposure to PDGFR inhibitors or EGFR inhibitors (Liau et al., 2017). These findings also suggest that mechanisms mediating resistance to NOTCH-targeted therapies may be context dependent. In the current study, we identified a combination therapy of GSIs and FTIs that selectively and synergistically targeted GBM stem cells in vitro. This combination was more effective in vitro and in vivo compared with either agent alone, and when administrated together with radiation, could result in prolonged tumor control in mice carrying intracranial GBM tumors. NOTCH activation has been increasingly described in the CSC subpopulation of GBM and other cancers (Bolos et al., 2009, Lathia et al., 2015). We demonstrated that CD133+ GBM cells expressed higher levels of NOTCH receptors and canonical NOTCH target genes compared with matched CD133− cells. In line with differential NOTCH activation, CD133+ GBM cells responded to RO4929097 at nanomolar concentrations, while CD133− cells were highly resistant. However, RO4929097 alone had limited activities in GBM stem cell cultures or xenograft models. The cytotoxicity of RO4929097 in GBM stem cells was significantly increased when combined with FTIs. Conversely, RO4929097 did not have a significant impact on differentiated GBM cells either alone or in combination with tipifarnib. Both RO4929097 and tipifarnib have been examined in clinical trials of various hematopoietic and solid cancers. RO4929097 has modest activities in a small subset of patients (De Jesus-Acosta et al., 2014, LoConte et al., 2015, Pan et al., 2016, Sahebjam et al., 2013, Tolcher et al., 2012). Although development of this compound was discontinued due to CYP3A4 auto-induction, other NOTCH-targeted agents are under development (De Jesus-Acosta et al., 2014, Tolcher et al., 2012). The clinical efficacy of tipifarnib was also limited in GBM and other cancer types, despite promising preclinical activities (Ducassou et al., 2013, Moyal et al., 2007, Nghiemphu et al., 2011). Our data agreed that neither RO4929097 nor tipifarnib alone had significant activities in subcutaneous and orthotopic GBM models. In contrast, the combination of these two compounds effectively reduced tumor growth and improved survival of mice carrying intracranial tumors. Although the combination therapy is expected to affect the diverse substrates of farnesyltransferase and γ-secretase, mice treated with the combination did not show significant weight loss, suggesting that these two classes of compounds may be safely combined. GBM stem cells were highly sensitive to radiation in the presence of both FTIs and GSIs. Results from our laboratory and several other groups have demonstrated that blockade of NOTCH signaling rendered GBM stem cells more sensitive to radiation or temozolomide (Dantas-Barbosa et al., 2015, Gilbert et al., 2010, Shen et al., 2015, Yahyanejad et al., 2016). Similar findings have been reported in several additional cancer types (Aleksic and Feller, 2008, Lagadec et al., 2013, Mizugaki et al., 2012). Based on these preclinical studies, RO4929097 has been evaluated in combination with the standard chemoradiotherapy in patients with newly diagnosed advanced glioma (Xu et al., 2016). With concurrent temozolomide and radiation, RO4929097 reduced NOTCH activity in tumors and decreased the fraction of CD133+ cells (Xu et al., 2016). Tipifarnib has also been tested concurrently with chemoradiotherapy in GBM patients, but the benefits were limited (Nghiemphu et al., 2011). Our data suggest that either RO4929097 or tipifarnib alone did not significantly improve the response to radiation in the orthotopic GBM model, although one outliner could have been cured with RO4929097 plus radiation. In contrast, the drug combination with concurrent radiation significantly extended the median survival of experimental animals with two cases of durable response. The response of intracranial tumors is consistent with the sensitivity of cultured GBM stem cells to the combination therapy. In contrast, non-stem GBM cells in culture were highly resistant, which appeared to be irrelevant to the outcomes. However, response to the combination therapy with concurrent radiation drastically varied among the experimental animals. One possibility is that two doses of radiation plus the drug combination only had a slight chance to successfully eradicate GBM stem cells, whereas a very small number of surviving CSCs could lead to rapid repopulation of the tumors. As such, further optimization of this combination therapy, such as increasing the number of radiation doses, is necessary to fully understand the therapeutic potential of the combination of GSIs and FTIs. Taken together, our results suggest that the therapeutic response of cultured GBM stem cells may be recapitulated in preclinical models of GBM. Further preclinical optimization and clinical development are needed to determine whether these encouraging findings can be translated into significant clinical benefits. Although the role of NOTCH in CSCs has been reported by many laboratories, GSIs may affect a variety of substrates of γ-secretase in addition to NOTCH (Haapasalo and Kovacs, 2011). Our data suggest that inhibition of both farnesyltransferase and γ-secretase results in more effective suppression of AKT and MAPK signaling than either agent alone. FTIs were initially developed to target RAS proteins through inhibition of their farnesylation and membrane interaction (Appels et al., 2005). However, alternative prenylation of KRAS renders KRAS-mutant cancers largely insensitive to FTIs. Our results suggest that FTIs may modulate upstream regulators of AKT and MAPK in GBM stem cells when combined with GSIs. We also showed that FTIs reduced expression of several cell-cycle regulators and impaired cell-cycle progression. FTIs have been shown to increase radiosensitivity through targeting the G2/M checkpoint mechanisms (Song et al., 2000). Another farnesyltransferase substrate, small GTPase RhoB, is also known to regulate tumor response to radiation through mitosis (Milia et al., 2005). Our data showed that multiple kinase inhibitors targeting cell-cycle regulators partially recapitulated the ability of FTIs to augment response to GSIs. Hence, regulation of cell-cycle progression appears to be another important mechanism implicated in the interaction between FTIs and GSIs. To summarize, our study identified a combination therapy of FTIs and GSIs that selectively target the cancer stem cell subpopulation in GBM. This combination therapy with concurrent radiation induced a durable response in orthotopic GBM models. The compounds tested in our study included two experimental agents that have shown modest efficacy in patients with advanced glioma. Although clinical development of RO4929097 and tipifarnib has been discontinued, our results suggest a potential revisit of NOTCH-targeted therapy with the objective to improve the response of GBM to the standard chemoradiotherapy.

Experimental Procedures

Cell Cultures

T4105, T4302, and T4597 primary GBM xenograft tumors were provided by Jeremy Rich at Cleveland Clinic. UAB-1005, 1027A, 1051, and 1079 were GBM patient-derived stem cell lines propagated in vitro. VU10369 and VU11044 were passage 3 primary xenograft tumors derived from GBM surgical specimens obtained through the Vanderbilt Molecular Neurosurgical Tissue Bank in accordance with protocols approved by the Institutional Review Board. NHNPs were purchased from Lonza. Matched cultures enriched or depleted for the CD133+ CSC subpopulation were prepared following methods described in our previous publications (Cheng et al., 2013, Wang et al., 2010a). Briefly, cells were derived from enzymatically dissociated subcutaneous xenograft tumors and magnetically sorted using the CD133 Microbead Kit following the manufacturer's instructions (Miltenyi Biotec). GBM stem cells and unsorted cells were maintained in neurobasal medium supplemented with the B-27 supplement without vitamin A (Thermo Fisher Scientific), 20 ng/mL human EGF, and 20 ng/mL human bFGF (R&D Systems). GBM cells depleted for the CD133+ fraction were maintained in DMEM supplemented with 10% fetal bovine serum (Atlantic Biologicals). All cells were cultured at 37°C with 5% CO2 and maintained for no more than six passages.

Subcutaneous and Orthotopic GBM Models

All animal experiments were performed in accordance with a protocol approved by the Vanderbilt University Institutional Animal Care and Use Committee. For subcutaneous models, half million T4105 CD133+ cells were bilaterally injected into flanks of female athymic nude mice. Ten days after implantation, most tumors were palpable. Tumor-bearing mice were randomized into 4 groups (n = 5) and treated via oral gavage with vehicle, 30 mg/kg RO4929097 once per day, 50 mg/kg tipifarnib twice per day, or the combination. Tumor sizes were determined using a formula of length × width × width ÷ 2. For orthotopic models, 5,000 T4302 CD133+ cells were injected into the right cortex of female nude mice. Ten days after tumor cell injection, mice were randomized (n = 7) and treated as described above. Treatment continued daily for 20 days. In an independent experiment, T4302 intracranial tumors were established and treated following the same procedure. However, during the first 2 days of treatment, all mice received one fraction of 4-Gy X-ray radiation each day at 4 hr after drug administration. Mice in this experiment were treated for 30 days in total. Animals were killed when significant adverse symptoms were observed, such as lethargy or hunched posture.

Statistics

All in vitro results are presented as means ± SD (n = 3 independent experiments), unless otherwise indicated. Individual experiments included at least three technical replicates for each condition. CI values were calculated following the Chou-Talalay statistical method using the CompuSyn software. p values of pairwise comparison were calculated according to the two-tailed Student's t test using the GraphPad Prism 5.0 software. For in vivo results, n stands for mouse numbers in each arm. The median survival was determined by the Kaplan-Meier estimator. Significance for survival was determined by the log rank test. p values of less than 0.05 were considered significant.

Author Contributions

Experimental Design, Data Collection, and Analysis, Y.M., Z.C., J.L., and L.T.-H.; Data Analysis, Manuscript Writing, and Financial Support, J.D.L., R.C.T., I.N., Y.G., and M.L.F.; Conception and Experimental Design, Data Analysis, Financial Support, Manuscript Writing, and Final Approval of Manuscript, J.W.
  59 in total

1.  Gamma-secretase inhibitors enhance temozolomide treatment of human gliomas by inhibiting neurosphere repopulation and xenograft recurrence.

Authors:  Candace A Gilbert; Marie-Claire Daou; Richard P Moser; Alonzo H Ross
Journal:  Cancer Res       Date:  2010-08-24       Impact factor: 12.701

2.  Effect of Notch expression in glioma stem cells on therapeutic response to chemo-radiotherapy in recurrent glioblastoma.

Authors:  Norihiko Saito; Kazuya Aoki; Nozomi Hirai; Satoshi Fujita; Junya Iwama; Yu Hiramoto; Masashi Ishii; Kenichiro Sato; Haruo Nakayama; Junichi Harashina; Morito Hayashi; Hideaki Izukura; Hitoshi Kimura; Keisuke Ito; Takatoshi Sakurai; Yuki Yokouchi; Toshiaki Oharazeki; Kei Takahashi; Satoshi Iwabuchi
Journal:  Brain Tumor Pathol       Date:  2015-02-10       Impact factor: 3.298

3.  Phase I pharmacologic and pharmacodynamic study of the gamma secretase (Notch) inhibitor MK-0752 in adult patients with advanced solid tumors.

Authors:  Ian Krop; Tim Demuth; Tina Guthrie; Patrick Y Wen; Warren P Mason; Prakash Chinnaiyan; Nicholas Butowski; Morris D Groves; Santosh Kesari; Steven J Freedman; Samuel Blackman; James Watters; Andrey Loboda; Alexei Podtelezhnikov; Jared Lunceford; Cong Chen; Maxine Giannotti; Jeremy Hing; Robert Beckman; Patricia Lorusso
Journal:  J Clin Oncol       Date:  2012-04-30       Impact factor: 44.544

4.  A phase I trial of tipifarnib with radiation therapy, with and without temozolomide, for patients with newly diagnosed glioblastoma.

Authors:  Phioanh Leia Nghiemphu; Patrick Y Wen; Kathleen R Lamborn; Jan Drappatz; H Ian Robins; Karen Fink; Mark G Malkin; Frank S Lieberman; Lisa M DeAngelis; Alejandro Torres-Trejo; Susan M Chang; Lauren Abrey; Howard A Fine; Alexis Demopoulos; Andrew B Lassman; Santosh Kesari; Minesh P Mehta; Michael D Prados; Timothy F Cloughesy
Journal:  Int J Radiat Oncol Biol Phys       Date:  2010-10-08       Impact factor: 7.038

5.  Inhibition of BET bromodomain targets genetically diverse glioblastoma.

Authors:  Zhixiang Cheng; Yuanying Gong; Yufang Ma; Kaihua Lu; Xiang Lu; Larry A Pierce; Reid C Thompson; Susanne Muller; Stefan Knapp; Jialiang Wang
Journal:  Clin Cancer Res       Date:  2013-02-12       Impact factor: 12.531

6.  αvβ3 Integrin and Fibroblast growth factor receptor 1 (FGFR1): Prognostic factors in a phase I-II clinical trial associating continuous administration of Tipifarnib with radiotherapy for patients with newly diagnosed glioblastoma.

Authors:  Anne Ducassou; Emmanuelle Uro-Coste; Pierre Verrelle; Thomas Filleron; Alexandra Benouaich-Amiel; Vincent Lubrano; Jean-Christophe Sol; Marie-Bernadette Delisle; Gilles Favre; Solea Ken; Anne Laprie; Peter De Porre; Christine Toulas; Muriel Poublanc; Elizabeth Cohen-Jonathan Moyal
Journal:  Eur J Cancer       Date:  2013-04-06       Impact factor: 9.162

7.  Phase I study of the gamma secretase inhibitor PF-03084014 in combination with docetaxel in patients with advanced triple-negative breast cancer.

Authors:  Marzia A Locatelli; Philippe Aftimos; E Claire Dees; Patricia M LoRusso; Mark D Pegram; Ahmad Awada; Bo Huang; Rossano Cesari; Yuqiu Jiang; M Naveed Shaik; Kenneth A Kern; Giuseppe Curigliano
Journal:  Oncotarget       Date:  2017-01-10

8.  A phase II study of the gamma secretase inhibitor RO4929097 in patients with previously treated metastatic pancreatic adenocarcinoma.

Authors:  Ana De Jesus-Acosta; Daniel Laheru; Anirban Maitra; John Arcaroli; Michelle A Rudek; Arvind Dasari; Patrick J Blatchford; Kevin Quackenbush; Wells Messersmith
Journal:  Invest New Drugs       Date:  2014-03-27       Impact factor: 3.850

9.  Inhibition of the NOTCH pathway using γ-secretase inhibitor RO4929097 has limited antitumor activity in established glial tumors.

Authors:  Carmela Dantas-Barbosa; Guillaume Bergthold; Estelle Daudigeos-Dubus; Heike Blockus; John F Boylan; Celine Ferreira; Stephanie Puget; Michel Abely; Gilles Vassal; Jacques Grill; Birgit Geoerger
Journal:  Anticancer Drugs       Date:  2015-03       Impact factor: 2.248

10.  Increased Notch Signaling Enhances Radioresistance of Malignant Stromal Cells Induced by Glioma Stem/ Progenitor Cells.

Authors:  Yuntian Shen; Hua Chen; Jinshi Zhang; Yanming Chen; Mengyao Wang; Jiawei Ma; Lei Hong; Ning Liu; Qiuhong Fan; Xueguan Lu; Ye Tian; Aidong Wang; Jun Dong; Qing Lan; Qiang Huang
Journal:  PLoS One       Date:  2015-11-23       Impact factor: 3.240

View more
  6 in total

Review 1.  Glioblastoma: Current Status, Emerging Targets, and Recent Advances.

Authors:  Amandeep Thakur; Chetna Faujdar; Ram Sharma; Sachin Sharma; Basant Malik; Kunal Nepali; Jing Ping Liou
Journal:  J Med Chem       Date:  2022-07-05       Impact factor: 8.039

2.  Wild-type TP53 defined gamma-secretase inhibitor sensitivity and synergistic activity with doxorubicin in GSCs.

Authors:  Chen Zhang; Emmanuel Martinez-Ledesma; Feng Gao; Wei Zhang; Jie Ding; Shaofang Wu; Xiaolong Li; Jimin Wu; Ying Yuan; Dimpy Koul; W K Alfred Yung
Journal:  Am J Cancer Res       Date:  2019-08-01       Impact factor: 6.166

3.  Androgen receptor-regulated circFNTA activates KRAS signaling to promote bladder cancer invasion.

Authors:  Jinbo Chen; Yin Sun; Zhenyu Ou; Shuyuan Yeh; Chi-Ping Huang; Bosen You; Yu-Chieh Tsai; Tzong-Jen Sheu; Xiongbing Zu; Chawnshang Chang
Journal:  EMBO Rep       Date:  2020-02-13       Impact factor: 8.807

Review 4.  Unlocking the Secrets of Cancer Stem Cells with γ-Secretase Inhibitors: A Novel Anticancer Strategy.

Authors:  Maryam Ghanbari-Movahed; Zahra Ghanbari-Movahed; Saeideh Momtaz; Kaitlyn L Kilpatrick; Mohammad Hosein Farzaei; Anupam Bishayee
Journal:  Molecules       Date:  2021-02-12       Impact factor: 4.411

5.  LncRNA SLC16A1-AS1 is Upregulated in Glioblastoma and Promotes Cancer Cell Proliferation by Regulating miR-149 Methylation.

Authors:  Yinbo Long; Heyang Li; Zhibin Jin; Xiang Zhang
Journal:  Cancer Manag Res       Date:  2021-02-10       Impact factor: 3.989

Review 6.  Cancer Stem Cells: Powerful Targets to Improve Current Anticancer Therapeutics.

Authors:  Rayana L Bighetti-Trevisan; Lucas O Sousa; Rogerio M Castilho; Luciana O Almeida
Journal:  Stem Cells Int       Date:  2019-11-12       Impact factor: 5.443

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.