Literature DB >> 22629288

Adverse events in patients with blood loss: a pooled analysis of 51 clinical studies from the celecoxib clinical trial database.

Gh Sands1, B Shell, R Zhang.   

Abstract

BACKGROUND: Chronic use of nonsteroidal anti-inflammatory drugs (NSAIDs) is associated with an increased risk of gastrointestinal (GI) toxicity, including occult blood loss and the development of clinically significant anemia. The aim of this study was to investigate the clinical importance of clinically significant anemia/blood loss.
METHODS: Pooled analysis of 51 blinded, controlled clinical studies ≥4 weeks duration from the celecoxib clinical trial database, comparing celecoxib with NSAIDs or placebo. The adverse event (AE) profile in patients with clinically significant anemia/blood loss (defined as decreases in hemoglobin ≥2 g/dL and/or hematocrit by ≥10% from baseline) was compared with the AE profile in patients without blood loss. Events that occurred in <0.5% of patients were excluded from any comparisons. A threefold difference between groups was defined arbitrarily as being markedly higher.
RESULTS: Overall 932/51,048 patients experienced clinically significant anemia/blood loss. Baseline demographics were similar in both groups. The incidence of AEs was markedly higher in patients who experienced clinically significant anemia/blood loss than those who did not; the majority of these differences were for GI AEs or their likely sequelae. The incidence of the following non-GI related AEs was also markedly higher in patients with blood loss: coronary artery disease (1.2% vs 0.3%), myocardial infarction (0.6% vs 0.2%), and pneumonia (1.7% vs 0.4%). Withdrawals due to AEs were more common among patients who experienced blood loss (16.7% vs 10.4%).
CONCLUSIONS: Clinically significant anemia/blood loss may have clinically important adverse consequences beyond the sequelae previously known to be associated with NSAID-related GI effects.

Entities:  

Keywords:  Blood loss; GI.; NSAIDs

Year:  2012        PMID: 22629288      PMCID: PMC3358714          DOI: 10.2174/1874312901206010044

Source DB:  PubMed          Journal:  Open Rheumatol J        ISSN: 1874-3129


INTRODUCTION

Nonsteroidal anti-inflammatory drugs (NSAIDs) are effective anti-inflammatory, antipyretic, and analgesic agents and are among the most widely prescribed drugs worldwide [1]. However, despite their accepted efficacy, it is well recognized that use of NSAIDs is associated with an increased risk of gastrointestinal (GI) damage, including overt bleeding, ulceration, occult blood loss, and the development of clinically significant anemia or blood loss [2, 3]. Recent evidence suggests some patients with mildly low or low-normal hemoglobin levels may have an increased risk of frailty, poor functional outcomes, hospitalization, and mortality [4-7]. In the recent Celecoxib versus Omeprazole and Diclofenac in Patients with Osteoarthritis and Rheumatoid Arthritis (CONDOR) randomized clinical trial [8] comparing the risk of GI events through the entire GI tract, clinically significant anemia or blood loss (predefined as a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% points from baseline) was an important component of the composite primary GI endpoint [8]. Although blood loss is common in patients taking NSAIDs, few studies have been performed to determine the exact burden and clinical impact of this problem in patients taking NSAIDs or aspirin, or to determine whether blood loss is associated with other more clinically apparent adverse events (AEs). The objective of this analysis of pooled data from the celecoxib clinical trial database, including both patients treated with NSAIDs and placebo, was to investigate whether there is a clinically important difference in the AE profile of patients with clinically significant anemia or blood loss (predefined as a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% points from baseline) compared with patients without such blood loss, regardless of treatment.

MATERIALS AND METHODOLOGY

Study Design and Selection

This was a retrospective, pooled analysis of 51 blinded, controlled clinical studies comparing celecoxib, a cyclooxygenase (COX)-2 selective NSAID, with other COX-2 selective and nonselective NSAIDs (nsNSAIDs) or placebo. To be eligible for inclusion, all clinical study reports (from Pfizer’s Celecoxib Clinical Trial Database) must have been finalized by October 1, 2007; only randomized, double-blind controlled clinical trials with at least one celecoxib and one comparator (active or placebo) group, of a planned duration of daily treatment ≥4 weeks, were included. All open-label extensions, crossover trials, and healthy volunteer studies were excluded. With these criteria applied, the resulting pooled dataset represents both male and female patients with osteoarthritis (OA), rheumatoid arthritis (RA), ankylosing spondylitis (AS), chronic low back pain, Alzheimer disease, and/or spontaneous adenomatous colorectal polyps.

Data Collection

The primary end point was blood loss status (Y/N) defined as “Yes” if a patient had a ≥2 g/dL hemoglobin drop and/or ≥10% hematocrit drop from baseline. This definition is consistent with the definition of clinically significant anemia or blood loss used (as a component of the composite primary GI end point) in both the CONDOR and Gastrointestinal Randomized Event and Safety Open-label NSAID Study (GI-REASONS) randomized clinical trials [8, 9]; the GI-REASONS study uses a prospectively randomized open-label blinded end point (PROBE) design (neither the CONDOR or GI-REASONS trials were included in this analysis, as they did not meet the clinical study report finalization date criterion). To determine whether there were any clinically important consequences in patients with blood loss as defined above, the AE profile in patients with the blood loss status “Yes” was compared with the AE profile in patients without such blood loss. For the primary analysis, an AE was considered to be associated with blood loss if it occurred at any time during the time window from the last laboratory day normal hemoglobin/hematocrit values were recorded (before the first hemoglobin/hematocrit decrease), to the day hemoglobin/hematocrit values returned to normal 30 days after the hemoglobin/hematocrit decrease, whichever occurred first (Fig. ).

Statistical Analysis

The pooled analysis was performed on the safety population (all patients who were randomized in any of the included 51 clinical trials who took at least one dose of study medication and who had at least one safety assessment). Summary statistics were used to compare AE profiles (preferred AE terms based on Medical Dictionary for Regulatory Activities, MedDRA 11.0) in patients who had clinically significant blood loss (“Yes” for the primary end point) versus patients who did not (“No” for the primary end point). When comparing the percentage of patients with specific AEs between the groups, a threefold difference was defined arbitrarily as being “markedly higher”; any AE that occurred for <0.5% of patients in both groups was excluded from treatment comparisons.

RESULTS

Included Studies

A total of 51 double-blind, randomized clinical trials met the criteria for inclusion and were pooled for this retrospective analysis (please see list of clinical trials, including details on study duration and comparator treatments in Table ). Study duration ranged from 4 weeks to 3 years. One study was event-driven, and thus patients in this study were exposed to study medication for different durations (median duration of 6-9 months), rather than for a protocol-defined time period.

PATIENTS

Generally, the majority of patients with clinically significant blood loss were approximately 1-year older than those without blood loss (mean age, 61 years vs 60 years, respectively; Table ). Overall 932/51,048 (1.83%) patients in the 51 studies described above experienced clinically significant anemia or blood loss (predefined by a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% from baseline). The majority of patients in both groups had follow-up for >6 months, and baseline demographics were similar when patients with clinically significant blood loss were compared with those without (Table ) such blood loss.

End Points

In general, patients with clinically significant blood loss had a higher incidence of AEs than those who did not (66% and 58%, respectively; Table ). The majority of the difference between groups could be accounted for by AEs representing GI disorders or their likely sequelae. The specific AEs of this type that were markedly increased (defined as greater than threefold difference) for patients with clinically significant blood loss versus those without it were: gastric ulcer (1.5% vs 0.2%, respectively); GI hemorrhage (0.8% vs <0.1%); esophageal ulcer (0.5% vs <0.1%); melena (1.3% vs 0.1%); anemia (8.8% vs 0.6%); increase in blood creatinine (1.7% vs 0.4%); decrease in hemoglobin (8.9% vs 0.2%); decrease in hematocrit (10.4% vs 0.5%); decrease in red blood cell count (0.8% vs <0.1%); and hematochezia (1.0% vs 0.3%). However, the incidence of the following non-GI related AEs was also markedly higher in patients with clinically significant blood loss compared with patients without such blood loss: coronary artery disease (1.2% vs 0.3%, respectively), myocardial infarction (0.6% vs 0.2%), and pneumonia (1.7% vs 0.4%). Withdrawals due to AEs were more common among patients who had clinically significant blood loss (17%) than among those who did not (10%) have such blood loss.

DISCUSSION

The findings of this retrospective pooled analysis support the hypothesis that a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% points from baseline represents a clinically relevant event. As might be expected, hematologic observations of this type may be associated with pathophysiologic processes that result in either overt bleeding (e.g. GI hemorrhage and melena) or lesions that may reasonably be expected to account for bleeding that cannot be observed directly (e.g. gastric and esophageal ulcers). However, pathophysiologic states resulting from such blood loss, for example a reduction in oxygen-carrying capacity or a compromised immune system, may explain the increased incidence of particular non-GI AEs observed in patients with blood loss (e.g. myocardial infarction, coronary artery disease, and pneumonia). As these kinds of events are relatively rare in clinical trial populations, it is not clear whether the inability to detect other non-GI events of related etiology in this current analysis was a result of underpowering due to limited sample size or due to more mechanistic effects. The goal of this analysis was to better understand the clinical implications of a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% points from baseline over time. Both the CONDOR [8, 9] and GI-REASONS [9] trials included this measure of clinically significant blood loss as a component of the predefined composite primary GI end point for “Clinically Significant Upper and Lower GI Events.” In contrast to the current analysis, the end point, in these two clinical trials, was adjudicated by an independent expert blinded panel to be of confirmed or likely GI source. We now know the majority of the primary end point events in CONDOR were adjudicated as meeting this prespecified definition of clinically significant blood loss rather than the more traditional end point for evaluation of GI effects for NSAIDs—GI perforations, ulcers, or overt bleeds (PUBs), or “ulcer complications” [8]. Thus, the results of this current respective analysis of data from 51 clinical studies may help to establish the clinical importance of blood loss events that are not readily identifiable as PUBs. The findings of the CONDOR trial [8] and the previous Celecoxib Long-term Arthritis Safety Study (CLASS) [10] suggest clinically significant blood loss, as defined in the current analysis and the CONDOR trial, is a consequence of the effects of NSAIDs on GI physiology. In both CONDOR and CLASS, decreases in hemoglobin ≥2 g/dL occurred similarly over time, despite differences in trial design, and were prevalent in these patients treated with NSAIDs [11]. In another recent study of 892 randomized participants with chronic knee pain, who were treated with either non-prescription doses of ibuprofen and acetaminophen or two different non-prescription dose combinations of ibuprofen/acetaminophen, up to approximately 18% of all participants had decreases of hemoglobin ≥2 g/dL in the various treatment groups, supporting the clinical relevance of this safety measure [12]. Of these three trials for which published data are available, CLASS and CONDOR had decreases in hemoglobin ≥2 g/dL prespecified for analysis; in the CONDOR trial (but not the CLASS trial) these decreases were also adjudicated for association with GI sources. Strand et al., analyzed 14 randomized clinical trials from the celecoxib database, including more than 14,000 arthritis patients, and discovered treatment in patients with decreases in hemoglobin ≥2 g/dL was associated with no improvement in physical function, contrasting to those patients with no decreases in hemoglobin. Following treatment, the latter group of patients demonstrated improvements in physical functioning, as assessed by the Medical Outcomes Study Short Form with 36 questions (SF-36) [13].

STRENGTHS/LIMITATIONS

One of the strengths of this analysis was the inclusion of more than 51,000 patients with active disease—OA, RA, or AS—giving a robust sample size. A second strength, was the use of the prespecified definition of clinically significant anemia or blood loss (previously used in both the CONDOR and GI-REASONS randomized clinical trials). However, we should be cautious when interpreting these findings as even in this analysis population of more than 51,000 patients, some of the specific AEs examined occurred in too few patients to provide the most robust information. Furthermore, analysis of trials solely from the celecoxib trial database might exclude relevant trials conducted elsewhere, and while many of the randomized controlled trials included in this pooled analysis had a similar study structure, they were not identical, which could potentially have introduced bias.

CONCLUSION

Clinically significant anemia or blood loss, defined as decreases in hemoglobin ≥2 g/dL and/or hematocrit by ≥10% from baseline, may have clinically important adverse consequences beyond the sequelae previously known to be associated with NSAID-related GI effects. The discovery of gastric and esophageal ulcers in the group of patients with a markedly higher incidence of clinically significant blood loss suggests possible occult GI bleeding from this source. The markedly increased incidence for some non-GI related AE terms suggests clinically significant blood loss may be especially important in those patients needing all of their oxygen-carrying capacity. Further studies are required to better understand the clinical importance of clinically significant anemia or blood loss.
Table 1.

Clinical Studies Included in the Pooled Analysis

Duration of TreatmentTreatment Groups
Osteoarthritis and/or Rheumatoid Arthritis
N49-96-02-0124 Wksplacebo, celecoxib 40 mg BID, celecoxib 200 mg BID, celecoxib 400 mg BID
N49-96-02-02012 Wksplacebo, celecoxib 50 mg BID, celecoxib 100 mg BID, celecoxib 200 mg BID, naproxen 500 mg BID
N49-96-02-02112 Wksplacebo, celecoxib 50 mg BID, celecoxib 100 mg BID, celecoxib 200 mg BID, naproxen 500 mg BID
N49-96-02-02212 Wksplacebo, celecoxib 100 mg BID, celecoxib 200 mg BID, celecoxib 400 mg BID, naproxen 500 mg BID
N49-96-02-02312 Wksplacebo, celecoxib 100 mg BID, celecoxib 200 mg BID, celecoxib 400 mg BID, naproxen 500 mg BID
I49-96-02-04124 Wkscelecoxib 200 mg BID, diclofenac SR 75 mg BID
I49-96-02-0426 Wkscelecoxib 100 mg BID, diclofenac 50 mg BID
N49-96-02-0474 Wksplacebo, celecoxib 25 mg BID, celecoxib 100 mg BID, celecoxib 400 mg BID
N49-96-02-05412 Wksplacebo, celecoxib 50 mg BID, celecoxib 100 mg BID, celecoxib 200 mg BID, naproxen 500 mg BID
N49-96-02-0606 Wksplacebo, celecoxib 100 mg BID, celecoxib 200 mg QD
N49-96-02-06212 Wkscelecoxib 200 mg, naproxen 500 mg BID
N49-96-02-07112 Wkscelecoxib 200 mg BID, diclofenac 75 mg BID, Ibuprofen 800 mg TID
N49-96-02-0876 Wksplacebo, celecoxib 100 mg BID, celecoxib 200 mg QD
I49-96-02-09612 Wkscelecoxib 100 mg BID, celecoxib 200 mg BID, diclofenac 50 mg BID, naproxen 500 mg BID
N49-96-02-035/102 (CLASS trial)Event-driven: median 6-9 monthscelecoxib 400 mg BID, ibuprofen 800 mg TID, diclofenac 75 BID
I49-96-02-10512 Wkscelecoxib 100 mg BID, diclofenac 50 mg BID
I49-96-02-10612 Wkscelecoxib 100 mg BID, diclofenac 50 mg BID
I49-96-02-10712 Wkscelecoxib 100 mg BID, diclofenac 50 mg BID
N49-96-02-1186 Wksplacebo, celecoxib 100 mg BID, diclofenac 50 mg TID
N49-96-02-1496 Wkscelecoxib 200 mg QD, rofecoxib 25 mg QD
N49-96-02-1526 Wkscelecoxib 200 mg QD, rofecoxib 25 mg QD
N49-96-02-1816 Wkscelecoxib 200 mg QD, rofecoxib 25 mg QD
J49-01-02-2164 Wksplacebo, celecoxib 100 mg BID, loxoprofen 60 mg TID
635-IFL-0508-00212 Wkscelecoxib 200 mg QD, rofecoxib 25 mg QD, naproxen 500 mg BID
635-IFL-0508-0036 Wksplacebo, celecoxib 200 mg QD, rofecoxib 25 mg QD
A319100652 Wkscelecoxib 200 mg QD, diclofenac 50 mg BID
A31910251 yracelecoxib 200 mg QD, diclofenac 50 mg BID
A31910516 Wksplacebo, celecoxib 200 mg QD, naproxen 500 mg BID
A31910526 Wksplacebo, celecoxib 200 mg QD, naproxen 500 mg BID
A31910536 Wksplacebo, celecoxib 200 mg QD, naproxen 500 mg BID
A31910626 Wksplacebo, celecoxib 200 mg QD, ibuprofen 800 mg TID
A31910636 Wksplacebo, celecoxib 200 mg QD, ibuprofen 800 mg TID
A31910696 Wksplacebo, celecoxib 200 mg QD
A31910826 Wksplacebo, celecoxib 200 mg QD
A31911526 Mthscelecoxib 200 mg QD, naproxen 500 mg BID
COXA-0508-26112 Wkscelecoxib 200 mg QD, diclofenac 50 mg TID
Ankylosing Spondylitis
F49-98-02-1376 Wksplacebo, celecoxib 100 mg BID, ketoprofen 100 mg BID
N49-01-02-19312 Wksplacebo, celecoxib 200 mg QD, celecoxib 400 mg QD, naproxen 500 mg BID
COXA-0503-24312 Wkscelecoxib 200 mg QD, celecoxib 200 mg BID, diclofenac 75 mg SR BID
COXA-0503-24712 Wkscelecoxib 200 mg QD, celecoxib 400 mg QD, diclofenac 75 mg TID
Chronic Low Back Pain
J49-01-02-2174 Wkscelecoxib 100 mg BID, loxoprofen 60 mg TID
COXA-0508-24412 Wksplacebo, celecoxib 200 mg QD
COXA-0508-24512 Wksplacebo, celecoxib 200 mg QD
COXA-0508-26912 Wksplacebo, celecoxib 200 mg QD, celecoxib 200 mg BID
A31911744 Wkscelecoxib 200 mg BID, loxoprofen 60 mg TID
Alzheimer Disease
IQ5-97-02-00152 Wksplacebo, celecoxib 200 mg BID
EQ5-98-02-0023 yraplacebo, celecoxib 200 mg BID
NQ5-98-02-0054 Wksplacebo, celecoxib 200 mg BID
Spontaneous Colorectal Adenomatous Polyps
NQ4-00-02-01112 Wksaplacebo, celecoxib 100 mg BID, celecoxib 200 mg BID, celecoxib 400 mg BID
EQ4-00-02-0183 yaplacebo, celecoxib 400 mg QD
IQ4-99-02-0053yaplacebo, celecoxib 200 mg BID, celecoxib 400 mg BID

For this analysis, blood loss was predefined as a decrease in hemoglobin ≥2 g/dL and/or hematocrit ≥10% from baseline.

QD: once daily; BID: twice daily; TID: three times daily.

Treatment with study medication was suspended or terminated early.

Table 2.

Baseline Demographics and Characteristics of Patients Included in the Pooled Analysis

Patients with Blood Loss (n=932)Patients without Blood Loss (n=50,116)
Age, y
Mean6160
Median6161
Range21-9117-96
Race, n (%)
White746 (80)38,166 (76)
Black54 (5.8)3218 (6.4)
Asian102 (11)5518 (11)
Other29 (3)2970 (66)
Missing1 (0.1)244 (0.5)
Sex, n (%)
Female547 (59)32,861 (66)
Male385 (41)17,255 (34)
Weight, kg
Female, n (%)544 (58)32,778 (65)
Mean7276
Median6973
Range36-16332-250
Weight, kg
Male, n (%)383 (41)17,225 (34)
Mean8788
Median8685
Range48-15835-232
Table 3.

Adverse Events (AEs) in Patients with Clinically Significant Anemia/Blood Lossa Versus those Without (Threshold ≥0.5%)

AEs, n (%)bPatients with Blood Loss (n=932)Patients without Blood Loss (n=50,116)
Any AE612 (66)29,222 (58)
GI-Related AEs
Gastric ulcer14 (1.5)101 (0.2)
GI hemorrhage7 (0.8)33 (< 0.1)
Esophageal ulcer5 (0.5)24 (< 0.1)
Melena12 (1.3)57 (0.1)
Potential GI-Related AEs
Anemia82 (8.8)317 (0.6)
Increase in blood creatinine16 (1.7)207 (0.4)
Decrease in hemoglobin83 (8.9)120 (0.2)
Decrease in hematocrit97 (10.4)228 (0.5)
Decrease in red blood cell count7 (0.8)23 (< 0.1)
Hematochezia9 (1.0)126 (0.3)
Non-GI-Related AEs
Coronary artery disease11 (1.2)144 (0.3)
Myocardial infarction6 (0.6)99 (0.2)
Pneumonia16 (1.7)202 (0.4)

Markedly higher, i.e. threefold difference between treatment groups in the incidence of AEs.

Preferred terms based on MedDRA 11.0.

  12 in total

1.  Late-life anemia is associated with increased risk of recurrent falls.

Authors:  Brenda W J H Penninx; Saskia M F Pluijm; Paul Lips; Richard Woodman; Kor Miedema; Jack M Guralnik; Dorly J H Deeg
Journal:  J Am Geriatr Soc       Date:  2005-12       Impact factor: 5.562

2.  Anemia in old age is associated with increased mortality and hospitalization.

Authors:  Brenda W J H Penninx; Marco Pahor; Richard C Woodman; Jack M Guralnik
Journal:  J Gerontol A Biol Sci Med Sci       Date:  2006-05       Impact factor: 6.053

Review 3.  Strategies to optimize treatment with NSAIDs in patients at risk for gastrointestinal and cardiovascular adverse events.

Authors:  James M Scheiman; Clemence E Hindley
Journal:  Clin Ther       Date:  2010-04       Impact factor: 3.393

4.  Gastrointestinal toxicity with celecoxib vs nonsteroidal anti-inflammatory drugs for osteoarthritis and rheumatoid arthritis: the CLASS study: A randomized controlled trial. Celecoxib Long-term Arthritis Safety Study.

Authors:  F E Silverstein; G Faich; J L Goldstein; L S Simon; T Pincus; A Whelton; R Makuch; G Eisen; N M Agrawal; W F Stenson; A M Burr; W W Zhao; J D Kent; J B Lefkowith; K M Verburg; G S Geis
Journal:  JAMA       Date:  2000-09-13       Impact factor: 56.272

5.  What constitutes normal hemoglobin concentration in community-dwelling disabled older women?

Authors:  Paulo H M Chaves; Qian-Li Xue; Jack M Guralnik; Luigi Ferrucci; Stefano Volpato; Linda P Fried
Journal:  J Am Geriatr Soc       Date:  2004-11       Impact factor: 5.562

6.  Celecoxib versus omeprazole and diclofenac in patients with osteoarthritis and rheumatoid arthritis (CONDOR): a randomised trial.

Authors:  Francis K L Chan; Angel Lanas; James Scheiman; Manuela F Berger; Ha Nguyen; Jay L Goldstein
Journal:  Lancet       Date:  2010-06-16       Impact factor: 79.321

7.  A novel composite endpoint to evaluate the gastrointestinal (GI) effects of nonsteroidal antiinflammatory drugs through the entire GI tract.

Authors:  Francis K L Chan; Byron Cryer; Jay L Goldstein; Angel Lanas; David A Peura; James M Scheiman; Lee S Simon; Gurkirpal Singh; Martin J Stillman; Charles M Wilcox; Manuela F Berger; Aurora Breazna; William Dodge
Journal:  J Rheumatol       Date:  2009-11-02       Impact factor: 4.666

Review 8.  Anemia in the elderly: current understanding and emerging concepts.

Authors:  Richard Eisenstaedt; Brenda W J H Penninx; Richard C Woodman
Journal:  Blood Rev       Date:  2006-02-10       Impact factor: 8.250

9.  Gastrointestinal damage associated with the use of nonsteroidal antiinflammatory drugs.

Authors:  M C Allison; A G Howatson; C J Torrance; F D Lee; R I Russell
Journal:  N Engl J Med       Date:  1992-09-10       Impact factor: 91.245

10.  Haemoglobin decreases in NSAID users over time: an analysis of two large outcome trials.

Authors:  J L Goldstein; F K L Chan; A Lanas; C M Wilcox; D Peura; G H Sands; M F Berger; H Nguyen; J M Scheiman
Journal:  Aliment Pharmacol Ther       Date:  2011-08-02       Impact factor: 8.171

View more
  1 in total

1.  Triggering of suicidal erythrocyte death by celecoxib.

Authors:  Adrian Lupescu; Rosi Bissinger; Kashif Jilani; Florian Lang
Journal:  Toxins (Basel)       Date:  2013-09-10       Impact factor: 4.546

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.