Literature DB >> 34190183

Efficacy and safety of ibuprofen in children with musculoskeletal injuries: A systematic review and meta-analysis of randomized controlled trials.

Jianping Jin1, Xiaoqing Wang, Jingjing Wang, Zhanhai Wan.   

Abstract

OBJECTIVE: To evaluate the analgesic efficacy and safety of ibuprofen in children with musculoskeletal injuries.
METHODS: PubMed, EMBASE, Web of science, and the Cochrane Central register of Controlled Trials (CENTRAL) were systematically searched to identify eligible randomized controlled trials (RCTs) that compared ibuprofen with other analgesics for pain relief in children with musculoskeletal injuries. Primary outcomes included change of visual analog scale (VAS) scores from baseline to post-medication, the proportion of patients achieving adequate analgesia, and the proportion of patients requiring additional analgesia. Secondary outcome was the incidence of adverse effects. Data analysis was performed using RevMan 5.3 software.
RESULTS: Five RCTs involving 1034 patients were included in this meta-analysis. Compared to the control group, change of VAS scores was greater in ibuprofen group at 60 min (standardized mean difference [SMD] = 0.28; 95% confidence intervals [CI], 0 to 0.57; P = .05), 90 min (SMD = 0.38; 95% CI, 0.17 to 0.59; P = .0005), and 120 min (SMD = 0.4; 95% CI, 0.23 to 0.57; P < .00001) after treatment. No difference was found in the change of VAS scores at 30 min (SMD = 0.07; 95% CI, -0.08 to 0.22; P = .36) after treatment. The proportion of patients who received adequate analgesia was higher in the ibuprofen group (risk ratios [RR] = 1.36; 95% CI, 1.20 to 1.56; P < .00001). The proportion of patients that required additional analgesia was lower in the ibuprofen group (RR = 0.7; 95% CI, 0.53 to 0.92; P = .01). The incidence of total adverse effects was lower in the ibuprofen group (RR = 0.59; 95% CI, 0.45 to 0.79; P = .0002).
CONCLUSIONS: Ibuprofen provides a better pain relief with a lower incidence of adverse effects in children with musculoskeletal injuries as compared to other analgesics. PROSPERO REGISTRATION NUMBER: CRD42021231975.
Copyright © 2021 the Author(s). Published by Wolters Kluwer Health, Inc.

Entities:  

Mesh:

Substances:

Year:  2021        PMID: 34190183      PMCID: PMC8257891          DOI: 10.1097/MD.0000000000026516

Source DB:  PubMed          Journal:  Medicine (Baltimore)        ISSN: 0025-7974            Impact factor:   1.817


Introduction

Musculoskeletal injuries, including fractures, bruises, and sprains, are one of the most common cause of children's visits to the emergency department for pain conditions.[ Numerous studies indicate that analgesia is not adequately provided to these pediatric patients.[ One study revealed that only 35% of children with a fracture or severe sprain were given the analgesics in emergency department.[ The undertreatment of pain in pediatrics may be due to the limited evidence in pain management for children with musculoskeletal injuries or to the worry about adverse events induced by opioids as well as other analgesics.[ Inadequate pain management in children may lead to detrimental effects, such as healing delay, anxiety, and hyperesthesia.[ Previous studies suggest that nonsteroidal anti-inflammatory drugs (NSAIDs), are the most commonly-used analgesics in managing children's pain from musculoskeletal injuries in emergency department, of which ibuprofen is currently the standard first-line drug.[ Other analgesics, such as acetaminophen,[ codeine,[ and morphine[ are also widely prescribed for pain management in children with musculoskeletal injuries. A number of studies have compared the analgesic effects of ibuprofen with other analgesics,[ but the results are inconsistent. A previous systematic review tried to synthesize the evidence regarding the effect of ibuprofen versus other analgesics on children's pain from musculoskeletal injuries but did not perform a meta-analysis for the consideration of variation of control protocols.[ Moreover, the authors did not focus on the side effects of ibuprofen versus other analgesics.[ Therefore, it is still necessary to conduct a meta-analysis to synthesize evidence regarding ibuprofen's effect and safety on children's pain management from musculoskeletal injuries.

Materials and methods

Ethical statements

No ethical approval is required because this is a literature-based study. This systematic review and meta-analysis was registered in the International Prospective Register of Systematic Reviews (PROSPERO; Registration NO. CRD42021231975) and was conducted in agreement with the PRISMA guideline.[

Search strategy

Two authors performed a comprehensive search for RCTs investigating the effect of ibuprofen on pediatric pain management from musculoskeletal injuries in a range of databases, namely, PubMed, EMBASE, CENTRAL, and Web of science, from inception to Jan 16, 2021 with restriction of English language. The key terms used in our systematic search include “ibuprofen”, “children”, “pediatric”, “fracture” and “Musculoskeletal injury”. We also tracked references for eligible studies that we may miss.

Eligible criteria

A study was eligible, if study design was RCT, study participants were pediatric patients (< 18 years) with musculoskeletal injuries, the study focused on the comparison between oral medication with ibuprofen only and oral medication with other analgesics for pain management, and any of the following outcomes of interest were reported: change of visual analog scale (VAS) from baseline, proportion of patients achieving adequate analgesia or requiring additional analgesia, and adverse effects (e.g., nausea, vomiting, drowsiness, dizziness and constipation).

Study selection and data extraction

Two authors independently identified the eligible studies by screening title and abstract first and then reviewing full-text of potentially eligible articles. Two authors independently extracted the following information from included studies: authors, publication year, sample size, study participants’ age and weight, interventions, controls, and outcomes. Since several scales for measuring severity of pain were used in included studies, we converted the results of pain measurement from different scales to a 0–100 mm VAS (VAS, 0: no pain, 100: worst imaginable pain). We attempted to contact corresponding authors for original data if the results of pain measurement were presented by median and range. If there was no response, we would convert median and range to mean and standard deviation according to the methods described by Hozo and colleagues.[ Disagreements were resolved by discussion with a third author.

Risk of bias assessment

Two authors independently assessed the quality of included studies using the Cochrane Collaboration's tool for risk of bias[ with six items: random sequence generation (selection bias); allocation concealment (selection bias); blinding of participants and personnel (performance bias); blinding of outcome assessment (detection bias); incomplete outcome data (attrition bias); and selective reporting (reporting bias). The estimated risk of bias for each item was rated as ‘low’, ‘high’, or ‘unclear’. Disagreements were discussed with a third author.

Statistical analysis

We calculated standardized mean differences (SMD) and risk ratios (RR) with 95% confidence intervals (CI) for continuous and dichotomous outcomes, respectively. To consider clinical heterogeneity (e.g., type of injury, kind of analgesics, and the method of pain measurements), we applied random-effect model to synthesize results from included studies. Statistical heterogeneity was assessed using the I2 test. Significant heterogeneity was considered to be present when I2 statistic was > 50%. P < .05 was considered to be statistically significant.

Results

Characteristics of included studies

A total of 266 studies were identified initially, of which we excluded 56 duplicates, 169 non-RCTs, 12 conference abstracts, 14 on-going RCTs and 9 irrelevant studies by reviewing title, abstract and full-text. Finally, a total of 6 RCTs were included, of which 5 studies[ involving 1034 patients were included into meta-analysis (Fig. 1). 424 patients received ibuprofen and 610 patients received other analgesics, including acetaminophen, codeine, and morphine.
Figure 1

The flow diagram of study selection.

The flow diagram of study selection. The characteristics of the included studies were present in Table 1. The risk of bias of the included studies was present in Table 2.
Table 1

Study characteristics.

StudyCountriesPatientsAge (years)Weight (kg)Pain causeInterventionsComparisonsOutcomesPain measurements
Clark 2007Canada31111.8 (2.8) vs 12.0 (2.9) vs 12.2 (3.1)NA.extremities, neck, or back injuriesibuprofen (10 mg/kg, orally, n = 103)acetaminophen (15 mg/kg, orally, n = 103) or codeine (1 mg/kg, orally, n = 105),change of pain scores; the number of patients requiring additional analgesia; the number of patients achieving adequate analgesia; adverse eventsVisual analog scale
Drendel 2009America2447.4 (4.0–17.9) vs 8.2 (4.2–14.9)27.9 (14.4–60.0) vs 29.4 (13.8–59.2)the radius, ulna, or humerus fracturesibuprofen 10 mg/kg, orally (n = 128)acetaminophen with codeine (1 mg/kg, orally, n = 116)the proportion of requirement for rescue medication; pain medication use; pain scores; functional outcomes; satisfaction; adverse effectsThe modified Bieri Faces Pain Scale
Friday 2009America6610.6 (3.4) vs 10.1 (3.4)47.3 (22.8) vs 43.0 (18.6)extremity injuriesibuprofen (10 mg / kg, orally, n = 34)acetaminophen with codeine (1 mg / kg, orally, n = 32)change of pain scores; requirement for additional analgesia; adverse effectsThe Color Analog Scale
Le May 2017Canada45612.2 (2.6) vs 11.7 (2.7) vs 12.0 (2.7)NA.upper or lower limb injuriesibuprofen (10 mg/kg, orally, n = 91)morphine (0.2 mg/kg, orally, n = 188) or morphine (0.2 mg/kg, orally) with ibuprofen (10 mg/kg, orally, n = 177)pain score < 30 mm at 60 min after treatment; adverse effectsVisual analog scale
Poonai 2014England13410.8 (3.1) vs 10.7 (3.3)NA.uncomplicated extremity fracturesibuprofen (10 mg/kg, orally, n = 68)morphine (0.5 mg/kg, orally, n = 66)change of pain scores; the number of participants who required acetaminophen; adverse effectsFaces Pain Scale
Koller 2007America6611.1 (3.6) vs 10.9 (2.8) vs 12.0 (2.6)56.1 (25.7) vs 51.3 (19.9) vs 66.6 (26.7)closed fractures or injuriesibuprofen (10 mg/kg, orally, n = 22)oxycodone (0.1 mg/kg, orally, n = 22) or oxycodone (0.1 mg/kg, orally) with ibuprofen (10 mg/kg, orally, n = 22)change of pain scores at 30, 60, 90, and 120 min after medication; adverse effectsFaces Pain Scale and Visual Analog Scale

Data are present as mean with standard deviation.

Data are present as mean with range. NA = Not applicable.

Table 2

Risk of bias of included trials.

StudyRandom sequence generationAllocation concealmentBlinding of participants and personnelBlinding of outcome assessmentIncomplete outcome dataSelective reporting
Clark 2007LowLowUnclearLowUnclearLow
Drendel 2009LowLowLowLowLowLow
Friday 2009LowHighLowLowLowLow
Le May 2017LowLowLowLowLowLow
Poonai 2014LowLowLowLowLowLow
Koller 2007UnclearHighLowLowLowLow

High = high risk of bias, Low = low risk of bias, Unclear = unclear risk of bias.

Study characteristics. Data are present as mean with standard deviation. Data are present as mean with range. NA = Not applicable. Risk of bias of included trials. High = high risk of bias, Low = low risk of bias, Unclear = unclear risk of bias.

Results of meta-analysis

Change of pain scores after treatment

Four studies[ reported change of VAS scores after treatment. Pooled results showed that the change of VAS scores was higher in ibuprofen group compared with control group (SMD = 0.27; 95% CI, 0.15 to 0.38; I2 = 55%; P < .00001) (Fig. 2).
Figure 2

Meta-analysis of the change of VAS scores from baseline to post-medication.

Meta-analysis of the change of VAS scores from baseline to post-medication. Subgroup analysis was conducted according to the time of pain measurements. No significant difference was found in the change of VAS scores at 30 min after treatment in the ibuprofen group compared with the control group (SMD = 0.07; 95% CI, -0.08 to 0.22; I2 = 17%; P = .36). However, a higher change of VAS scores was found at 60 min (SMD = 0.28; 95% CI, 0 to 0.57; I2 = 71%; P = .05), 90 min (SMD = 0.38; 95% CI, 0.17 to 0.59; I2 = 40%; P = .0005), and 120 min (SMD = 0.4; 95% CI, 0.23 to 0.57; I2 = 0%; P < .00001) in the ibuprofen group compared with the control group. Subgroup analysis was also conducted according to the pain medication. Compared with morphine, the effect of ibuprofen was similar on the change of VAS scores at 30 min after treatment (SMD = -0.04; 95% CI, -0.25 to 0.18; I2 = 13%; P = .75).

Adequate analgesia

Two studies[ reported the proportion of adequate analgesia. Pooled results showed that 36% more children in ibuprofen group achieved adequate analgesia than the control group (RR = 1.36; 95% CI, 1.20 to 1.56; I2 = 2%; P < .00001) (Fig. 3).
Figure 3

Meta-analysis of the proportion of patients achieving adequate analgesia.

Meta-analysis of the proportion of patients achieving adequate analgesia. Subgroup analysis was conducted according to the time of pain measurements. The results showed a higher proportion of adequate analgesia at 60 min (RR = 1.30; 95% CI, 1.07 to 1.57; I2 = 0%; P = .007), and 120 min (RR = 1.45; 95% CI, 1.13 to 1.86; I2 = 45%; P = .003) in the ibuprofen group compared with the control group.

Requiring additional analgesia (Failure of analgesia)

Four studies[ reported the proportion of failure of analgesia. Pooled results showed that the proportion of failure of analgesia was lower in the ibuprofen group compared with the control group (RR = 0.7; 95% CI, 0.53 to 0.92; I2 = 0%; P = .01) (Fig. 4).
Figure 4

Meta-analysis of the proportion of patients requiring additional analgesia.

Meta-analysis of the proportion of patients requiring additional analgesia. Subgroup analysis was conducted according to the pain medication. Compared with acetaminophen-codeine, the proportion of failure of analgesia was lower but with no statistical significance after ibuprofen treatment (RR = 0.67; 95% CI, 0.44 to 1.02; I2 = 0%; P = .06).

Adverse effects

Five studies[ reported the incidence of adverse effects. Pooled results showed that ibuprofen group had 41% lower risk of adverse events than control group (RR = 0.59; 95% CI, 0.45 to 0.79; I2 = 21%; P = .0002) (Fig. 5). Specifically, children using ibuprofen had 75% lower risk of nausea (RR = 0.25; 95% CI, 0.13 to 0.48; I2 = 0%; P < .0001), 77% lower risk of vomiting (RR = 0.23; 95% CI, 0.09 to 0.57; I2 = 0%; P = .002), and 35% lower risk of drowsiness (RR = 0.65; 95% CI, 0.46 to 0.91; I2 = 0%; P = .01) compared to the control. No difference was found in the incidence of dizziness (RR = 0.62; 95% CI, 0.27 to 1.38; I2 = 0%; P = .24) and constipation (RR = 0.64; 95% CI, 0.12 to 3.47; I2 = 32%; P = .61) between ibuprofen group and control group (Fig. 6).
Figure 5

Meta-analysis of the incidence of total adverse effects.

Figure 6

Meta-analysis of the incidence of specific adverse effects.

Meta-analysis of the incidence of total adverse effects. Meta-analysis of the incidence of specific adverse effects. Subgroup analysis was conducted according to the pain medication. Compared with morphine, the incidence of adverse effects was lower after ibuprofen treatment (RR = 0.47; 95% CI, 0.28 to 0.79; I2 = 35%; P = .004). Compared with acetaminophen-codeine, the incidence of total adverse effects was lower after ibuprofen treatment (RR = 0.58; 95% CI, 0.42 to 0.80; I2 = 0%; P = .0008). Data from one study[ were not suitable for quantitative synthesis. The authors reported that oxycodone, ibuprofen, and the combination provided a comparable decrease in pain scores at 30, 60, 90, and 120 min after medication. However, patients in the combination treatment group had more side effects.

Publication bias

Funnel plots for publication bias could not be reliably tested because of the small number of included studies.

Discussion

In this meta-analysis, we found that oral intake of ibuprofen produced a better analgesic effect than other analgesics for children with musculoskeletal injuries at 60 min, 90 min, and 120 min after medication. The analgesic effect was comparable between ibuprofen and other analgesics at 30 min after medication. Compared with other analgesics, ibuprofen had higher proportion of patients that achieved adequate analgesia and lower proportion of patients that required additional analgesia. In addition, ibuprofen had a lower incidence of adverse effects than other analgesics. Painful condition is commonly seen in children with musculoskeletal injury that remains undertreated in emergency department.[ Inadequate analgesia may cause detrimental effects in children.[ It is essential to adequately assess pain and provide effective analgesia treatment in these pediatric population. The ideal drug should adequately alleviate pain symptoms with minimal adverse effects and no long-term addiction potential.[ Nonsteroidal anti-inflammatory drugs (NSAIDs) are usually recommended for acute pain management in patients with musculoskeletal injuries due to their non-inferior analgesic effect and low possibility of adverse effects.[ Traditionally, opioids are commonly prescribed for pain relief after acute injuries.[ Unfortunately, opioids may lead to significant adverse events (e.g., somnolence, delirium, respiratory depression, abuse, dependence and addiction), creating a need for better alternatives.[ Several studies demonstrate that NSAIDs provide analgesia comparable to that of opioids for both adult and pediatric patients with musculoskeletal injuries.[ Consistently, pooled results in our meta-analysis showed that ibuprofen was equivalent with morphine in pain relief but generated fewer adverse effects. Therefore, ibuprofen is a reasonable option for children with musculoskeletal injuries. Although this meta-analysis showed ibuprofen is more effective in offering adequate analgesia than other analgesics, two studies reported only 52%[ and 29.9%[ of children achieved adequate analgesia at 60 min after treatment, suggesting that ibuprofen alone is not adequate for pain relief in all children with musculoskeletal injury. However, the combination of ibuprofen with codeine or oxycodone as well as morphine did not significantly improve the proportion of children that achieved adequate analgesia, but led to more adverse events.[ Therefore, pain management provided by current medications remains suboptimal for most patients. There have been concerns prescribing ibuprofen for children with musculoskeletal injuries because of negative effects of NSAIDS on fracture healing. Animal studies suggest that NSAIDS, such as indomethacin, aspirin, and ibuprofen affect fractures healing in rats,[ but there is no conclusive evidence in human studies.[ Retrospective studies of pediatric patients showed no cases with NSAIDS use have delayed bone healing.[ One RCT reported no significant delay in healing of Colle's fractures in adults by piroxicam.[ For children, RCTs also reported ibuprofen did not affect fracture healing.[ However, long-term use of indomethacin for 6 weeks increased the risk of nonunion of acetabular fractures.[ Nevertheless, there is no evidence that a short-term use of ibuprofen is associated with delayed fracture healing in humans. Acetaminophen-codeine and ibuprofen are commonly prescribed oral analgesics. However, this combination does not provide better pain relief but lead to more side effects than ibuprofen in pediatrics.[ Our pooled results showed that the proportion of analgesia failure was lower but with no statistical significance after ibuprofen treatment compared with acetaminophen-codeine. Moreover, the incidence of total adverse effects was lower after ibuprofen treatment. In addition, administration of codeine-containing analgesics may be difficult to perform prior to adequate evaluation, initial prescription of ibuprofen for children with acute injuries is thus recommended. Musculoskeletal pain persists in children after discharge from emergency department. Currently, limited clinical trials evaluate analgesia situation in children with musculoskeletal injuries in the outpatient setting. One included study in this meta-analysis found that ibuprofen produced comparable rates of successful analgesia with acetaminophen-codeine for children with arm fractures.[ However, functional outcomes, such as play, were better in children receiving ibuprofen. Moreover, fewer adverse effects and more satisfaction were seen in children receiving ibuprofen. Therefore, ibuprofen appears to be preferable to acetaminophen-codeine for children with musculoskeletal pain in an outpatient setting. Another RCT indicated that both ibuprofen and paracetamol can effectively alleviate children's pain from an acute fracture in the outpatient setting.[ However, analgesic effects and side effects are comparable between ibuprofen and paracetamol. Therefore, either drug appears to be a reasonable option for pediatric acute limb fracture after discharge from the emergency department. Antidepressants are generally first-line medications for chronic pain associated with musculoskeletal injuries in adults, such as back pain and osteoarthritis pain.[ A recent systematic review and meta-analysis showed that serotonin-noradrenaline reuptake inhibitors (SNRIs) could reduce back pain and osteoarthritis pain, but tricyclic antidepressants (TCAs) and other antidepressants did not reduce back pain.[ In this meta-analysis, we mainly focused on the effects of ibuprofen or other analgesics on the acute pain from musculoskeletal injuries in children. A substantial number of patients with acute pain might turn into chronic pain patients with musculoskeletal injuries. However, the evidence that regarding the efficacy of antidepressants in children with acute/chronic pain from musculoskeletal injuries were limited.[ Therefore, the large sample multi-center randomized controlled trials are needed to determine the definitive effects of antidepressants on acute/chronic pain from musculoskeletal injuries in children. Some limitations exist in this meta-analysis. Firstly, only six studies are included in and the sample size is relatively small. Secondly, the different conditions among included studies, including type of injury, the control analgesics, the method of pain measurement that may increase the clinical heterogeneity.

Conclusions

Ibuprofen can provide a better pain relief with fewer adverse effects in children with musculoskeletal injuries as compared to other analgesics. This meta-analysis supports ibuprofen as the first-line drug for children with musculoskeletal injuries.

Author contributions

Conceptualization: Jianping Jin, Zhanhai Wan. Data curation: Xiaoqing Wang, Jingjing Wang. Formal analysis: Jianping Jin, Xiaoqing Wang, Jingjing Wang. Methodology: Jianping Jin, Jingjing Wang. Validation: Jianping Jin, Zhanhai Wan. Writing – original draft: Jianping Jin. Writing – review & editing: Zhanhai Wan.
  35 in total

1.  Nonsteroidal Anti-inflammatory Drugs May Be Considered in Patients With Acute Fractures.

Authors:  Michael Gottlieb; Stephen Alerhand
Journal:  Ann Emerg Med       Date:  2020-11       Impact factor: 5.721

2.  Efficacy of an ibuprofen/codeine combination for pain management in children presenting to the emergency department with a limb injury: a pilot study.

Authors:  Sylvie Le May; Serge Gouin; Christophe Fortin; Alexia Messier; Marie-Andrée Robert; Marilyse Julien
Journal:  J Emerg Med       Date:  2012-12-08       Impact factor: 1.484

3.  Pediatric musculoskeletal pain in the emergency department: a medical record review of practice variation.

Authors:  Janeva Kircher; Amy L Drendel; Amanda S Newton; Sukhdeep Dulai; Ben Vandermeer; Samina Ali
Journal:  CJEM       Date:  2014-11       Impact factor: 2.410

4.  Effectiveness of oxycodone, ibuprofen, or the combination in the initial management of orthopedic injury-related pain in children.

Authors:  Darwin M Koller; Amanda B Myers; Doug Lorenz; Sandip A Godambe
Journal:  Pediatr Emerg Care       Date:  2007-09       Impact factor: 1.454

5.  Effect of a Single Dose of Oral Opioid and Nonopioid Analgesics on Acute Extremity Pain in the Emergency Department: A Randomized Clinical Trial.

Authors:  Andrew K Chang; Polly E Bijur; David Esses; Douglas P Barnaby; Jesse Baer
Journal:  JAMA       Date:  2017-11-07       Impact factor: 56.272

6.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration.

Authors:  Alessandro Liberati; Douglas G Altman; Jennifer Tetzlaff; Cynthia Mulrow; Peter C Gøtzsche; John P A Ioannidis; Mike Clarke; P J Devereaux; Jos Kleijnen; David Moher
Journal:  BMJ       Date:  2009-07-21

7.  Ibuprofen provides analgesia equivalent to acetaminophen-codeine in the treatment of acute pain in children with extremity injuries: a randomized clinical trial.

Authors:  Janet H Friday; John T Kanegaye; Ian McCaslin; Amy Zheng; Jim R Harley
Journal:  Acad Emerg Med       Date:  2009-07-14       Impact factor: 3.451

8.  A comparison of ibuprofen versus acetaminophen with codeine in the young tonsillectomy patient.

Authors:  C S St Charles; B H Matt; M M Hamilton; B P Katz
Journal:  Otolaryngol Head Neck Surg       Date:  1997-07       Impact factor: 5.591

9.  Efficacy of ibuprofen in musculoskeletal post-traumatic pain in children: A systematic review.

Authors:  Niccolò Parri; Simone Lazzeri
Journal:  PLoS One       Date:  2020-12-03       Impact factor: 3.240

Review 10.  Pain Management of Pediatric Musculoskeletal Injury in the Emergency Department: A Systematic Review.

Authors:  Sylvie Le May; Samina Ali; Christelle Khadra; Amy L Drendel; Evelyne D Trottier; Serge Gouin; Naveen Poonai
Journal:  Pain Res Manag       Date:  2016-04-11       Impact factor: 3.037

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.