Literature DB >> 27366060

Factors associated with exacerbation in mild- to-moderate COPD patients.

Joo Kyung Kim1, Soo Haeng Lee1, Bho Hyeon Lee1, Chang Youl Lee2, Do Jin Kim3, Kyung Hoon Min4, Sung Kyoung Kim5, Kwang Ha Yoo6, Ki-Suck Jung1, Yong Il Hwang1.   

Abstract

INTRODUCTION: COPD exacerbation negatively impacts the patient's quality of life and lung function, increases mortality, and increases socioeconomic costs. In a real-world setting, the majority of patients with COPD have mild-to-moderate airflow limitation. Therefore, it is important to evaluate COPD exacerbation in patients with mild-to-moderate airflow limitation, although most studies have focused on the patients with moderate or severe COPD. The objective of this study was to evaluate factors associated with COPD exacerbation in patients with mild-to-moderate airflow limitation.
METHODS: Patients registered in the Korean COPD Subtype Study cohort were recruited from 37 tertiary referral hospitals in Korea. We obtained their clinical data including demographic characteristics, past medical history, and comorbidities from medical records. Patients were required to visit the hospital to document their COPD status using self-administered questionnaires every 6 months.
RESULTS: A total of 570 patients with mild-to-moderate airflow limitation were enrolled. During the first year of follow-up, 30.5% patients experienced acute exacerbation, with exacerbations being more common in patients with poor lung function. Assessed factors associated with COPD exacerbation included COPD assessment test scores, modified Medical Research Council dyspnea assessment test scores, St George's Respiratory Questionnaire for COPD scores, a previous history of exacerbation, and histories of pneumonia and allergic rhinitis. Logistic regression tests revealed St George's Respiratory Questionnaire for COPD scores (odds ratio [OR], 1.02; 95% confidence interval [CI], 1.00-1.04; P=0.034), a previous history of exacerbation (OR, 3.12; 95% CI, 1.35-7.23; P=0.008), and a history of pneumonia (OR, 1.85; 95% CI, 1.06-3.25; P=0.032) as risk factors for COPD exacerbation.
CONCLUSION: Our results suggest that COPD exacerbation in patients with mild-to-moderate airflow limitation is associated with the patient's quality of life, previous history of exacerbation, and history of pneumonia.

Entities:  

Keywords:  COPD; exacerbation; risk factors

Mesh:

Year:  2016        PMID: 27366060      PMCID: PMC4914068          DOI: 10.2147/COPD.S105583

Source DB:  PubMed          Journal:  Int J Chron Obstruct Pulmon Dis        ISSN: 1176-9106


Introduction

Patients with COPD may experience acute exacerbations, which are defined as events characterized by a worsening of respiratory symptoms that is beyond normal day-to-day variations, necessitating a change in medications.1 COPD exacerbation is important because frequent acute exacerbations have a negative effect on the quality of life of patients2 and are one of the most common causes of hospitalization and mortality.3 Moreover, the frequency of exacerbations contributes to a long-term decline in lung function.4 From economic perspectives, acute exacerbation results in an increase in the economic and social burden.5 Regardless of the degree of airflow limitation, the known precipitating factors for acute exacerbation include viral or bacterial infection, and air pollutants, with no specific factors identified for approximately one-third of cases.1 It has been reported that mild-to-moderate airway obstruction (Global Initiative for Chronic Obstructive Lung Disease [GOLD] class 1 and 2) accounts for the majority of COPD patients in several prevalence studies on COPD.6–8 The exacerbation rate in these patients is 0.7–0.9/year, as estimated from large randomized controlled trials.1 However, few studies have evaluated the incidence of acute exacerbations and the associated risk factors in COPD patients with mild-to-moderate airflow limitation in real-world practice. The aim of this study was to determine factors associated with acute COPD exacerbations in patients with mild-to-moderate airflow limitation in actual clinical settings.

Materials and methods

Study participants

We enrolled COPD patients with mild-to-moderate airflow limitation from the Korean COPD Subtype Study (KOCOSS) cohort, which is a registry organized to clarify the clinical phenotype of COPD in Korea.9,10 Patients were recruited from 37 tertiary referral hospitals in Korea. The inclusion criteria for KOCOSS cohort were as follows: age ≥40 years, postbronchodilator forced expiratory volume in 1 second (FEV1)/forced vital capacity (FVC) <0.7, and the presence of respiratory symptoms such as cough, sputum, and dyspnea. We excluded patients receiving treatment for any respiratory diseases mimicking COPD, such as bronchiectasis, asthma, and tuberculosis-destroyed lungs. The definition of mild-to-moderate airflow limitation was adopted from the GOLD guidelines (FEV1 ≥50% of the predicted value).1 All patients included in this analysis were part of the patient dataset obtained on December 31, 2014.

Procedures

Clinical examinations and spirometry were performed to assess the severity of COPD in all patients. We used self-administered questionnaires to acquire demographic characteristics, past medical histories, and data related to comorbidities. Dyspnea and quality of life were assessed by the modified Medical Research Council (mMRC) score, COPD assessment test (CAT), and St George’s Respiratory Questionnaire for COPD (SGRQ-c).11–13 Because there can be discrepancies between mMRC and CAT scores, we collected both data simultaneously.10 SGRQ-c is also a reliable, valid instrument to measure the self-reported quality of life in COPD patients. Therefore, we gathered data using three different questionnaires at baseline. Histories of exacerbation before enrollment were gathered at baseline. Exacerbation was defined in this study as worsening of one of the respiratory symptoms, such as an increase in sputum volume, purulence, or dyspnea, necessitating treatment with systemic corticosteroids, antibiotics, or both.9 Furthermore, when the exacerbation required a visit to the emergency room or hospitalization, it was defined as moderate or severe exacerbation, respectively. The patients received appropriate treatment according to their COPD status. Prospective exacerbation data were collected according to the KOCOSS protocol. The patients were required to visit the hospital every 6 months, and spirometry was performed every year during the follow-up period. When patients could not visit the hospital, we contacted them by telephone to acquire data. During follow-up, the doctors assessed the disease status, conducted physical examinations, and asked patients to complete questionnaires. December 31, 2014 was used as the cutoff date for available longitudinal data. We gathered exacerbation data according to severity of airflow limitation and GOLD risk group and compared the baseline characteristics of patients stratified by the presence or absence of a previous acute exacerbation history.

Statistical analyses

All data are presented as mean ± standard deviation where appropriate and were analyzed using SPSS 22.0 (IBM Corporation, Armonk, NY, USA) for Windows. Descriptive analyses were performed to assess differences in baseline characteristics between patients with and without exacerbation histories. We used chi-square tests and Fisher’s exact test for categorical variables and the Kruskal–Wallis test for continuous variables. In addition, we performed logistic regression analysis to determine the risk factors for COPD exacerbation. All P-values were two-sided, and values of <0.05 were considered to be statistically significant.

Ethical statement

This study protocol was reviewed and approved by the ethics and review board of each participating study center (Hallym University Sacred Heart Hospital, IRB No 2012-I027). All patients provided written informed consent before participation.

Results

Patient characteristics

A total of 570 COPD patients with mild-to-moderate airflow limitation were enrolled in this study. The proportion of males was 90.4%, the mean follow-up duration was 22.3±21.4 months, and the mean age of patients was 69.8±7.8 years. A total of 114 (20%) patients had experienced acute exacerbation a year before enrollment. Furthermore, 90.7% patients exhibited moderate airflow limitation (GOLD 2), while the remaining exhibited mild airflow limitation (GOLD 1). According to the 2011 GOLD classification, 24.9% and 74.7% patients exhibited GOLD class A and B, respectively. The enrolled patients exhibited comorbidities, with hypertension being the most frequently encountered (37.9%). A total of 14.2% patients had a history of pneumonia. The patients’ baseline characteristics are summarized in Table 1.
Table 1

Baseline characteristics of included patients with COPD and mild-to-moderate airflow limitation

CharacteristicsTotal (n=570)
Age (years), mean (SD)69.8 (7.8)
Male, no (%)515 (90.4)
Follow-up duration (months), mean (SD)22.3 (21.4)
Lung function, mean (SD)
 Postbronchodilator FEV1 (L)1.79 (0.54)
 Postbronchodilator FEV1 (% of predicted)66.0 (11.6)
 Postbronchodilator FVC (L)3.28 (0.75)
 Postbronchodilator FVC (% of predicted)87.4 (15.4)
Smoking amount (pack-years), mean (SD)43.8 (24.3)
Total CAT score, mean (SD)13.9 (6.9)
mMRC score, mean (SD)1.36 (0.85)
SGRQ-c, mean (SD)30.4 (6.5)
Number of patients with previous exacerbation history, no (%)114 (20)
Comorbidities, no (%)
 Hypertension37.9
 Diabetes mellitus14.3
 Gastroesophageal reflux disease10.4
 Hyperlipidemia8.3
 Osteoporosis3.8
 Congestive heart failure3.1
Past medical history, no (%)
 Asthma65.4
 Tuberculosis22.1
 Measles17.4
 Pneumonia14.2
 Allergic rhinitis11.0

Abbreviations: CAT, COPD assessment test; FEV1, forced expiratory volume in 1 second; FVC, forced vital capacity; mMRC, modified Medical Research Council; SD, standard deviation; SGRQ-c, St George’s Respiratory Questionnaire for COPD.

Experience of acute exacerbation

A total of 30.5% patients experienced acute exacerbation during the first year of follow-up. The estimated exacerbation rates were 23.1% for patients with an FEV1 of ≥80% of the predicted value, 28.3% for patients with an FEV1 of 60%–80% of the predicted value, and 35.8% for patients with an FEV1 of ≤60% of the predicted value (P=0.369). Using the new GOLD classification for comparisons, we found that 34.2% patients with GOLD class B developed exacerbation during the first year of follow-up, whereas only 19.3% patients with GOLD class A experienced exacerbation during this period (P=0.036; Figure 1). We showed the proportion of patients according to the exacerbation of COPD during the first year of follow-up in Figure S1. A total of 58.3% patients with a history of exacerbation before enrollment experienced exacerbation events during the first year of follow-up. Among the patients with exacerbation, 36.9% exhibited moderate or severe exacerbations (emergency room visit or hospital admission).
Figure 1

Exacerbation rate of COPD according to the GOLD classification and severity of airflow limitation during the first year of follow-up.

Abbreviations: FEV1, forced expiratory volume in 1 second; GOLD, Global Initiative for Chronic Obstructive Lung Disease.

Factors associated with acute exacerbation of COPD

We compared baseline characteristics between patients with COPD exacerbation and those without during the follow-up period and found that mean mMRC, CAT, and SGRQ-c scores were significantly higher for the former than for the latter (Table 2).
Table 2

Comparison of baseline characteristics between patients with experience of COPD exacerbation and those without

VariablesExperience of acute exacerbationNon-experience of acute exacerbationP-value
Age (years)70.4±6.970.4±7.70.989
BMI (kg/m2)23.6±2.923.4±3.50.732
mMRC score1.57±0.931.25±0.850.015
SGRQ-c score37.9±2.0028.1±1.60.000
CAT score16.41±7.8013.25±6.830.005
Postbronchodilator FEV1 (L)1.69±0.441.80±0.480.102
Postbronchodilator FEV1 (% of predicted)64.5±13.867.1±13.00.188

Notes: Data shown as mean ± standard deviation. An independent t-test was used to compare the two groups.

Abbreviations: BMI, body mass index; CAT, COPD assessment test; FEV1, forced expiratory volume in 1 second; mMRC, modified Medical Research Council; SGRQ-c, St George’s Respiratory Questionnaire for COPD.

With regard to comorbidities, hyperlipidemia was more frequent in patients with exacerbation than in those without, while hypertension, diabetes mellitus, congestive heart failure, osteoporosis, and gastroesophageal reflux disease showed similar prevalences in both groups. Among the patients with exacerbation, histories of pneumonia and allergic rhinitis were more prevalent (Table 3). Multivariate analysis using a logistic regression model that included all associated variables revealed that the SGRQ-c score (odds ratio [OR], 1.02; 95% confidence interval [CI], 1.00–1.04; P=0.034), a previous history of exacerbation (OR, 3.12; 95% CI, 1.35–7.23; P=0.008), and a history of pneumonia (OR, 1.85; 95% CI, 1.06–3.25; P=0.032) were independently related to a higher risk of COPD exacerbation (Table 4).
Table 3

Comparison of self-reported comorbidities and past medical histories between patients with a history of COPD exacerbation and those without

VariablesPresence of acute exacerbationAbsence of acute exacerbationP-value
Comorbidities (%)
 Hypertension40.639.90.203
 Diabetes mellitus12.512.50.453
 Congestive heart failure3.14.90.392
 Osteoporosis3.12.80.249
 Gastroesophageal reflux disease7.811.90.419
 Hyperlipidemia5.73.10.018
Past medical history (%)
 Asthma62.971.60.143
 Allergic rhinitis27.410.80.008
 Pneumonia23.014.90.008
 Measles21.018.90.475
 Tuberculosis19.422.30.110

Note: A chi-square test was used to compare the two groups.

Table 4

Logistic regression model for the risk factors for COPD exacerbation

VariableOR (95% CI)P-value
Previous exacerbation history3.12 (1.35–7.23)0.008
History of pneumonia1.85 (1.06–3.25)0.032
SGRQ-c score1.02 (1.00–1.04)0.034
Allergic rhinitis1.15 (0.61–2.19)0.667
mMRC1.07 (0.66–1.75)0.777
CAT score1.00 (0.93–1.07)0.883
Hyperlipidemia0.82 (0.52–1.30)0.384

Abbreviations: CAT, COPD assessment test; CI, confidence interval; mMRC, modified Medical Research Council; OR, odds ratio; SGRQ-c, St George’s Respiratory Questionnaire for COPD.

Discussion

In the present study, we showed that 30.5% COPD patients with mild-to-moderate airflow limitation experienced acute exacerbation in the first year of follow-up. When compared according to baseline FEV1 levels, 23.1% patients with an FEV1 of ≥80% of the predicted value (mild COPD) and 64.1% with an FEV1 of 50%–80% of the predicted value (moderate COPD) experienced exacerbation. The risk of exacerbation is known to increase with an increase in the degree of airflow limitation.1 The estimated annual exacerbation rate from several medium-term studies has been reported to range from 0.5 to 3.5 per patient per year, regardless of the severity of airflow limitation.14–16 Furthermore, the annual rate of exacerbation in patients with moderate COPD has been reported as 1.02 per person per year for females and 0.74 per person per year for males.17 The estimated annual rate of exacerbation in our study was 0.57 per patient per year, which was relatively lower than that in previous studies. This discrepancy may be attributed to differences in the study population; our study included 9.3% patients with mild COPD and a majority of male patients. A previous history of exacerbation is a well-known risk factor for future exacerbation,14 and our study confirmed this. A total of 58.3% patients with a previous history of exacerbation experienced acute exacerbations in the first year of follow-up. This figure was significantly higher than that for patients without a history of exacerbation (P=0.000). In logistic regression analysis, OR for a previous exacerbation history was 3.12 (95% CI, 1.35–7.23; P=0.008). We also explored the association between baseline FEV1 and COPD exacerbations. The estimated exacerbation rates were 23.1% for patients with an FEV1 of ≥80% of the predicted value, 28.3% for patients with an FEV1 of 60%–80% of the predicted value, and 35.8% for patients with an FEV1 ≤60% of the predicted value. There was no significant association, although the COPD exacerbation rate was higher for patients with poor lung function (P=0.369). SGRQ-c and CAT scores were significantly higher for patients with a previous history of exacerbation, and the differences between groups were above the minimal clinically important difference for each score.18,19 This finding supported the findings of previous studies reporting that exacerbations were significantly associated with an impairment in health status.2,20 Binominal logistic regression analysis revealed that patients with poor SGRQ-c scores were at greater risk of COPD exacerbation. Although some previous studies have demonstrated that a poor SGRQ-c score was a risk factor for readmission or increased COPD-related mortality,21–24 to the best of our knowledge, this is the first study to report a direct association between the SGRQ-c score and COPD exacerbation, particularly in patients with mild-to-moderate airflow limitation. We also evaluated the association between self-reported comorbidities and COPD exacerbation and found that only hyperlipidemia was associated with COPD exacerbation; other diseases such as hypertension, diabetes mellitus, congestive heart failure, osteoporosis, and gastroesophageal reflux disease were not significant factors. However, because of the short follow-up duration in this study, it was difficult to fully determine the relationship between the COPD exacerbation rate and comorbidities. Further research is needed to determine this association. Pneumonia is a well-known risk factor for COPD exacerbation.1,25 Patients with a history of childhood pneumonia were found to develop more frequent and severe COPD exacerbations compared with patients with no history.26 We showed that a history of pneumonia was more frequent in patients with COPD exacerbation and was a risk factor for COPD exacerbation according to logistic regression analysis. This finding was consistent with that of a study conducted in South Korea, where it was reported that a history of pneumonia increased the risk of COPD exacerbation by 18 times.20 Distinct phenotypes are believed to exist in terms of acute COPD exacerbation,27 and there may be different phenotypes in patients with different degrees of airway limitation in terms of the development of acute exacerbation. In the present study, we showed that a history of pneumonia was associated with COPD exacerbation in addition to a history of previous exacerbation. This finding suggests that chronic airway bacterial colonization is a more important risk factor for COPD exacerbation in patients with mild-to-moderate airflow limitation. This study has some limitations. First, the follow-up period was relatively short; therefore, we were unable to assess the long-term exacerbation events in patients with mild-to-moderate COPD. However, we believe that this study provides an insight that a substantial number of COPD patients with mild-to-moderate airflow limitation can experience exacerbation. Second, we attempted to determine the relationship between comorbidities and COPD exacerbation; however, the exacerbation rate was not fully evaluated with regard to comorbidities. Also, the use of self-reported comorbidities may have confounded the accuracy of results. Third, the predominance of male patients and patients with GOLD 2 is inconsistent with the patients samples in previous prevalence studies regarding COPD.7,8 Because our subjects were already diagnosed with COPD, our study may differ from those of previous prevalence studies aimed at the general population. Furthermore, our study sample may reflect the actual situation in Korea.28 Despite these limitations, to the best of our knowledge, this is the first study to report the incidence of exacerbation in COPD patients with mild-to-moderate airflow limitation in actual clinical setting. In future course of this ongoing study, we will determine the entire natural course of disease in this patient population.

Conclusion

We found that 30.5% COPD patients with mild-to-moderate airflow limitation developed acute exacerbation in the first year of follow-up. The development of acute exacerbation was associated with quality of life, a previous history of exacerbation, and a history of pneumonia. Patients with mild-to-moderate airflow limitation may exhibit different phenotypes; this will be clarified during the future course of this ongoing study.

Summary at a glance

This study examines the factors associated with acute exacerbation in patients with mild-to-moderate COPD in South Korea. The results suggest that exacerbations occur more frequently in patients with a history of pneumonia or exacerbation in mild-to-moderate COPD patients. Proportion of patients according to the exacerbation of COPD during the first year of follow-up. Abbreviation: GOLD, Global Initiative for Chronic Obstructive Lung Disease.
  26 in total

1.  The economic burden of COPD.

Authors:  S D Sullivan; S D Ramsey; T A Lee
Journal:  Chest       Date:  2000-02       Impact factor: 9.410

2.  Time course and recovery of exacerbations in patients with chronic obstructive pulmonary disease.

Authors:  T A Seemungal; G C Donaldson; A Bhowmik; D J Jeffries; J A Wedzicha
Journal:  Am J Respir Crit Care Med       Date:  2000-05       Impact factor: 21.405

Review 3.  Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) Workshop summary.

Authors:  R A Pauwels; A S Buist; P M Calverley; C R Jenkins; S S Hurd
Journal:  Am J Respir Crit Care Med       Date:  2001-04       Impact factor: 21.405

4.  Severe acute exacerbations and mortality in patients with chronic obstructive pulmonary disease.

Authors:  J J Soler-Cataluña; M A Martínez-García; P Román Sánchez; E Salcedo; M Navarro; R Ochando
Journal:  Thorax       Date:  2005-07-29       Impact factor: 9.139

5.  Heterogeneity of chronic obstructive pulmonary disease exacerbations: a two-axes classification proposal.

Authors:  Jose Luis Lopez-Campos; Alvar Agustí
Journal:  Lancet Respir Med       Date:  2015-07-09       Impact factor: 30.700

6.  Relationship between exacerbation frequency and lung function decline in chronic obstructive pulmonary disease.

Authors:  G C Donaldson; T A R Seemungal; A Bhowmik; J A Wedzicha
Journal:  Thorax       Date:  2002-10       Impact factor: 9.139

7.  History of pneumonia is a strong risk factor for chronic obstructive pulmonary disease (COPD) exacerbation in South Korea: the Epidemiologic review and Prospective Observation of COPD and Health in Korea (EPOCH) study.

Authors:  Yong Il Hwang; Sang Haak Lee; Jee Hong Yoo; Bock Hyun Jung; Kwang Ha Yoo; Moon Jun Na; Jong Deog Lee; Myung Jae Park; Chi Young Jung; Jae Jeong Shim; Kyung Chan Kim; Yeon Jae Kim; Hye Sook Choi; Ik Su Choi; Choon-Taek Lee; Sang Do Lee; Do Jin Kim; Soo-Taek Uh; Ho Sung Lee; Young Sam Kim; Kwan Ho Lee; Seung Won Ra; Hak Ryul Kim; Soo Jeon Choi; In Won Park; Yong Bum Park; So Young Park; Jaehee Lee; Ki-Suck Jung
Journal:  J Thorac Dis       Date:  2015-12       Impact factor: 2.895

8.  Development and Validation of an Improved, COPD-Specific Version of the St. George Respiratory Questionnaire.

Authors:  Makiko Meguro; Elizabeth A Barley; Sally Spencer; Paul W Jones
Journal:  Chest       Date:  2007-07-23       Impact factor: 9.410

9.  Minimum clinically important difference for the COPD Assessment Test: a prospective analysis.

Authors:  Samantha S C Kon; Jane L Canavan; Sarah E Jones; Claire M Nolan; Amy L Clark; Mandy J Dickson; Brigitte M Haselden; Michael I Polkey; William D-C Man
Journal:  Lancet Respir Med       Date:  2014-02-04       Impact factor: 30.700

10.  Development and first validation of the COPD Assessment Test.

Authors:  P W Jones; G Harding; P Berry; I Wiklund; W-H Chen; N Kline Leidy
Journal:  Eur Respir J       Date:  2009-09       Impact factor: 16.671

View more
  6 in total

1.  Cost-effectiveness of the Aerobika* oscillating positive expiratory pressure device in the management of COPD exacerbations.

Authors:  Shoghag Khoudigian-Sinani; Stacey Kowal; Jason A Suggett; Dominic P Coppolo
Journal:  Int J Chron Obstruct Pulmon Dis       Date:  2017-10-19

2.  Smoking, environmental tobacco smoke and occupational irritants increase the risk of chronic rhinitis.

Authors:  Hanna Hisinger-Mölkänen; Päivi Piirilä; Tari Haahtela; Anssi Sovijärvi; Paula Pallasaho
Journal:  World Allergy Organ J       Date:  2018-03-14       Impact factor: 4.084

3.  Exacerbations and health care resource use among patients with COPD in relation to blood eosinophil counts.

Authors:  Hana Müllerová; Beth Hahn; Edgar P Simard; George Mu; Umur Hatipoğlu
Journal:  Int J Chron Obstruct Pulmon Dis       Date:  2019-03-22

4.  The efficacy of a flipping education program on improving self-management in patients with chronic obstructive pulmonary disease: a randomized controlled trial.

Authors:  Yi-Ya Chang; Yu-Tzu Dai
Journal:  Int J Chron Obstruct Pulmon Dis       Date:  2019-06-06

5.  Overcoming Therapeutic Inertia to Reduce the Risk of COPD Exacerbations: Four Action Points for Healthcare Professionals.

Authors:  Dave Singh; Steve Holmes; Claire Adams; Mona Bafadhel; John R Hurst
Journal:  Int J Chron Obstruct Pulmon Dis       Date:  2021-11-01

6.  Distribution of COPD Comorbidities and Creation of Acute Exacerbation Risk Score: Results from SCICP.

Authors:  Haiyan Ge; Xuanqi Liu; Wenchao Gu; Xiumin Feng; Fengying Zhang; Fengfeng Han; Yechang Qian; Xiaoyan Jin; Beilan Gao; Li Yu; Hong Bao; Min Zhou; Shengqing Li; Zhijun Jie; Jian Wang; Zhihong Chen; Jingqing Hang; Jingxi Zhang; Huili Zhu
Journal:  J Inflamm Res       Date:  2021-07-15
  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.