Literature DB >> 30334942

A cluster randomized controlled trial to test the feasibility and preliminary effectiveness of a family dementia caregiver intervention in Vietnam: The REACH VN study protocol.

Tuan Anh Nguyen1, Huong Nguyen2, Thang Pham3, Trong Hung Nguyen3, Ladson Hinton4.   

Abstract

BACKGROUND: Resources for Enhancing All Caregivers Health in the Department of Veterans Affairs (REACH VA) is an evidence-based intervention supporting family dementia caregivers that has been shown to improve caregiver outcomes for culturally diverse populations in the United States. However, this model has not been tested in low- and middle-income countries (LMICs) including Vietnam, where community-based psychosocial interventions are urgently needed. The objectives of this study are to assess the feasibility and preliminary effectiveness of a culturally adapted version of the Resources for Enhancing All Caregivers Health in Vietnam (REACH VN).
METHODS: A cluster randomized controlled trial (RCT) will be conducted over a 6-month period in Soc Son district located in Hanoi. An expected sample of 10 to 12 communes, representing approximately 50 dementia primary caregivers, will be randomized to either the REACH VN intervention or an enhanced control condition. Inclusion criteria for the caregiver include age ≥18, family member who provides the most day-to-day care for person with dementia, and a total score for the brief (4 item) Zarit Burden Scale of ≥6. Over the course of 2 to 3 months, each participant in the intervention group will receive the REACH VN intervention comprised of 4 core sessions on problem solving, mood management/cognitive restructuring, stress management, and communication, and up to 2 additional sessions based on caregiver's needs. The enhanced control group will receive a single session that provides verbal and written information on dementia. Caregiver outcomes will be assessed at baseline (i.e., time of enrolment) and 3 months. The feasibility will be assessed with regard to recruitment, retention, treatment adherence, treatment fidelity, and assessment processes. For preliminary effectiveness, we will examine caregiver burden as the primary outcome and changes in caregiver depressive symptoms and in Alzheimer disease knowledge as secondary outcomes. DISCUSSION: This is the first study to test community-based family dementia caregiver intervention in Vietnam. Results from this study will provide the foundation for a larger effectiveness trial and broader dissemination in Vietnam and may help inform efforts to develop similar community-based family dementia caregiver support programs in other LMICs. TRIAL REGISTRATION: ClinicalTrials.gov, ID: NCT03587974. Published online July 16, 2018.

Entities:  

Mesh:

Year:  2018        PMID: 30334942      PMCID: PMC6211867          DOI: 10.1097/MD.0000000000012553

Source DB:  PubMed          Journal:  Medicine (Baltimore)        ISSN: 0025-7974            Impact factor:   1.817


Background

In the next several decades, because of a dramatic demographic transition, Vietnam and other low- and middle-income countries (LMICs) will experience a substantial increase in the number of elderly people, including those with dementia. The proportion of the population aged ≥60 years in Vietnam was 10% in 2015 and is predicted to rise to 28% by 2050.[ Based on current estimates of 4% to 8% of Vietnamese aged ≥60 years having dementia,[ Vietnam will have >2 million people living with dementia by the year 2050. Dementia and cognitive impairment are costly and among the leading causes of disability and dependency in old people.[ The total cost for dementia in 2018 is estimated to be 1 trillion US dollars worldwide and it will double by 2030.[ The impact of dementia is not only on patients, but also on their families, communities, and society.[ The families of people with dementia have to spend significant amount of time, effort, and money to support and care for patients with dementia. The high costs of long-term care for people with dementia also strains health and social systems, as well as government budgets.[ Therefore, there is an urgent need for LMICs, including Vietnam to develop a comprehensive national plan and health care initiatives to address dementia as a public health issue and to develop effective approaches to both prevent the disease and to provide adequate support to family caring for persons with dementia in the community. A range of interventions have been developed to respond to dementia, including both pharmacological and non-pharmacological therapies.[ Research has shown that non-pharmacological approaches (e.g., strengthening capacity of family caregivers of people living with dementia via education, skill-building, and stress reduction) are effective in improving caregiver's outcomes and have lower risks and adverse reactions than pharmacological treatments, and result in a better health outcomes for patients and caregivers.[ Among these approaches, Resources for Enhancing All Caregivers Health in the Department of Veterans Affairs (REACH VA) is an evidence-based model supporting dementia caregivers with many advantages. REACH and the follow-up REACH II study, the intervention models upon which REACH VA is based, have been tested and disseminated in a number of countries.[ Their effectiveness has been demonstrated not only in multicultural countries such as the United States, but also in Hong Kong—a country with similar cultural characteristics as in Vietnam.[ Compared with the original REACH and REACH II interventions, REACH VA is briefer, easier to apply, and potentially more sustainable.[ It has also been shown to be as effective in improving outcomes for family caregivers compared with previous versions of the REACH intervention.[ The REACH interventions, including REACH VA, have not yet been tested in LMICs including Vietnam, where community-based approaches are urgently needed. Despite many promising advantages, it is crucial for a new, multi-component psychosocial intervention like REACH VA to be adapted to the local context of Vietnam (e.g., culture and resources) and tested before being implemented nationally.[ Wainberg et al[ developed a model for adapting evidence-based behavioral interventions to a new culture. The model consists of 4 phases namely: selecting an existing model through literature review and discussing with stakeholders; conducting a formative phase to guide the development of the manual; piloting to refine the treatment; and evaluating the adapted treatment using a randomized controlled trial (RCT) design. Following this model, we have conducted a literature review and chosen the REACH VA model after discussion with collaborators in Vietnam, conducted formative interviews with both family caregivers, community leaders, and health workers to modify the REACH VA intervention, developed adapted Vietnamese versions of the caregivers material and interventionist guide, and conducted a case series to pilot the intervention. This study protocol describes the design of a cluster RCT to evaluate our adapted REACH VA intervention (REACH VN). The primary objective of this study is to examine the feasibility of REACH VN in Vietnam. A secondary objective is to conduct exploratory analyses to examine the preliminary effectiveness of REACH VN.

Methods

Study design

A two-arm, 3-month follow-up, cluster RCT will be conducted. A cluster RCT design was chosen because of concerns about “contamination effects” if the intervention and control subjects were drawn from the same geographic area (i.e., commune). The communes in Vietnam are small and people in a commune often know each other well. If subjects from the intervention groups talk to the controlled group about the intervention, it would contaminate the study. Clusters (i.e., communes) will be randomized into group A (REACH VN) or group B (enhanced usual care). All eligible dementia caregiver-care recipient dyads in the intervention communes (group A) will receive the REACH VN intervention while those in the enhanced control communes (group B) will receive enhanced usual care, enhanced by education and receipt of written information on Alzheimer disease and related dementia. At the conclusion of the study, all participants in the enhanced control group will be offered an optional caregiving training workshop.

Study setting

Soc Son district in Hanoi, Vietnam, a community that has worked closely with the National Geriatric Hospital of Vietnam on other projects, has been selected as the site for this study. The National Geriatric Hospital has maintained an existing registry of people with dementia in Soc Son and people with dementia from this registry and their family caregivers will be screened and invited to participate.

Eligibility criteria

Inclusion criteria are family caregivers of persons diagnosed with dementia (Clinical Dementia Rating—CDR score of 1.0 or above[) living in one of the designated clusters (communes). In addition, to be eligible, the primary family caregivers must be 18 years of age or older, the family members who is most involved in dementia patients’ day-to-day care, and have a total score for the brief (4 items) Zarit Burden Scale of 6 or higher.[ Caregivers with significant cognitive impairment will be excluded from the study.

Description of the REACH VN and enhanced control conditions

Participants in the intervention group will receive a culturally adapted intervention that based on the REACH VA intervention.[ While a number of adaptations were made to the REACH VA model (paper in preparation), including translation of manuals and materials into Vietnamese, the REACH VN is very similar in most respects. The intervention itself consists of 4 “core” training sessions on problem solving, mood management/cognitive restructuring, stress management (e.g., signal breath, mindfulness medication, pleasant event scheduling), and communication, plus up to 2 additional sessions based on caregiver's needs and clinical judgment[ and will be delivered over the course of 2 to 3 months. Each session will last approximately 1-hour and will be delivered by an interventionist certified to deliver the intervention. The interventionists will be healthcare professionals and include nurses, physicians, and social workers. The sessions will be administered in the home (or other setting of the subject's choice such as a clinic) and include several components, including psychoeducation, stress reduction, skill-building. While it is anticipated that most sessions will be face-to-face, the interventionist will also have the option of conducting sessions by phone. The intervention will be tailored to the needs and preferences of the caregiver. At the first session, each participant will receive written materials on dementia as well as a caregiver notebook with detailed information on a variety of topics related to dementia caregiving and will serve as a reference during the intervention. After each session, an observer will complete the Treatment Delivery Form to document the delivery of key components of the intervention. The enhanced control condition will consist of a single face-to-face session that will occur at the time of enrollment and be held in the caregiver's home (or another place of their choosing). Caregivers will be educated about the nature of dementia and provided with written educational materials. In addition, any safety issues identified during the visit will be addressed by research staff. All enhanced control participants will be invited to attend a caregiving training workshop that will be held after the conclusion of the study.

Outcomes measures

The primary objective of this study is to assess feasibility of the intervention. The feasibility of the study method will be assessed by using accepted guidelines[ with respect to recruitment, retention, treatment adherence, treatment fidelity, and assessment processes. Recruitment feasibility will be judged by the number of family caregivers screened in order to identify caregivers meeting eligibility criteria and who consent to participation. We will record the subject retention in both arms of the study and track intervention adherence. As part of the feasibility assessment, we will assess treatment fidelity (i.e., interventionist adherence to the treatment protocol) through both direct observation of sessions by one of the study leaders and by having an independent observer assess delivery of key components of the intervention at the end of each session. A comparison between the content actually delivered in sessions (reviewing interventionist notes) and the treatment manual's checklist will also be performed. In addition, the feasibility of the study administration will be measured by the percentage of baseline and 3-month assessments completed, timeliness and length of assessments, and completeness of collected data. While the study will not be powered to examine efficacy, we will conduct analyses to examine caregiver outcomes. For the exploratory analyses of intervention effectiveness, we will use a 4-item version of the Zarit Burden Scale as the primary outcome for caregivers.[ Secondary caregiver outcomes for this analysis will include change in depressive symptoms as measured by the Patient Health Questionnaire 4 (PHQ-4)[ and change in Alzheimer disease knowledge.

Sample size and study duration

This cluster RCT is a pilot study, exploring the preliminary efficacy of the REACH VN intervention and the feasibility of the intervention and study methods to further refine the intervention and prepare for a larger RCT to fully test the intervention effectiveness. Therefore, it is not powered optimally to examine the effectiveness. An expected sample of 10 to 12 communes consisting of approximately 50 dementia primary caregivers will be enrolled into the trial over a 6-month period. For participants, the intervention will consist of 4 to 6 sessions delivered over 2 to 3 months.

Randomization process

Designated communes will be randomly allocated to either the intervention or the enhanced control group with a 1:1 allocation. Randomization will be conducted by one of the principal investigators (PIs) who is not familiar with the characteristics of the communes being randomized. All eligible dementia caregiver-care recipient dyads living in the intervention communes will be the intervention participants while those living in the control communes will be control participants.

Subject recruitment and reimbursement

Participants for this study will be drawn from a registry of individuals in Soc Son who have been previously diagnosed with dementia by neurologists from the National Geriatric Hospital (NGH) in collaboration with local health clinics. NGH staff will contact families of elders with dementia who reside in the designated geographic areas (i.e., communes), introduce the study, and screen caregivers for eligibility criteria. Caregivers who meet inclusion criteria will be asked for permission to have research staff contact to set up an initial visit (i.e., enrollment visit). During the enrollment visit, the research staff will provide additional information for the study and complete verbal consent. Participants in both the REACH VN intervention and the enhanced control group will be reimbursed the equivalent of US $9 for each session they participate in. As part of the consent process, all caregivers are informed that they can withdraw at any time.

Blinding

Because randomization will occur at the level of individual clusters, individual participants will not be blind to the condition they will receive. Staff conducting baseline assessments will not be blind to participant allocation. Staff conducting outcome assessments at 3 months will be blind to allocation.

Assessment of outcomes

Study outcomes will be assessed at the time of enrollment and at 3-months after their enrollment visit. The baseline survey and 3-month follow-up assessments will take approximately 30 to 45 minutes.

Statistical analyses

Data will be analyzed using Stata 15 (StataCorp, College Station, TX)[ or a similar statistical software to generate all statistical reports. Data will be analyzed on an intention to treat basis. For continuous data, the normality of data distribution will be tested using the Shapiro-Wilk test. Mean and standard deviation (SD) will be presented for normally distributed data while median and interquartile rage (IQR) will be used otherwise. For categorical data, frequencies and percentages will be presented. To evaluate efficacy, a general linear model, analogous to an ANCOVA model, which includes the baseline assessment as a covariate, will be used to compare the groups; this model will further incorporate a cluster random effect to account for the clustered design of the trial.

Data monitoring, safety, and quality control

The Institutional Review Boards (IRBs) or similar committee at UC Davis, the University of South Carolina and the NGH will review the study protocol. The IRBs will maintain ongoing oversight of the risks and benefits of the study and ensure compliance with institutional and NIH guidelines. The PI will be responsible for notifying the IRBs at each institution of adverse events in a timely fashion or any changes to study protocol. All study staff will be instructed in the rules of confidentiality and data safeguarding for the study. Patient-identifiable information will be removed from all data. Participant baseline and follow-up data and medical chart abstraction data will be directly entered into a secure, password-protected database by study staff, and will only be linked to a unique study identification number. All participant contact information will be maintained in locked file cabinets at the NGH or the UC Davis Department of Psychiatry. The identity of study participants will be known by the study staff only as needed for purposes of the study. Periodic reports will be generated using graphs and tables summarizing the status of participant, recruitment, and data collection. Missing data will be routinely rectified. Raw data will be kept for 1 year following the publication of the final reports on the study. This study will have a safety officer (SO) but will not have a data safety monitoring board (DSMB). The rationale for not having a DSMB is that this is a single-site, minimal risk clinical trial with a relatively small number of subjects in total. The lead investigators will meet quarterly with SO during the clinical trial. During these meetings, the SO responsibility will be to review the progress of the study, adverse events, procedures for maintaining the confidentiality of data, and the quality of data collection, management, and any analyses. The SO will also review any issues that arise in terms of conflict of interest. The data safety-monitoring plan helps to ensure the safety of participants, the validity of data, and the appropriate termination of the study if significant benefits or risks are uncovered or if it appears that the trial cannot be concluded successfully. The PI and research team will be responsible for monitoring data safety and integrity. Specific data safety and monitoring tasks include: Monitoring patient accrual: Informed consent and patient enrollment processes will be routinely monitored. Data will be collected on the numbers of study eligible participants; those completing informed consent; those refusing study participation; and those unable to be located. Periodic reports will be generated with this information and reviewed by the PI and study staff. When indicated, appropriate action will be initiated to address accrual problems (e.g., incorrect telephone numbers, methods of approaching patients). Monitoring severe adverse events: All study staff will be trained in procedures to identify and handle adverse events. All adverse events will also be reviewed by the study SO. If an adverse event is determined to be likely due to study participation, the PI will report the conclusions of the review to study investigators and to the IRBs of UC Davis, the University of South Carolina, the National Geriatric Hospital, and NIH within 1 week. Adverse events determined to be unlikely to be related to study participation will be reported to the IRBs and NIH as part of routine progress reports. Monitoring study progress: Caregiver outcome data will be collected by study staff and monitored by the project manager and, if necessary, by the biostatistician. The PI and project manager will meet regularly to monitor recruitment, attrition, patient safety, and study implementation; the entire study team.

DISCUSSION

This is a unique study because it is the first to test a culturally-adapted and evidence-based community family dementia caregiver intervention in Vietnam. If successful, the intervention will be an important step towards a larger study to test its effectiveness in Vietnam. The study team is interdisciplinary, including American, Australian, and Vietnamese specialists who are not only experts in different fields relating to dementia care such as gerontology, psychiatry, neurology, pharmacy, social work and nursing, but also has extensive field work experience in Vietnam. The team members from the United States and Australia, 2 of whom are bilingual in English and Vietnamese, have deep understanding of Vietnamese culture as well as the health care system. The Vietnamese study team is based at the NGH, a leading institution in Vietnam for national geriatric policy, as well as geriatric training, healthcare, and research. The collaboration with a leading institution in Vietnam will enhance the future wider “scaling-up” of the final intervention model in Vietnam and the translation of this research into policies to enhance sustainability. This study fills an important and acute gap in Vietnam. While there are a number of psychosocial family caregiver interventions conducted in Asia over the past 2 decades,[ the vast majority have been conducted in high income countries with very few in LMIC. The intervention which will be used in this research is an evidence-based model that has been systematically adapted to ensure that it will align with the local culture, language, and resources. We believe that our project has the potential to significantly influence dementia care practice in Vietnam and REACH VN and might eventually be a model suitable for adoption and use in other LMICs.

Acknowledgments

Danielle Harvey PhD provided consultation on statistics sections of this manuscript. Jennifer Martingdale-Adams PhD and Linda Nichols PhD provided consultation on adaptation of the intervention.

Author contributions

All authors contributed to the paper's conception and design. Tuan Anh Nguyen and Ladson Hinton contributed to the writing of the manuscript. Huong Nguyen and Thang Pham reviewed and commented on the manuscript. All authors read and approved the final manuscript. Conceptualization: Tuan Anh Nguyen, Huong Nguyen, Thang Pham, Trong Hung Nguyen, Ladson Hinton. Funding acquisition: Huong Nguyen, Thang Pham, Trong Hung Nguyen, Ladson Hinton. Investigation: Tuan Anh Nguyen, Huong Nguyen, Thang Pham, Trong Hung Nguyen, Ladson Hinton. Methodology: Tuan Anh Nguyen, Huong Nguyen, Thang Pham, Trong Hung Nguyen, Ladson Hinton. Writing – original draft: Tuan Anh Nguyen. Writing – review & editing: Huong Nguyen, Thang Pham, Ladson Hinton. Tuan Anh Nguyen orcid: 0000-0002-9528-9278
  19 in total

1.  The effectiveness of a mutual support group for family caregivers of a relative with dementia.

Authors:  Wai-Yin Fung; Wai-Tong Chien
Journal:  Arch Psychiatr Nurs       Date:  2002-06       Impact factor: 2.218

2.  Translating Evidence-Based Dementia Caregiving Interventions into Practice: State-of-the-Science and Next Steps.

Authors:  Laura N Gitlin; Katherine Marx; Ian H Stanley; Nancy Hodgson
Journal:  Gerontologist       Date:  2015-02-17

3.  Nonpharmacologic management of behavioral symptoms in dementia.

Authors:  Laura N Gitlin; Helen C Kales; Constantine G Lyketsos
Journal:  JAMA       Date:  2012-11-21       Impact factor: 56.272

4.  Meta-analysis of nonpharmacological interventions for neuropsychiatric symptoms of dementia.

Authors:  Henry Brodaty; Caroline Arasaratnam
Journal:  Am J Psychiatry       Date:  2012-09       Impact factor: 18.112

5.  A model for adapting evidence-based behavioral interventions to a new culture: HIV prevention for psychiatric patients in Rio de Janeiro, Brazil.

Authors:  Milton L Wainberg; Karen McKinnon; Paulo E Mattos; Diana Pinto; Claudio Gruber Mann; Claudia Simone Dos Santos de Oliveira; Suely Broxado de Oliveira; Robert H Remien; Katherine S Elkington; Francine Cournos
Journal:  AIDS Behav       Date:  2007-01-10

6.  An ultra-brief screening scale for anxiety and depression: the PHQ-4.

Authors:  Kurt Kroenke; Robert L Spitzer; Janet B W Williams; Bernd Löwe
Journal:  Psychosomatics       Date:  2009 Nov-Dec       Impact factor: 2.386

7.  The Clinical Dementia Rating (CDR): current version and scoring rules.

Authors:  J C Morris
Journal:  Neurology       Date:  1993-11       Impact factor: 9.910

8.  Randomized controlled trial of a dementia care programme for families of home-resided older people with dementia.

Authors:  Wai Tong Chien; Isabella Y M Lee
Journal:  J Adv Nurs       Date:  2010-12-28       Impact factor: 3.187

9.  Resources for Enhancing Alzheimer's Caregiver Health (REACH): overview, site-specific outcomes, and future directions.

Authors:  Richard Schulz; Louis Burgio; Robert Burns; Carl Eisdorfer; Dolores Gallagher-Thompson; Laura N Gitlin; Diane Feeney Mahoney
Journal:  Gerontologist       Date:  2003-08

10.  The effectiveness of a home care program for supporting caregivers of persons with dementia in developing countries: a randomised controlled trial from Goa, India.

Authors:  Amit Dias; Michael E Dewey; Jean D'Souza; Rajesh Dhume; Dilip D Motghare; K S Shaji; Rajiv Menon; Martin Prince; Vikram Patel
Journal:  PLoS One       Date:  2008-06-04       Impact factor: 3.240

View more
  8 in total

1.  Engaging families to advance global mental health intervention research.

Authors:  Ladson Hinton; Brandon A Kohrt; Arthur Kleinman
Journal:  Lancet Psychiatry       Date:  2019-04-04       Impact factor: 27.083

2.  Resources for Enhancing Alzheimer's Caregiver Health in Vietnam (REACH VN): study protocol for a cluster randomized controlled trial to test the efficacy of a family dementia caregiver intervention in Vietnam.

Authors:  Duyen Tran; Huong Nguyen; Thang Pham; Anh T Nguyen; Hung T Nguyen; Ngoc B Nguyen; Bien H Nguyen; Danielle Harvey; Laura Gitlin; Ladson Hinton
Journal:  Trials       Date:  2022-05-09       Impact factor: 2.728

3.  Advancing family dementia caregiver interventions in low- and middle-income countries: A pilot cluster randomized controlled trial of Resources for Advancing Alzheimer's Caregiver Health in Vietnam (REACH VN).

Authors:  Ladson Hinton; Huong Nguyen; Hung Trong Nguyen; Danielle J Harvey; Linda Nichols; Jennifer Martindale-Adams; Binh Thanh Nguyen; Binh Thi Thanh Nguyen; Anh Ngoc Nguyen; Chinh Hong Nguyen; Thu Thi Hoai Nguyen; Thuy Le Nguyen; Anh Thi Phuong Nguyen; Ngoc Bich Nguyen; Quyen Q Tiet; Tuan Anh Nguyen; Phong Quy Nguyen; Trung Anh Nguyen; Thang Pham
Journal:  Alzheimers Dement (N Y)       Date:  2021-01-23

4.  The Potential for the Internet and Telehealth in Caregiver Support. Comment on "Using Technology to Facilitate Fidelity Assessments: The Tele-STAR Caregiver Intervention".

Authors:  Kohei Kajiwara; Jun Kako; Hiroko Noto; Yasufumi Oosono; Masamitsu Kobayashi
Journal:  J Med Internet Res       Date:  2021-02-16       Impact factor: 5.428

5.  Empowering Dementia Carers With an iSupport Virtual Assistant (e-DiVA) in Asia-Pacific Regional Countries: Protocol for a Pilot Multisite Randomized Controlled Trial.

Authors:  Tuan Anh Nguyen; Kham Tran; Adrian Esterman; Bianca Brijnath; Lily Dongxia Xiao; Penelope Schofield; Sunil Bhar; Nilmini Wickramasinghe; Ronald Sinclair; Thu Ha Dang; Sarah Cullum; Yuda Turana; Ladson Hinton; Katrin Seeher; Andre Q Andrade; Maria Crotty; Susan Kurrle; Stefanie Freel; Thang Pham; Thanh Binh Nguyen; Henry Brodaty
Journal:  JMIR Res Protoc       Date:  2021-11-16

6.  "It's extremely hard but it's not a burden": A qualitative study of family caregiving for people living with dementia in Vietnam.

Authors:  Huong Nguyen; Trang Nguyen; Duyen Tran; Ladson Hinton
Journal:  PLoS One       Date:  2021-11-29       Impact factor: 3.240

7.  Expert Consensus on the Care and Management of Patients with Cognitive Impairment in China.

Authors:  Yuliang Han; Jianjun Jia; Xia Li; Yang Lv; Xuan Sun; Shanshan Wang; Yongjun Wang; Zhiwen Wang; Jintao Zhang; Jiong Zhou; Yuying Zhou
Journal:  Neurosci Bull       Date:  2019-12-02       Impact factor: 5.271

8.  Interventions to support family caregivers of people living with dementia in high, middle and low-income countries in Asia: a scoping review.

Authors:  Ladson Hinton; Duyen Tran; Thuc-Nhi Nguyen; Janis Ho; Laura Gitlin
Journal:  BMJ Glob Health       Date:  2019-11-12
  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.