Literature DB >> 34461776

Transition to Independent Surgical Practice and Burnout Among Early Career General Surgeons.

Mohammed Firdouse1, Caitlin Chrystoja1, Sandra de Montbrun2, Jaime Escallon2,3, Tulin Cil2,3.   

Abstract

Background: The transition from surgical residency to independent practice is a challenging period that has not been well studied.
Methods: An email invitation to complete a 55-item survey and the Maslach Burnout Inventory-Human Services Survey (MBI-HSS) was sent to early career general surgeons across Canada. The chi-square test or Fisher's exact test was used to compare demographic and survey characteristics with burnout. Multivariable logistic regression was performed.
Results: Of the 586 surgeons contacted, 88 responded (15%); 51/88 surgeons (58.0%) were classified as burnt out according to the MBI-HSS. Most surgeons (68.2%) were not confident in their abilities to handle the business aspect of practice. The majority (60.2%) believed that a transition to independent practice program would be beneficial to recent surgical graduates. Conclusions: Our data showed high prevalence of burnout among recently graduated general surgeons across Canada. Further, respondents were not confident in their managerial and administrative skills required to run a successful independent practice.

Entities:  

Keywords:  burnout; general surgery; independent practice; residency; stress; transition

Mesh:

Year:  2021        PMID: 34461776      PMCID: PMC9016671          DOI: 10.1177/15533506211039682

Source DB:  PubMed          Journal:  Surg Innov        ISSN: 1553-3506            Impact factor:   1.785


Introduction

Within North America, medical trainees must successfully complete a residency program and in some cases, pursue fellowship training before they can start practicing as an attending staff in independent practice. This transition from trainee to staff physician may be stressful and overwhelming.[2,3] Within a short period of time, staff physicians are faced with multiple challenges such as adapting to a new setting with new colleagues, taking on the role of primary clinical decision maker, and managing non-clinical tasks such as teaching, research, financial planning, and their personal lives. The issues affecting recent graduates during this stressful transition period have been sparsely covered in the literature, and none of the published studies resulted in an empirically founded conceptual framework.[4-10] The American College of Surgeons has recognized this and focused efforts toward creating transition to practice programs to better equip residents for a smoother transition. Recent studies also highlight the growing problem of burnout in medical practitioners. Within general surgery, rates of burnout are significant and may manifest with symptoms of depersonalization, emotional exhaustion, and reduced personal accomplishment. Physician burnout is a serious area of concern as it has been correlated with low morale, personal dysfunction, insomnia, physical exhaustion, personal problems, poor performance, and deterioration in quality of medical care.[14,15] In addition, both depression and burnout have been associated with major medical errors. Of note, studies have demonstrated that burnout develops as early as medical school and continues throughout residency.[15,17] Considering the potential increase in stress during the transition from residency or fellowship training to independent practice, we hypothesize that this subset of surgeons may have particularly greater prevalence of burnout. Furthermore, most residency training programs focus on competencies and skills development in the residency curriculum. This leaves little or no teaching on the other aspects of career management including the administrative and business responsibilities of medical practice. The aims of this research were twofold. First, we sought to assess issues affecting new graduates of general surgery programs within Canada, particularly their perception of their ability to manage an independent practice. Second, we assessed the prevalence of burnout among this subset of general surgeons.

Methods

After obtaining institutional research ethics board review, a study invite was sent out via email to early career general surgeons across Canada asking them to complete a cross-sectional survey accessible through a provided URL from www.fluidsurvey.com. The names and contact information of surgeons were obtained from the database of surgical graduates participating in the annual General Surgery Review Course in Toronto, ON. This included surgeons who had graduated between 2007 and 2012 from a general surgery residency program in Canada. The survey was composed of 55 questions covering demographic factors, issues regarding independent practice, surgeons’ perception of their roles, responsibilities, and training preparation. We also included the validated Maslach Burnout Inventory–Human Services Survey (MBI-HSS). Three iterations of the invitation emails were sent with 2-week intervals in between each. The completion and submission of the survey indicated implied consent for the data to be used in the study. The demographic characteristics section of the survey was constructed by referring to several papers assessing burnout in healthcare providers,[19-22] especially Soler et al, Balch et al, Napolitano et al, and Friedell et al. The MBI-HSS is the most widely used measure of burnout for healthcare professionals. It has been extensively tested for its reliability and validity since its creation in the early 1980s. Consequently, the MBI-HSS has become the gold-standard tool for burnout assessment and was selected for this study based on its strong psychometric properties. The MBI-HSS is a 22-item self-report questionnaire that measures three dimensions of the burnout syndrome: emotional exhaustion (EE), depersonalization (DP), and reduced personal accomplishment (PA). The response for each question is a 7-item Likert scale ranging from 0 (never) to 6 (everyday). For each dimension, the total score is calculated by summation of its questions and then classified into “low,” “moderate,” and “high” categories based on the cutoff scores outlined in the MBI-HSS interpretation guidelines. There is considerable heterogeneity in how studies define burnout syndrome. For this study, we classified participants with high EE (score ≥27) or high DP (score ≥13) as having burnout. We described demographic, survey, and burnout characteristics for all participants. Categorical variables were described as numbers and percentages. The chi-square test, or Fisher’s exact test as appropriate, was used to compare demographic and survey characteristics with burnout. Missing responses for question components related to EE or DP were assigned a score of 3. A sensitivity analysis was conducted assessing the impact of missing response score assignment on classification of burnout. Multivariable logistic regression of the association of demographic and survey characteristics with burnout was performed utilizing the screening variable selection method. First, we selected covariates with a P-value of .25 or less on bivariate analysis, with burnout as the outcome variable. Second, we selected variables with the highest chi-square value, for the greatest number of variables allowed by the convention of one independent variable for every 10 events (or non-events, whichever is smaller). Third, we constructed a full model and verified model assumptions. P-values less than .05 were considered statistically significant. All statistical analyses were performed with SAS Studio 3.6 (SAS Institute, Carty, NC).

Results

Demographics

A total of 630 early career general surgeons were contacted; 44 (7%) emails bounced back due to inactive or incorrect contact information. Of the remaining 586, 88 participants responded to the survey (15.0%) with a 98% completion rate; 44 (50%) responses were from men, 43 (48.9%) from women, and 1 participant (1.1%) chose not to disclose their sex. The majority of participants were married (68.2%). Most (41.4%) general surgeons had 2–3 years (37.5%) of independent surgical practice (see Table 1 for more details).
Table 1.

Demographics of Survey Participants (n=88).

DemographicsnPercentage of total respondents
Age
 25–352326.1%
 36–455865.9%
 46–5555.7%
 56–6511.1%
 >6511.1%
Gender
 Male4450%
 Female4349.9%
 Undisclosed11.1%
Marital status
 Single1415.9%
 Partnership78.0%
 Common law55.7%
 Married6068.2%
 Divorced/separated22.3%
Years since MD attained
 1–578.0%
 6–104247.7%
 11–153236.4%
 16–2044.6%
 >2133.4%
Specialty
 General surgery3640.9%
 Breast surgery33.4%
 Surgical oncology1314.8%
 Pediatric surgery44.5%
 Trauma surgery66.8%
 Minimally invasive1314.8%
 Other1213.6%
 Missing11.1%
Years of independent practice
 0–155.7%
 2–33337.5%
 4–52123.9%
 5+2933.0%
Demographics of Survey Participants (n=88).

Confidence and Comfort in Independent Practice

The majority of surgeons (80/88—92.0%) felt that the operating skills they gained during their residency training were sufficient and appropriate for independent practice. However, 60/88 surgeons (68.2%) were not comfortable in their abilities to handle the business aspect of practice and 48/88 surgeons (54.5%) were not confident in coding and billing their services. Although 75/88 surgeons (85.2%) felt comfortable in functioning in an attending’s role, 53/88 surgeons (60.2%) believed that a transition to independent practice program would be beneficial to recent surgical graduates (refer to Table 2 for more details).
Table 2.

Confidence and Comfort Levels of Participants (n=88) With Regard to Independent Practice.

QuestionDefinitely not confident (%)Somewhat not confident (%)Neutral (%)Somewhat confident (%)Extremely confident (%)Missing (%)
Do you feel that the operating skill gained during your training is sufficient and appropriate for independent practice?02.35.860.931.01.1
When you started independent practice, how confident did you feel in your surgical skills and competencies?2.35.824.152.914.91.1
How confident are you in successfully managing and running an outpatient clinic?1.22.314.937.943.71.1
How confident and comfortable are you in handling the business aspects of practice?16.125.326.427.64.61.1
How confident are you in coding and billing your services?4.620.728.736.89.21.1
How confident and comfortable are you in keeping up with latest research and practicing evidence-based medicine?1.28.134.551.74.61.1
How comfortable and confident are you in functioning in an attending’s role?02.311.549.436.81.1
How comfortable and confident are you in your operative decision-making as an independent practitioner?005.857.037.22.2
How comfortable and confident are you in your clinical decision-making as an independent practitioner?004.660.934.51.1
Do you feel you are adequately prepared to transition from a resident/fellow to an attending role?04.619.551.724.11.1
How comfortable do you feel about resolving conflicts within your healthcare team in independent practice?4.79.318.655.811.62.2
Do you feel a transition to independent practice program would be beneficial to recent surgical graduates?3.512.623.041.419.51.1
Confidence and Comfort Levels of Participants (n=88) With Regard to Independent Practice.

Perceptions of Burnout

Many surgeons (40.2%) from our study identified as having experienced burnout currently or in the past. The majority (85/88—96.6%) perceived no commitment in their workplaces to prevent burnout; 87/88 surgeons (98.9%) claimed they did not receive any formal training to prevent burnout and 82/88 surgeons (93.2%) felt that change was needed to address burnout in their workplace (refer to Table 3 for more details).
Table 3.

Perceptions of Burnout Among Surgeons (n = 88).

QuestionNone (%)Little (%)Neutral (%)Some (%)More than needed (%)Missing (%)
How much support do you feel you have at work?3.518.427.643.76.91.1
How much personal support (family, friends, etc.) do you feel you have?1.28.120.747.123.01.1
How much commitment do you perceive there is in your workplace to prevent burnout?58.123.315.13.502.2
How taboo is the discussion of burnout and risk factors for burnout at your workplace?8.117.424.433.716.32.2
How much training to prevent burnout do you perceive there to be in your workplace?62.827.98.11.202.2
How much more needs to be done to address burnout in your workplace?04.725.622.147.72.2
How frequently do you have to take time off work for leisure/vacation?
 Every monthn=5 (5.8%)
 Every 3 monthsn=44 (50.6%)
 Every 6 monthsn=31 (35.6%)
 Every 12 monthsn=4 (4.6%)
 Every 12+ monthsn=3 (3.5%)
 Missingn=1 (1.1%)
Do you perceive yourself as experiencing burnout?
 Yes, currentlyn=16 (18.4%)
 Yes, previouslyn=22 (25.3%)
 Mayben=37 (42.5%)
 Definitely notn=15 (17.2%)
 Missingn=1 (1.1%)
Perceptions of Burnout Among Surgeons (n = 88).

Maslach Burnout Inventory Scores

Over half of respondents (51/88—58.0%) met the criteria for burnout; 26 surgeons (29.6%) had high DP and 47 surgeons (53.4%) had high EE. Only 11 (12.5%) surgeons had low PA. The sensitivity analysis demonstrated no impact on burnout classification based on assigning missing question components related to EE or DP any score value between 0 and 6 (refer to Tables 4, 5).
Table 4.

Maslach Burnout Inventory Scores (n = 88 Respondents).

MBI componentnPercentage of total respondents (%)
Emotional exhaustion
 Low1820.5
 Medium2326.1
 High4753.4
Depersonalization
 Low3034.1
 Medium3236.4
 High2629.6
Personal accomplishment
 Low1112.5
 Medium2933.0
 High4854.6
Table 5.

Bivariate Analysis of Demographic and Survey Characteristics to the Presence of Burnout.

Not burnout (n=37)Burnout (n=51)P-value
Gender.60
 Male17 (38.6%)27 (61.4%)
 Female19 (44.2%)24 (55.8%)
Age.87
 25–3510 (43.5%)13 (56.5%)
 36–65+27 (41.5%)38 (58.5%)
Marital status.48
 Single/separated/divorced8 (50.0%)8 (50.0%)
 Relationship/common law/married29 (40.3%)43 (59.7%)
Children.49
 None15 (46.9%)17 (53.1%)
 1 or more22 (39.3%)34 (60.7%)
Years of independent practice.67
 0–315 (39.5%)23 (60.5%)
 4–5+22 (44.0%)28 (56.0%)
Surgical specialty.69
 General14 (38.9%)22 (61.1%)
 Subspecialty22 (43.1%)29 (56.9%)
Do you feel that the operating skill gained during your training is sufficient and appropriate for independent practice?1.00
 Definitely not confident–neutral3 (37.5%)5 (62.5%)
 Somewhat confident–extremely confident34 (42.5%)46 (57.5%)
How confident are you in successfully managing and running an outpatient clinic?.53
 Definitely not confident–neutral6 (35.3%)11 (64.7%)
 Somewhat confident–extremely confident31 (43.7%)40 (56.3%)
How confident and comfortable are you in handling the business aspects of practice?.72
 Definitely not confident–neutral26 (43.3%)34 (56.7%)
 Somewhat confident–extremely confident11 (39.3%)17 (60.7%)
How confident are you in coding and billing your services?.43
 Definitely not confident–neutral22 (45.8%)26 (54.2%)
 Somewhat confident–extremely confident15 (37.5%)25 (62.5%)
How confident and comfortable are you in keeping up with latest research and practicing evidence-based medicine?.86
 Definitely not confident–neutral16 (41.0%)23 (59.0%)
 Somewhat confident–extremely confident21 (42.9%)28 (57.1%)
How comfortable and confident are you in functioning in an attending’s role?.78
 Definitely not confident–neutral5 (38.5%)8 (61.5%)
 Somewhat confident–extremely confident32 (42.7%)43 (57.3%)
How comfortable and confident are you in your operative decision-making as an independent practitioner? .02
 Definitely not confident–neutral0 (0%)7 (100%)
 Somewhat confident–extremely confident37 (45.7%)44 (54.3%)
How comfortable and confident are you in your clinical decision making as an independent practitioner?.07
 Definitely not confident–neutral0 (0%)5 (100%)
 Somewhat confident–extremely confident37 (44.6%)46 (55.4%)
Do you feel you are adequately prepared to transition from a resident/fellow to an attending role? .03
 Definitely not confident–neutral5 (22.7%)17 (77.3%)
 Somewhat confident–extremely confident32 (48.5%)34 (51.5%)
How comfortable do you feel about resolving conflicts within your healthcare team in independent practice?.46
 Definitely not confident–neutral11 (36.7%)19 (63.3%)
 Somewhat confident–extremely confident26 (44.8%)32 (55.2%)
Do you feel a transition to independent practice program would be beneficial to recent surgical graduates?.15
 Definitely not confident–neutral18 (51.4%)17 (48.6%)
 Somewhat confident–extremely confident19 (35.9%)34 (64.2%)
How much support do you feel you have at work? .005
 None–neutral12 (27.3%)32 (72.7%)
 Some–more than needed25 (56.8%)19 (43.2%)
How much personal support (family, friends, etc.) do you feel you have?.12
 None–neutral8 (29.6%)19 (70.4%)
 Some–more than needed29 (47.5%)32 (52.5%)
How much commitment do you perceive there is in your workplace to prevent burnout?1.00
 None–neutral36 (42.4%)49 (57.7%)
 Some–more than needed1 (33.3%)2 (66.7%)
How taboo is the discussion of burnout and risk factors for burnout at your workplace?.13
 Not at all–little7 (29.2%)17 (70.8%)
 Neutral–completely taboo30 (46.9%)34 (53.1%)
How much training to prevent burnout do you perceive there to be in your workplace?.42
 None–neutral36 (41.4%)51 (58.6%)
 Some–more than needed1 (100%)0 (05)
How much more needs to be done to address burnout in your workplace?.23
 None–little4 (66.7%)2 (33.3%)
 Neutral–lots of change33 (40.2%)49 (59.8%)
How frequently do you have to take time off work for leisure/vacation?.13
 Every month–every 3 months (1)25 (51.0%)24 (49.0%)
 Every 6 months–every 12+ months12 (34.3%)23 (65.7%)
Do you perceive yourself as experiencing burnout? .03
 Currently or previously10 (28.6%)25 (71.4%)
 Maybe or definitely not27 (51.9%)25 (48.1%)
Maslach Burnout Inventory Scores (n = 88 Respondents). Bivariate Analysis of Demographic and Survey Characteristics to the Presence of Burnout.

Association of Demographics and Survey Characteristics With Burnout

There was no difference in burnout by gender, age, marital status, having children, years of independent practice, or by general surgical sub-specialty (Table 5). Factors associated with burnout included lack of confidence in operative decision-making as an independent practitioner (P=.02), lack of confidence in preparation to transition from a resident/fellow to an attending role (P=.03), lack of support at work (P=.005), and self-perception of currently or previously experiencing burnout (P=.03). Of the 35/87 surgeons (40.2%) from our study who perceived themselves as being burnt out, 25 surgeons (71.5%) met the criteria for burnout based on the MBI. Contrarily, of the 52/87 surgeons who were either unsure or not confident about experiencing burnout, 25 surgeons (48%) met burnout criteria. The multivariable logistic regression model evaluating the association between demographic and survey characteristics and burnout is shown in Table 6. The overall model was significant (omnibus likelihood ratio χ2=12.3, P=.002) with 69.8% discriminant ability. A lack of support at work was associated with increased odds of having burnout (OR 4.33, 95% CI 1.68–11.20, P=.003), as was feeling that the discussion of burnout in the workplace is taboo (OR 3.05, 95% CI 1.02–9.13, P=.05).
Table 6.

Multivariable Logistic Regression Analysis of the Association Between Survey Characteristics and Burnout.

PredictorAdjusted odds ratio (95% CI)Test statisticP-value
Omnibus likelihood ratio (χ2 (df), P-value)12.3 (2).002 a
Support at work (none–neutral vs some–more than needed)4.33 (1.68–11.20)9.17.003 a
Discussion of burnout in the workplace is taboo (neutral–completely taboo vs not at all–little)3.05 (1.02–9.13)3.96.05 a

a Statistically significant association.

Multivariable Logistic Regression Analysis of the Association Between Survey Characteristics and Burnout. a Statistically significant association.

Discussion

Over half of the surgeons from our study were classified with burnout based on their responses to the MBI-HSS, although many did not identify or recognize this. This is in line with findings by Bucholz et al from a national survey of 4136 American general surgery residents. Although, our data did not highlight any sex-based differences in burnout rates, likely due to a small sample size, a higher prevalence amongst female surgeons has been clearly demonstrated by various authors.[13,25-27] Furthermore, in the national survey of American general surgery residents conducted by Elmore et al, those who voluntarily left their training programs cited the lack of a mechanism to discuss their personal and professional concerns without fear of reprisal as a contributing factor for burnout and their decision to change careers. Our data corroborate the aforementioned finding and warrant further implementation of institutional interventions to raise awareness as well as prevent and address burnout in the workplace setting.[12,28] Our study also found that early career general surgeons did not receive sufficient training in easing their transition to independent practice. Of note, De Montbrun et al showed that experiences during this transitional period are crucial in the growth and professional development of recently trained attending staff. Strikingly, while the majority of surgeons in our study felt confident with their technical skills and ability to operate in an attending’s role, only a minority was confident in their ability to successfully manage and run an outpatient clinic independently. Similar to our findings, Klingensmith et al have demonstrated a strong desire and need from general surgery residents in the United States for training on surgical practice administration such as coding and reimbursement, patient billing, and taxes. Hashimoto et al have also pointed toward lack of increased resident autonomy as being one of the factors hindering a smooth transition to independent practice. This study represents the largest study on burnout among general surgeons at the start of their surgical careers. Although much focus has been placed on facilitating the transitions in other training periods (eg, from medical school to residency), no study to our knowledge has focused on the later end of the surgical training and early career period. Similar to a surgical boot camp for medical students entering surgery training, perhaps residency and fellowship programs may address their final year trainees to ensure they are adequately equipped to transition into independent practice. The American College of Surgeons has recognized this and focused efforts toward creating transition to practice programs to better equip residents for a smoother transition.[11,32] However, long-term outcomes and utility of such curricula need to be further assessed.[33,34] Wakeam et al has also suggested a practice-sharing model for surgeons early in their career. In this model, senior surgeons close to their retirement may mentor and train the incoming new graduate for a few years, which may help alleviate some of their stress. A limitation of our study is the relatively small sample size of 88 surgeons across Canada. This may call into question the study’s external validity and generalizability of our findings. Although the sample size is smaller than desired, we did have a diverse population representative of many training programs. Furthermore, our study included both general surgeons as well as subspecialty surgeons practicing in both community and academic settings. Although our survey data illustrate the various types of subspecialty vs general surgeons, we do not know the distribution of the participants based on the type of practice setting (community or academic). This variable may have provided further context to our findings as these practice settings may certainly yield different issues and potential stressors for participants. A final limitation of the study, as with any survey study, is that the value of the collected data solely depends on how accurately and truthfully the participants responded to questions in the survey. In general, survey studies assume the data collected to be legitimate and reflective of the participants’ true beliefs; however, this might not always be the case. Larger studies focusing on the aforementioned drawbacks are warranted. Our findings provide some insight into the factors contributing to burnout amongst the recently graduated general surgeon population. Since burnout adversely effects physician–patient interactions and is associated with higher economic costs (as a result of higher absenteeism, job turnover, and quality control issues), the goal in preventing or mitigating burnout is to improve not only physicians’ quality of life but also patient care.[36,37] Future directions for research include focusing on at risk populations to identify measures necessary to reduce burnout and ease the transition of surgical graduates to independent practices.

Conclusion

Our data showed high prevalence of burnout amongst recently graduated general surgeons across Canada. During the transition phase to independent practice, although most surgeons felt satisfied with their surgical skills, they were not confident in their managerial and administrative skills required to run a successful independent practice. Addressing these issues in surgical training programs may be beneficial for future surgeons.
  33 in total

1.  Burnout in medical students: examining the prevalence and associated factors.

Authors:  Sally A Santen; Danielle B Holt; Jean D Kemp; Robin R Hemphill
Journal:  South Med J       Date:  2010-08       Impact factor: 0.954

2.  Thoughts of Quitting General Surgery Residency: Factors in Canada.

Authors:  David Nathan Ginther; Sheev Dattani; Sarah Miller; Paul Hayes
Journal:  J Surg Educ       Date:  2015-12-18       Impact factor: 2.891

3.  Burnout and medical errors among American surgeons.

Authors:  Tait D Shanafelt; Charles M Balch; Gerald Bechamps; Tom Russell; Lotte Dyrbye; Daniel Satele; Paul Collicott; Paul J Novotny; Jeff Sloan; Julie Freischlag
Journal:  Ann Surg       Date:  2010-06       Impact factor: 12.969

4.  Practice transition in graduate medical education.

Authors:  Robyn Shaffer; Nancy Piro; Laurence Katznelson; Melanie Hayden Gephart
Journal:  Clin Teach       Date:  2017-02-06

5.  Entering medical practice for the very first time: emotional talk, meaning and identity development.

Authors:  Esther Helmich; Sanneke Bolhuis; Tim Dornan; Roland Laan; Raymond Koopmans
Journal:  Med Educ       Date:  2012-11       Impact factor: 6.251

6.  Are general surgery residents ready to practice? A survey of the American College of Surgeons Board of Governors and Young Fellows Association.

Authors:  Lena M Napolitano; Mark Savarise; Juan C Paramo; Laurel C Soot; S Rob Todd; Jay Gregory; Gary L Timmerman; William G Cioffi; Elisabeth Davis; Ajit K Sachdeva
Journal:  J Am Coll Surg       Date:  2014-02-06       Impact factor: 6.113

Review 7.  Quality of Life and Burnout Rates Across Surgical Specialties: A Systematic Review.

Authors:  Marisa Pulcrano; Stephen R T Evans; Michael Sosin
Journal:  JAMA Surg       Date:  2016-10-01       Impact factor: 14.766

8.  Practice administration training needs of recent general surgery graduates.

Authors:  Mary E Klingensmith; Thomas H Cogbill; Kelli Samonte; Andrew Jones; Mark A Malangoni
Journal:  Surgery       Date:  2015-06-06       Impact factor: 3.982

9.  Our trainees' confidence: results from a national survey of 4136 US general surgery residents.

Authors:  Emily M Bucholz; Gloria R Sue; Heather Yeo; Sanziana A Roman; Richard H Bell; Julie A Sosa
Journal:  Arch Surg       Date:  2011-08

10.  Training experience and views of recently appointed consultants in geriatric medicine.

Authors:  M Sandler
Journal:  J R Coll Physicians Lond       Date:  1992-01
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.