Literature DB >> 34810360

Comparative evaluation of crestal bone level by flapless and flap techniques for implant placement: Systematic review and meta-analysis.

Krishankumar Lahoti1, Sayali Dandekar1, Jaykumar Gade1, Megha Agrawal1.   

Abstract

Aim: :To compare the crestal bone level of flapless technique of dental implant placement with the flap technique. Setting and Design: This Systematic review and Meta-analysis was conducted according to the Preferred Reporting Items For Systematic Review and Meta-Analyses (PRISMA) Guidelines and registered with PROSPERO. Materials and
Methods: Electronic search of Medline and Google scholar databases for articles from 2010 till March 2020 was performed. Studies comparing the crestal bone level with both the techniques were included. After the collection of data, the risk of bias was assessed for each study. Statistical Analysis Used: Meta-analysis was executed using RevMan 5 software version 5.3.
Results: 23 studies were included. Statistically significant difference in crestal bone level was found between flapless and flap surgery with mean difference of -0.14 (flapless placement versus flap surgery; 95% CI: -0.24 to -0.03; P = 0.01FNx01). The difference in crestal bone level between the 2 groups was not statistically significant with a mean difference of -0.05(Guided flapless placement versus flap surgery; 95% CI: -0.10 to 0.00; P=0.06). Meta-analysis of the freehand flapless surgery with flap surgery generated a mean difference of -0.20 which was found to be statistically significant (Freehand flapless placement versus flap surgery; 95% CI: -0.37 to -0.03; P=0.02FNx01). Conclusions: Flapless placement of implant can positively influence crestal bone loss in comparison with conventional flap technique.

Entities:  

Keywords:  Crestal bone level; dental implant; flapless; guided flapless

Mesh:

Year:  2021        PMID: 34810360      PMCID: PMC8617445          DOI: 10.4103/jips.jips_208_21

Source DB:  PubMed          Journal:  J Indian Prosthodont Soc        ISSN: 0972-4052


INTRODUCTION

Dental implants facilitate mastication, phonation, and esthetics and are one of the most common treatment modalities used for the rehabilitation of missing teeth. To provide support for the dental prosthesis, implants form a direct connection with the surrounding bone known as “osseointegration.”[1] Enhancing patient comfort and predictability of treatment with precise presurgical treatment planning have been the goals of evolving implant dentistry.[2] Branemark has advocated flap elevation technique for implant placement since the 1970s. The protocol by Branemark placed the incision line and sutures away from the implant location, reducing the risk of infection at the surgical site location.[34] The current advancements and incorporation of new technologies have led to an approach wherein the implants can be placed with minimal incision either freehand or with the assistance of surgical guide. Sustained efforts to incorporate this minimally invasive flapless technique have been made in the field of implantology. Although the scientific evidence to prove the accuracy is still not considered adequate, many researchers advocate this approach based on their assessment of the literature.[567] Chrcanovic et al. in 2014[5] in their systematic review stated that flapless approach significantly influenced the implant survival rate compared to conventional surgery. Lin et al.[6] and Lemos et al.[7] could not establish a significant difference in the survival rate or crestal bone loss between the two techniques. Although freehand implant placement is not considered as accurate as guided flapless surgery as reported by Nickenig et al. in 2010,[8] a review by Voulgarakis et al. in 2014[9] suggested that the surgical guides did not significantly influence the outcome. No real conclusion has been reached to date which would clearly state the benefit of one approach over the other. This systematic review was thereby designed to compile the literature and compare the flapless and flap techniques in terms of crestal bone level.

MATERIALS AND METHODS

This systematic review was designed and performed in accordance with PRISMA guidelines laid down in 2015.[10] A specifically formulated protocol was registered with PROSPERO (CRD42020162689) before the start of the review.

Study question

“How is the crestal bone level by flapless technique compared to flap technique for dental implant placement?” which fulfills the PICOS framework [Table 1].
Table 1

PICOS framework

DomainDescription
PPatients requiring dental implant surgery
IFlapless technique
CFlap technique
OCrestal bone level around implant
SProspective clinical trials
PICOS framework

Search strategy

Electronic search of MEDLINE and Google Scholar from 2010 to March 2020 was performed. Subject AND Adjective combinations were used: Subject: Dental implant OR dental implant placement AND Adjective: flapless technique OR flapless placement OR open flap OR flap elevation OR flapless surgery OR Keywords – combinations of the following keywords: “crestal bone level;” “dental implant;” “surgery;” “flap;” and “flapless;” “Flapless versus Flap surgery;” and “crestal bone loss.” Furthermore, a manual search was conducted based on the references of selected studies.

Inclusion criteria

Studies on patients requiring rehabilitation with dental implant Studies which had data regarding the crestal bone level of both the intervention and comparison groups Prospective clinical studies Full-text access of article Primary language of article: English.

Exclusion criteria

Duplicate studies, In vitro studies, case reports, opinions, letters, and reviews.

Data collection

After the studies were scanned for information, relevant data were tabulated which comprised authors of the study, study year, technique of placement, crestal bone changes, and other outcome measures. Any disagreements were resolved by discussion. The data were compiled to perform meta-analysis.

Risk of bias for individual studies

Bias assessment for randomized studies was done based on the fulfillment of criteria of sequence generation, blinding, allocation concealment, and addressed outcome measures. For nonrandomized studies, the Newcastle–Ottawa scale was used.

Statistical analysis

Crestal bone level was the primary outcome measure, which was treated as a continuous data variable. Aggregate analysis using a fixed-effects model and a random-effects model was carried out. Heterogeneity was tested. Forest plot was generated showing standardized mean difference as the effect measure. Funnel plot was drawn to check for publication bias. The analysis was performed by using Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.

RESULTS

Study selection

Four thousand four hundred and forty-three records were obtained by the selection process [Figure 1]. After removing duplicate records, 2343 were held back. Fifty-seven records were reached after 2286 were scanned according to eligibility criteria. Thirty-four articles were removed after full-text reading for reasons mentioned in Table 2. In the end, only 23 articles were retained for meta-analysis.
Figure 1

PRISMA flow diagram for study selection process

Table 2

List of excluded studies

Reason for exclusionReferences
No control groupNikzad and Azari[11]Jeong et al.[12]Lee et al.[13]Tee[14]Kareem et al.[15]Oliver et al.[16]Komiyama et al.[17]Altinci et al.[18]Jesch et al.[19]
Review articlesLin et al.[6]Chrcanovic et al.[5]Vohra et al.[20]Romero-Ruiz et al.[21]Llamas-Monteagudo et al.[22]Zhuang et al.[23]Yadav et al.[24]Cai et al.[25]
Data inadequate for crestal bone lossArisan et al.[26]Berdougo et al.[27]Bashutski et al.[28]Voulgarakis et al.[9]Meizi et al.[29]Yadav et al. (2018)[30]Gupta et al.[31]
Retrospective studiesNickenig et al.[8]Rousseau et al.[32]De Bruyn et al.[33]Nguyen et al.[34]Yue et al.[35]
Immediate implant placementStoupel et al.[36]Mazzocco et al. (2017)[37]
Other outcome comparison studiesDanza and Carinci[38]Lindeboom and van Wijk[2]Kaur et al.[39]
PRISMA flow diagram for study selection process List of excluded studies

Description of included studies

This review consisted of 23 studies listed in Table 3. Total data from 948 patients rehabilitated with 1407 implants were included. Of the 23 studies, 3 studies had a follow-up time of up to 3 months.[435658] Six had a long follow-up of 3 years or more.[4246474851] In 8 studies, flapless surgery was done with the help of computed tomography (CT)-guided or surgical stent,[56464748545961] while the remaining 15 were performed by the freehand approach. Some studies used a submerged protocol,[41445356] whereas others used a nonsubmerged protocol,[404345495152575860] and two studies involved both the protocols.[4655] Loading time of the implants was also mentioned in the studies. In five studies, implants were loaded immediately or early for both the groups.[4350596061] Fourteen studies applied a delayed loading protocol,[4041424445474849515253545557] whereas two studies[4654] involved both protocols of loading, and in two studies, the implants were not loaded.[5658]
Table 3

Description of studies

NamePublished timeStudyPatientsFollow-up timeAge range (years)Failed implantsSurvival rateLoading time
Anumala et al.[40]2019P30 patients30 implants6 months25-50NMNMConventional
Kumar et al.[41]2018RCT20 patients20 implants1 year25-601/10 (T)0/10 (C)NMConventional
Naeini et al.[42]2018P49 patients53 implants6-9 years28-850/26 (T)0/27 (C)100% (T)100% (C)Conventional
Singla et al.[43]2018RP20 patients20 implants3 months30-50NMNMImmediate
Shamsan et al.[44]2018RCT12 patients16 implants6 months20-600/10 (T)1/10 (C)NMConventional
Wang et al.[45]2017RCT40 patients40 implants2 years19-45 (39±13.2)0/20 (T)0/20 (C)100% (T)100% (C)Conventional
Bömicke et al.[46]2017RCT38 patients38 implants3 years53 (21-70)6/19 (T)5/19 (C)95% (T)100% (C)Immediate (T)Conventional (C)
Froum and Khouly[47]2017RCT60 patients60 implants8.6 yearsNM0/30 (T)0/30 (C)100% (T)100% (C)Conventional
Pisoni et al.[48]2016RCT40 patients69 implants3 years61.69±14.235/39 (T)2/30 (C)87.2% (T)93.3% (C)Conventional
Maier[49]2016P80 patients195 implants1 year18-780/95 (T)0/100 (C)100% (T)100% (C)Conventional
Maló et al.[50]2016P40 patients72 implants3 years19-791/32 (T)0/40 (C)96.8% (T)100%(C)Immediate nonfunctional
Prati et al.[51]2016P60 patients132 implants3 years25-722/64 (T)1/65 (C)96.9% (T)98.5% (C)Conventional
Samad et al.[52]2016P60 patients60 implants6 months19-751/30 (T)1/30 (C)96.6% (T)96.6% (C)Conventional
Kanwar et al.[53]2016P10 patients20 implants6 months20-600/10 (T)0/10 (C)100% (T)100% (C)Conventional
Pozzi et al.[54]2014RCT51 patients51 implants1 year28-840/25 (T)1/26 (C)100% (T)96.2% (C)Immediate and Conventional
Sunitha and Sapthagiri[55]2013P40 patients40 implants2 years25-620/20 (T)0/20 (C)100% (T)100% (C)Conventional
Katsoulis et al.[56]2012P40 patients195 implants3 months20-79 (61±9)0/85 (T)0/110 (C)100% (T)100% (C)Not loaded
Tsoukaki et al.[57]2013RCT20 patients30 implants12 weeks47.47±9.72 (T)46.40±9.52 (C)0/15 (T)0/15 (C)100% (T)100% (C)Conventional
Al-Juboori et al.[58]2013P9 patients22 implants12 weeks27-62 (50)0/11 (T)0/11 (C)100% (T)100% (C)Implants not loaded
Froum et al.[59]2011P52 patients52 implants12 monthsNM0/27 (T)0/25 (C)100% (T)100% (C)Early Loading
Cannizzaro et al.[60]2011RCT40 patients143 implants1 year22-652/76 (T)2/67 (C)97.3% (T)97% (C)Immediate
Marcelis et al.[54]2012P20 patients20 implants1 year48.7±16.40/16 (T)1/18 (C)100% (T)94.4% (C)Conventional
Van de Velde et al.[61]2010RCT13 patients70 implants18 months39-75 (55.7)1/36 (T)0/34 (C)97.2% (T)100% (C)Immediate

P: Prospective study, RCT: Randomized controlled trial, RP: Radiographic prospective, T: Test group (Flapless surgery), C: Control group (flap surgery), MBL: Marginal bone loss, NM: Not mentioned, CT: Computed tomography, PPD: Probing pocket depth, PI: Plaque index, GI: Gingival Index

Description of studies P: Prospective study, RCT: Randomized controlled trial, RP: Radiographic prospective, T: Test group (Flapless surgery), C: Control group (flap surgery), MBL: Marginal bone loss, NM: Not mentioned, CT: Computed tomography, PPD: Probing pocket depth, PI: Plaque index, GI: Gingival Index Among the 23 studies, 694 implants were placed by flapless technique and 713 implants were placed by flap technique. Implant survival ranged from 87.2% to 100% for flapless implant placement and 93.3% to 100% for flap technique. 100% survival was found in 10 studies.[42454749535556575859] Significant results indicating less crestal bone loss with flapless technique were reported by studies.[424449515758]

Risk of bias assessment of the studies

The Newcastle–Ottawa scale, as shown in Table 4a, showed that all the studies had low bias considering the number of stars. For randomized studies, if studies did not fulfill two or more of the four criteria, the risk of bias was considered high. Among the ten randomized studies, five were low risk,[4145576061] two were judged to be at moderate risk,[4647] and the remaining three were at high risk of bias [Table 4b].[414448]
Table 4a

Quality assessment of nonrandomized controlled trials by the Newcastle-Ottawa scale

StudySelection
Comparability
Outcome
Total (9/9)
Representativeness of the exposed CohortSelection of the nonexposed CohortAscertainment of exposureDemonstration that the outcome of interest was not present at the start of studyComparability of Cohorts on the basis of the design or analysis
Assessment of outcomeWas follow-up long enough for outcomes to occurAdequacy of follow-up of Cohorts
Main factorAdditional factor
Anumala et al.[40]*****0*0*7/9
Naeini et al.[42]*****0***8/9
Singla et al.[43]*****0*0*7/9
Maier[49]*****0***8/9
Maló et al.[50]*****0***8/9
Prati et al.[51]*****0***8/9
Samad et al.[52]*****0*0*7/9
Kanwar et al.[53]*****0*0*7/9
Sunitha and Sapthagiri[55]*****0***8/9
Katsoulis et al.[56]*****0*0*7/9
Al-Juboori et al.[58]*****0*0*7/9
Froum et al.[59]*****0***8/9
Marcelis et al.[54]*****0***8/9

At least 1-year follow-up was considered adequate for the outcome. *-Present, 0-Absent

Table 4b

Quality assessment of randomized controlled trials

NamePublished timeSequence generationAllocation concealmentIncomplete outcome data addressedBlindingEstimated potential risk of bias
Kumar et al.[41]2018YesUnclearYesUnclearHigh
Shamsan et al.[24]2018NoInadequateNoNoHigh
Wang et al.[44]2017YesAdequateYesYesLow
Pisoni et al.[48]2017YesUnclearYesNoHigh
Froum and Khouly[47]2017YesUnclearUnclearYesModerate
Bömicke et al.[46]2017YesAdequateYesNoModerate
Pozzi et al.[54]2014YesAdequateYesYesLow
Tsoukaki et al.[57]2012YesAdequateYesYesLow
Cannizzaro et al.[60]2011YesAdequateYesYesLow
Van de Velde et al.[61]2010YesAdequateYesYesLow
Quality assessment of nonrandomized controlled trials by the Newcastle-Ottawa scale At least 1-year follow-up was considered adequate for the outcome. *-Present, 0-Absent Quality assessment of randomized controlled trials

Meta-analysis of the studies

Twenty-three studies were included with 1407 implants placed in 948 patients. On account of the heterogeneity (Tau2 = 0.04, Chi-square = 126.96, df = 21, P < 0.00001; I2 = 83%), a random-effects model was used. Meta-analysis revealed statistically significant difference in crestal bone level with MD of −0.14 (flapless placement vs. flap surgery; 95% confidence interval [CI]: −0.24–−0.03; P = 0.01FNx01), indicating the positive effect of flapless technique on the outcome measure in comparison with flap technique, as shown in Figure 2.
Figure 2

Forest plot of meta-analysis results comparing crestal bone level of flapless and flap surgery groups

Forest plot of meta-analysis results comparing crestal bone level of flapless and flap surgery groups For subgroup analysis, meta-analysis of eight studies was performed. Low heterogeneity (Chi-square = 7.77, df = 7, P = 0.35; I2 = 10%) led to the fixed-effects model. The results indicated that the difference in crestal bone level between these guided flapless and flap technique groups was not statistically significant with a mean difference of −0.05 (guided flapless placement vs. flap surgery; 95% CI: −0.10–0.00; P = 0.06) [Figure 3]. Subgroup analysis of the freehand flapless surgery with flap surgery generated a random-effects model due to the high heterogeneity (Tau2 = 0.07, Chi-square = 110.60, df = 13, P < 0.00001; I2 = 88%) with MD of −0.20, which was found to be statistically significant (freehand flapless placement vs. flap surgery; 95% CI: −0.37–−0.03; P = 0.02FNx01) [Figure 4].
Figure 3

Forest plot of meta-analysis results comparing crestal bone level of guided flapless and flap surgeries

Figure 4

Forest plot of meta-analysis results comparing crestal bone level of freehand flapless and flap surgery groups

Forest plot of meta-analysis results comparing crestal bone level of guided flapless and flap surgeries Forest plot of meta-analysis results comparing crestal bone level of freehand flapless and flap surgery groups

Publication bias

Funnel plot indicated the absence of publication bias, as shown in Figures 5-7.
Figure 5

Funnel plot for studies reporting outcome of crestal bone levels of freehand flapless and flap surgeries

Figure 7

Funnel plot for studies reporting outcome of crestal bone levels of freehand flapless and flap surgeries

Funnel plot for studies reporting outcome of crestal bone levels of freehand flapless and flap surgeries Funnel plot for studies reporting outcome of crestal bone levels of guided flapless and flap surgeries Funnel plot for studies reporting outcome of crestal bone levels of freehand flapless and flap surgeries

DISCUSSION

Implant placement with flap reflection is a traditional well-accepted approach, while flapless placement has been an experimental evolving technique which still requires a backup of substantial evidence. It is much of a controversy with versatile opinions, and no specific conclusion has still been reached. Thus, this review was aimed to compare the available literature to reach a more specific conclusion with evidentiary support from meta-analysis. Narrowing the inclusion criteria to only randomized trials could have enhanced the homogeneity, but it was noticed that it could exclude several studies with significant data. The latest meta-analysis concerning the outcome was published in 2020 by Cai et al.[25] They included only six studies with high heterogeneity (I2 = 78%) in the meta-analysis and failed to state a statistical difference in long-term crestal bone loss. Results of the analysis performed by Cai et al.[25] should be interpreted with caution because of the limited number of studies included. Furthermore, they included only the long-term studies which excluded all the literature published after 2017. In this meta-analysis, 23 studies were included. The result showed that the flapless placement significantly reduced the crestal bone loss with the mean difference of −0.14. This reduced bone loss could be explained by intact periosteum and blood supply which is a known advantage of flapless technique.[62] In flap technique, the branches of supraperiosteal vessels get compromised, affecting the blood supply.[63] Kim et al. in 2009[64] in their study on dogs stated that flapless implant placement presented a much richer vascularization. Al Juboori et al.[58] and Kim et al.[64] attributed lesser bone with flapless technique to the excellent defense to bacterial invasion because of the intact bloody supply. Jeong et al. in 2007[65] showed that sites with flapless technique had a greater bone–implant contact and less bone loss. Similar findings of reduced bone loss with flapless technique were noted by You et al.,[66] Mazzocco et al.,[37] Kumar et al.,[41] Shamsan et al.,[44] Maier,[49] and Sunitha and Sapthagiri.[55] The flapless technique ensures a favorable healing environment for the soft-tissue architecture as well as hard-tissue volume with reduced time for stable remodeling.[67] Studies[5061] with the view that flapless surgery leads to more crestal bone loss than conventional flap failed to prove a significant difference. One of the reasons for more bone loss associated with flapless technique could be because of the contamination of the surgical site with the epithelial and connective tissue cells from the oral mucosa.[68] Interestingly, several studies[454851535659] and reviews[520] showed comparable outcome with both the surgical techniques. The flapless surgery can thus be considered as an acceptable treatment option based on the evidence obtained from the literature. The use of CT scans, advanced planning software, surgical guides, and dynamic navigation systems can help to improve the predictability and precision. Subgroup analysis comparing the guided flapless approach with the conventional surgery did not yield a significant result. This could be attributed to the limited data available and the variability of the guided approach used. Furthermore, there remain concerns with the deviations in the inclination and positioning of implants by flapless surgery from the ideally planned position, which could affect the outcome.[5] Comparison of the freehand flapless placement with conventional surgery showed a significant difference, indicating that flapless surgery can affect the crestal bone loss even without the use of a guided approach. Based on the results of this study, the choice of surgical technique significantly affects crestal bone level which is in agreement with a previous systematic review by Zhuang et al. in 2018.[23] However, the studies included have high heterogeneity, and the authors in cases of doubt have opted for direct visualization of the surgical field. Presurgical planning is a must to reduce the possible complications. The fear of such complications should not stop the clinicians to acknowledge the benefits that the flapless technique can provide. With the upcoming digital trends in implantology, flapless surgeries have the capacity to evolve with a greater safety margin. The results of this review should be interpreted with caution because of its limitations. Confounding factors may have affected the outcomes. Further, less emphasis was given on local or systemic condition of patients. Furthermore, heterogeneity of the included studies was high. Double-blinded randomized controlled trials with broader pool of patients to determine the effect of flapless implant surgery on patient outcome variables are required to reach definitive conclusions.

CONCLUSIONS

Flapless technique of dental implant placement has significantly less crestal bone loss compared to the flap technique. Therefore, flapless implant surgery can be considered as a promising alternative to conventional flap The use of a guided or freehand approach of flapless surgery both showed less crestal bone loss compared to flap surgery; however, significant results could not be obtained.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.
  58 in total

1.  The clinical and radiographic outcome of implants placed in the posterior maxilla with a guided flapless approach and immediately restored with a provisional rehabilitation: a randomized clinical trial.

Authors:  T Van de Velde; L Sennerby; H De Bruyn
Journal:  Clin Oral Implants Res       Date:  2010-11       Impact factor: 5.977

2.  Flapless implant surgery using an image-guided system. A 1- to 4-year retrospective multicenter comparative clinical study.

Authors:  Marc Berdougo; Thomas Fortin; Eric Blanchet; Michel Isidori; Jean-Luc Bosson
Journal:  Clin Implant Dent Relat Res       Date:  2009-02-13       Impact factor: 3.932

3.  Comparison of implant stability by means of resonance frequency analysis for flapless and conventionally inserted implants.

Authors:  Joannis Katsoulis; Marianna Avrampou; Christian Spycher; Marko Stipic; Norbert Enkling; Regina Mericske-Stern
Journal:  Clin Implant Dent Relat Res       Date:  2011-03-17       Impact factor: 3.932

4.  Long-term clinical outcome of single implants inserted flaplessly or conventionally.

Authors:  Emitis N Naeini; Melissa Dierens; Mandana Atashkadeh; Hugo De Bruyn
Journal:  Clin Implant Dent Relat Res       Date:  2018-08-15       Impact factor: 3.932

5.  Flapless surgery and immediately loaded implants: a retrospective comparison between implantation with and without computer-assisted planned surgical stent.

Authors:  Matteo Danza; Francesco Carinci
Journal:  Stomatologija       Date:  2010

Review 6.  Comparison of crestal bone loss around dental implants placed in healed sites using flapped and flapless techniques: a systematic review.

Authors:  Fahim Vohra; Abdulaziz A Al-Kheraif; Khalid Almas; Fawad Javed
Journal:  J Periodontol       Date:  2014-09-04       Impact factor: 6.993

7.  An up to 17-year follow-up retrospective analysis of a minimally invasive, flapless approach: 18 945 implants in 7783 patients.

Authors:  Philip Jesch; Wolfgang Jesch; Emanuel Bruckmoser; Mischa Krebs; Tibor Kladek; Rudolf Seemann
Journal:  Clin Implant Dent Relat Res       Date:  2018-02-15       Impact factor: 3.932

8.  Implant surgery using bone- and mucosa-supported stereolithographic guides in totally edentulous jaws: surgical and post-operative outcomes of computer-aided vs. standard techniques.

Authors:  Volkan Arisan; Cüneyt Z Karabuda; Tayfun Ozdemir
Journal:  Clin Oral Implants Res       Date:  2010-05-24       Impact factor: 5.977

9.  A comparison of two implant techniques on patient-based outcome measures: a report of flapless vs. conventional flapped implant placement.

Authors:  Jerome A Lindeboom; Arjen J van Wijk
Journal:  Clin Oral Implants Res       Date:  2010-02-01       Impact factor: 5.977

10.  Three-Year Outcome of Fixed Partial Rehabilitations Supported by Implants Inserted with Flap or Flapless Surgical Techniques.

Authors:  Paulo Maló; Miguel de Araújo Nobre; Armando Lopes
Journal:  J Prosthodont       Date:  2015-11-20       Impact factor: 2.752

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.