Literature DB >> 29472236

Assessment of choroidal blood flow using laser speckle flowgraphy.

Giacomo Calzetti1,2, Klemens Fondi1, Ahmed M Bata1, Nikolaus Luft3,4, Piotr A Wozniak1,5, Katarzyna J Witkowska1, Matthias Bolz3, Alina Popa-Cherecheanu6,7, René M Werkmeister8, Doreen Schmidl1, Gerhard Garhöfer1, Leopold Schmetterer1,8,9,10,11.   

Abstract

BACKGROUND/AIMS: There is considerable interest in novel techniques to quantify choroidal blood flow (CBF) in humans. In the present study, we investigated a novel technique to measure CBF based on laser speckle flowgraphy (LSFG) in healthy subjects.
METHODS: This study included 31 eyes of 31 healthy, non-smoking subjects aged between 19 and 74 years. A commercial LSFG instrument was used to measure choroidal vessel diameter (CVD) and relative flow volume (RFV) in choroidal vessels that were identified on fundus photos, an approach that was used previously only for retinal vessels. The reproducibility and the effect of isometric exercise on these parameters were investigated. The latter was compared with measurement of subfoveal CBF using laser Doppler flowmetry (LDF).
RESULTS: Intraclass correlation coefficients for CVD and RFV were higher than 0.8 indicating excellent reproducibility. During isometric exercise, we observed an increase in ocular perfusion pressure of approximately 60% (P<0.001). The increase in RFV and CBF was lower, but also highly significant versus baseline (at minute 6 of isometric exercise: RFV 10.5%±4.2%, CBF 8.3%±3.6%; P<0.001 each) indicating choroidal autoregulation.
CONCLUSION: LSFG may be a novel approach to study blood flow in choroidal vessels. Data are reproducible and show good agreement with LDF data. TRIAL REGISTRATION NUMBER: NCT02102880, Results. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Entities:  

Keywords:  choroid; imaging; physiology

Mesh:

Year:  2018        PMID: 29472236      PMCID: PMC6287569          DOI: 10.1136/bjophthalmol-2017-311750

Source DB:  PubMed          Journal:  Br J Ophthalmol        ISSN: 0007-1161            Impact factor:   4.638


Introduction

There is increasing interest in the quantification of choroidal blood flow (CBF), related to accumulating evidence that abnormalities in choroidal perfusion play a role in the pathogenesis of age-related macular degeneration (AMD).1–3 To image and measure CBF with optical techniques is, however, not easy because light is strongly scattered in the retinal pigment epithelium (RPE). Laser Doppler flowmetry (LDF) has been used to study blood flow in the choroid, but measurements are limited to the subfoveal area, because of the lack of retinal vessels.4 Colour Doppler imaging assesses blood velocities in the retrobulbar vessels including the posterior ciliary arteries supplying the choroid,5 but no information on volumetric blood flow can be obtained and reproducibility is poor.6 Indocyanine green angiography provides visualisation of the choroid, but the technique requires intravenous administration of a dye and extraction of quantitative blood flow data has proven difficult.7 Recently, optical coherence tomography angiography (OCTA) has attracted much interest but up to now quantification of blood flow is not possible.8 9 Quantification of blood flow in larger choroidal blood vessels was, however, achieved using Doppler OCT in a small group of healthy subjects.10 Using these technologies, several links between abnormal choroidal perfusion and AMD were established. Two longitudinal studies have shown that low CBF is a risk factor for the development of choroidal neovascularisation.11 12 In the Comparison of Age-related Macular Degeneration Treatment Trials  (CATT) study, patchy choroidal filling was identified as an important risk factor for vision loss during anti-vascular endothelial growth factor (VEGF) therapy.13 A variety of OCTA provided links between choroidal vascular changes and different stages of AMD.14–17 Laser speckle flowgraphy (LSFG) is a technique that quantifies blood flow based on speckle statistics.18 This technique has been used to study optic nerve head blood flow,19 20 but when retinal areas are measured the signal contains proportions from both retinal and choroidal circulations.18 21

Materials and methods

Subjects

The study population consisted of a subgroup of healthy subjects, who participated in previously published studies.22 23 All research adhered to the guidelines set forth in the Declaration of Helsinki. Written informed consent was obtained from all participating volunteers after the nature and possible consequences of the study were explained in detail. Those subjects in whom a choroidal vessel was clearly identified were chosen for the present analysis. For reproducibility analysis, we included 21 subjects, and 10 subjects were included for the analysis during isometric exercise. Prior to the study, all subjects underwent a comprehensive screening examination comprising medical history, physical examination, best-corrected visual acuity testing using standard ETDRS charts, slit-lamp examination including indirect funduscopy, measurement of intraocular pressure (IOP) using Goldmann applanation tonometry, measurements of systolic blood pressure (SBP) and diastolic blood pressure (DBP) with automated oscillometry and a urine pregnancy test in women with childbearing potential. The inclusion and exclusion criteria of the study were published previously.22 23 Twelve hours prior to the study, subjects were instructed to abstain from alcohol and beverages containing xanthine derivatives such as tea, coffee or cola.

Protocol

Reproducibility analysis was based on the protocol published previously.22 Briefly, three consecutive LSFG scans were acquired with a natural scotopic pupil; after pharmacological dilation of the pupil with 0.5% topical tropicamide eye drops (Mydriaticum Agepha Augentropfen; Agepha Ges.m.b.H., Vienna, Austria) and a resting period of 20 min, a second set of three consecutive LSFG measurements was acquired. The scans performed in mydriasis were used to assess reproducibility. At the end of the experiments, we performed measurements of IOP and systemic blood pressure. Experiments during isometric exercise followed the protocol described in Witwowska et al.23 A baseline recording using LSFG was performed and systemic blood pressure, pulse rate (PR) and IOP were taken while subjects were seated in a chair. Thereafter, isometric exercise was started and maintained for 6 min. This period of isometric exercise consisted of squatting in a position where the upper and the lower legs formed almost a right angle. For this purpose, the chair was carefully removed and the subjects were asked to remain in their position. LSFG measurements of blood flow, as well as readings for systemic blood pressure and PR were performed every minute throughout these experiments. In addition, a second period of isometric exercise was performed after a resting period of at least 20 min, which followed the same schedule as the first period. During the second session of isometric exercise, subfoveal CBF was, however, measured using LDF as described previously.24 25

Laser speckle flowgraphy

In the present study, we used a commercially available LSFG system (LSFG-NAVI; Softcare Co, Fukuoka, Japan) to study CBF. The principles of LSFG have previously been summarised in detail.18 Briefly, the device consists of a fundus camera supplied with an 830 nm diode laser and a digital charge-coupled device camera. The output parameter of LSFG is mean blur rate (MBR), which constitutes a measure of relative blood flow velocity in arbitrary units (AU) and is calculated using first order speckle statistics. One LSFG scan consists of a total of 118 images captured at a rate of 30 Hz resulting in total measurement time of approximately 4 s. The analysis software (LSFG Analyzer, Version 3.1.58; Softcare Co) produces a ‘composite map’ which colour codes perfusion at the posterior eye pole within one cardiac cycle. Recently, a technique was introduced to extract blood flow information from retinal vessels. For this purpose, a rectangular band (RB) is centred on the retinal vessel of interest. The signal from this area contains information from the blood stream within the vessel as well as from the microvasculature beneath the vessel. The signal arising from the larger vessels can automatically be separated from background MBR originating from the surrounding microvasculature by computing a threshold between MBR values. The software extracts the vessel diameter as expressed in pixels as well as the relative flow volume (RFV) in AU. In the present study, we extended this concept that was originally developed for retinal vessels to choroidal vessels (figure 1). Larger choroidal vessels were identified on fundus images and LSFG intensity maps. The vessel selection was restricted to the 21° field of view of the LSFG camera, which was centred at the optic nerve head. Afterwards, a RB having three times the width of the choroidal vessel of interest was placed over this vessel in the LSFG perfusion map and analysis was done in a similar way as previously described for retinal vessels.21 During the vessel selection, we took care to draw a RB which encompassed the choroidal vessel of interest without including any other larger vessel. The size of the RB on the first scan was saved and then exported to all the following scans for each subject.
Figure 1

Identification of choroidal blood vessels for Laser Speckle Flowgraphy (LSFG) analysis. (A) First a choroidal vessel is identified based on a fundus photograph. The choroidal vessel of interest is shown inside a white rectangular band that is manually placed. (B) The presence of the choroidal vessel is then confirmed at the LSFG intensity image. (C) In the perfusion map, a rectangular white band is traced across the vessel which appears red because of the high intravascular blood velocity.

Identification of choroidal blood vessels for Laser Speckle Flowgraphy (LSFG) analysis. (A) First a choroidal vessel is identified based on a fundus photograph. The choroidal vessel of interest is shown inside a white rectangular band that is manually placed. (B) The presence of the choroidal vessel is then confirmed at the LSFG intensity image. (C) In the perfusion map, a rectangular white band is traced across the vessel which appears red because of the high intravascular blood velocity.

Laser Doppler flowmetry

Continuous measurement of CBF was performed by LDF as described previously.26 Briefly, vascularised tissue is illuminated by coherent laser light and the following haemodynamic parameters are determined from the Doppler shift power spectrum: the mean velocity of the red blood cells moving in the sampled tissue proportional to the mean Doppler frequency shift, the blood volume defined as the number of moving red blood cells proportional to the amount of Doppler shifted light and CBF calculated as the product of velocity and volume. In the present study, a laser portable confocal Doppler flowmeter was used.27

Systemic haemodynamics

SBP and DBP were measured using an automated oscillometric device. Mean arterial blood pressure (MAP) and ocular perfusion pressure (OPP) in the seated position were calculated as follows: MAP=DBP+1/3(SBP–DBP), OPP=2/3 MAP–IOP.

Statistical analysis

Descriptive data are presented as mean and SD. A repeated measures analysis of variance (ANOVA) model was used to characterise the effects of isometric exercise on the outcome parameters. To quantify reliability of measurements, intraclass correlation coefficients () were calculated using the three repeated measurements. The calculation of is based on a repeated measure ANOVA model using the variance among subjects (), the variance among measurements () and the residual error variance () and is calculated as A of 1 means perfect reproducibility. The higher the intraclass correlation coefficient, the less is the variability of the method. In addition, the coefficients of variation were calculated. A P value of <0.05 was used as an indicator of statistical significance. All statistical analysis was carried out using CSS Statistica (Version 6.0, Tulsa, Oklahoma, USA).

Results

In a previous study on the reproducibility of LSFG in Caucasian subjects, we included a total of 80 subjects equally distributed in four age groups (group 1: 18–34 years; group 2: 35–49 years; group 3: 50–64 years; group 4: 65–80 years) each consisting of 10 male and 10 female subjects.22 For the present reproducibility analysis, a subgroup of 21 subjects was included (table 1). The subgroup of subjects in whom the effect of isometric exercise was investigated consisted of volunteers that were included in a study on the effect of squatting on optic nerve head blood flow (table 1).23
Table 1

Demographic and baseline characteristics of subjects.

Reproducibility study
 Sex (M/F)11/10
 Age (years)45.3±11.8
 Mean arterial pressure (mm Hg)96.4±3.5
 Pulse rate (beats/min)71.2±3.1
 Intraocular pressure (mm Hg)12.8±2.3
 Ocular perfusion pressure (mm Hg)51.2±6.1
 Relative flow volume (AU)268.3±53.1
 Choroidal vessel diameter (AU)27.8±5.5
Isometric exercise study
 Sex (M/F)6/4
 Age (years)24.8±4.0
 Mean arterial pressure (mm Hg)91.8±2.7
 Pulse rate (beats/min)65.9±5.3
 Intraocular pressure (mm Hg)13.5±2.6
 Ocular perfusion pressure (mm Hg)46.8±5.9
 Relative flow volume (AU)303.5±67.1
 Choroidal vessel diameter (AU)31.3±7.0
 Choroidal blood flow (AU)33.3±4.7

Data are presented as means±SD.

Demographic and baseline characteristics of subjects. Data are presented as means±SD. Table 2 summarises the coefficient of variation and intraclass correlation coefficient for vessel diameters and RFV in the selected choroidal vessels. The RFV values at the three measurements were 270.2±55.3 AU, 266.1±52.7 AU and 265.6±53.9 AU, respectively. Values for CVD also showed little variability with values of 27.5±5.7 AU, 28.1±5.9 AU and 27.9±5.3 AU. According to Cicchetti, intraclass correlation coefficients of 0.75 and higher are considered as excellent reproducibility.28
Table 2

Repeatability indices for laser speckle flowgraphy parameters

Coefficient of variation (%)Intraclass correlation coefficient
Relative flow volume (AU)7.70.86
Choroidal vessel diameter (AU)9.70.82
Repeatability indices for laser speckle flowgraphy parameters Changes in CVD, RFV and OPP during isometric exercise are presented in figure 2. The CBF and OPP data as obtained during the second period of isometric exercise are presented in figure 3. The increase in RFV, CBF and OPP was highly significant (P<0.001 each). The per cent change in OPP was, however, more pronounced than the increase in RFV and CBF indicating choroidal autoregulation. When we compared the time course of RFV and CBF, we observed a slightly higher increase with the former parameter (at minute 6 of isometric exercise: RFV: 10.5%±4.2%, CBF: 8.3%±3.6%). These data were, however, obtained during different periods of isometric exercise, but differences between the OPP increase during the two periods were small. The choroidal vessel diameter showed a tendency to decrease during isometric exercise, but this effect was not significant (at minute 6 of isometric exercise: −3.8±4.2%; P=0.08).
Figure 2

Ocular perfusion pressure (OPP), relative flow volume (RFV) and choroidal vessel diameter (CVD) during isometric exercise. Data are expressed as per cent change from baseline. Data are presented as means±SD (n=10).

Figure 3

Ocular perfusion pressure (OPP) and choroidal blood flow (CBF) during isometric exercise. Data are expressed as per cent change from baseline. Data are presented as means±SD (n=10).

Ocular perfusion pressure (OPP), relative flow volume (RFV) and choroidal vessel diameter (CVD) during isometric exercise. Data are expressed as per cent change from baseline. Data are presented as means±SD (n=10). Ocular perfusion pressure (OPP) and choroidal blood flow (CBF) during isometric exercise. Data are expressed as per cent change from baseline. Data are presented as means±SD (n=10).

Discussion

Herein, we present a novel approach to quantify CBF based on LSFG technology. The approach provides acceptable reproducibility and is capable of characterising changes in CBF induced by isometric exercise. Given that there is currently no other method commercially available for obtaining quantitative information on CBF, this technique may have considerable potential for understanding choroidal perfusion abnormalities in diseases of the outer retina. The increase in CBF as observed with this technique during isometric exercise was slightly larger than the changes as obtained with LDF, but followed the same direction. In this context, several important differences between the current approach and LDF need to be mentioned which may account for these differences. On the one hand, LDF assesses the microcirculation in the subfoveal choroid, whereas the LSFG-based technique selects one larger vessel. As such LDF measures blood flow in choriocapillaris and LSFG measures blood flow in single vessels in Sattler’s or Haller’s layer. A major advantage of the present approach is that it relies on a commercially available technique that can easily be implemented. There are, however, also several drawbacks with the technique. On the one hand, we were not able to identify choroidal vessels that were suitable for analysis in all participating subjects. On the other hand, we and others have previously shown that there may be a zero-setoff with RFV measurements when applied in retinal vessels.21 29 These conclusions were drawn based on comparison with other techniques to measure retinal blood flow such as laser Doppler velocimetry or Doppler OCT.30 31 This may also be the case when measurements of RFV are applied to choroidal vessels, but due to the absence of a gold standard technique for CBF evaluation such validation experiments cannot be performed in choroidal vessels. Since LSFG is based on a decorrelation analysis one may, however, assume that the outcome parameters do not scale linearly with blood velocity over the entire velocity range.14 Reproducibility of our approach is in the same range to that of previous techniques for the assessment of CBF6 such as pneumotonometry,32 laser interferometric measurement of fundus pulsation33 and LDF26 and superior to that of colour Doppler imaging of retrobulbar posterior ciliary arteries.6 Further studies are required to investigate what is the minimum diameter of choroidal vessels that can be studied with this approach. The results during isometric exercise are in good agreement with previous data24 25 34–36 and support the concept that the choroid is not a passive vascular bed but rather shows characteristics of autoregulation. During isometric exercise, we observed a tendency towards vasoconstriction, which did, however, not reach the level of significance, most likely because of the small sample size and the limited pixel resolution of the employed charge-coupled device camera. This is compatible with the idea of myogenic autoregulation which has been proposed by Kiel and co-workers previously based on a set of experiments in rabbits.37–39 In conclusion, our data indicate that quantitative blood flow information of choroidal blood vessels can be extracted using a commercial LSFG system. Future studies are warranted to investigate the potential of this technique in studying CBF in diseases such as AMD in which perfusion abnormalities are assumed to play a role in the development of late stage disease.
  38 in total

1.  Comparison of choroidal and optic nerve head blood flow regulation during changes in ocular perfusion pressure.

Authors:  Doreen Schmidl; Agnes Boltz; Semira Kaya; Rene Werkmeister; Nikolaus Dragostinoff; Michael Lasta; Elzbieta Polska; Gerhard Garhöfer; Leopold Schmetterer
Journal:  Invest Ophthalmol Vis Sci       Date:  2012-07-01       Impact factor: 4.799

2.  Ultrahigh-Speed, Swept-Source Optical Coherence Tomography Angiography in Nonexudative Age-Related Macular Degeneration with Geographic Atrophy.

Authors:  WooJhon Choi; Eric M Moult; Nadia K Waheed; Mehreen Adhi; ByungKun Lee; Chen D Lu; Talisa E de Carlo; Vijaysekhar Jayaraman; Philip J Rosenfeld; Jay S Duker; James G Fujimoto
Journal:  Ophthalmology       Date:  2015-10-17       Impact factor: 12.079

3.  Foveolar choroidal circulation and choroidal neovascularization in age-related macular degeneration.

Authors:  Tatyana I Metelitsina; Juan E Grunwald; Joan C DuPont; Gui-Shuang Ying; Alexander J Brucker; Joshua L Dunaief
Journal:  Invest Ophthalmol Vis Sci       Date:  2008-01       Impact factor: 4.799

Review 4.  Ocular blood flow assessment using continuous laser Doppler flowmetry.

Authors:  Charles E Riva; Martial Geiser; Benno L Petrig
Journal:  Acta Ophthalmol       Date:  2010-09       Impact factor: 3.761

5.  Choroidal blood flow during isometric exercises.

Authors:  C E Riva; P Titze; M Hero; A Movaffaghy; B L Petrig
Journal:  Invest Ophthalmol Vis Sci       Date:  1997-10       Impact factor: 4.799

6.  A comparison between laser interferometric measurement of fundus pulsation and pneumotonometric measurement of pulsatile ocular blood flow. 1. Baseline considerations.

Authors:  L Schmetterer; S Dallinger; O Findl; H G Eichler; M Wolzt
Journal:  Eye (Lond)       Date:  2000-02       Impact factor: 3.775

7.  Hemodynamic parameter estimation from ocular fluorescein angiograms.

Authors:  I H van Stokkum; G N Lambrou; T J van den Berg
Journal:  Graefes Arch Clin Exp Ophthalmol       Date:  1995-03       Impact factor: 3.117

8.  Ocular perfusion pressure and choroidal blood flow in the rabbit.

Authors:  J W Kiel; W A van Heuven
Journal:  Invest Ophthalmol Vis Sci       Date:  1995-03       Impact factor: 4.799

9.  Measurements of Retinal Perfusion Using Laser Speckle Flowgraphy and Doppler Optical Coherence Tomography.

Authors:  Nikolaus Luft; Piotr A Wozniak; Gerold C Aschinger; Klemens Fondi; Ahmed M Bata; René M Werkmeister; Doreen Schmidl; Katarzyna J Witkowska; Matthias Bolz; Gerhard Garhöfer; Leopold Schmetterer
Journal:  Invest Ophthalmol Vis Sci       Date:  2016-10-01       Impact factor: 4.799

10.  Optic nerve head and retinal blood flow regulation during isometric exercise as assessed with laser speckle flowgraphy.

Authors:  Katarzyna J Witkowska; Ahmed M Bata; Giacomo Calzetti; Nikolaus Luft; Klemens Fondi; Piotr A Wozniak; Doreen Schmidl; Matthias Bolz; Alina Popa-Cherecheanu; René M Werkmeister; Gerhard Garhöfer; Leopold Schmetterer
Journal:  PLoS One       Date:  2017-09-12       Impact factor: 3.240

View more
  10 in total

Review 1.  Microvascular contributions to age-related macular degeneration (AMD): from mechanisms of choriocapillaris aging to novel interventions.

Authors:  Agnes Lipecz; Lauren Miller; Illes Kovacs; Cecília Czakó; Tamas Csipo; Judit Baffi; Anna Csiszar; Stefano Tarantini; Zoltan Ungvari; Andriy Yabluchanskiy; Shannon Conley
Journal:  Geroscience       Date:  2019-12-04       Impact factor: 7.713

2.  Imposed positive defocus changes choroidal blood flow in young human subjects.

Authors:  Barbara Swiatczak; Frank Schaeffel; Giacomo Calzetti
Journal:  Graefes Arch Clin Exp Ophthalmol       Date:  2022-09-29       Impact factor: 3.535

3.  Correlation Between Laser Speckle Flowgraphy and OCT-Derived Retinal and Choroidal Metrics in Healthy Human Eye.

Authors:  Yiming Lu; Hao Zhou; Xiao Zhou; Yuxuan Chen; Ruikang K Wang
Journal:  Transl Vis Sci Technol       Date:  2022-06-01       Impact factor: 3.048

4.  Micron resolution, high-fidelity three-dimensional vascular optical imaging phantoms.

Authors:  Callum D Little; Radhika K Poduval; Richard Caulfield; Sacha Noimark; Richard J Colchester; Chris D Loder; Manish K Tiwari; Roby D Rakhit; Ioannis Papakonstantinou; Adrien E Desjardins
Journal:  J Biomed Opt       Date:  2019-02       Impact factor: 3.170

5.  Assessment of Choroidal Neovascularization Perfusion: A Pilot Study With Laser Speckle Flowgraphy.

Authors:  Giacomo Calzetti; Paolo Mora; Stefania Favilla; Giorgia Ottonelli; Giulia Devincenzi; Arturo Carta; Salvatore Tedesco; Anna Mursch-Edlmayr; Gerhard Garhöfer; Stefano Gandolfi; Leopold Schmetterer
Journal:  Transl Vis Sci Technol       Date:  2020-04-16       Impact factor: 3.283

6.  Intravital Imaging of Circulating Red Blood Cells in the Retinal Vasculature of Growing Mice.

Authors:  Jehwi Jeon; Yoonha Hwang; Jingu Lee; Eunji Kong; Jieun Moon; Sujung Hong; Pilhan Kim
Journal:  Transl Vis Sci Technol       Date:  2021-04-01       Impact factor: 3.283

7.  Longitudinal Study of Optic Disk Perfusion and Retinal Structure in Leber's Hereditary Optic Neuropathy.

Authors:  Giacomo Calzetti; Chiara La Morgia; Marco Cattaneo; Arturo Carta; Francesca Bosello; Giulia Amore; Michele Carbonelli; Maria Lucia Cascavilla; Stefano Gandolfi; Valerio Carelli; Leopold Schmetterer; Hendrik P N Scholl; Piero Barboni
Journal:  Invest Ophthalmol Vis Sci       Date:  2022-01-03       Impact factor: 4.799

8.  Short-term changes in retinal and choroidal relative flow volume after anti-VEGF treatment for neovascular age-related macular degeneration.

Authors:  Giacomo Calzetti; Paolo Mora; Enrico Borrelli; Riccardo Sacconi; Guido Ricciotti; Arturo Carta; Stefano Gandolfi; Giuseppe Querques
Journal:  Sci Rep       Date:  2021-12-09       Impact factor: 4.379

9.  Change of intraocular blood flow during treatment for thyroid eye disease.

Authors:  Masashi Mimura; Yuko Nishikawa; Keiko Inagaki; Yohei Sato; Yasushi Fujita; Don O Kikkawa
Journal:  Taiwan J Ophthalmol       Date:  2022-02-28

10.  Role of ICAM-1 in impaired retinal circulation in rhegmatogenous retinal detachment.

Authors:  Harumasa Yokota; Taiji Nagaoka; Hidetaka Noma; Akemi Ofusa; Tomoe Kanemaki; Hiroshi Aso; Hirotsugu Hanazaki; Satoru Yamagami; Masahiko Shimura
Journal:  Sci Rep       Date:  2021-07-28       Impact factor: 4.379

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.