Purpose: To determine the agreement and repeatability of inner retinal thickness measures from widefield imaging compared to standard scans in healthy nonhuman primates. Methods: Optical coherence tomography (OCT) scans were acquired from 30 healthy rhesus monkeys, with 11 animals scanned at multiple visits. The scan protocol included 20° × 20° raster scans centered on the macula and optic nerve head (ONH), a 12° diameter circular scan centered on the ONH, and a 55 × 45° widefield raster scan. Each scan was segmented using custom neural network-based algorithms. Bland-Altman analysis were used for comparing average circumpapillary retinal nerve fiber layer (RNFL) thickness and ganglion cell inner plexiform layer (GCIPL) thickness for a 16° diameter region. Comparisons were also made for similar 1° × 1° superpixels from the raster scans. Results: Average circumpapillary RNFL thickness from the circular scan was 114.2 ± 5.8 µm, and 113.2 ± 7.3 µm for an interpolated scan path from widefield imaging (bias = -1.03 µm, 95% limits of agreement [LOA] -8.6 to 6.5 µm). GCIPL thickness from standard raster scans was 72.7 ± 4.3 µm, and 73.7 ± 3.7 µm from widefield images (bias = 1.0 µm, 95% LOA -2.4 to 4.4 µm). Repeatability for both RNFL and GCIPL standard analysis was less than 5.2 µm. For 1° × 1° superpixels, the 95% limits of agreement were between -13.9 µm and 13.7 µm for RNFL thickness and -2.5 µm and 2.5 µm for GCIPL thickness. Conclusions: Inner retinal thickness measures from widefield imaging have good repeatability and are comparable to those measured using standard scans. Translational Relevance: Monitoring retinal ganglion cell loss in the non-human primate experimental glaucoma model could be enhanced using widefield imaging.
Purpose: To determine the agreement and repeatability of inner retinal thickness measures from widefield imaging compared to standard scans in healthy nonhuman primates. Methods: Optical coherence tomography (OCT) scans were acquired from 30 healthy rhesus monkeys, with 11 animals scanned at multiple visits. The scan protocol included 20° × 20° raster scans centered on the macula and optic nerve head (ONH), a 12° diameter circular scan centered on the ONH, and a 55 × 45° widefield raster scan. Each scan was segmented using custom neural network-based algorithms. Bland-Altman analysis were used for comparing average circumpapillary retinal nerve fiber layer (RNFL) thickness and ganglion cell inner plexiform layer (GCIPL) thickness for a 16° diameter region. Comparisons were also made for similar 1° × 1° superpixels from the raster scans. Results: Average circumpapillary RNFL thickness from the circular scan was 114.2 ± 5.8 µm, and 113.2 ± 7.3 µm for an interpolated scan path from widefield imaging (bias = -1.03 µm, 95% limits of agreement [LOA] -8.6 to 6.5 µm). GCIPL thickness from standard raster scans was 72.7 ± 4.3 µm, and 73.7 ± 3.7 µm from widefield images (bias = 1.0 µm, 95% LOA -2.4 to 4.4 µm). Repeatability for both RNFL and GCIPL standard analysis was less than 5.2 µm. For 1° × 1° superpixels, the 95% limits of agreement were between -13.9 µm and 13.7 µm for RNFL thickness and -2.5 µm and 2.5 µm for GCIPL thickness. Conclusions: Inner retinal thickness measures from widefield imaging have good repeatability and are comparable to those measured using standard scans. Translational Relevance: Monitoring retinal ganglion cell loss in the non-human primate experimental glaucoma model could be enhanced using widefield imaging.
Optical coherence tomography (OCT) produces high-resolution images of ocular tissues and has become an essential tool for managing ocular pathologies. For glaucoma management, retinal ganglion cell content is assessed using circumpapillary retinal nerve fiber layer (RNFL) thickness and macula ganglion cell inner plexiform layer (GCIPL) thickness., In combination or independently, these measures demonstrate good repeatability and diagnostic value.–Although there have been significant improvements in OCT resolution and speed, assessing RNFL and GCIPL thickness commonly requires two separate scans. These include a volume or circular scan centered on the optic nerve head and a volume scan centered on the fovea. Because there are often expected losses in both regions, combining the scanned areas with montaging algorithms has been shown to have added value. In fact, by montaging several raster scans, inner retinal thickness maps covering the entire area sampled by perimetry can be generated., Although montaging is effective, scanning multiple regions with subsequent scan registration takes longer and adds an element of variability. In contrast, widefield OCT can scan areas routinely sampled for visual function. These single wide-angle scans are valuable for detecting arcuate defects, and segmented thickness measures correspond well to those from more standard scan protocols.,The rhesus macaque (Macaca mulatta) has similar ocular and brain anatomy to humans, and experimental glaucoma in this model has provided valuable insights into disease pathophysiology and changes in visual function.– As with the human condition, monitoring experimental glaucoma nominally involves two scans to assess optic nerve head and macula health. Widefield scans are commonly not acquired in this model, and normative data, including variability of thickness measures, have not yet been established. Nonhuman primates (NHPs) are a scarce resource, hence maximizing and standardizing data collected are important for comparability across studies. We hypothesized that inner retinal thickness measures from widefield scans are similar to those obtained using standard protocols and have similar repeatability. Our study aimed to determine the utility of widefield scans in quantifying RNFL and macula ganglion cell inner plexiform layer (GCIPL) thickness in healthy rhesus macaques.
Methods
Subjects
A total of 30 rhesus monkeys (13 female) were used for this study (mean age 5.6 years, range 1.6–9.8 years). Both eyes of each animal were imaged, but to minimize bias from intereye symmetry, data from only one randomized eye was used for analysis (14 right eyes). Eleven animals were imaged at least four times, with each of the repeated scans obtained at least two weeks apart to determine repeatability. Experimental and animal care procedures were reviewed and approved by the Institutional Animal Care and Use Committee of the University of Houston. The use of animals adhered to the ARVO Statement for the Use of Animals in Ophthalmic and Vision Research.
Animal Sedation
Before sedation, animals were fasted for at least 12 hours but were allowed free access to water. An intramuscular injection of ketamine (20–25 mg/kg) and xylazine (0.4–0.5 mg/kg) was administered after lightly squeezing the animal in their home cage. After transport to the imaging laboratory, animals were given a subcutaneous injection of atropine sulfate (0.04 mg/kg), and pupils were dilated with 1% tropicamide. Most imaging sessions lasted approximately one hour, and when extra time was needed, an additional injection of ketamine (20–25 mg/kg) and xylazine (0.4–0.5 mg/kg) was administered an hour after the initial dose. For the duration of anesthesia, heart rate and partial pressure of oxygen were continuously monitored, and a heated pad was used to keep the animal at a steady body temperature. After the imaging session, atipamezole (0.1 mg/kg) was used for reversal, and the animal was returned to their home cage.
OCT
For imaging, the monkey was placed in a prone position, and their head stabilized using mouth and occipital bars. Eyelids were held open using a pediatric speculum, and the cornea was protected from dehydration using a gas permeable contact lens, which covered the entire cornea.All scans were acquired using the Spectralis OCT (Heidelberg Engineering, Heidelberg, Germany) system with high-resolution and small eye settings. For circumpapillary RNFL thickness, a standard 12° diameter circular scan with 100 frames averaged was used. With nine frame averaging, 20 × 20° raster scans with 193 b-scans were acquired centered on the optic nerve head and macula. Scan density was reduced to 97 lines when excessive eye movement was present. Widefield imaging included a 217 line raster scan covering 55 × 45°, with nine frames averaged. With this protocol, the 20 × 20° raster scans had twice the b-scan and a-scan density compared to the widefield raster volume. Images were exported as “*.vol” files and then read into Matlab (R2021, The MathWorks Inc, Natick, MA, USA), where images were segmented using custom programs, and thickness measures extracted.
OCT Segmentation
The RNFL and GCIPL were segmented using three separate neural networks, each trained on a DeepLab v3+ network based on ResNet-18, to an accuracy of 98.5% or better and loss of less than 0.02., The trained networks were specific for the optic nerve head region (RNFL), macula region (RNFL and GCIPL), and widefield imaging (RNFL and GCIPL). Scans previously segmented for other studies, which included controls and eyes with experimental glaucoma, were used for training the optic nerve head and macular region networks,,– whereas a separate series of 6117 b-scans was used to train the network for widefield scans. Segmentation criteria used for the training dataset have been previously reported,,, and none of the b-scans used for the training sets were included in the analysis for this study. Figure 1 illustrates a sample representative output using these methods for the three raster scans from the left eye of a single subject.
Figure 1.
(A, B) Widefield (55° × 45°) segmented RNFL and GCIPL for a healthy eye. (C, D) Corresponding 20° × 20° raster scans centered on the optic nerve head and macula from the same animal.
(A, B) Widefield (55° × 45°) segmented RNFL and GCIPL for a healthy eye. (C, D) Corresponding 20° × 20° raster scans centered on the optic nerve head and macula from the same animal.
Individual and Average Thickness Comparisons
Global RNFL thickness was determined for the circumpapillary scan, and thickness maps were generated for each of the raster scans using linear interpolation. For comparison, circumpapillary RNFL thickness was determined for an interpolated 12° scan path from each widefield thickness map. Similarly, the average GCIPL thickness for each subject was determined for a 16° diameter circular region centered on the macula for both the 20° × 20° and 55° × 45° raster scans.Afterward, an average thickness map for each of the three raster scan protocols was generated using data from all 30 animals. Resultant thickness maps from left eyes were flipped on the vertical axis to maintain a right eye output for statistical analysis. For the 20° × 20° scans, data were aligned to either the center of the fovea or the optic nerve head. The horizontal raphe was identified on widefield en face images flattened to the inner limiting membrane. Each widefield scan was then aligned to the fovea raphe plane, with the fovea in the center of the frame. From the average widefield thickness maps, 20° × 20° regions centered on the macula and optic nerve head (Figs. 2A, 3A, dashed lines), were extracted. For both the 20° × 20° standard scans and the extracted 20° × 20° regions from widefield scan, the average thickness map was further segmented to 1° × 1° thickness superpixel regions (Figs. 2C, 2D, 3C, 3D). For areas centered on the optic nerve head, the optic nerve head region was masked and not used for analysis.
Figure 2.
Average widefield (A) and 20° × 20° raster (B) RNFL thickness maps from scans of 30 healthy eyes. (C) Average thickness for 1° × 1° regions from B. (D) Average thickness for 1° × 1° regions from widefield imaging, corresponding to an identical 20 × 20 area as in B (dashed boxed region in A). The optic nerve head region in A–D has been masked. (E) Bland-Altman plot comparing thickness measures from each of the locations in C and D.
Figure 3.
Average widefield (A) and 20° × 20° raster (B) GCIPL thickness maps from scans of 30 healthy eyes. (C) Average thickness for 1° × 1° regions from B. (D) Average thickness for 1° × 1° regions from widefield imaging, corresponding to an identical 20 × 20 area as in B (dashed boxed region in A). (E) Bland-Altman plot comparing thickness measures from each of the locations in C and D.
Average widefield (A) and 20° × 20° raster (B) RNFL thickness maps from scans of 30 healthy eyes. (C) Average thickness for 1° × 1° regions from B. (D) Average thickness for 1° × 1° regions from widefield imaging, corresponding to an identical 20 × 20 area as in B (dashed boxed region in A). The optic nerve head region in A–D has been masked. (E) Bland-Altman plot comparing thickness measures from each of the locations in C and D.Average widefield (A) and 20° × 20° raster (B) GCIPL thickness maps from scans of 30 healthy eyes. (C) Average thickness for 1° × 1° regions from B. (D) Average thickness for 1° × 1° regions from widefield imaging, corresponding to an identical 20 × 20 area as in B (dashed boxed region in A). (E) Bland-Altman plot comparing thickness measures from each of the locations in C and D.
Repeatability
Eleven animals had each of the described scans repeated at five sessions, separated by a minimum of two weeks. Only four sessions were used for two of the subjects because of instrument misalignment at one of the scan sessions. As for average thickness comparisons, repeatability of RNFL and GCIPL was assessed for one-degree square superpixel regions across the scanned area.
Statistics
Thickness data are presented as mean ± standard deviation. Repeatability was calculated as 2.77 × intrasubject standard deviation (Sw). Comparisons between thickness measures from standard scan protocols and widefield imaging included a Bland-Altman analysis and intraclass correlation., Bland-Altman analyses are reported as the mean difference and 95% limits of agreement, with 95% confidence intervals. Intraclass correlation coefficients (ICC) were computed with two-way mixed effects and absolute agreement, with 95% confidence intervals. IBM SPSS (Version 27.0, IBM Corp, Armonk, NY, USA) was used for statistical analysis, and all plots were made using SigmaPlot (Version 14.0, Systat Software Inc, San Jose, CA, USA).
Results
Each animal included in the study was determined to have good systemic health and healthy eyes at the time of imaging. All scans used for data analysis had a quality greater than 25dB, and two repeatability scan sessions were excluded because of scan misalignment.Average circumpapillary RNFL thickness from standard 12° circular scans was 114.2 ± 5.8 µm, with repeatability of 4.5 µm. For the equivalent interpolated scan path from widefield imaging, RNFL thickness was 113.2 ± 7.3 µm, with a repeatability of 5.2 µm. The mean difference between the two RNFL thickness methods was −1.03 µm (Fig. 4A), with 95% limits of agreement, and 95% confidence interval, between −8.6µm (−11.1 µm, −6.1 µm) and 6.5 µm (4.0 µm, 9.0 µm). The ICC for the two methods was 0.90 (0.80, 0.95), suggesting very good agreement. Average GCIPL thickness from the 20° × 20° raster scan was 72.7 ± 4.3 µm, with repeatability of 3.2 µm. For the same region, GCIPL thickness from widefield imaging was 73.7 ± 3.7 µm, with a repeatability of 2.7 µm. The mean difference between the two methods was 1.0 µm (Fig. 4B), with 95% limits of agreement between −2.4 µm (−3.5 µm, −1.3 µm) and 4.4 µm (3.2 µm, 5.5 µm). The ICC for the two methods was 0.94 (0.83, 0.97).
Figure 4.
(A) Bland-Altman plots comparing circumpapillary RNFL thickness from a traditional circular scan to that interpolated from widefield imaging. (B) Comparison of average GCIPL thickness from 20° × 20° raster and widefield scans.
(A) Bland-Altman plots comparing circumpapillary RNFL thickness from a traditional circular scan to that interpolated from widefield imaging. (B) Comparison of average GCIPL thickness from 20° × 20° raster and widefield scans.For the three raster scan types, data from all animals were successfully aligned and used to generate average thickness maps oriented to the right eye. Comparisons between standard 20° × 20° raster and widefield imaging were made after binning the average maps using one-degree superpixel squares (Figs. 2, 3). For the area centered on the optic nerve head, a total of 364 average binned RNFL thickness measures were compared after masking out the nerve region. The mean difference in RNFL thickness for the two methods was −0.11 µm, with 95% limits of agreement between −13.9 µm (−15.1 µm, −12.6 µm) and 13.7 µm (12.4 µm, 14.9 µm). The ICC for the two methods was 0.99 (0.992, 0.995). For the macula region, all 400 one-degree binned squares were compared. The mean difference in GCIPL thickness comparing the two methods was −0.02 µm, with 95% limits of agreement between −2.5 µm (−2.8 µm, −2.3 µm) and 2.5 µm (2.3 µm, 2.7 µm), and the ICC was 0.998 (0.998, 0.998). There was no significant trend (P > 0.05) for the mean versus thickness differences for either RNFL of GCIPL.In addition to global measures, repeatability for one-degree binned squares was determined for all three raster scan protocols (Fig. 5). For comparison, similar regions to the 20° × 20° scans (Figs. 5C, 5D) were extracted from widefield data (dashed lines in Figs. 5A, 5B). For the optic nerve head region, the variability of RNFL thickness was the greatest closest to the rim margin, and similar for both 20° × 20° and widefield scans (Fig. 5C). Bland-Altman analysis comparing repeatability of the two methods (Fig. 5E) had a mean bias of −0.10 µm, with 95% limits of agreement between −5.2 µm (−5.7 µm, −4.7 µm) and 5.0 µm (4.5 µm, 5.5 µm). In general, there was no pattern to the repeatability from the 20° × 20° raster scanned macula region (Fig. 5D). In contrast, repeatability was larger for the central foveal region and nasal periphery for widefield scans. Bland-Altman analysis comparing repeatability of the two methods (Fig. 5F) for the central 20° had a mean bias of −0.08 µm, with limits of agreement between −1.8 µm (−2.0 µm, −1.7 µm) and 2.0 µm (1.8 µm, 2.1 µm).
Figure 5.
Repeatability of RNFL and GCIPL thickness was determined for 1° × 1° thickness regions for both widefield (A, B) and 20° × 20° (C, D) scans (n = 11 NHPs). For comparison, C and D illustrate corresponding identical regions from widefield imaging (boxed regions in A, B). (E, F) The Bland-Altman plots for data shown in C and D.
Repeatability of RNFL and GCIPL thickness was determined for 1° × 1° thickness regions for both widefield (A, B) and 20° × 20° (C, D) scans (n = 11 NHPs). For comparison, C and D illustrate corresponding identical regions from widefield imaging (boxed regions in A, B). (E, F) The Bland-Altman plots for data shown in C and D.
Discussion
Noninvasive measures of inner retinal thickness have become essential for the detection, and monitoring of optic neuropathies. In the NHP experimental glaucoma model, morphological changes are assessed using a combination of raster, radial, and circular OCT scans.– These well-established scan protocols have very good repeatability but are limited to a 30° scan area. Although there is evidence from clinical studies that widefield imaging has advantages,,, these have not been adopted in the NHP, because of a lack of normative data. The present study of healthy NHP eyes shows that inner retinal thickness measures from widefield imaging are similar to those from standard raster scans, and have similar repeatability. In addition, aligned data from 30 healthy NHP subjects provide normative data for both 20° and widefield raster scans.Thickness measures from OCT systems are known to correspond well with histology., However, there are often discrepancies in absolute thickness measurements and repeatability when comparing different OCT systems.,– Although instrument differences in image quality can be a factor, discrepancy in thickness measures often reflects differences in image processing., This is due to lack of standards for retinal layer segmentation and the fact that most algorithms are proprietary. Furthermore, in experimental animal models, instrument-based segmentation generally performs poorly, necessitating the development of custom algorithms. In the described study, the training data set for the neural networks were segmented using identical criteria for each of the three raster scan types. Briefly, borders of the inner limiting membrane, nerve fiber layer, inner plexiform layer and Bruch's membrane were manually marked, and major retinal vessels were included in the nerve fiber layer when these had any physical contact with that layer.,, Hence, although there were differences in the transverse spacing of A-scans and B-scans, thickness measures were similar for traditional 20° scan protocols and widefield imaging.RNFL thickness profiles (i.e., temporal-superior-nasal-inferior-temporal [TSNIT] plots) from circumpapillary scans and the corresponding sectoral and global average thicknesses are among the most commonly used analyses to monitor clinical disease and experimental glaucoma in the non-human primate.– Nominally these are derived from a single circular scan, 12° in diameter, but interpolated images extracted from raster scans are also used. Regardless of methodology, global circumpapillary RNFL thickness is correlated with total retrobulbar axons.,, Although thickness metrics from circumpapillary scans are sensitive, and local defects can be identified on TSNIT profiles, they cannot be used to determine the arcuate nature of loss. In this case, OCT en face images and RNFL probability maps from raster scans have excellent diagnostic value.– Furthermore, several clinical studies have shown that wedge defects identified on thickness or deviation maps mirror those on red-free fundus imaging.– Similarly, although NHP experimental glaucoma normally results in a global reduction in RNFL thickness, there are associated localized arcuate defects (Fig. 6). Longitudinal monitoring of these measures could provide valuable insights regarding both structure-structure and structure-function relationships.
Figure 6.
RNFL and GCIPL thickness maps from an animal with mild to moderate experimental glaucoma. The RNFL thickness map illustrates an inferior wedge defect, with corresponding GCIPL thickness loss.
RNFL and GCIPL thickness maps from an animal with mild to moderate experimental glaucoma. The RNFL thickness map illustrates an inferior wedge defect, with corresponding GCIPL thickness loss.Arcuate losses visualized on RNFL thickness maps provide information on localizing defects to a specific optic nerve head sector but not the precise location of RGC soma loss. For this, GCIPL thickness is known to relate well with localized RGC soma content, at least for the macula region where cell density is greatest. As with RGC densities from histology, GCIPL thickness from widefield imaging is concentrated in the central 20° degrees (boxed region in Fig. 3), thinning to a uniform thickness in the periphery. In principle, because in vivo structural measures and thresholds from visual fields reflect on RGC content, there should be good correspondence between the two measures. Although GCIPL thickness is reduced in the periphery, when combined with RNFL thickness, perimetric thresholds can be predicted from in vivo structure., This suggests that peripheral thickness measures from widefield imaging may provide useful insight into RGC content. Hence, it is possible that longitudinal monitoring of disease progression using widefield imaging may provide valuable insights into the compartmental losses associated with glaucoma.The confidence for detecting progression depends on the sources of variability for OCT thickness measures, which include animal factors, instrument factors, and segmentation. All animals used for assessing repeatability had good health throughout the imaging session for the described experiment. In addition, all sessions were at approximately the same time of the day, minimizing diurnal sources of variability. Imaging with OCT technology is robust. However, two instances of instrument error were encountered and images from these sessions were excluded from analysis. In our previous work,,– we used semiautomated segmentation, which was depended on manually correcting segmentation errors, and inherently had subjective bias. Although the neural network learns some of these biases, they are typically agnostic to the eye being analyzed and the disease state. Repeatability using segmentation from neural networks of widefield imaging is on par with measures from standard 20° scan protocols. Furthermore, although the dynamic range of widefield inner retinal thickness is not currently known for this model, repeatability (Fig. 5) is at least five times the average thickness (Figs. 2, 3), suggesting that loss of inner retinal thickness, even in peripheral locations should be quantifiable.There are several limitations to the current work. Although identical criteria were used for manual segmentation, the training dataset was labeled by only three individuals, and differences between the three were not considered. During imaging, we were careful with maintaining clear optics and alignment. However, sedated animals can have cyclotorsion, and scans were not acquired aligned to either the fovea—Bruch's membrane opening axis—or the horizontal raphe., Each of the animals used for determining repeatability had healthy eyes. Although OCT measures are known to have good repeatability in disease eyes, it will be important to establish repeatability at varying stages of neuropathy to assess the utility of widefield imaging in experimental disease. Previous work comparing thickness from widefield imaging and raster scans accounted for differences in retinal curvature, which were not accounted for in the present study. Although this was initially part of the experimental design, animals used for the current work were emmetropic, and scans acquired were relatively flat. However, accounting for retinal curvature will likely be needed for myopic eyes.In this study, we show that RNFL and GCIPL thickness can be reliably quantified using widefield imaging in the non-human primate. The data encompass standard 20° raster scans and have similar thickness and repeatability. Although histological correlations for widefield in vivo measures are unknown, they could provide methods for predicting visual thresholds and determining the time course of compartmental losses in experimental disease. Because the NHP is a scarce resource, the normative data and neural networks used in this study will be made freely available.
Authors: Mauro T Leite; Harsha L Rao; Robert N Weinreb; Linda M Zangwill; Christopher Bowd; Pamela A Sample; Ali Tafreshi; Felipe A Medeiros Journal: Am J Ophthalmol Date: 2010-10-20 Impact factor: 5.258
Authors: Jean-Claude Mwanza; Robert T Chang; Donald L Budenz; Mary K Durbin; Mohamed G Gendy; Wei Shi; William J Feuer Journal: Invest Ophthalmol Vis Sci Date: 2010-06-23 Impact factor: 4.799
Authors: Christopher K S Leung; Shi Lam; Robert N Weinreb; Shu Liu; Cong Ye; Lan Liu; Jing He; Gilda W K Lai; Taiping Li; Dennis S C Lam Journal: Ophthalmology Date: 2010-07-21 Impact factor: 12.079