Visualization and correct assessment of alveolar volume via intact lung imaging is important to study and assess respiratory mechanics. Optical Coherence Tomography (OCT), a real-time imaging technique based on near-infrared interferometry, can image several layers of distal alveoli in intact, ex vivo lung tissue. However optical effects associated with heterogeneity of lung tissue, including the refraction caused by air-tissue interfaces along alveoli and duct walls, and changes in speed of light as it travels through the tissue, result in inaccurate measurement of alveolar volume. Experimentally such errors have been difficult to analyze because of lack of 'ground truth,' as the lung has a unique microstructure of liquid-coated thin walls surrounding relatively large airspaces, which is difficult to model with cellular foams. In addition, both lung and foams contain airspaces of highly irregular shape, further complicating quantitative measurement of optical artifacts and correction. To address this we have adapted the Bragg-Nye bubble raft, a crystalline two-dimensional arrangement of elements similar in geometry to alveoli (up to several hundred μm in diameter with thin walls) as an inflated lung phantom in order to understand, analyze and correct these errors. By applying exact optical ray tracing on OCT images of the bubble raft, the errors are predicted and corrected. The results are validated by imaging the bubble raft with OCT from one edge and with a charged coupled device (CCD) camera in transillumination from top, providing ground truth for the OCT.
Visualization and correct assessment of alveolar volume via intact lung imaging is important to study and assess respiratory mechanics. Optical Coherence Tomography (OCT), a real-time imaging technique based on near-infrared interferometry, can image several layers of distal alveoli in intact, ex vivo lung tissue. However optical effects associated with heterogeneity of lung tissue, including the refraction caused by air-tissue interfaces along alveoli and duct walls, and changes in speed of light as it travels through the tissue, result in inaccurate measurement of alveolar volume. Experimentally such errors have been difficult to analyze because of lack of 'ground truth,' as the lung has a unique microstructure of liquid-coated thin walls surrounding relatively large airspaces, which is difficult to model with cellular foams. In addition, both lung and foams contain airspaces of highly irregular shape, further complicating quantitative measurement of optical artifacts and correction. To address this we have adapted the Bragg-Nye bubble raft, a crystalline two-dimensional arrangement of elements similar in geometry to alveoli (up to several hundred μm in diameter with thin walls) as an inflated lung phantom in order to understand, analyze and correct these errors. By applying exact optical ray tracing on OCT images of the bubble raft, the errors are predicted and corrected. The results are validated by imaging the bubble raft with OCT from one edge and with a charged coupled device (CCD) camera in transillumination from top, providing ground truth for the OCT.
Illustration of the artifacts in OCT images caused by air/tissue interfaces. Upper panel: simulated OCT cross sections of a turbid agarose gel stick (left) and air bubble (right) surrounded by olive oil to demonstrate image generation for fluid and air-filled alveoli. OCT cross sections of the phantom measurements of (A)optical turbid agarose gel stick and (B) air bubble in olive oil.(C) OCT en-face image showing the artifacts caused by the air/tissue interfaces that result in pseudodoubled alveolar walls (white arrows). Image by Sven Meissner et al. (This figure is reproduced with permission from the Journal of Biomedical Optics and the authors [18].)
Fig. 3
Experimental setup - a bubble raft on a glass cover slip was imaged on edge by OCT, and from above by CCD. The raft was illuminated from below by a green LED to improve contrast in the CCD. For the experiment in this paper, the raft is a single layer of bubbles approximately 250μm thick.
Illustration of the artifacts in OCT images caused by air/tissue interfaces. Upper panel: simulated OCT cross sections of a turbid agarose gel stick (left) and air bubble (right) surrounded by olive oil to demonstrate image generation for fluid and air-filled alveoli. OCT cross sections of the phantom measurements of (A)optical turbid agarose gel stick and (B) air bubble in olive oil.(C) OCT en-face image showing the artifacts caused by the air/tissue interfaces that result in pseudodoubled alveolar walls (white arrows). Image by Sven Meissner et al. (This figure is reproduced with permission from the Journal of Biomedical Optics and the authors [18].)Experimental setup - a bubble raft on a glass cover slip was imaged on edge by OCT, and from above by CCD. The raft was illuminated from below by a green LED to improve contrast in the CCD. For the experiment in this paper, the raft is a single layer of bubbles approximately 250μm thick.
2. Methods
2.1. Bubble raft
A bubble raft was made from a solution-mixture consisting of 100 ml distilled water, 3 ml dish soap and 15 ml whole milk. Milk was used to increase scattering effects under OCT and improve contrast to be comparable to that of lung. To produce bubbles, air was blown at a constant air pressure of approximately 28 cmH2O, through a 31 gauge hypodermic needle with a 0.005 inch (0.127 mm) inner diameter placed approximately 0.5 cm below the surface of the soap solution. To improve uniformity and decrease average bubble diameter to 200 μm, the solution was heated to 24°C and rotated, the latter method originally suggested by Bragg and Nye [21]. The bubbles naturally formed a hexagonal arrangement on the liquid surface, and a stirring rod and heated wire were used to remove crystalline defects, again as reported previously [21]. A perfect flat edge was achieved by destroying outlying bubbles with a soldering iron. When a suitable raft was arranged, it was transferred to a glass laboratory slide (via scooping) to stabilize it for carrying to the OCT apparatus. As the bubbles were indistinguishable from each other under both OCT and CCD imaging, a negative fiducial marker was created when needed, by popping several bubbles on the edge.Bubble raft imaged (a) from above via CCD and (b) from the edge using OCT. Arrows show popped bubbles used for matching in registration. (c) OCT (red plane) and CCD (green plane) images overlaid, via rotation, translation and isotropic scaling.
2.2. Data acquisition
The bubble raft was imaged from the edge utilizing OCT and a CCD camera was used with normal orientation to the raft as shown in Fig. 3. The CCD setup was an Olympus E-P1 digital camera with an Olympus 14–42 mm lens and a M.U.K macro extension tube. To improve visibility, the raft was illuminated from below with a green LED. OCT images were taken from the edge of the raft utilizing a commercial standard SR-OCT (Thorlabs, Inc., Newton, NJ) with an imaging depth of 1.6 mm and axial resolution of 6.2 um. CCD images and OCT images of the bubble raft used for the analysis are shown in Figs. 4a, b, and c respectively. Although there are qualitative similarities (e.g. periodicity, near-spherical walls), there are also significant differences, which are analyzed below.
Fig. 4
Bubble raft imaged (a) from above via CCD and (b) from the edge using OCT. Arrows show popped bubbles used for matching in registration. (c) OCT (red plane) and CCD (green plane) images overlaid, via rotation, translation and isotropic scaling.
2.3. Data processing
After the OCT image was acquired, it was registered to the corresponding CCD image manually, using a global affine transformation allowing only translation, rotation, and isotropic scaling so that the structure of the measurements stayed unchanged. The location of the top surface of the top layer of bubbles in the bubble raft was used as the landmark feature to be aligned in the two set of image data. This allowed both images to be registered into a common space, i.e., the CCD image space. Figs. 5a and b show the same bubble, simultaneously imaged via OCT and CCD, respectively. There are a few salient features, which are the foci of this paper. First, the top surface of the OCT bubble shows a wall of milk solution-mixture that is thicker than in the CCD image. Second, the bottom surface of the OCT bubble is disconnected from the top surface, and distorted, forming a double-wall image shown by an arrow in Fig. 5a. This effect has been previously reported in [18]. In this section we describe a means to predict the OCT artifacts, and correct for them, using methods outlined in [22].
Fig. 5
(a) OCT image of a single bubble. Arrow points to ’double wall’ artifact. (b) CCD image of the same bubble, with surrounding bubbles visible. Images are scaled to same size. (c) Model showing refractive effects on a single bubble of air (white) in a medium with higher refractive index (grey). A light ray (black line) crossing the medium-air interface at (i) is normal to the interface, and is not refracted, impinging on the bottom surface at (iii). This is backscattered to i and no artifact occurs. The light ray (grey line) crossing at (ii) is refracted to impinge the bottom surface (grey dashed arc) at (iv), where it is backscattered to (ii). However, the OCT system interprets this as a ray parallel to the optical axis (grey dotted line), thus ”detecting” the bottom surface at (v). Rays refracted in this way lead to construction of the double wall (grey dotted arc.)
(a) OCT image of a single bubble. Arrow points to ’double wall’ artifact. (b) CCD image of the same bubble, with surrounding bubbles visible. Images are scaled to same size. (c) Model showing refractive effects on a single bubble of air (white) in a medium with higher refractive index (grey). A light ray (black line) crossing the medium-air interface at (i) is normal to the interface, and is not refracted, impinging on the bottom surface at (iii). This is backscattered to i and no artifact occurs. The light ray (grey line) crossing at (ii) is refracted to impinge the bottom surface (grey dashed arc) at (iv), where it is backscattered to (ii). However, the OCT system interprets this as a ray parallel to the optical axis (grey dotted line), thus ”detecting” the bottom surface at (v). Rays refracted in this way lead to construction of the double wall (grey dotted arc.)A forward ray tracing model was used to predict the distorted measurements of the bottom surface, using the correct measurements of the top surface, while assuming an ellipsoidal geometry for the entire bubble. The first step was to correct for the incorrect depth of the bubble top surface measured by the OCT signal, due to change in the index of refraction from air to liquid. Using the OCT measurements, the location of the top surface of the bubble was manually detected by selecting a finite number of points on locations where an edge in the bubble top surface was visible. The points were then fitted to an ellipse in a least square manner. The coordinates of the collection of points on the ellipse top surface are denoted by (X′1, Z′1). In this step, the correction for the distortions that result from change in the speed of light in the milk solution was only required along the optical axis. Thus, the correct location of the points on the top surface were calculated by simply dividing the distance traveled between surface of the milk solution, denoted by Z0, and the top surface of the bubble measured by OCT, denoted by Z′1, by the index of refraction of the milk solution, n = 1.33 as shown below:Once the corrected top surface was found, the bottom surface was analyzed. As stated in [22], the double wall artifact arises due to refractive effects that are not accounted for in OCT, and is schematized in Fig. 5c. When rays hit the bottom surface they are partially backscattered, re-tracing their original paths. However, OCT interprets these rays path as parallel to the optical axis, so while the distance traveled is conserved, the direction of origin is altered by the refraction angle. Thus, the reconstructed bottom surface appears distorted and disconnected.After coordinates of the correct location of the top surface, (X1, Z1), were found, inverse ray tracing was used to predict the correct location of the bottom surface using the locations of both top and bottom surface as measured by the OCT. First, using the OCT measurements the location of the bottom surface of the bubble was found in the same manner as the top surface was found. The coordinates of the collection of points on the bottom surface are referred to as (X′2, Z′2).The points on the bottom surface of the bubble were projected to the correct location of the bubble top surface parallel to the optical (z) axis to find the point at which each ray met the liquid-air interface. Using Snell’s Law and the curvature of the top surface at each such position, the refraction angle θ was calculated for each i’th ray. Since the travel time in the bubble as assumed by the OCT device was correct, as the medium was air, the corrected bottom surface of the bubble was found by traveling the original length of each projected ray but at the correct angle for that ray. The original length of each projected ray is referred to as r. Thus in effect each location on the measured bottom surface was rotated by pivoting on its corresponding parallel ray around the entry point of that ray into the bubble at corrected top surface, and the predicted angle for that ray. The corresponding coordinates of the corrected top surface, were thus transformed to find the coordinates of the corrected bottom surface, referred to as (X2, Z2).After the correct location of both top and bottom surfaces were calculated, an ellipse was fitted to these locations to predict the entire bubble surface, then that shape was compared to the corresponding CCD images.
3. Results and discussion
The CCD image in Fig. 4a shows the true shape of the bubbles within the raft, with each bubble being nominally a sphere. However, in the OCT image in Fig. 4b, the lower surfaces of the spheres have a smaller radius of curvature than the top surfaces, resulting in a discontinuity in the apparent bubble surface, leading to a shape that can be described as a shield or double wall. This is evident in Fig. 4c where the OCT image (red plane) is registered to the corresponding CCD image (green plane).Figure 6 (a–d) shows the results of the ray tracing methods; Figs. 6a and c predict the errors arising from refractive effects in OCT (forward ray tracing) and Figs. 6b and d display corrections (inverse ray tracing). The yellow dashed line shows the edge at which rays enter the top surface of the milk solution-mixture. The uncorrected top bubble surface in OCT was found to fit an ellipse, which also describes the distance from the yellow line and is shown in green. The uncorrected top bubble surface is superimposed on the CCD image in Fig. 6c, where it has a tighter curvature than the actual bubble surface. By dividing the z-coordinate by 1.33, this elliptical surface is translated toward the edge, and a corrected thickness and bubble top surface is obtained. This can be compared to the original OCT image (Figs. 6a, b) and the CCD image in Fig. 6d, although the milk solution-mixture edge is rather diffuse under CCD. However, note that the top bubble surface shape is nearly identical to that obtained under CCD, after correction via inverse ray tracing. Using the CCD image (Fig. 6c) and a liquid refractive index of 1.33 as input, forward ray tracing predicts a distorted bottom surface, denoted by the red line in Figs. 6a and c.
Fig. 6
Illustration of forward (left panels) and inverse (right panels) ray tracing stages. (Note that the notation used in the legend corresponds to the equations in the text.) The top panels show OCT images of the bubble raft, while the bottom panels show those same images overlaid on the CCD camera image of the same portion of the raft. On all four images, the yellow dashed line shows the location of the OCT imager. The dashed cyan line along the top of the bubble shows the location of the top surface as determined from the OCT image (as described in text). The dashed green line shows the corrected top surface (obscured by the measured location in some cases). The dashed magenta line along the top surface indicates the extent over which rays refract into the bubble. For the forward ray tracing in the left planes (a) and (c), the dashed red curve shows the location of the bottom surface as measured by OCT imaging model (determined via forward ray tracing). The small cyan circle near the bottom of the bubble shows the locate of the manually selected location of the center of the bottom surface on the OCT image; the small green circle shows its location after applying the correction algorithm. The ellipse fit to the corrected top surface and a corrected central point on bottom surface is shown with a dotted blue line. On the right panels (b) and (d), the solid cyan shows the bottom as seen in the original OCT images, while the solid magenta curve shows the bottom surface after correction. The dashed blue ellipse on these panels shows the estimated bubble surface after correction with inverse ray tracing, determined by a fit to the corrected top and bottom surfaces.
Illustration of forward (left panels) and inverse (right panels) ray tracing stages. (Note that the notation used in the legend corresponds to the equations in the text.) The top panels show OCT images of the bubble raft, while the bottom panels show those same images overlaid on the CCD camera image of the same portion of the raft. On all four images, the yellow dashed line shows the location of the OCT imager. The dashed cyan line along the top of the bubble shows the location of the top surface as determined from the OCT image (as described in text). The dashed green line shows the corrected top surface (obscured by the measured location in some cases). The dashed magenta line along the top surface indicates the extent over which rays refract into the bubble. For the forward ray tracing in the left planes (a) and (c), the dashed red curve shows the location of the bottom surface as measured by OCT imaging model (determined via forward ray tracing). The small cyan circle near the bottom of the bubble shows the locate of the manually selected location of the center of the bottom surface on the OCT image; the small green circle shows its location after applying the correction algorithm. The ellipse fit to the corrected top surface and a corrected central point on bottom surface is shown with a dotted blue line. On the right panels (b) and (d), the solid cyan shows the bottom as seen in the original OCT images, while the solid magenta curve shows the bottom surface after correction. The dashed blue ellipse on these panels shows the estimated bubble surface after correction with inverse ray tracing, determined by a fit to the corrected top and bottom surfaces.Note that the predicted bottom surface artifact falls on the experimentally-observed OCT results (Fig 6a) closely. This prediction also agrees, qualitatively, with previous observations in the literature [18]. In addition, the artifacts agree with a fully computational model of OCT on a hexagonal porous material, using a finite difference time domain (FDTD) that approximates Maxwells equations [23, 24]. Using the correct shape of the top surface and the OCT-observed shape of the bottom surface as input, and applying the algorithm described in the methods section, a corrected bottom surface is obtained, and shown in Figs. 6b, d. Note the significant difference between the corrected model line and the OCT artifact (Fig. 6b) and also the strong similarity between the corrected bottom surface and the actual CCD image (Fig. 6d.)As shown in previous studies [18], the artifacts from OCT can lead to under-estimation in alveolar volume. We observe a similar phenomenon, and by image analysis the error is approximately 20 %. Previous studies reported errors of 26 % but the difference between methods could be attributed to methods of image analysis. There are slight mismatches between the corrected OCT surfaces when overlaid on the CCD, but we can attribute this to errors in registration of the original images. In addition, the current exercise utilizes soap bubbles that are approximately 250 μm in diameter, which is larger than typical alveolar size. However, prediction of artifacts, and their correction using ray tracing should continue to be applicable at smaller sizes. Finally, as this has been experimentally verified, it would be a reasonable exercise to approximate errors that could be obtained on alveoli of 100 μm or smaller diameter. In addition, this method would be applicable to other highly porous heterogeneous materials, including aerogels, or synthetic liquid foams.
4. Conclusion
Errors that arise from imaging heterogeneous, high porosity materials using OCT have been observed, predicted and corrected in this paper by recourse to a ray tracing approach. The Bragg Nye bubble raft was shown to be a plausible phantom for alveoli, as the geometry and refractive properties are similar. Single bubbles, or the first layer of bubbles, were addressed in this paper.However, smaller bubbles or different scattering behavior of the liquid from which the bubbles arise would presumably allow imaging of successive layers, and analysis of artifacts under OCT. In addition, non-spherical ’bubbles’ could possibly be produced by constraining the top and bottom of the raft, for future study. Moreover, the analysis presented here, while focusing on lung, could also be used in highly porous gels or foams.
Authors: D Huang; E A Swanson; C P Lin; J S Schuman; W G Stinson; W Chang; M R Hee; T Flotte; K Gregory; C A Puliafito Journal: Science Date: 1991-11-22 Impact factor: 47.728
Authors: Andrew Gouldstone; Nazli Caner; Tristan B Swedish; Salmon M Kalkhoran; Charles A DiMarzio Journal: IEEE Trans Biomed Eng Date: 2011-06-23 Impact factor: 4.538
Authors: N Hanna; D Saltzman; D Mukai; Z Chen; S Sasse; J Milliken; S Guo; W Jung; H Colt; M Brenner Journal: J Thorac Cardiovasc Surg Date: 2005-03 Impact factor: 5.209
Authors: Ashok P Sarnaik; Kshama M Daphtary; Kathleen L Meert; Mary W Lieh-Lai; Sabrina M Heidemann Journal: Pediatr Crit Care Med Date: 2004-03 Impact factor: 3.624
Authors: Madeleine S Durkee; Landon D Nash; Fatemeh Nooshabadi; Jeffrey D Cirillo; Duncan J Maitland; Kristen C Maitland Journal: J Vis Exp Date: 2018-02-12 Impact factor: 1.355