Nomarski serial time-encoded amplified microscopy for high-speed contrast-enhanced imaging of transparent media.

High-speed high-contrast imaging modalities that enable image acquisition of transparent media without the need for chemical staining are essential tools for a broad range of applications; from semiconductor process monitoring to blood screening. Here we introduce a method for contrast-enhanced imaging of unstained transparent objects that is capable of high-throughput imaging. This method combines the Nomarski phase contrast capability with the ultrahigh frame rate and shutter speed of serial time-encoded amplified microscopy. As a proof of concept, we show imaging of a transparent test structure and white blood cells in flow at a shutter speed of 33 ps and a frame rate of 36.1 MHz using a single-pixel photo-detector. This method is expected to be a valuable tool for high-throughput screening of unstained cells.

1. Introduction

Optical imaging is widely used for detection, inspection, and diagnostics in numerous industrial, biomedical, and scientific applications. In particular, imaging modalities, such as differential interference contrast (DIC) microscopy [1,2] and phase-contrast (PC) microscopy [2], which can capture images of transparent objects without the need for chemical staining, are of a significant importance. Metallurgy and semiconductor processing heavily rely on these modalities for imaging surface scratches, lines and edges, defects, and contaminations inside the material being tested [3-5]. Also, such modalities play a crucial role in detection and diagnostics of diseased cells (e.g., leukemia) in advanced biomedical research and clinical settings [6-9].

High-throughput imaging in such applications is highly desirable [10], but extremely challenging. For instance, high-throughput screening of biological cells (that show nearly no contrast with respect to their aqueous surroundings) enables finding of rare diseased cells in a large population of healthy cells. However, conventional techniques (e.g., DIC microscopy) with the ability to perform this task have relied on CCD (charge-coupled device) and CMOS (complementary metal-oxide-semiconductor) image sensors [11]. Hence, their image acquisition throughput is limited by that of CCD and CMOS cameras. More importantly, the shutter speed of even the fastest cameras is too slow, resulting in significant blurring of images during high-speed screening. Due to these technological limitations, conventional DIC and PC microscopy have not been commonly used for applications that require monitoring of dynamic samples in real time with high throughput.

The recently introduced imaging technology known as serial time-encoded amplified imaging or microscopy (STEAM) [12] overcomes limitations in conventional imaging and provides ~1000 times higher frame rates and shutter speeds than conventional image sensors. STEAM employs an amplified space-to-time mapping technique to encode the spatial information of an object into a one-dimensional (1D) serial time-domain optical waveform and optically amplify the image, simultaneously. The high-speed capability of the STEAM imager enables its use for applications in which high-throughput screening of an object is of interest, such as blood cell screening [13]. Unfortunately, the STEAM imager is inadequate for imaging of transparent objects but rather limited to opaque samples or samples with high refractive-index or absorption contrast. While the objects (e.g. biological cells) can be stained with dyes to increase their contrast, chemical staining requires time-consuming sample preparation and is often accompanied by cell death.

Here we present a method that overcomes the contrast limitation of STEAM and hence performs high-speed contrast-enhanced imaging of transparent media without the need for chemical staining. The presented technique, which we refer to as Nomarski serial time-encoded amplified microscopy (N-STEAM) combines STEAM’s high-speed capability and DIC/Nomarski microscopy’s ability to image unstained transparent objects. To demonstrate our method, we show contrast enhancement in imaging of a transparent refractive-index-modulated structure and white blood cells in flow with 33 ps dwell time (shutter speed) at 36.1 MHz frame rate using a single-pixel photodetector. This method is expected to be a valuable tool for high-throughput screening and sorting of unstained cells.

2. Working principle of N-STEAM

N-STEAM is a DIC implementation of STEAM that obtains a differential phase contrast image of the object with very fast shutter speed and high frame rates. The N-STEAM employs a Nomarski prism (also known as modified Wollaston prism) [14,15] and spatial light dispersers (e.g., a pair of diffraction gratings) to produce two 1D spatially-dispersed orthogonally-polarized beams as illustrated in Fig. 1(a) . It, then, illuminates two adjacent points on the object with each wavelength component but different polarizations. The illumination beams travel through the two incident points on the transparent object and hence, they experience different phase shifts associated with the optical path lengths (i.e., the product of the refractive index and thickness) of the two incident points on the object [Fig. 1(b)]. By recombining the two phase-encoded beams using the same Nomarski prism, the differential phase information is converted into an intensity modulation. In other words, the optical path length difference between the two incident points results in constructive/deconstructive interference for each wavelength. The image-encoded spectrum [Fig. 1(b)] is then converted into a temporal data stream, stretched in time, and simultaneously amplified using an amplified dispersive Fourier transformation [16-18]. The time stretch allows the image to be digitized by a conventional electronic digitizer. Also, the optical image amplification (~20 dB) over a wide optical bandwidth (as large as 60 nm) overcomes the loss of signal at high frame rates and is a key feature of this method. The temporal waveform in Fig. 1(c) indicates the repetitive pulses (corresponding to the line scans) detected by a single-pixel photodetector and illustrates the operation of N-STEAM at 36.1 MHz frame rate. In other words, N-STEAM’s real-time capture of time-domain pulses enables pulse-to-pulse (frame-by-frame) image acquisition at 36.1 MHz rate.

Fig. 1

Nomarski serial time-encoded amplified microscopy (N-STEAM). N-STEAM builds on a unique combination of STEAM’s high-speed imaging capability and DIC/Nomarski microscopy’s ability to image transparent objects without staining. (a) Schematic of the N-STEAM imager. The N-STEAM uses a Nomarski prism to encode the optical path length (the product of the refractive index and thickness) of the object into the optical spectrum of the illumination beam. (b) Evolution of the intensity, phase, and polarization of the illumination beam(s) at different points in the system. (c) Temporal waveform that shows N-STEAM’s frames (line scans) at 36.1 MHz, corresponding to a repetition period of 27.7 ns.

A phase contrast implementation of the STEAM imager based on Hilbert transform has been reported by us before [19]. In that implementation, which does not use the Nomarski technique, the time domain signal is upconverted to a higher modulation frequency; therefore, the requirements on the speed of the digitizer is more demanding, and digital signal processing is required to perform the Hilbert transform. The present Nomarski based technique does not have such requirements.

3. N-STEAM implementation

In an implementation of N-STEAM, the broadband pulse laser is a mode-locked laser with a center wavelength of 1560 nm and a pulse repetition rate of 36.1 MHz. A highly nonlinear fiber and optical band-pass filter following the laser produces a train of pulses with ~20 nm bandwidth centered at 1591 nm as an illumination beam. Using a pair of diffraction gratings with 1100 lines/mm groove density, the pulses are spatially-dispersed into a 1D rainbow pattern enabling 1D line-scanning of the object. The 1D spatially-dispersed beam (i.e., 1D rainbow) is sent to a half-wave plate and a polarizer to rotate the polarization state of the light and ensure 45-degree linear polarization incident on the Nomarski prism. The Nomarski prism splits the illumination beam into two orthogonally-polarized 1D rainbow patterns (0 and 90 degrees).

The design of the Nomarski prism and the subsequent optics are such that the two orthogonally-polarized beams are incident on the object in the direction normal to the direction of the line scan. A mirror is placed at the back of the object to return the phase-encoded beams to the same optics, which results in double passing of the illumination beams through the object, and hence, doubles the phase shifts. After recombining the phase-encoded beams using the same Nomarski prism, the spectrally-encoded beam is directed to a spool of optically-pumped dispersive fiber (with dispersion value of −1373 ps/nm) via an optical circulator to perform amplified dispersive Fourier transformation (gain of ~20dB). The time-encoded optical pulses are then captured by a high-speed photodetector with 10 GHz bandwidth and digitized by a real-time digitizer with 16 GHz bandwidth and 50 GS/s sampling rate (Tektronix – DPO71604). Digital signal processing including background and noise removal is performed offline to reconstruct the image of the object under test.

4. Results

To demonstrate our method, we performed imaging of a transparent structure using N-STEAM. The object is a transparent material with a periodic refractive-index modulation [i.e., a transmission grating with a groove density of 70 lines per millimeter, Fig. 2(a) ]. Figures 2(b) and 2(c) compare the reconstructed two-dimensional (2D) images with N-STEAM and STEAM, respectively. The second dimension of the images was obtained by translating the object in the direction orthogonal to that of the line scans. The design of the object is such that the refractive-index modulation is small; hence, the reflection from different points on the object is below the sensitivity of the STEAM imager. With the Nomarski prism, the system provides differential phase-contrast in imaging of the object [Fig. 2(b)]. The captured image without the Nomarski prism (i.e., using STEAM without DIC implementation) shows the normalized reflectivity map of the object [Fig. 2(c)]. As evident from the images, significant contrast-enhancement is achieved by using N-STEAM. The high-intensity lines in the image are ~14 μm apart, which agrees with the specifications of the transparent structure.

Fig. 2

(a) Schematic of the transparent refractive-index modulated structure aligned with the illumination beams. Images of a transparent refractive-index modulated structure captured using N-STEAM with (b) and without (c) the Nomarski prism. The imager without the prism is equivalent to STEAM, while the enhancement in the image contrast was obtained with the Nomarski prism (i.e., N-STEAM). The second dimension of the images was obtained by translating the sample in the direction normal to the line scans. The comparison of the images indicates significant contrast enhancement obtained by the N-STEAM.

In order to demonstrate the use of our method in high-speed high-contrast imaging of unstained biological cells and tissue, we also performed imaging of fast-flowing unstained white blood cells in a microfluidic channel [20,21]. White blood cells were isolated from whole blood by hypotonic lysis of red blood cells and resuspended in phosphate buffered saline. To acquire 2D images of the cells, they flow [Fig. 3(a) ] at a flow speed of 1 meter/s in the direction orthogonal to that of the line scans – providing 400-500 image pixels in the flow direction for each white blood cell. Figures 3(b) and 3(c) compare the images of white blood cells captured by N-STEAM and STEAM, respectively. The image captured by N-STEAM [Fig. 3(b)] is based on the relative phase shift between the illumination beams when propagating through the cell, while the image captured by STEAM [Fig. 3(c)] shows the reflection from the surface of the cell. Note that the color coding in Fig. 3(b) represents the normalized optical path length of the cell, while that in Fig. 3(c) represents the normalized reflectivity of the cell. Interestingly, the image contrasts of the white blood cells captured by N-STEAM is >15 times higher than those of captured by STEAM; that is equivalent to ~12-dB signal-to-noise ratio (SNR) improvement over STEAM. This is due to poor refractive-index contrast and/or absorption of unstained white blood cells compared to their aqueous surrounding (i.e., phosphate buffered saline). Since N-STEAM reveals the optical path length of the cell (i.e., the product of refractive index and size), it can be potentially used to distinguish different types of cells that are similar in size, and hence suggests a path to high-throughput imaging-based cell analysis.

Fig. 3

(a) Schematic of the microfluidic channel aligned with respect to 1-D rainbow illumination pulses. Images of unstained white blood cells captured by N-STEAM, (b) with and, (c) without the Nomarski prism. The flow rate was 1 meter/s. The image contrasts obtained by N-STEAM is >15 times larger than those of obtained by STEAM. The rest of scale bars, 10μm.

5. Discussions

5.1. Contrast enhancement

The N-STEAM’s enhanced image-contrast can be obtained as follows. It can be adjusted using the offset phase shift between the two spatially-dispersed orthogonally-polarized beams. Similar to the expression derived in Ref. [22]. for conventional DIC or Nomarski microscopy, the intensity of each wavelength component of the interfered beam in N-STEAM is obtained by the expression,

where a1 = cos2(φ) and a2 = −0.5 sin (2φ)sin(2φ). Here φ and φ are the angles of the analyzer and polarizer, respectively, and χ is the differential phase shift between the two polarized beams. In N-STEAM, the polarizer and analyzer are the same as illustrated in Fig. 1(a); hence, φ and φ are equal to 45 degrees. The differential phase shift (χ) is composed of two parts: the phase shift offset and the phase shift due to the optical path length difference between the incident points on the object to be imaged. The phase shift offset is a constant phase shift due to different optical paths travelled by the two spatially-dispersed beams. This can be adjusted by changing the tilt angle of the prism with respect to the propagation direction of the illumination beam.

5.2. Specifications

The specification of N-STEAM demonstrated here is evaluated as follows. The number of image pixels is found to be N = |D|⋅Δλ⋅fdig = 1373, where D is the total dispersion in the dispersive fiber (D = −1373 ps/nm), Δλ is the optical bandwidth (Δλ = 20 nm), and fdig is the sampling rate of the digitizer (fdig = 50 GS/s). The diffraction-limited spatial resolution [23] is determined to be d ≈λ/2/NA ≈2 μm, where λ is the operation wavelength (λ = 1591 nm) and NA is the numerical aperture of the objective lens (NA = 0.4). The number of resolvable spectral points is estimated to be ~180 from the spectral resolution of the ADFT process [23]. Hence, the dwell time (shutter speed) is found to be ~33 ps from the bandwidth of each subpulse or wavelength component (20 nm / 180) in the line scan. The current implementation of the N-STEAM provides a 1D line-scan width of 100 μm; this has been validated using a known target (Resolution test target, Thorlabs, R2L2S1N).

6. Conclusion

We have proposed and demonstrated a method that enables high-speed contrast-enhanced image acquisition of transparent objects without the need for chemical staining. This imaging modality, N-STEAM, fills the contrast and speed gap between phase imaging-based techniques and STEAM imager. It couples the high-speed capability of the STEAM imager and differential phase contrast imaging of DIC / Nomarski microscopy. As the proof of concept, we performed imaging of a transparent structure and white blood cells in flow at 33 ps shutter speed and 36.1 MHz frame rate. N-STEAM holds promise for high-throughput imaging of unstained biological cells.