Jingwei Zhao1, Manu Jain2, Ucalene G Harris2, Kivanc Kose2, Clara Curiel-Lewandrowski3, Dongkyun Kang1,3,4. 1. College of Optical Sciences, University of Arizona, Tucson, Arizona, 85721. 2. Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, New York, 10021. 3. University of Arizona Cancer Center, Tucson, Arizona, 85721. 4. Department of Biomedical Engineering, University of Arizona, Tucson, Arizona, 85721.
Abstract
BACKGROUND AND OBJECTIVE: Portable confocal microscopy (PCM) is a low-cost reflectance confocal microscopy technique that can visualize cellular details of human skin in vivo. When PCM images are acquired with a short exposure time to reduce motion blur and enable real-time 3D imaging, the signal-to-noise ratio (SNR) is decreased significantly, which poses challenges in reliably analyzing cellular features. In this paper, we evaluated deep learning (DL)-based approach for reducing noise in PCM images acquired with a short exposure time. STUDY DESIGN/ MATERIALS AND METHODS: Content-aware image restoration (CARE) network was trained with pairs of low-SNR input and high-SNR ground truth PCM images obtained from 309 distinctive regions of interest (ROIs). Low-SNR input images were acquired from human skin in vivo at the imaging speed of 180 frames/second. The high-SNR ground truth images were generated by registering 30 low-SNR input images obtained from the same ROI and summing them. The CARE network was trained using the Google Colaboratory Pro platform. The denoising performance of the trained CARE network was quantitatively and qualitatively evaluated by using image pairs from 45 unseen ROIs. RESULTS: CARE denoising improved the image quality significantly, increasing similarity with the ground truth image by 1.9 times, reducing noise by 2.35 times, and increasing SNR by 7.4 dB. Banding noise, prominent in input images, was significantly reduced in CARE denoised images. CARE denoising provided quantitatively and qualitatively better noise reduction than non-DL filtering methods. Qualitative image assessment by three confocal readers showed that CARE denoised images exhibited negligible noise more often than input images and non-DL filtered images. CONCLUSIONS: Results showed the potential of using a DL-based method for denoising PCM images obtained at a high imaging speed. The DL-based denoising method needs to be further trained and tested for PCM images obtained from disease-suspicious skin lesions.
BACKGROUND AND OBJECTIVE: Portable confocal microscopy (PCM) is a low-cost reflectance confocal microscopy technique that can visualize cellular details of human skin in vivo. When PCM images are acquired with a short exposure time to reduce motion blur and enable real-time 3D imaging, the signal-to-noise ratio (SNR) is decreased significantly, which poses challenges in reliably analyzing cellular features. In this paper, we evaluated deep learning (DL)-based approach for reducing noise in PCM images acquired with a short exposure time. STUDY DESIGN/ MATERIALS AND METHODS: Content-aware image restoration (CARE) network was trained with pairs of low-SNR input and high-SNR ground truth PCM images obtained from 309 distinctive regions of interest (ROIs). Low-SNR input images were acquired from human skin in vivo at the imaging speed of 180 frames/second. The high-SNR ground truth images were generated by registering 30 low-SNR input images obtained from the same ROI and summing them. The CARE network was trained using the Google Colaboratory Pro platform. The denoising performance of the trained CARE network was quantitatively and qualitatively evaluated by using image pairs from 45 unseen ROIs. RESULTS: CARE denoising improved the image quality significantly, increasing similarity with the ground truth image by 1.9 times, reducing noise by 2.35 times, and increasing SNR by 7.4 dB. Banding noise, prominent in input images, was significantly reduced in CARE denoised images. CARE denoising provided quantitatively and qualitatively better noise reduction than non-DL filtering methods. Qualitative image assessment by three confocal readers showed that CARE denoised images exhibited negligible noise more often than input images and non-DL filtered images. CONCLUSIONS: Results showed the potential of using a DL-based method for denoising PCM images obtained at a high imaging speed. The DL-based denoising method needs to be further trained and tested for PCM images obtained from disease-suspicious skin lesions.
Authors: Milind Rajadhyaksha; Ashfaq Marghoob; Anthony Rossi; Allan C Halpern; Kishwer S Nehal Journal: Lasers Surg Med Date: 2016-10-27 Impact factor: 4.025
Authors: Gary Peterson; Daniella Karassawa Zanoni; Marco Ardigo; Jocelyn C Migliacci; Snehal G Patel; Milind Rajadhyaksha Journal: Lasers Surg Med Date: 2019-05-08 Impact factor: 4.025
Authors: Esther E Freeman; Aggrey Semeere; Hany Osman; Gary Peterson; Milind Rajadhyaksha; Salvador González; Jeffery N Martin; R Rox Anderson; Guillermo J Tearney; Dongkyun Kang Journal: Biomed Opt Express Date: 2018-03-26 Impact factor: 3.732