Mingshu Liang1, Cory Bernadt2, Soon Boon Justin Wong3, Changsoon Choi1, Richard Cote2, Changhuei Yang1. 1. Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA. 2. Department of Pathology and Immunology, Washington University School of Medicine, MO 63110, USA. 3. Department of Pathology, National University Hospital, 119074, Singapore.
Abstract
Context: Cytology is the study of whole cells in diagnostic pathology. Unlike standard histologic thinly sliced specimens, cytologic preparations consist of preparations of whole cells where cells commonly cluster and aggregate. As such, cytology preparations are generally much thicker than histologic slides, resulting in large patches of defocus when examined under the microscope. A diagnostic aggregate of cells often cannot be viewed in focus together, requiring pathologists to continually manipulate the focal plane, complicating the task of accurately assessing the entire cellular aggregate and thus in making a diagnosis. Further, it is extremely difficult to acquire useful uniformly in-focus digital images of cytology preparations for applications such as remote diagnostic evaluations and artificial intelligence models. The predominant current method to address this issue is to acquire digital images at multiple focal planes of the entire slide, which demands long scanning time, complex and expensive scanning systems, and huge storage capacity. Aims: Here we report a unique imaging method that can acquire cytologic images efficiently and computationally render all-in-focus digital images that are highly compact. Methods and material: This method applies a metric-based digital refocusing to microscopy data collected with a Fourier ptychographic microscope (FPM). The digitally refocused patches of images are then synthesized into an all-in-focus image. Results: We report all-in-focus FPM results of thyroid fine needle aspiration (FNA) cytology samples, demonstrating our method's ability to overcome the height variance of 30 μm caused by cell aggregation, and rendering images at high resolution (corresponds to a standard microscope with objective NA of 0.75) and that are all-in-focus. Conclusions: This technology is applicable to standard microscopes, and we believe can have an impact on diagnostic accuracy as well as ease and speed of diagnosing challenging specimens. While we focus on cytology slides here, we anticipate this technology's advantages will translate well for histology applications. This technique also addresses the issue of remote rapid evaluation of cytology preparations. Finally, we believe that by resolving the focus heterogeneity issues in standard digital images, this technique is a critical advance for applying machine learning to cytology specimens.
Context: Cytology is the study of whole cells in diagnostic pathology. Unlike standard histologic thinly sliced specimens, cytologic preparations consist of preparations of whole cells where cells commonly cluster and aggregate. As such, cytology preparations are generally much thicker than histologic slides, resulting in large patches of defocus when examined under the microscope. A diagnostic aggregate of cells often cannot be viewed in focus together, requiring pathologists to continually manipulate the focal plane, complicating the task of accurately assessing the entire cellular aggregate and thus in making a diagnosis. Further, it is extremely difficult to acquire useful uniformly in-focus digital images of cytology preparations for applications such as remote diagnostic evaluations and artificial intelligence models. The predominant current method to address this issue is to acquire digital images at multiple focal planes of the entire slide, which demands long scanning time, complex and expensive scanning systems, and huge storage capacity. Aims: Here we report a unique imaging method that can acquire cytologic images efficiently and computationally render all-in-focus digital images that are highly compact. Methods and material: This method applies a metric-based digital refocusing to microscopy data collected with a Fourier ptychographic microscope (FPM). The digitally refocused patches of images are then synthesized into an all-in-focus image. Results: We report all-in-focus FPM results of thyroid fine needle aspiration (FNA) cytology samples, demonstrating our method's ability to overcome the height variance of 30 μm caused by cell aggregation, and rendering images at high resolution (corresponds to a standard microscope with objective NA of 0.75) and that are all-in-focus. Conclusions: This technology is applicable to standard microscopes, and we believe can have an impact on diagnostic accuracy as well as ease and speed of diagnosing challenging specimens. While we focus on cytology slides here, we anticipate this technology's advantages will translate well for histology applications. This technique also addresses the issue of remote rapid evaluation of cytology preparations. Finally, we believe that by resolving the focus heterogeneity issues in standard digital images, this technique is a critical advance for applying machine learning to cytology specimens.
Authors: Jinho Kim; Beverley M Henley; Charlene H Kim; Henry A Lester; Changhuei Yang Journal: Biomed Opt Express Date: 2016-07-22 Impact factor: 3.732
Authors: Timo Kohlberger; Yun Liu; Melissa Moran; Po-Hsuan Cameron Chen; Trissia Brown; Jason D Hipp; Craig H Mermel; Martin C Stumpe Journal: J Pathol Inform Date: 2019-12-12