Alexander Song1, Jeff L Gauthier2, Jonathan W Pillow3, David W Tank4, Adam S Charles5. 1. Princeton Neuroscience Institute, Princeton University, Princeton, 08540 NJ, USA; Department of Physics, Princeton University, Princeton, 08540 NJ, USA. 2. Princeton Neuroscience Institute, Princeton University, Princeton, 08540 NJ, USA. 3. Princeton Neuroscience Institute, Princeton University, Princeton, 08540 NJ, USA; Department of Psychology, Princeton University, Princeton, 08540 NJ, USA. 4. Princeton Neuroscience Institute, Princeton University, Princeton, 08540 NJ, USA; Bezos Center for Neural Circuit Dynamics, Princeton University, Princeton, 08540 NJ, USA; Department of Molecular Biology, Princeton University, Princeton, 08540 NJ, USA. 5. Department of Biomedical Engineering, Johns Hopkins University, Baltimore, 21218, MD, USA; Mathematical Institute for Data Science, Johns Hopkins University, Baltimore, 21218, MD, USA; Center for Imaging Science, Johns Hopkins University, Baltimore, 21218, MD, USA; Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, 21218, MD, USA.
Abstract
BACKGROUND: The past decade has seen a multitude of new in vivo functional imaging methodologies. However, the lack of ground-truth comparisons or evaluation metrics makes the large-scale, systematic validation vital to the continued development and use of optical microscopy impossible. NEW- METHOD: We provide a new framework for evaluating two-photon microscopy methods via in silico Neural Anatomy and Optical Microscopy (NAOMi) simulation. Our computationally efficient model generates large anatomical volumes of mouse cortex, simulates neural activity, and incorporates optical propagation and scanning to create realistic calcium imaging datasets. RESULTS: We verify NAOMi simulations against in vivo two-photon recordings from mouse cortex. We leverage this in silico ground truth to directly compare different segmentation algorithms and optical designs. We find modern segmentation algorithms extract strong neural time-courses comparable to estimation using oracle spatial information, but with an increase in the false positive rate. Comparison between optical setups demonstrate improved resilience to motion artifacts in sparsely labeled samples using Bessel beams, increased signal-to-noise ratio and cell-count using low numerical aperture Gaussian beams and nuclear GCaMP, and more uniform spatial sampling with temporal focusing versus multi-plane imaging. COMPARISON WITH EXISTING METHODS: NAOMi is a first-of-its kind framework for assessing optical imaging modalities. Existing methods are either anatomical simulations or do not address functional imaging. Thus there is no competing method for simulating realistic functional optical microscopy data. CONCLUSIONS: By leveraging the rich accumulated knowledge of neural anatomy and optical physics, we provide a powerful new tool to assess and develop important methods in neural imaging.
BACKGROUND: The past decade has seen a multitude of new in vivo functional imaging methodologies. However, the lack of ground-truth comparisons or evaluation metrics makes the large-scale, systematic validation vital to the continued development and use of optical microscopy impossible. NEW- METHOD: We provide a new framework for evaluating two-photon microscopy methods via in silico Neural Anatomy and Optical Microscopy (NAOMi) simulation. Our computationally efficient model generates large anatomical volumes of mouse cortex, simulates neural activity, and incorporates optical propagation and scanning to create realistic calcium imaging datasets. RESULTS: We verify NAOMi simulations against in vivo two-photon recordings from mouse cortex. We leverage this in silico ground truth to directly compare different segmentation algorithms and optical designs. We find modern segmentation algorithms extract strong neural time-courses comparable to estimation using oracle spatial information, but with an increase in the false positive rate. Comparison between optical setups demonstrate improved resilience to motion artifacts in sparsely labeled samples using Bessel beams, increased signal-to-noise ratio and cell-count using low numerical aperture Gaussian beams and nuclear GCaMP, and more uniform spatial sampling with temporal focusing versus multi-plane imaging. COMPARISON WITH EXISTING METHODS: NAOMi is a first-of-its kind framework for assessing optical imaging modalities. Existing methods are either anatomical simulations or do not address functional imaging. Thus there is no competing method for simulating realistic functional optical microscopy data. CONCLUSIONS: By leveraging the rich accumulated knowledge of neural anatomy and optical physics, we provide a powerful new tool to assess and develop important methods in neural imaging.
Authors: Philbert S Tsai; John P Kaufhold; Pablo Blinder; Beth Friedman; Patrick J Drew; Harvey J Karten; Patrick D Lyden; David Kleinfeld Journal: J Neurosci Date: 2009-11-18 Impact factor: 6.167
Authors: Linda Madisen; Aleena R Garner; Daisuke Shimaoka; Amy S Chuong; Nathan C Klapoetke; Lu Li; Alexander van der Bourg; Yusuke Niino; Ladan Egolf; Claudio Monetti; Hong Gu; Maya Mills; Adrian Cheng; Bosiljka Tasic; Thuc Nghi Nguyen; Susan M Sunkin; Andrea Benucci; Andras Nagy; Atsushi Miyawaki; Fritjof Helmchen; Ruth M Empson; Thomas Knöpfel; Edward S Boyden; R Clay Reid; Matteo Carandini; Hongkui Zeng Journal: Neuron Date: 2015-03-04 Impact factor: 17.173
Authors: Hod Dana; Tsai-Wen Chen; Amy Hu; Brenda C Shields; Caiying Guo; Loren L Looger; Douglas S Kim; Karel Svoboda Journal: PLoS One Date: 2014-09-24 Impact factor: 3.240
Authors: Rongwen Lu; Wenzhi Sun; Yajie Liang; Aaron Kerlin; Jens Bierfeld; Johannes D Seelig; Daniel E Wilson; Benjamin Scholl; Boaz Mohar; Masashi Tanimoto; Minoru Koyama; David Fitzpatrick; Michael B Orger; Na Ji Journal: Nat Neurosci Date: 2017-02-27 Impact factor: 24.884
Authors: Adam S Charles; Nathan Cermak; Rifqi O Affan; Benjamin B Scott; Jackie Schiller; Gal Mishne Journal: IEEE Trans Image Process Date: 2022-05-18 Impact factor: 11.041
Authors: F K Janiak; P Bartel; M R Bale; T Yoshimatsu; E Komulainen; M Zhou; K Staras; L L Prieto-Godino; T Euler; M Maravall; T Baden Journal: Nat Commun Date: 2022-01-27 Impact factor: 14.919