Eftychios A Pnevmatikakis1, Andrea Giovannucci2. 1. Center for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY 10010, USA. Electronic address: epnevmatikakis@flatironinstitute.org. 2. Center for Computational Biology, Flatiron Institute, Simons Foundation, New York, NY 10010, USA.
Abstract
BACKGROUND: Motion correction is a challenging pre-processing problem that arises early in the analysis pipeline of calcium imaging data sequences. The motion artifacts in two-photon microscopy recordings can be non-rigid, arising from the finite time of raster scanning and non-uniform deformations of the brain medium. NEW METHOD: We introduce an algorithm for fast Non-Rigid Motion Correction (NoRMCorre) based on template matching. NoRMCorre operates by splitting the field of view (FOV) into overlapping spatial patches along all directions. The patches are registered at a sub-pixel resolution for rigid translation against a regularly updated template. The estimated alignments are subsequently up-sampled to create a smooth motion field for each frame that can efficiently approximate non-rigid artifacts in a piecewise-rigid manner. EXISTING METHODS: Existing approaches either do not scale well in terms of computational performance or are targeted to non-rigid artifacts arising just from the finite speed of raster scanning, and thus cannot correct for non-rigid motion observable in datasets from a large FOV. RESULTS: NoRMCorre can be run in an online mode resulting in comparable to or even faster than real time motion registration of streaming data. We evaluate its performance with simple yet intuitive metrics and compare against other non-rigid registration methods on simulated data and in vivo two-photon calcium imaging datasets. Open source Matlab and Python code is also made available. CONCLUSIONS: The proposed method and accompanying code can be useful for solving large scale image registration problems in calcium imaging, especially in the presence of non-rigid deformations.
BACKGROUND: Motion correction is a challenging pre-processing problem that arises early in the analysis pipeline of calcium imaging data sequences. The motion artifacts in two-photon microscopy recordings can be non-rigid, arising from the finite time of raster scanning and non-uniform deformations of the brain medium. NEW METHOD: We introduce an algorithm for fast Non-Rigid Motion Correction (NoRMCorre) based on template matching. NoRMCorre operates by splitting the field of view (FOV) into overlapping spatial patches along all directions. The patches are registered at a sub-pixel resolution for rigid translation against a regularly updated template. The estimated alignments are subsequently up-sampled to create a smooth motion field for each frame that can efficiently approximate non-rigid artifacts in a piecewise-rigid manner. EXISTING METHODS: Existing approaches either do not scale well in terms of computational performance or are targeted to non-rigid artifacts arising just from the finite speed of raster scanning, and thus cannot correct for non-rigid motion observable in datasets from a large FOV. RESULTS: NoRMCorre can be run in an online mode resulting in comparable to or even faster than real time motion registration of streaming data. We evaluate its performance with simple yet intuitive metrics and compare against other non-rigid registration methods on simulated data and in vivo two-photon calcium imaging datasets. Open source Matlab and Python code is also made available. CONCLUSIONS: The proposed method and accompanying code can be useful for solving large scale image registration problems in calcium imaging, especially in the presence of non-rigid deformations.
Authors: Mariska van Lier; M Hadi Saiepour; Koen Kole; Juliette E Cheyne; Nawal Zabouri; Thomas Blok; Yi Qin; Emma Ruimschotel; J Alexander Heimel; Christian Lohmann; Christiaan N Levelt Journal: J Neurosci Date: 2020-06-11 Impact factor: 6.167
Authors: Daniel A Cantu; Bo Wang; Michael W Gongwer; Cynthia X He; Anubhuti Goel; Anand Suresh; Nazim Kourdougli; Erica D Arroyo; William Zeiger; Carlos Portera-Cailliau Journal: Front Neural Circuits Date: 2020-05-15 Impact factor: 3.492
Authors: Mark J Wagner; Tony Hyun Kim; Jonathan Kadmon; Nghia D Nguyen; Surya Ganguli; Mark J Schnitzer; Liqun Luo Journal: Cell Date: 2019-03-28 Impact factor: 41.582
Authors: Somayyeh Soltanian-Zadeh; Kaan Sahingur; Sarah Blau; Yiyang Gong; Sina Farsiu Journal: Proc Natl Acad Sci U S A Date: 2019-04-11 Impact factor: 11.205