Mohammad-Parsa Hosseini1, Mohammad-Reza Nazem-Zadeh2, Dario Pompili3, Kourosh Jafari-Khouzani4, Kost Elisevich5, Hamid Soltanian-Zadeh6. 1. Department of Electrical and Computer Engineering, Rutgers University, New Brunswick, New Jersey 08854 and Medical Image Analysis Laboratory, Departments of Radiology and Research Administration, Henry Ford Health System, Detroit, Michigan 48202. 2. Medical Image Analysis Laboratory, Departments of Radiology and Research Administration, Henry Ford Health System, Detroit, Michigan 48202. 3. Department of Electrical and Computer Engineering, Rutgers University, New Brunswick, New Jersey 08854. 4. Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts 02129. 5. Department of Clinical Neuroscience, Spectrum Health System, Grand Rapids, Michigan 49503 and Division of Neurosurgery, College of Human Medicine, Michigan State University, Grand Rapids, Michigan 49503. 6. Medical Image Analysis Laboratory, Departments of Radiology and Research Administration, Henry Ford Health System, Detroit, Michigan 48202; Control and Intelligent Processing Center of Excellence (CIPCE), School of Electrical and Computer Engineering, University of Tehran, Tehran 1439957131, Iran; and School of Cognitive Sciences, Institute for Studies in Theoretical Physics and Mathematics (IPM), Tehran 1954856316, Iran.
Abstract
PURPOSE: Segmentation of the hippocampus from magnetic resonance (MR) images is a key task in the evaluation of mesial temporal lobe epilepsy (mTLE) patients. Several automated algorithms have been proposed although manual segmentation remains the benchmark. Choosing a reliable algorithm is problematic since structural definition pertaining to multiple edges, missing and fuzzy boundaries, and shape changes varies among mTLE subjects. Lack of statistical references and guidance for quantifying the reliability and reproducibility of automated techniques has further detracted from automated approaches. The purpose of this study was to develop a systematic and statistical approach using a large dataset for the evaluation of automated methods and establish a method that would achieve results better approximating those attained by manual tracing in the epileptogenic hippocampus. METHODS: A template database of 195 (81 males, 114 females; age range 32-67 yr, mean 49.16 yr) MR images of mTLE patients was used in this study. Hippocampal segmentation was accomplished manually and by two well-known tools (FreeSurfer and hammer) and two previously published methods developed at their institution [Automatic brain structure segmentation (ABSS) and LocalInfo]. To establish which method was better performing for mTLE cases, several voxel-based, distance-based, and volume-based performance metrics were considered. Statistical validations of the results using automated techniques were compared with the results of benchmark manual segmentation. Extracted metrics were analyzed to find the method that provided a more similar result relative to the benchmark. RESULTS: Among the four automated methods, ABSS generated the most accurate results. For this method, the Dice coefficient was 5.13%, 14.10%, and 16.67% higher, Hausdorff was 22.65%, 86.73%, and 69.58% lower, precision was 4.94%, -4.94%, and 12.35% higher, and the root mean square (RMS) was 19.05%, 61.90%, and 65.08% lower than LocalInfo, FreeSurfer, and hammer, respectively. The Bland-Altman similarity analysis revealed a low bias for the ABSS and LocalInfo techniques compared to the others. CONCLUSIONS: The ABSS method for automated hippocampal segmentation outperformed other methods, best approximating what could be achieved by manual tracing. This study also shows that four categories of input data can cause automated segmentation methods to fail. They include incomplete studies, artifact, low signal-to-noise ratio, and inhomogeneity. Different scanner platforms and pulse sequences were considered as means by which to improve reliability of the automated methods. Other modifications were specially devised to enhance a particular method assessed in this study.
PURPOSE: Segmentation of the hippocampus from magnetic resonance (MR) images is a key task in the evaluation of mesial temporal lobe epilepsy (mTLE) patients. Several automated algorithms have been proposed although manual segmentation remains the benchmark. Choosing a reliable algorithm is problematic since structural definition pertaining to multiple edges, missing and fuzzy boundaries, and shape changes varies among mTLE subjects. Lack of statistical references and guidance for quantifying the reliability and reproducibility of automated techniques has further detracted from automated approaches. The purpose of this study was to develop a systematic and statistical approach using a large dataset for the evaluation of automated methods and establish a method that would achieve results better approximating those attained by manual tracing in the epileptogenic hippocampus. METHODS: A template database of 195 (81 males, 114 females; age range 32-67 yr, mean 49.16 yr) MR images of mTLE patients was used in this study. Hippocampal segmentation was accomplished manually and by two well-known tools (FreeSurfer and hammer) and two previously published methods developed at their institution [Automatic brain structure segmentation (ABSS) and LocalInfo]. To establish which method was better performing for mTLE cases, several voxel-based, distance-based, and volume-based performance metrics were considered. Statistical validations of the results using automated techniques were compared with the results of benchmark manual segmentation. Extracted metrics were analyzed to find the method that provided a more similar result relative to the benchmark. RESULTS: Among the four automated methods, ABSS generated the most accurate results. For this method, the Dice coefficient was 5.13%, 14.10%, and 16.67% higher, Hausdorff was 22.65%, 86.73%, and 69.58% lower, precision was 4.94%, -4.94%, and 12.35% higher, and the root mean square (RMS) was 19.05%, 61.90%, and 65.08% lower than LocalInfo, FreeSurfer, and hammer, respectively. The Bland-Altman similarity analysis revealed a low bias for the ABSS and LocalInfo techniques compared to the others. CONCLUSIONS: The ABSS method for automated hippocampal segmentation outperformed other methods, best approximating what could be achieved by manual tracing. This study also shows that four categories of input data can cause automated segmentation methods to fail. They include incomplete studies, artifact, low signal-to-noise ratio, and inhomogeneity. Different scanner platforms and pulse sequences were considered as means by which to improve reliability of the automated methods. Other modifications were specially devised to enhance a particular method assessed in this study.
Authors: Arnaldo Mayer; Gali Zimmerman-Moreno; Ran Shadmi; Amit Batikoff; Hayit Greenspan Journal: IEEE Trans Med Imaging Date: 2010-08-16 Impact factor: 10.048
Authors: Thomas M Doring; Tadeu T A Kubo; L Celso H Cruz; Mario F Juruena; Jiosef Fainberg; Romeu C Domingues; Emerson L Gasparetto Journal: J Magn Reson Imaging Date: 2011-03 Impact factor: 4.813
Authors: Jyrki Mp Lötjönen; Robin Wolz; Juha R Koikkalainen; Lennart Thurfjell; Gunhild Waldemar; Hilkka Soininen; Daniel Rueckert Journal: Neuroimage Date: 2009-10-24 Impact factor: 6.556
Authors: J W Haller; G E Christensen; S C Joshi; J W Newcomer; M I Miller; J G Csernansky; M W Vannier Journal: Radiology Date: 1996-06 Impact factor: 11.105
Authors: Mike F Schmidt; Judd M Storrs; Kevin B Freeman; Clifford R Jack; Stephen T Turner; Michael E Griswold; Thomas H Mosley Journal: Hum Brain Mapp Date: 2018-02-21 Impact factor: 5.038
Authors: Robert J Anderson; James J Cook; Natalie Delpratt; John C Nouls; Bin Gu; James O McNamara; Brian B Avants; G Allan Johnson; Alexandra Badea Journal: Neuroinformatics Date: 2019-07
Authors: Mohammad-Parsa Hosseini; Madison Beary; Alex Hadsell; Ryan Messersmith; Hamid Soltanian-Zadeh Journal: Front Comput Neurosci Date: 2022-01-20 Impact factor: 2.380
Authors: Peter N Hadar; Lohith G Kini; Carlos Coto; Virginie Piskin; Lauren E Callans; Stephanie H Chen; Joel M Stein; Sandhitsu R Das; Paul A Yushkevich; Kathryn A Davis Journal: Neuroimage Clin Date: 2018-10-10 Impact factor: 4.881