Fernando Pérez-García1, Rachel Sparks2, Sébastien Ourselin2. 1. Department of Medical Physics and Biomedical Engineering, University College London, UK; Wellcome / EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, UK; School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, UK. Electronic address: fernando.perezgarcia.17@ucl.ac.uk. 2. School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, UK.
Abstract
BACKGROUND AND OBJECTIVE: Processing of medical images such as MRI or CT presents different challenges compared to RGB images typically used in computer vision. These include a lack of labels for large datasets, high computational costs, and the need of metadata to describe the physical properties of voxels. Data augmentation is used to artificially increase the size of the training datasets. Training with image subvolumes or patches decreases the need for computational power. Spatial metadata needs to be carefully taken into account in order to ensure a correct alignment and orientation of volumes. METHODS: We present TorchIO, an open-source Python library to enable efficient loading, preprocessing, augmentation and patch-based sampling of medical images for deep learning. TorchIO follows the style of PyTorch and integrates standard medical image processing libraries to efficiently process images during training of neural networks. TorchIO transforms can be easily composed, reproduced, traced and extended. Most transforms can be inverted, making the library suitable for test-time augmentation and estimation of aleatoric uncertainty in the context of segmentation. We provide multiple generic preprocessing and augmentation operations as well as simulation of MRI-specific artifacts. RESULTS: Source code, comprehensive tutorials and extensive documentation for TorchIO can be found at http://torchio.rtfd.io/. The package can be installed from the Python Package Index (PyPI) running pip install torchio. It includes a command-line interface which allows users to apply transforms to image files without using Python. Additionally, we provide a graphical user interface within a TorchIO extension in 3D Slicer to visualize the effects of transforms. CONCLUSION: TorchIO was developed to help researchers standardize medical image processing pipelines and allow them to focus on the deep learning experiments. It encourages good open-science practices, as it supports experiment reproducibility and is version-controlled so that the software can be cited precisely. Due to its modularity, the library is compatible with other frameworks for deep learning with medical images.
BACKGROUND AND OBJECTIVE: Processing of medical images such as MRI or CT presents different challenges compared to RGB images typically used in computer vision. These include a lack of labels for large datasets, high computational costs, and the need of metadata to describe the physical properties of voxels. Data augmentation is used to artificially increase the size of the training datasets. Training with image subvolumes or patches decreases the need for computational power. Spatial metadata needs to be carefully taken into account in order to ensure a correct alignment and orientation of volumes. METHODS: We present TorchIO, an open-source Python library to enable efficient loading, preprocessing, augmentation and patch-based sampling of medical images for deep learning. TorchIO follows the style of PyTorch and integrates standard medical image processing libraries to efficiently process images during training of neural networks. TorchIO transforms can be easily composed, reproduced, traced and extended. Most transforms can be inverted, making the library suitable for test-time augmentation and estimation of aleatoric uncertainty in the context of segmentation. We provide multiple generic preprocessing and augmentation operations as well as simulation of MRI-specific artifacts. RESULTS: Source code, comprehensive tutorials and extensive documentation for TorchIO can be found at http://torchio.rtfd.io/. The package can be installed from the Python Package Index (PyPI) running pip install torchio. It includes a command-line interface which allows users to apply transforms to image files without using Python. Additionally, we provide a graphical user interface within a TorchIO extension in 3D Slicer to visualize the effects of transforms. CONCLUSION: TorchIO was developed to help researchers standardize medical image processing pipelines and allow them to focus on the deep learning experiments. It encourages good open-science practices, as it supports experiment reproducibility and is version-controlled so that the software can be cited precisely. Due to its modularity, the library is compatible with other frameworks for deep learning with medical images.
Authors: Jiequan Zhang; Qingyu Zhao; Ehsan Adeli; Adolf Pfefferbaum; Edith V Sullivan; Robert Paul; Victor Valcour; Kilian M Pohl Journal: Med Image Anal Date: 2021-10-13 Impact factor: 8.545
Authors: Xuzhe Zhang; Xinzi He; Jia Guo; Nabil Ettehadi; Natalie Aw; David Semanek; Jonathan Posner; Andrew Laine; Yun Wang Journal: IEEE Trans Med Imaging Date: 2022-09-30 Impact factor: 11.037
Authors: Florian Kofler; Ivan Ezhov; Lucas Fidon; Carolin M Pirkl; Johannes C Paetzold; Egon Burian; Sarthak Pati; Malek El Husseini; Fernando Navarro; Suprosanna Shit; Jan Kirschke; Spyridon Bakas; Claus Zimmer; Benedikt Wiestler; Bjoern H Menze Journal: Front Neurosci Date: 2021-12-30 Impact factor: 5.152
Authors: Justus Schock; Daniel Truhn; Darius Nürnberger; Stefan Conrad; Marc Sebastian Huppertz; Sebastian Keil; Christiane Kuhl; Dorit Merhof; Sven Nebelung Journal: Sci Rep Date: 2021-12-01 Impact factor: 4.379
Authors: Santiago Estrada; Ran Lu; Kersten Diers; Weiyi Zeng; Philipp Ehses; Tony Stöcker; Monique M B Breteler; Martin Reuter Journal: Neuroimage Date: 2021-08-10 Impact factor: 6.556