Oleksandra Tmenova1,2, Rémi Martin3, Luc Duong3. 1. Department of Software and IT Engineering, École de technologie supérieure., 1100 Notre-Dame W., Montreal, Canada. oleksandra.tmenova@gmail.com. 2. Taras Shevchenko National University of Kyiv, Volodymyrska St, 60, Kyiv, Ukraine. oleksandra.tmenova@gmail.com. 3. Department of Software and IT Engineering, École de technologie supérieure., 1100 Notre-Dame W., Montreal, Canada.
Abstract
PURPOSE: We aim to perform generation of angiograms for various vascular structures as a mean of data augmentation in learning tasks. The task is to enhance the realism of vessels images generated from an anatomically realistic cardiorespiratory simulator to make them look like real angiographies. METHODS: The enhancement is performed by applying the CycleGAN deep network for transferring the style of real angiograms acquired during percutaneous interventions into a data set composed of realistically simulated arteries. RESULTS: The cycle consistency was evaluated by comparing an input simulated image with the one obtained after two cycles of image translation. An average structural similarity (SSIM) of 0.948 on our data sets has been obtained. The vessel preservation was measured by comparing segmentations of an input image and its corresponding enhanced image using Dice coefficient. CONCLUSIONS: We proposed an application of the CycleGAN deep network for enhancing the artificial data as an alternative to classical data augmentation techniques for medical applications, particularly focused on angiogram generation. We discussed success and failure cases, explaining conditions for the realistic data augmentation which respects both the complex physiology of arteries and the various patterns and textures generated by X-ray angiography.
PURPOSE: We aim to perform generation of angiograms for various vascular structures as a mean of data augmentation in learning tasks. The task is to enhance the realism of vessels images generated from an anatomically realistic cardiorespiratory simulator to make them look like real angiographies. METHODS: The enhancement is performed by applying the CycleGAN deep network for transferring the style of real angiograms acquired during percutaneous interventions into a data set composed of realistically simulated arteries. RESULTS: The cycle consistency was evaluated by comparing an input simulated image with the one obtained after two cycles of image translation. An average structural similarity (SSIM) of 0.948 on our data sets has been obtained. The vessel preservation was measured by comparing segmentations of an input image and its corresponding enhanced image using Dice coefficient. CONCLUSIONS: We proposed an application of the CycleGAN deep network for enhancing the artificial data as an alternative to classical data augmentation techniques for medical applications, particularly focused on angiogram generation. We discussed success and failure cases, explaining conditions for the realistic data augmentation which respects both the complex physiology of arteries and the various patterns and textures generated by X-ray angiography.
Keywords:
Data augmentation; Deep learning; Image translation; Vascular angiograms
Authors: Joes Staal; Michael D Abràmoff; Meindert Niemeijer; Max A Viergever; Bram van Ginneken Journal: IEEE Trans Med Imaging Date: 2004-04 Impact factor: 10.048
Authors: Camilo Bermudez; Andrew J Plassard; Taylor L Davis; Allen T Newton; Susan M Resnick; Bennett A Landman Journal: Proc SPIE Int Soc Opt Eng Date: 2018-03
Authors: Thijs Kooi; Geert Litjens; Bram van Ginneken; Albert Gubern-Mérida; Clara I Sánchez; Ritse Mann; Ard den Heeten; Nico Karssemeijer Journal: Med Image Anal Date: 2016-08-02 Impact factor: 8.545
Authors: Dominik F Bauer; Tom Russ; Barbara I Waldkirch; Christian Tönnes; William P Segars; Lothar R Schad; Frank G Zöllner; Alena-Kathrin Golla Journal: Int J Comput Assist Radiol Surg Date: 2021-05-02 Impact factor: 3.421