Yu Zhao1, Andrei Gafita2, Bernd Vollnberg3, Giles Tetteh1, Fabian Haupt3, Ali Afshar-Oromieh3, Bjoern Menze1, Matthias Eiber2, Axel Rominger3,4, Kuangyu Shi5,6. 1. Department of Informatics, Technische Universität München, Munich, Germany. 2. Department of Nuclear Medicine, Technische Universität München, Munich, Germany. 3. Department of Nuclear Medicine, University of Bern, Freiburgstrasse 18, 3010, Bern, Switzerland. 4. Department of Nuclear Medicine, Ludwig Maximilian University of Munich, Munich, Germany. 5. Department of Informatics, Technische Universität München, Munich, Germany. kuangyu.shi@dbmr.unibe.ch. 6. Department of Nuclear Medicine, University of Bern, Freiburgstrasse 18, 3010, Bern, Switzerland. kuangyu.shi@dbmr.unibe.ch.
Abstract
PURPOSE: This study proposes an automated prostate cancer (PC) lesion characterization method based on the deep neural network to determine tumor burden on 68Ga-PSMA-11 PET/CT to potentially facilitate the optimization of PSMA-directed radionuclide therapy. METHODS: We collected 68Ga-PSMA-11 PET/CT images from 193 patients with metastatic PC at three medical centers. For proof-of-concept, we focused on the detection of pelvis bone and lymph node lesions. A deep neural network (triple-combining 2.5D U-Net) was developed for the automated characterization of these lesions. The proposed method simultaneously extracts features from axial, coronal, and sagittal planes, which mimics the workflow of physicians and reduces computational and memory requirements. RESULTS: Among all the labeled lesions, the network achieved 99% precision, 99% recall, and an F1 score of 99% on bone lesion detection and 94%, precision 89% recall, and an F1 score of 92% on lymph node lesion detection. The segmentation accuracy is lower than the detection. The performance of the network was correlated with the amount of training data. CONCLUSION: We developed a deep neural network to characterize automatically the PC lesions on 68Ga-PSMA-11 PET/CT. The preliminary test within the pelvic area confirms the potential of deep learning methods. Increasing the amount of training data should further enhance the performance of the proposed method and may ultimately allow whole-body assessments.
PURPOSE: This study proposes an automated prostate cancer (PC) lesion characterization method based on the deep neural network to determine tumor burden on 68Ga-PSMA-11 PET/CT to potentially facilitate the optimization of PSMA-directed radionuclide therapy. METHODS: We collected 68Ga-PSMA-11 PET/CT images from 193 patients with metastatic PC at three medical centers. For proof-of-concept, we focused on the detection of pelvis bone and lymph node lesions. A deep neural network (triple-combining 2.5D U-Net) was developed for the automated characterization of these lesions. The proposed method simultaneously extracts features from axial, coronal, and sagittal planes, which mimics the workflow of physicians and reduces computational and memory requirements. RESULTS: Among all the labeled lesions, the network achieved 99% precision, 99% recall, and an F1 score of 99% on bone lesion detection and 94%, precision 89% recall, and an F1 score of 92% on lymph node lesion detection. The segmentation accuracy is lower than the detection. The performance of the network was correlated with the amount of training data. CONCLUSION: We developed a deep neural network to characterize automatically the PC lesions on 68Ga-PSMA-11 PET/CT. The preliminary test within the pelvic area confirms the potential of deep learning methods. Increasing the amount of training data should further enhance the performance of the proposed method and may ultimately allow whole-body assessments.
Entities:
Keywords:
Deep learning; Lesion detection; PET/CT; PSMA; Prostate cancer
Authors: S Hijazi; B Meller; C Leitsmann; A Strauss; J Meller; C O Ritter; J Lotz; H-U Schildhaus; L Trojan; C O Sahlmann Journal: Prostate Date: 2015-09-10 Impact factor: 4.104
Authors: Marie Bieth; Markus Krönke; Robert Tauber; Marielena Dahlbender; Margitta Retz; Stephan G Nekolla; Bjoern Menze; Tobias Maurer; Matthias Eiber; Markus Schwaiger Journal: J Nucl Med Date: 2017-05-25 Impact factor: 10.057
Authors: David Pfister; Daniel Porres; Axel Heidenreich; Isabel Heidegger; Ruth Knuechel; Florian Steib; Florian F Behrendt; Frederik A Verburg Journal: Eur J Nucl Med Mol Imaging Date: 2016-03-19 Impact factor: 9.236
Authors: Freddie Bray; Jacques Ferlay; Isabelle Soerjomataram; Rebecca L Siegel; Lindsey A Torre; Ahmedin Jemal Journal: CA Cancer J Clin Date: 2018-09-12 Impact factor: 508.702
Authors: Tobias Maurer; Gregor Weirich; Margret Schottelius; Martina Weineisen; Benjamin Frisch; Asli Okur; Hubert Kübler; Mark Thalgott; Nassir Navab; Markus Schwaiger; Hans-Jürgen Wester; Jürgen E Gschwend; Matthias Eiber Journal: Eur Urol Date: 2015-05-06 Impact factor: 20.096
Authors: Bjoern H Menze; Andras Jakab; Stefan Bauer; Jayashree Kalpathy-Cramer; Keyvan Farahani; Justin Kirby; Yuliya Burren; Nicole Porz; Johannes Slotboom; Roland Wiest; Levente Lanczi; Elizabeth Gerstner; Marc-André Weber; Tal Arbel; Brian B Avants; Nicholas Ayache; Patricia Buendia; D Louis Collins; Nicolas Cordier; Jason J Corso; Antonio Criminisi; Tilak Das; Hervé Delingette; Çağatay Demiralp; Christopher R Durst; Michel Dojat; Senan Doyle; Joana Festa; Florence Forbes; Ezequiel Geremia; Ben Glocker; Polina Golland; Xiaotao Guo; Andac Hamamci; Khan M Iftekharuddin; Raj Jena; Nigel M John; Ender Konukoglu; Danial Lashkari; José Antonió Mariz; Raphael Meier; Sérgio Pereira; Doina Precup; Stephen J Price; Tammy Riklin Raviv; Syed M S Reza; Michael Ryan; Duygu Sarikaya; Lawrence Schwartz; Hoo-Chang Shin; Jamie Shotton; Carlos A Silva; Nuno Sousa; Nagesh K Subbanna; Gabor Szekely; Thomas J Taylor; Owen M Thomas; Nicholas J Tustison; Gozde Unal; Flor Vasseur; Max Wintermark; Dong Hye Ye; Liang Zhao; Binsheng Zhao; Darko Zikic; Marcel Prastawa; Mauricio Reyes; Koen Van Leemput Journal: IEEE Trans Med Imaging Date: 2014-12-04 Impact factor: 10.048
Authors: Manuela A Hoffmann; Matthias Miederer; Helmut J Wieler; Christian Ruf; Frank M Jakobs; Mathias Schreckenberger Journal: Oncotarget Date: 2017-11-14
Authors: Jake Kendrick; Roslyn J Francis; Ghulam Mubashar Hassan; Pejman Rowshanfarzad; Jeremy S L Ong; Martin A Ebert Journal: Eur J Nucl Med Mol Imaging Date: 2022-08-17 Impact factor: 10.057
Authors: Kerstin Johnsson; Johan Brynolfsson; Hannicka Sahlstedt; Nicholas G Nickols; Matthew Rettig; Stephan Probst; Michael J Morris; Anders Bjartell; Mathias Eiber; Aseem Anand Journal: Eur J Nucl Med Mol Imaging Date: 2021-08-31 Impact factor: 10.057
Authors: Dejan Kostyszyn; Tobias Fechter; Nico Bartl; Anca L Grosu; Christian Gratzke; August Sigle; Michael Mix; Juri Ruf; Thomas F Fassbender; Selina Kiefer; Alisa S Bettermann; Nils H Nicolay; Simon Spohn; Maria U Kramer; Peter Bronsert; Hongqian Guo; Xuefeng Qiu; Feng Wang; Christoph Henkenberens; Rudolf A Werner; Dimos Baltas; Philipp T Meyer; Thorsten Derlin; Mengxia Chen; Constantinos Zamboglou Journal: J Nucl Med Date: 2020-10-30 Impact factor: 10.057
Authors: Thomas Wendler; Fijs W B van Leeuwen; Nassir Navab; Matthias N van Oosterom Journal: Eur J Nucl Med Mol Imaging Date: 2021-06-29 Impact factor: 9.236