Ellen J L Brunenberg1, Isabell K Steinseifer1, Sven van den Bosch1, Johannes H A M Kaanders1, Charlotte L Brouwer2, Mark J Gooding3, Wouter van Elmpt4, René Monshouwer1. 1. Department of Radiation Oncology, Radboud University Medical Center, Nijmegen, The Netherlands. 2. Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands. 3. Mirada Medical Ltd, Oxford, United Kingdom. 4. Department of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands.
Abstract
BACKGROUND AND PURPOSE: Head and neck (HN) radiotherapy can benefit from automatic delineation of tumor and surrounding organs because of the complex anatomy and the regular need for adaptation. The aim of this study was to assess the performance of a commercially available deep learning contouring (DLC) model on an external validation set. MATERIALS AND METHODS: The CT-based DLC model, trained at the University Medical Center Groningen (UMCG), was applied to an independent set of 58 patients from the Radboud University Medical Center (RUMC). DLC results were compared to the RUMC manual reference using the Dice similarity coefficient (DSC) and 95th percentile of Hausdorff distance (HD95). Craniocaudal spatial information was added by calculating binned measures. In addition, a qualitative evaluation compared the acceptance of manual and DLC contours in both groups of observers. RESULTS: Good correspondence was shown for the mandible (DSC 0.90; HD95 3.6 mm). Performance was reasonable for the glandular OARs, brainstem and oral cavity (DSC 0.78-0.85, HD95 3.7-7.3 mm). The other aerodigestive tract OARs showed only moderate agreement (DSC 0.53-0.65, HD95 around 9 mm). The binned measures displayed the largest deviations caudally and/or cranially. CONCLUSIONS: This study demonstrates that the DLC model can provide a reasonable starting point for delineation when applied to an independent patient cohort. The qualitative evaluation did not reveal large differences in the interpretation of contouring guidelines between RUMC and UMCG observers.
BACKGROUND AND PURPOSE: Head and neck (HN) radiotherapy can benefit from automatic delineation of tumor and surrounding organs because of the complex anatomy and the regular need for adaptation. The aim of this study was to assess the performance of a commercially available deep learning contouring (DLC) model on an external validation set. MATERIALS AND METHODS: The CT-based DLC model, trained at the University Medical Center Groningen (UMCG), was applied to an independent set of 58 patients from the Radboud University Medical Center (RUMC). DLC results were compared to the RUMC manual reference using the Dice similarity coefficient (DSC) and 95th percentile of Hausdorff distance (HD95). Craniocaudal spatial information was added by calculating binned measures. In addition, a qualitative evaluation compared the acceptance of manual and DLC contours in both groups of observers. RESULTS: Good correspondence was shown for the mandible (DSC 0.90; HD95 3.6 mm). Performance was reasonable for the glandular OARs, brainstem and oral cavity (DSC 0.78-0.85, HD95 3.7-7.3 mm). The other aerodigestive tract OARs showed only moderate agreement (DSC 0.53-0.65, HD95 around 9 mm). The binned measures displayed the largest deviations caudally and/or cranially. CONCLUSIONS: This study demonstrates that the DLC model can provide a reasonable starting point for delineation when applied to an independent patient cohort. The qualitative evaluation did not reveal large differences in the interpretation of contouring guidelines between RUMC and UMCG observers.
Authors: Gian Carlo Mattiucci; Luca Boldrini; Giuditta Chiloiro; Giuseppe Roberto D'Agostino; Silvia Chiesa; Fiorenza De Rose; Luigi Azario; Danilo Pasini; Maria Antonietta Gambacorta; Mario Balducci; Vincenzo Valentini Journal: Acta Oncol Date: 2013-08-19 Impact factor: 4.089
Authors: Ward van Rooij; Max Dahele; Hugo Ribeiro Brandao; Alexander R Delaney; Berend J Slotman; Wilko F Verbakel Journal: Int J Radiat Oncol Biol Phys Date: 2019-03-02 Impact factor: 7.038
Authors: Gregory Sharp; Karl D Fritscher; Vladimir Pekar; Marta Peroni; Nadya Shusharina; Harini Veeraraghavan; Jinzhong Yang Journal: Med Phys Date: 2014-05 Impact factor: 4.071
Authors: Tim Lustberg; Johan van Soest; Mark Gooding; Devis Peressutti; Paul Aljabar; Judith van der Stoep; Wouter van Elmpt; Andre Dekker Journal: Radiother Oncol Date: 2017-12-05 Impact factor: 6.280
Authors: Lisanne V van Dijk; Lisa Van den Bosch; Paul Aljabar; Devis Peressutti; Stefan Both; Roel J H M Steenbakkers; Johannes A Langendijk; Mark J Gooding; Charlotte L Brouwer Journal: Radiother Oncol Date: 2019-10-22 Impact factor: 6.280
Authors: Sven van den Bosch; Tim Dijkema; Martina C Kunze-Busch; Chris H J Terhaard; Cornelis P J Raaijmakers; Patricia A H Doornaert; Frank J P Hoebers; Marije R Vergeer; Bas Kreike; Oda B Wijers; Wim J G Oyen; Johannes H A M Kaanders Journal: BMC Cancer Date: 2017-03-21 Impact factor: 4.430
Authors: J P Kieselmann; C P Kamerling; N Burgos; M J Menten; C D Fuller; S Nill; M J Cardoso; U Oelfke Journal: Phys Med Biol Date: 2018-07-11 Impact factor: 3.609
Authors: Bjoern H Menze; Andras Jakab; Stefan Bauer; Jayashree Kalpathy-Cramer; Keyvan Farahani; Justin Kirby; Yuliya Burren; Nicole Porz; Johannes Slotboom; Roland Wiest; Levente Lanczi; Elizabeth Gerstner; Marc-André Weber; Tal Arbel; Brian B Avants; Nicholas Ayache; Patricia Buendia; D Louis Collins; Nicolas Cordier; Jason J Corso; Antonio Criminisi; Tilak Das; Hervé Delingette; Çağatay Demiralp; Christopher R Durst; Michel Dojat; Senan Doyle; Joana Festa; Florence Forbes; Ezequiel Geremia; Ben Glocker; Polina Golland; Xiaotao Guo; Andac Hamamci; Khan M Iftekharuddin; Raj Jena; Nigel M John; Ender Konukoglu; Danial Lashkari; José Antonió Mariz; Raphael Meier; Sérgio Pereira; Doina Precup; Stephen J Price; Tammy Riklin Raviv; Syed M S Reza; Michael Ryan; Duygu Sarikaya; Lawrence Schwartz; Hoo-Chang Shin; Jamie Shotton; Carlos A Silva; Nuno Sousa; Nagesh K Subbanna; Gabor Szekely; Thomas J Taylor; Owen M Thomas; Nicholas J Tustison; Gozde Unal; Flor Vasseur; Max Wintermark; Dong Hye Ye; Liang Zhao; Binsheng Zhao; Darko Zikic; Marcel Prastawa; Mauricio Reyes; Koen Van Leemput Journal: IEEE Trans Med Imaging Date: 2014-12-04 Impact factor: 10.048
Authors: Noémie Johnston; Jeffrey De Rycke; Yolande Lievens; Marc van Eijkeren; Jan Aelterman; Eva Vandersmissen; Stephan Ponte; Barbara Vanderstraeten Journal: Phys Imaging Radiat Oncol Date: 2022-07-25
Authors: Roque Rodríguez Outeiral; Paula Bos; Hedda J van der Hulst; Abrahim Al-Mamgani; Bas Jasperse; Rita Simões; Uulke A van der Heide Journal: Phys Imaging Radiat Oncol Date: 2022-08-13