S Growcott1, T Dembrey2, R Patel3, D Eaton3, A Cameron4. 1. Department of Clinical Oncology, University Hospitals Bristol NHS Foundation Trust, Bristol Haematology and Oncology Centre, Bristol, UK. Electronic address: siona.growcott@gmail.com. 2. University Hospitals Bristol NHS Foundation Trust, Bristol, UK. 3. National Radiotherapy Trials Quality Assurance Group (RTTQA), Mount Vernon Hospital, Northwood, UK. 4. Department of Clinical Oncology, University Hospitals Bristol NHS Foundation Trust, Bristol Haematology and Oncology Centre, Bristol, UK.
Abstract
AIMS: To quantify inter-observer variation between all the intracranial stereotactic radiosurgery (SRS) providers in England in delineating the target volumes of four brain tumour cases. MATERIALS AND METHODS: Twenty-two, cross-platform SRS providers in England were instructed during a national commissioning assessment to contour the gross tumour volume (GTV) of six brain metastases, one cavernous sinus meningioma, one vestibular schwannoma and one pituitary adenoma. An expert reference group provided feedback if submitted contours were considered to be outliers and those centres were instructed to resubmit their contours. All contours were analysed in Python. The target volume contour (observed volume; VOBS), encompassing volume, 50% agreement volume (AV50), 100% agreement volume (AV100), concordance index (CCI) and discordance index (DCI) were calculated. RESULTS: Twenty-one centres participated using five different treatment platforms (CyberKnife, Gamma Knife, Varian Linac, Elekta Linac, Tomotherapy) and seven different treatment planning systems (GammaPlan, iPlan, Multiplan, Pinnacle, Eclipse, CMS Focal). The greatest variability was observed in the smallest brain metastases (GTV5 AV50 0.0 cm3, CCI 0.28-0.84, DCI 0.00-0.70) and pituitary case (AV50 1.1 cm3, CCI 0.42-0.82, DCI 0.01-0.40). The greatest agreement was observed with the vestibular schwannoma (AV50 2.8 cm3, CCI 0.77-0.94, DCI 0.00-0.17). There were four resubmissions for the cavernous sinus meningioma and three resubmissions for the pituitary adenoma. CONCLUSIONS: Inter-observer variability was most evident with the smallest brain metastases and pituitary case. Several additional outliers and one acceptable contour were suggested using the metric-based analysis of AV50, CCI and DCI. Comparing contours using these metrics is an effective way to identify whether individual contours are similar to the 'true' target and to flag potentially significant deviations.
AIMS: To quantify inter-observer variation between all the intracranial stereotactic radiosurgery (SRS) providers in England in delineating the target volumes of four brain tumour cases. MATERIALS AND METHODS: Twenty-two, cross-platform SRS providers in England were instructed during a national commissioning assessment to contour the gross tumour volume (GTV) of six brain metastases, one cavernous sinus meningioma, one vestibular schwannoma and one pituitary adenoma. An expert reference group provided feedback if submitted contours were considered to be outliers and those centres were instructed to resubmit their contours. All contours were analysed in Python. The target volume contour (observed volume; VOBS), encompassing volume, 50% agreement volume (AV50), 100% agreement volume (AV100), concordance index (CCI) and discordance index (DCI) were calculated. RESULTS: Twenty-one centres participated using five different treatment platforms (CyberKnife, Gamma Knife, Varian Linac, Elekta Linac, Tomotherapy) and seven different treatment planning systems (GammaPlan, iPlan, Multiplan, Pinnacle, Eclipse, CMS Focal). The greatest variability was observed in the smallest brain metastases (GTV5 AV50 0.0 cm3, CCI 0.28-0.84, DCI 0.00-0.70) and pituitary case (AV50 1.1 cm3, CCI 0.42-0.82, DCI 0.01-0.40). The greatest agreement was observed with the vestibular schwannoma (AV50 2.8 cm3, CCI 0.77-0.94, DCI 0.00-0.17). There were four resubmissions for the cavernous sinus meningioma and three resubmissions for the pituitary adenoma. CONCLUSIONS: Inter-observer variability was most evident with the smallest brain metastases and pituitary case. Several additional outliers and one acceptable contour were suggested using the metric-based analysis of AV50, CCI and DCI. Comparing contours using these metrics is an effective way to identify whether individual contours are similar to the 'true' target and to flag potentially significant deviations.
Authors: E Lotan; B Zhang; S Dogra; W D Wang; D Carbone; G Fatterpekar; E K Oermann; Y W Lui Journal: AJNR Am J Neuroradiol Date: 2021-12-02 Impact factor: 3.825
Authors: Joeri Mul; Patrick Melchior; Enrica Seravalli; Daniel Saunders; Stephanie Bolle; Alison L Cameron; Kristin Gurtner; Semi Harrabi; Yasmin Lassen-Ramshad; Naomi Lavan; Henriette Magelssen; Henry Mandeville; Tom Boterberg; Petra S Kroon; Alexis N T J Kotte; Bianca A W Hoeben; Peter S N van Rossum; Martine van Grotel; Norbert Graf; Marry M van den Heuvel-Eibrink; Christian Rübe; Geert O Janssens Journal: Clin Transl Radiat Oncol Date: 2021-03-11