Kirrily Cloak1,2,3, Michael G Jameson1,2,3, Andrea Paneghel4, Kirsty Wiltshire4, Andrew Kneebone5,6, Maria Pearse7, Mark Sidhom1,2, Colin Tang8, Carol Fraser-Browne7, Lois C Holloway1,2,3, Annette Haworth5. 1. South Western Sydney Clinical School, University of NSW, Sydney, New South Wales, Australia. 2. Cancer Therapy Centre, Liverpool Hospital, Sydney, New South Wales, Australia. 3. Ingham Institute of Applied Medical Research, Liverpool Hospital, Sydney, New South Wales, Australia. 4. Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia. 5. University of Sydney, Sydney, New South Wales, Australia. 6. Royal North Shore Hospital, Sydney, New South Wales, Australia. 7. Auckland Hospital, Auckland, New Zealand. 8. Sir Charles Gairdner Hospital, Perth, Western Australia, Australia.
Abstract
INTRODUCTION: Variation in target volume delineation from clinical trial protocols has been shown to contribute to poorer patient outcomes. A clinical trial quality assurance framework can support compliance with trial protocol. Results of the TROG 08.03 RAVES benchmarking exercise considering variation from protocol, inter-observer variability and impact on dosimetry are reported in this paper. METHODS: Clinicians were required to contour and plan a benchmarking case according to trial protocol. Geometric pjmirometers including volume, Hausdorff Distance, Mean Distance to Agreement and DICE similarity coefficient were analysed for targets and organs at risk. Submitted volumes were compared to a STAPLE and consensus 'reference' volume for each structure. Dosimetric analysis was performed using dose volume histogram data. RESULTS: Benchmarking exercise submissions were received from 96 clinicians. In total 205 protocol variations were identified. The most common variation was inadequate contouring of the CTV in 84/205 (41%). The CTV volume ranged from 65.3 to 193.1 cm3 with a median of 113.2 cm3 . The most common dosimetric protocol variation related to rectal dosimetry. The mean submitted rectal volume receiving 40 Gy and 60 Gy, respectively, was 56.14% ± 5.55% and 30.25% ± 6.15%. When corrected to the protocol defined length the mean rectal volume receiving 40 Gy was 60.8% ± 7.92%, while the volume receiving 60 Gy was 33.86% ± 8.21%. CONCLUSION: Variations from protocol were found in the RAVES benchmarking exercise, most notably in CTV and rectum delineation. Inter-observer variability was evident. Incorrect delineation of the rectum impacted on dosimetric compliance with protocol.
INTRODUCTION: Variation in target volume delineation from clinical trial protocols has been shown to contribute to poorer patient outcomes. A clinical trial quality assurance framework can support compliance with trial protocol. Results of the TROG 08.03 RAVES benchmarking exercise considering variation from protocol, inter-observer variability and impact on dosimetry are reported in this paper. METHODS: Clinicians were required to contour and plan a benchmarking case according to trial protocol. Geometric pjmirometers including volume, Hausdorff Distance, Mean Distance to Agreement and DICE similarity coefficient were analysed for targets and organs at risk. Submitted volumes were compared to a STAPLE and consensus 'reference' volume for each structure. Dosimetric analysis was performed using dose volume histogram data. RESULTS: Benchmarking exercise submissions were received from 96 clinicians. In total 205 protocol variations were identified. The most common variation was inadequate contouring of the CTV in 84/205 (41%). The CTV volume ranged from 65.3 to 193.1 cm3 with a median of 113.2 cm3 . The most common dosimetric protocol variation related to rectal dosimetry. The mean submitted rectal volume receiving 40 Gy and 60 Gy, respectively, was 56.14% ± 5.55% and 30.25% ± 6.15%. When corrected to the protocol defined length the mean rectal volume receiving 40 Gy was 60.8% ± 7.92%, while the volume receiving 60 Gy was 33.86% ± 8.21%. CONCLUSION: Variations from protocol were found in the RAVES benchmarking exercise, most notably in CTV and rectum delineation. Inter-observer variability was evident. Incorrect delineation of the rectum impacted on dosimetric compliance with protocol.