Thomas E Hamilton1, Douglas Barnhart2, Kenneth Gow3, Fernando Ferrer4, Jessica Kandel5, Richard Glick6, Roshni Dasgupta7, Arlene Naranjo8, Ying He8, Eric Gratias9, James Geller10, Elizabeth Mullen11, Peter Ehrlich12. 1. Dana Farber Cancer Institute, Boston Children's Hospital, Boston MA. Electronic address: thomas.hamilton@childrens.harvard.edu. 2. Primary Children's Medical Center, Salt Lake City UT. 3. Seattle Children's Hospital, Seattle WA. 4. Connecticut Children's Hospital, Hartford CT. 5. Columbia University Medical Center, New York NY. 6. Cohen Children's Medical Center of New York, New York NY. 7. Cinncinnati Children's Hospital, Cincinnati OH. 8. Children's Oncology Group, University of Florida, Gainesville FL. 9. T. C. Thompson Children's Hospital, Chattanooga TN. 10. Cincinnati Children's Hospital, Cincinnati Medical Center, Cincinnati OH. 11. Dana Farber Cancer Institute, Boston Children's Hospital, Boston MA. 12. C.S. Mott Children's Hospital, University of Michigan, Ann Arbor MI.
Abstract
PURPOSE: The Children's Oncology Group (COG) renal tumor study (AREN03B2) requires real-time central review of radiology, pathology, and the surgical procedure to determine appropriate risk-based therapy. The purpose of this study was to determine the inter-rater reliability of the surgical reviews. METHODS: Of the first 3200 enrolled AREN03B2 patients, a sample of 100 enriched for blood vessel involvement, spill, rupture, and lymph node involvement was selected for analysis. The surgical assessment was then performed independently by two blinded surgical reviewers and compared to the original assessment, which had been completed by another of the committee surgeons. Variables assessed included surgeon-determined local tumor stage, overall disease stage, type of renal procedure performed, presence of tumor rupture, occurrence of intraoperative tumor spill, blood vessel involvement, presence of peritoneal implants, and interpretation of residual disease. Inter-rater reliability was measured using the Fleiss' Kappa statistic two-sided hypothesis tests (Kappa, p-value). RESULTS: Local tumor stage correlated in all 3 reviews except in one case (Kappa=0.9775, p<0.001). Similarly, overall disease stage had excellent correlation (0.9422, p<0.001). There was strong correlation for type of renal procedure (0.8357, p<0.001), presence of tumor rupture (0.6858, p<0.001), intraoperative tumor spill (0.6493, p<0.001), and blood vessel involvement (0.6470, p<0.001). Variables that had lower correlation were determination of the presence of peritoneal implants (0.2753, p<0.001) and interpretation of residual disease status (0.5310, p<0.001). CONCLUSION: The inter-rater reliability of the surgical review is high based on the great consistency in the 3 independent review results. This analysis provides validation and establishes precedent for real-time central surgical review to determine treatment assignment in a risk-based stratagem for multimodal cancer therapy.
PURPOSE: The Children's Oncology Group (COG) renal tumor study (AREN03B2) requires real-time central review of radiology, pathology, and the surgical procedure to determine appropriate risk-based therapy. The purpose of this study was to determine the inter-rater reliability of the surgical reviews. METHODS: Of the first 3200 enrolled AREN03B2 patients, a sample of 100 enriched for blood vessel involvement, spill, rupture, and lymph node involvement was selected for analysis. The surgical assessment was then performed independently by two blinded surgical reviewers and compared to the original assessment, which had been completed by another of the committee surgeons. Variables assessed included surgeon-determined local tumor stage, overall disease stage, type of renal procedure performed, presence of tumor rupture, occurrence of intraoperative tumor spill, blood vessel involvement, presence of peritoneal implants, and interpretation of residual disease. Inter-rater reliability was measured using the Fleiss' Kappa statistic two-sided hypothesis tests (Kappa, p-value). RESULTS: Local tumor stage correlated in all 3 reviews except in one case (Kappa=0.9775, p<0.001). Similarly, overall disease stage had excellent correlation (0.9422, p<0.001). There was strong correlation for type of renal procedure (0.8357, p<0.001), presence of tumor rupture (0.6858, p<0.001), intraoperative tumor spill (0.6493, p<0.001), and blood vessel involvement (0.6470, p<0.001). Variables that had lower correlation were determination of the presence of peritoneal implants (0.2753, p<0.001) and interpretation of residual disease status (0.5310, p<0.001). CONCLUSION: The inter-rater reliability of the surgical review is high based on the great consistency in the 3 independent review results. This analysis provides validation and establishes precedent for real-time central surgical review to determine treatment assignment in a risk-based stratagem for multimodal cancer therapy.
Authors: Peter F Ehrlich; Michael L Ritchey; Tomas E Hamilton; Gerald M Haase; San Ou; Norman Breslow; Paul Grundy; Daniel Green; Patricia Norkool; Jennifer Becker; Robert C Shamberger Journal: J Pediatr Surg Date: 2005-01 Impact factor: 2.545
Authors: B Jereb; M F Tournade; J Lemerle; P A Voûte; J F Delemarre; L Ahstrom; R Flamant; R Gérard-Marchant; B Sandstedt Journal: Cancer Date: 1980-04-01 Impact factor: 6.860
Authors: R C Shamberger; K A Guthrie; M L Ritchey; G M Haase; J Takashima; J B Beckwith; G J D'Angio; D M Green; N E Breslow Journal: Ann Surg Date: 1999-02 Impact factor: 12.969
Authors: J M Bueno-de-Mesquita; D S A Nuyten; J Wesseling; H van Tinteren; S C Linn; M J van de Vijver Journal: Ann Oncol Date: 2009-07-21 Impact factor: 32.976
Authors: Hans Theodor Eich; Susanne Staar; Axel Gossmann; Katja Hansemann; Roman Skripnitchenko; Martin Kocher; Robert Semrau; Andreas Engert; Andreas Josting; Jeremy Franklin; Barbara Krug; Volker Diehl; Rolf-Peter Müller Journal: Int J Radiat Oncol Biol Phys Date: 2004-03-15 Impact factor: 7.038
Authors: Peter Ehrlich; Yuen Y Chi; Murali M Chintagumpala; Fred A Hoffer; Elizabeth J Perlman; John A Kalapurakal; Ann Warwick; Robert C Shamberger; Geetika Khanna; Tom E Hamilton; Ken W Gow; Arnold C Paulino; Eric J Gratias; Elizabeth A Mullen; James I Geller; Paul E Grundy; Conrad V Fernandez; Michael L Ritchey; James S Dome Journal: Ann Surg Date: 2017-09 Impact factor: 12.969