Musaddiq Awan1, Jayashree Kalpathy-Cramer2, G Brandon Gunn1, Beth M Beadle1, Adam S Garden1, Jack Phan1, Emma Holliday1, William E Jones3, Elizabeth Maani3, Abhilasha Patel4, Jehee Choi4, Virginia Clyburn4, Bundhit Tantiwongkosi5, David I Rosenthal1, Clifton D Fuller6. 1. Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas. 2. Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Harvard Medical School, Charlestown, Massachusetts; Department of Radiology and Neuroscience, Massachusetts General Hospital, Charlestown, Massachusetts; Department of Radiation Medicine, Oregon Health & Science University, Portland, Oregon. 3. South Texas Veterans Affairs Health Care System, San Antonio, Texas; Department of Radiation Oncology, The University of Texas Health Science Center at San Antonio, San Antonio, Texas. 4. Department of Radiation Oncology, The University of Texas Health Science Center at San Antonio, San Antonio, Texas. 5. Department of Radiology, The University of Texas Health Science Center at San Antonio, San Antonio, Texas. 6. Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas; Department of Radiation Medicine, Oregon Health & Science University, Portland, Oregon. Electronic address: cdfuller@mdanderson.org.
Abstract
PURPOSE: A number of studies have previously assessed the role of teaching interventions to improve organ-at-risk (OAR) delineation. We present a preliminary study demonstrating the benefit of a combined atlas and real time software-based feedback intervention to aid in contouring of OARs in the head and neck. METHODS AND MATERIALS: The study consisted of a baseline evaluation, a real-time feedback intervention, atlas presentation, and a follow-up evaluation. At baseline evaluation, 8 resident observers contoured 26 OARs on a computed tomography scan without intervention or aid. They then received feedback comparing their contours both statistically and graphically to a set of atlas-based expert contours. Additionally, they received access to an atlas to contour these structures. The resident observers were then asked to contour the same 26 OARs on a separate computed tomography scan with atlas access. In addition, 6 experts (5 radiation oncologists specializing in the head and neck, and 1 neuroradiologist) contoured the 26 OARs on both scans. A simultaneous truth and performance level estimation (STAPLE) composite of the expert contours was used as a gold-standard set for analysis of OAR contouring. RESULTS: Of the 8 resident observers who initially participated in the study, 7 completed both phases of the study. Dice similarity coefficients were calculated for each user-drawn structure relative to the expert STAPLE composite for each structure. Mean dice similarity coefficients across all structures increased between phase 1 and phase 2 for each resident observer, demonstrating a statistically significant improvement in overall OAR-contouring ability (P < .01). Additionally, intervention improved contouring in 16/26 delineated organs-at-risk across resident observers at a statistically significant level (P ≤ .05) including all otic structures and suprahyoid lymph node levels of the head and neck. CONCLUSIONS: Our data suggest that a combined atlas and real-time feedback-based educational intervention detectably improves contouring of OARs in the head and neck.
PURPOSE: A number of studies have previously assessed the role of teaching interventions to improve organ-at-risk (OAR) delineation. We present a preliminary study demonstrating the benefit of a combined atlas and real time software-based feedback intervention to aid in contouring of OARs in the head and neck. METHODS AND MATERIALS: The study consisted of a baseline evaluation, a real-time feedback intervention, atlas presentation, and a follow-up evaluation. At baseline evaluation, 8 resident observers contoured 26 OARs on a computed tomography scan without intervention or aid. They then received feedback comparing their contours both statistically and graphically to a set of atlas-based expert contours. Additionally, they received access to an atlas to contour these structures. The resident observers were then asked to contour the same 26 OARs on a separate computed tomography scan with atlas access. In addition, 6 experts (5 radiation oncologists specializing in the head and neck, and 1 neuroradiologist) contoured the 26 OARs on both scans. A simultaneous truth and performance level estimation (STAPLE) composite of the expert contours was used as a gold-standard set for analysis of OAR contouring. RESULTS: Of the 8 resident observers who initially participated in the study, 7 completed both phases of the study. Dice similarity coefficients were calculated for each user-drawn structure relative to the expert STAPLE composite for each structure. Mean dice similarity coefficients across all structures increased between phase 1 and phase 2 for each resident observer, demonstrating a statistically significant improvement in overall OAR-contouring ability (P < .01). Additionally, intervention improved contouring in 16/26 delineated organs-at-risk across resident observers at a statistically significant level (P ≤ .05) including all otic structures and suprahyoid lymph node levels of the head and neck. CONCLUSIONS: Our data suggest that a combined atlas and real-time feedback-based educational intervention detectably improves contouring of OARs in the head and neck.
Authors: Vincent Grégoire; Peter Levendag; Kian K Ang; Jacques Bernier; Marijel Braaksma; Volker Budach; Cliff Chao; Emmanuel Coche; Jay S Cooper; Guy Cosnard; Avraham Eisbruch; Samy El-Sayed; Bahman Emami; Cai Grau; Marc Hamoir; Nancy Lee; Philippe Maingon; Karin Muller; Hervé Reychler Journal: Radiother Oncol Date: 2003-12 Impact factor: 6.280
Authors: Heather D Pacholke; Robert J Amdur; Ilona M Schmalfuss; Debbie Louis; William M Mendenhall Journal: Am J Clin Oncol Date: 2005-04 Impact factor: 2.339
Authors: Jayashree Kalpathy-Cramer; Musaddiq Awan; Steven Bedrick; Coen R N Rasch; David I Rosenthal; Clifton D Fuller Journal: J Digit Imaging Date: 2014-02 Impact factor: 4.056
Authors: Clifton D Fuller; Jasper Nijkamp; Joop C Duppen; Coen R N Rasch; Charles R Thomas; Samuel J Wang; Paul Okunieff; William E Jones; Daniel Baseman; Shilpen Patel; Carlo G N Demandante; Anna M Harris; Benjamin D Smith; Alan W Katz; Camille McGann; Jennifer L Harper; Daniel T Chang; Stephen Smalley; David T Marshall; Karyn A Goodman; Niko Papanikolaou; Lisa A Kachnic Journal: Int J Radiat Oncol Biol Phys Date: 2010-04-18 Impact factor: 7.038
Authors: Michael K Rooney; Fan Zhu; Erin F Gillespie; Jillian R Gunther; Ryan P McKillip; Matthew Lineberry; Ara Tekian; Daniel W Golden Journal: Int J Radiat Oncol Biol Phys Date: 2018-06-06 Impact factor: 7.038
Authors: Abdallah S R Mohamed; Manee-Naad Ruangskul; Musaddiq J Awan; Charles A Baron; Jayashree Kalpathy-Cramer; Richard Castillo; Edward Castillo; Thomas M Guerrero; Esengul Kocak-Uzel; Jinzhong Yang; Laurence E Court; Michael E Kantor; G Brandon Gunn; Rivka R Colen; Steven J Frank; Adam S Garden; David I Rosenthal; Clifton D Fuller Journal: Radiology Date: 2014-11-07 Impact factor: 11.105
Authors: Emma Holliday; Clifton D Fuller; Jayashree Kalpathy-Cramer; Daniel Gomez; Andreas Rimner; Ying Li; Suresh Senan; Lynn D Wilson; Jehee Choi; Ritsuko Komaki; Charles R Thomas Journal: J Radiat Oncol Date: 2015-11-03
Authors: Mustafa Abugideiri; Eduard Schreibmann; Jeffrey Switchenko; Mark W McDonald; Jonathan J Beitler; Walter J Curran; Deborah Bruner; Pretesh Patel; Wondemagegnhu Tigeneh; Miressa Mijena; Sibo Tian; Anees Dhabaan; Natia Esiashvili; Tian Liu; Arif N Ali Journal: J Glob Oncol Date: 2019-05
Authors: Hesham Elhalawani; Baher Elgohari; Timothy A Lin; Abdallah S R Mohamed; Thomas J Fitzgerald; Fran Laurie; Kenneth Ulin; Jayashree Kalpathy-Cramer; Thomas Guerrero; Emma B Holliday; Gregory Russo; Abhilasha Patel; William Jones; Gary V Walker; Musaddiq Awan; Mehee Choi; Roi Dagan; Omar Mahmoud; Anna Shapiro; Feng-Ming Spring Kong; Daniel Gomez; Jing Zeng; Roy Decker; Femke O B Spoelstra; Laurie E Gaspar; Lisa A Kachnic; Charles R Thomas; Paul Okunieff; Clifton D Fuller Journal: Clin Transl Radiat Oncol Date: 2019-01-06
Authors: Ingrid Kristensen; Kristina Nilsson; Måns Agrup; Karin Belfrage; Anna Embring; Hedda Haugen; Anna-Maja Svärd; Tommy Knöös; Per Nilsson Journal: Tech Innov Patient Support Radiat Oncol Date: 2017-11-04