Joshua S Scheuermann1, Janet S Reddin2, Adam Opanowski3, Paul E Kinahan4, Barry A Siegel5, Lalitha K Shankar6, Joel S Karp2. 1. Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania jscheu@mail.med.upenn.edu. 2. Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania. 3. American College of Radiology Imaging Network, Philadelphia, Pennsylvania. 4. Department of Radiology, University of Washington, Seattle, Washington. 5. Mallinckrodt Institute of Radiology and Alvin J. Siteman Cancer Center, School of Medicine, Washington University, St. Louis, Missouri; and. 6. Cancer Imaging Program, National Cancer Institute, Rockville, Maryland.
Abstract
The National Cancer Institute developed the Centers for Quantitative Imaging Excellence (CQIE) initiative in 2010 to prequalify imaging facilities at all of the National Cancer Institute-designated comprehensive and clinical cancer centers for oncology trials using advanced imaging techniques, including PET. Here we review the CQIE PET/CT scanner qualification process and results in detail. Methods: Over a period of approximately 5 y, sites were requested to submit a variety of phantoms, including uniform and American College of Radiology-approved phantoms, PET/CT images, and examples of clinical images. Submissions were divided into 3 distinct time periods: initial submission (T0) and 2 requalification submissions (T1 and T2). Images were analyzed using standardized procedures, and scanners received a pass or fail designation. Sites had the opportunity to submit new data for scanners that failed. Quantitative results were compared across scanners within a given time period and across time periods for a given scanner. Results: Data from 65 unique PET/CT scanners across 56 sites were submitted for CQIE T0 qualification; 64 scanners passed the qualification. Data from 44 (68%) of those 65 scanners were submitted for T2. From T0 to T2, the percentage of scanners passing the CQIE qualification on the first attempt rose from 38% for T1 to 67% for T2. The most common reasons for failure were SUV outside specifications, incomplete submission, and uniformity issues. Uniform phantom and American College of Radiology-approved phantom results between scanner manufacturers were similar. Conclusion: The results of the CQIE process showed that periodic requalification may decrease the frequency of deficient data submissions. The CQIE project also highlighted the concern within imaging facilities about the burden of maintaining different qualifications and accreditations. Finally, for quantitative imaging-based trials, further evaluation of the relationships between the level of the qualification (e.g., bias or precision) and the quality of the image data, accrual rates, and study power is needed.
The National Cancer Institute developed the Centers for Quantitative Imaging Excellence (CQIE) initiative in 2010 to prequalify imaging facilities at all of the National Cancer Institute-designated comprehensive and clinical cancer centers for oncology trials using advanced imaging techniques, including PET. Here we review the CQIE PET/CT scanner qualification process and results in detail. Methods: Over a period of approximately 5 y, sites were requested to submit a variety of phantoms, including uniform and American College of Radiology-approved phantoms, PET/CT images, and examples of clinical images. Submissions were divided into 3 distinct time periods: initial submission (T0) and 2 requalification submissions (T1 and T2). Images were analyzed using standardized procedures, and scanners received a pass or fail designation. Sites had the opportunity to submit new data for scanners that failed. Quantitative results were compared across scanners within a given time period and across time periods for a given scanner. Results: Data from 65 unique PET/CT scanners across 56 sites were submitted for CQIE T0 qualification; 64 scanners passed the qualification. Data from 44 (68%) of those 65 scanners were submitted for T2. From T0 to T2, the percentage of scanners passing the CQIE qualification on the first attempt rose from 38% for T1 to 67% for T2. The most common reasons for failure were SUV outside specifications, incomplete submission, and uniformity issues. Uniform phantom and American College of Radiology-approved phantom results between scanner manufacturers were similar. Conclusion: The results of the CQIE process showed that periodic requalification may decrease the frequency of deficient data submissions. The CQIE project also highlighted the concern within imaging facilities about the burden of maintaining different qualifications and accreditations. Finally, for quantitative imaging-based trials, further evaluation of the relationships between the level of the qualification (e.g., bias or precision) and the quality of the image data, accrual rates, and study power is needed.
Authors: Frederic H Fahey; Paul E Kinahan; Robert K Doot; Mehmet Kocak; Harold Thurston; Tina Young Poussaint Journal: Med Phys Date: 2010-07 Impact factor: 4.071
Authors: Ronald Boellaard; Wim J G Oyen; Corneline J Hoekstra; Otto S Hoekstra; Eric P Visser; Antoon T Willemsen; Bertjan Arends; Fred J Verzijlbergen; Josee Zijlstra; Anne M Paans; Emile F I Comans; Jan Pruim Journal: Eur J Nucl Med Mol Imaging Date: 2008-08-15 Impact factor: 9.236
Authors: Francois Cornelis; Vlasios Sotirchos; Elena Violari; Constantinos T Sofocleous; Heiko Schoder; Jeremy C Durack; Robert H Siegelbaum; Majid Maybody; John Humm; Stephen B Solomon Journal: J Nucl Med Date: 2016-02-23 Impact factor: 10.057
Authors: Michael M Graham; Richard L Wahl; John M Hoffman; Jeffrey T Yap; John J Sunderland; Ronald Boellaard; Eric S Perlman; Paul E Kinahan; Paul E Christian; Otto S Hoekstra; Gary S Dorfman Journal: J Nucl Med Date: 2015-04-16 Impact factor: 10.057
Authors: S F Barrington; J E MacKewn; P Schleyer; P K Marsden; N G Mikhaeel; W Qian; P Mouncey; P Patrick; B Popova; P Johnson; J Radford; M J O'Doherty Journal: Ann Oncol Date: 2010-09-02 Impact factor: 32.976
Authors: Robert K Doot; Larry A Pierce; Darrin Byrd; Brian Elston; Keith C Allberg; Paul E Kinahan Journal: Transl Oncol Date: 2014-02-01 Impact factor: 4.243
Authors: Darrin Byrd; Rebecca Christopfel; Grae Arabasz; Ciprian Catana; Joel Karp; Martin A Lodge; Charles Laymon; Eduardo G Moros; Mikalai Budzevich; Sadek Nehmeh; Joshua Scheuermann; John Sunderland; Jun Zhang; Paul Kinahan Journal: J Med Imaging (Bellingham) Date: 2018-01-04
Authors: Robert H Press; Hui-Kuo G Shu; Hyunsuk Shim; James M Mountz; Brenda F Kurland; Richard L Wahl; Ella F Jones; Nola M Hylton; Elizabeth R Gerstner; Robert J Nordstrom; Lori Henderson; Karen A Kurdziel; Bhadrasain Vikram; Michael A Jacobs; Matthias Holdhoff; Edward Taylor; David A Jaffray; Lawrence H Schwartz; David A Mankoff; Paul E Kinahan; Hannah M Linden; Philippe Lambin; Thomas J Dilling; Daniel L Rubin; Lubomir Hadjiiski; John M Buatti Journal: Int J Radiat Oncol Biol Phys Date: 2018-06-30 Impact factor: 7.038
Authors: Delphine Vallot; Elena De Ponti; Sabrina Morzenti; Anna Gramek; Anna Pieczonka; Gabriel Reynés Llompart; Jakub Siennicki; Paul Deak; Chiranjib Dutta; Jorge Uribe; Olivier Caselles Journal: EJNMMI Phys Date: 2020-05-12