Anton Gies1, Katarina Cuk2, Petra Schrotz-King1, Hermann Brenner3. 1. Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), Heidelberg, Germany. 2. Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany. 3. Division of Preventive Oncology, German Cancer Research Center (DKFZ) and National Center for Tumor Diseases (NCT), Heidelberg, Germany; Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany; German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Heidelberg, Germany. Electronic address: h.brenner@dkfz.de.
Abstract
BACKGROUND & AIMS: A variety of fecal immunochemical tests (FITs) for hemoglobin (Hb) are used in colorectal cancer screening. It is unclear to what extent differences in reported sensitivities and specificities reflect true heterogeneity in test performance or differences in study populations or varying pre-analytical conditions. We directly compared the sensitivity and specificity values with which 9 quantitative (laboratory-based and point-of-care) FITs detected advanced neoplasms (AN) in a single colorectal cancer screening study. METHODS: Pre-colonoscopy stool samples were obtained from participants of screening colonoscopy in Germany from 2005 through 2010 and frozen at -80°C until analysis. The stool samples were thawed, homogenized, and used for 9 different quantitative FITs in parallel. Colonoscopy and histology reports were collected from all participants and evaluated by 2 independent, trained research assistants who were blinded to the test results. Comparative evaluations of diagnostic performance for AN were made at preset manufacturers' thresholds (range, 2.0-17.0 μg Hb/g feces), at a uniform threshold (15 μg Hb/g feces), and at adjusted thresholds yielding defined levels of specificity (99%, 97%, and 93%). RESULTS: Of the 1667 participants who fulfilled the inclusion criteria, all cases with AN (n = 216) and 300 randomly selected individuals without AN were included in the analysis. Sensitivities and specificities for AN varied widely when we used the preset thresholds (21.8%-46.3% and 85.7%-97.7%, respectively) or the uniform threshold (16.2%-34.3% and 94.0%-98.0%, respectively). Adjusting thresholds to yield a specificity of 99%, 97%, or 93% resulted in almost equal sensitivities for detection of AN (14.4%-18.5%, 21.3%-23.6%, and 30.1%-35.2%, respectively) and almost equal positivity rates (2.8%-3.4%, 5.8%-6.1%, and 10.1%-10.9%, respectively). CONCLUSIONS: Apparent heterogeneity in diagnostic performance of quantitative FITs can be overcome to a large extent by adjusting thresholds to yield defined levels of specificity or positivity rates. Rather than simply using thresholds recommended by the manufacturer, screening programs should choose thresholds based on intended levels of specificity and manageable positivity rates.
BACKGROUND & AIMS: A variety of fecal immunochemical tests (FITs) for hemoglobin (Hb) are used in colorectal cancer screening. It is unclear to what extent differences in reported sensitivities and specificities reflect true heterogeneity in test performance or differences in study populations or varying pre-analytical conditions. We directly compared the sensitivity and specificity values with which 9 quantitative (laboratory-based and point-of-care) FITs detected advanced neoplasms (AN) in a single colorectal cancer screening study. METHODS: Pre-colonoscopy stool samples were obtained from participants of screening colonoscopy in Germany from 2005 through 2010 and frozen at -80°C until analysis. The stool samples were thawed, homogenized, and used for 9 different quantitative FITs in parallel. Colonoscopy and histology reports were collected from all participants and evaluated by 2 independent, trained research assistants who were blinded to the test results. Comparative evaluations of diagnostic performance for AN were made at preset manufacturers' thresholds (range, 2.0-17.0 μg Hb/g feces), at a uniform threshold (15 μg Hb/g feces), and at adjusted thresholds yielding defined levels of specificity (99%, 97%, and 93%). RESULTS: Of the 1667 participants who fulfilled the inclusion criteria, all cases with AN (n = 216) and 300 randomly selected individuals without AN were included in the analysis. Sensitivities and specificities for AN varied widely when we used the preset thresholds (21.8%-46.3% and 85.7%-97.7%, respectively) or the uniform threshold (16.2%-34.3% and 94.0%-98.0%, respectively). Adjusting thresholds to yield a specificity of 99%, 97%, or 93% resulted in almost equal sensitivities for detection of AN (14.4%-18.5%, 21.3%-23.6%, and 30.1%-35.2%, respectively) and almost equal positivity rates (2.8%-3.4%, 5.8%-6.1%, and 10.1%-10.9%, respectively). CONCLUSIONS: Apparent heterogeneity in diagnostic performance of quantitative FITs can be overcome to a large extent by adjusting thresholds to yield defined levels of specificity or positivity rates. Rather than simply using thresholds recommended by the manufacturer, screening programs should choose thresholds based on intended levels of specificity and manageable positivity rates.
Authors: Esmée J Grobbee; Pieter Ha Wisse; Eline H Schreuders; Aafke van Roon; Leonie van Dam; Ann G Zauber; Iris Lansdorp-Vogelaar; Wichor Bramer; Sarah Berhane; Jonathan J Deeks; Ewout W Steyerberg; Monique E van Leerdam; Manon Cw Spaander; Ernst J Kuipers Journal: Cochrane Database Syst Rev Date: 2022-06-06
Authors: Kevin Selby; Christopher D Jensen; Jeffrey K Lee; Chyke A Doubeni; Joanne E Schottinger; Wei K Zhao; Jessica Chubak; Ethan Halm; Nirupa R Ghai; Richard Contreras; Celette Skinner; Aruna Kamineni; Theodore R Levin; Douglas A Corley Journal: Ann Intern Med Date: 2018-09-18 Impact factor: 25.391
Authors: Kevin Selby; Emma H Levine; Cecilia Doan; Anton Gies; Hermann Brenner; Charles Quesenberry; Jeffrey K Lee; Douglas A Corley Journal: Gastroenterology Date: 2019-08-22 Impact factor: 22.682
Authors: Amanda J Cross; Kate Wooldrage; Emma C Robbins; Ines Kralj-Hans; Eilidh MacRae; Carolyn Piggott; Iain Stenson; Aaron Prendergast; Bhavita Patel; Kevin Pack; Rosemary Howe; Nicholas Swart; Julia Snowball; Stephen W Duffy; Stephen Morris; Christian von Wagner; Stephen P Halloran; Wendy S Atkin Journal: Gut Date: 2018-12-11 Impact factor: 23.059
Authors: Carrie M Nielson; Amanda F Petrik; Lorie Jacob; William M Vollmer; Erin M Keast; Jennifer L Schneider; Jennifer S Rivelli; Tanya J Kapka; Richard T Meenan; Rajasekhara R Mummadi; Beverly B Green; Gloria D Coronado Journal: Cancer Med Date: 2018-08-13 Impact factor: 4.452
Authors: Marta Herreros-Villanueva; Saray Duran-Sanchon; Ana Carmen Martín; Rosa Pérez-Palacios; Elena Vila-Navarro; María Marcuello; Mireia Diaz-Centeno; Joaquín Cubiella; Maria Soledad Diez; Luis Bujanda; Angel Lanas; Rodrigo Jover; Vicent Hernández; Enrique Quintero; Juan José Lozano; Marta García-Cougil; Ibon Martínez-Arranz; Antoni Castells; Meritxell Gironella; Rocio Arroyo Journal: Clin Transl Gastroenterol Date: 2019-01 Impact factor: 4.488