Annette S Kim1, Angela N Bartley2, Julia A Bridge3, Suzanne Kamel-Reid4, Alexander J Lazar5, Neal I Lindeman1, Thomas A Long6, Jason D Merker7, Alex J Rai8, David L Rimm9, Paul G Rothberg10, Patricia Vasalos6, Joel T Moncur11. 1. Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts. 2. St Joseph Mercy Hospital, Ann Arbor, Michigan. 3. University of Nebraska Medical Center, Omaha. 4. University Health Network, University of Toronto, Ontario, Canada. 5. University of Texas MD Anderson Cancer Center, Houston. 6. College of American Pathologists, Northfield, Illinois. 7. Stanford University, Palo Alto, California. 8. Columbia University Medical Center, New York, New York. 9. Yale University School of Medicine, New Haven, Connecticut. 10. Strong Memorial Hospital, University of Rochester Medical Center, Rochester, New York. 11. Walter Reed National Military Medical Center, Bethesda, Maryland.
Abstract
Importance: The debate about the role of the Food and Drug Administration (FDA) in the regulation of laboratory-developed tests (LDTs) has focused attention on the analytical performance of all clinical laboratory testing. This study provides data comparing the performance of LDTs and FDA-approved companion diagnostics (FDA-CDs) in proficiency testing (PT) provided by the College of American Pathologists Molecular Oncology Committee. Objective: To compare the analytical performance of LDTs and FDA-CDs on well-characterized PT samples and to compare the practice characteristics of laboratories using these assays. Design, Setting, and Participants: This comparison of PT responses examines the performance of laboratories participating in the College of American Pathologists PT for 3 oncology analytes for which both FDA-CDs and LDTs are used: BRAF, EGFR, and KRAS. A total of 6897 PT responses were included: BRAF (n = 2524; 14 PT samples), EGFR (n = 2216; 11 PT samples), and KRAS (n = 2157, 10 PT samples). US Food and Drug Administration companion diagnostics and LDTs are compared for both accuracy and preanalytic practices of the laboratories. Main Outcomes and Measures: As per the College of American Pathologists PT standards, results were scored and the percentages of acceptable responses for each analyte were compared. These were also broken down by the specific variants tested, by kit manufacturer for laboratories using commercial reagents, and by preanalytic practices. Results: From analysis of 6897 PT responses, this study demonstrates that both LDTs and FDA-CDs have excellent performance overall, with both test types exceeding 97% accuracy for all 3 genes (BRAF, EGFR, and KRAS) combined. Rare variant-specific differences did not consistently favor LDTs or FDA-CDs. Additionally, more than 60% of participants using an FDA-CD reported adapting their assay from the approved procedure to allow for a greater breadth of sample types, minimum tumor content, and instrumentation, changing the classification of their assay from FDA-CD to LDT. Conclusions: This study demonstrates the high degree of accuracy and comparable performance of both LDTs and FDA-CDs for 3 oncology analytes. More significantly, the majority of laboratories using FDA-CDs have modified the scope of their assay to allow for more clinical practice variety, rendering them LDTs. These findings support both the excellent and equivalent performance of both LDTs and FDA-CDs in clinical diagnostic testing.
Importance: The debate about the role of the Food and Drug Administration (FDA) in the regulation of laboratory-developed tests (LDTs) has focused attention on the analytical performance of all clinical laboratory testing. This study provides data comparing the performance of LDTs and FDA-approved companion diagnostics (FDA-CDs) in proficiency testing (PT) provided by the College of American Pathologists Molecular Oncology Committee. Objective: To compare the analytical performance of LDTs and FDA-CDs on well-characterized PT samples and to compare the practice characteristics of laboratories using these assays. Design, Setting, and Participants: This comparison of PT responses examines the performance of laboratories participating in the College of American Pathologists PT for 3 oncology analytes for which both FDA-CDs and LDTs are used: BRAF, EGFR, and KRAS. A total of 6897 PT responses were included: BRAF (n = 2524; 14 PT samples), EGFR (n = 2216; 11 PT samples), and KRAS (n = 2157, 10 PT samples). US Food and Drug Administration companion diagnostics and LDTs are compared for both accuracy and preanalytic practices of the laboratories. Main Outcomes and Measures: As per the College of American Pathologists PT standards, results were scored and the percentages of acceptable responses for each analyte were compared. These were also broken down by the specific variants tested, by kit manufacturer for laboratories using commercial reagents, and by preanalytic practices. Results: From analysis of 6897 PT responses, this study demonstrates that both LDTs and FDA-CDs have excellent performance overall, with both test types exceeding 97% accuracy for all 3 genes (BRAF, EGFR, and KRAS) combined. Rare variant-specific differences did not consistently favor LDTs or FDA-CDs. Additionally, more than 60% of participants using an FDA-CD reported adapting their assay from the approved procedure to allow for a greater breadth of sample types, minimum tumor content, and instrumentation, changing the classification of their assay from FDA-CD to LDT. Conclusions: This study demonstrates the high degree of accuracy and comparable performance of both LDTs and FDA-CDs for 3 oncology analytes. More significantly, the majority of laboratories using FDA-CDs have modified the scope of their assay to allow for more clinical practice variety, rendering them LDTs. These findings support both the excellent and equivalent performance of both LDTs and FDA-CDs in clinical diagnostic testing.
Authors: Andrea Ferreira-Gonzalez; Rajyasree Emmadi; Stephen P Day; Robert F Klees; Jennifer R Leib; Elaine Lyon; Jan A Nowak; Victoria M Pratt; Mary S Williams; Roger D Klein Journal: J Mol Diagn Date: 2014-01 Impact factor: 5.568
Authors: Jason D Merker; Kelly Devereaux; A John Iafrate; Suzanne Kamel-Reid; Annette S Kim; Joel T Moncur; Stephen B Montgomery; Rakesh Nagarajan; Bryce P Portier; Mark J Routbort; Craig Smail; Lea F Surrey; Patricia Vasalos; Alexander J Lazar; Neal I Lindeman Journal: Arch Pathol Lab Med Date: 2018-10-30 Impact factor: 5.534
Authors: Hetal Desai Marble; Richard Huang; Sarah Nixon Dudgeon; Amanda Lowe; Markus D Herrmann; Scott Blakely; Matthew O Leavitt; Mike Isaacs; Matthew G Hanna; Ashish Sharma; Jithesh Veetil; Pamela Goldberg; Joachim H Schmid; Laura Lasiter; Brandon D Gallas; Esther Abels; Jochen K Lennerz Journal: J Pathol Inform Date: 2020-08-06
Authors: Erica K Barnell; Kenneth F Newcomer; Zachary L Skidmore; Kilannin Krysiak; Sydney R Anderson; Lukas D Wartman; Stephen T Oh; John S Welch; Keith E Stockerl-Goldstein; Ravi Vij; Amanda F Cashen; Iskra Pusic; Peter Westervelt; Camille N Abboud; Armin Ghobadi; Geoffrey L Uy; Mark A Schroeder; John F Dipersio; Mary C Politi; David H Spencer; Eric J Duncavage; Timothy J Ley; Malachi Griffith; Meagan A Jacoby; Obi L Griffith Journal: JCO Precis Oncol Date: 2021-01-14
Authors: Ibiayi Dagogo-Jack; Christopher G Azzolli; Florian Fintelmann; Mari Mino-Kenudson; Anna F Farago; Justin F Gainor; Ginger Jiang; Zofia Piotrowska; Rebecca S Heist; Inga T Lennes; Jennifer S Temel; Meghan J Mooradian; Jessica J Lin; Subba R Digumarthy; Julie M Batten; Hayley Robinson; Vania Nose; Miguel Rivera; Valentina Nardi; Dora Dias-Santagata; Long P Le; Lecia V Sequist; Martha Pitman; Jo-Anne O Shepard; Alice T Shaw; A John Iafrate; Jochen K Lennerz Journal: JCO Precis Oncol Date: 2018-07-24
Authors: Kristen L Deak; Jennifer B Jackson; Kenneth C Valkenburg; Laurel A Keefer; Kelly M Robinson Gerding; Samuel V Angiuoli; Michael B Datto; Shannon J McCall Journal: J Mol Diagn Date: 2021-07-24 Impact factor: 5.568