David L Rimm1, Gang Han2, Janis M Taube3, Eunhee S Yi4, Julia A Bridge5, Douglas B Flieder6, Robert Homer1, William W West5, Hong Wu6, Anja C Roden4, Junya Fujimoto7, Hui Yu8, Robert Anders3, Ashley Kowalewski8, Christopher Rivard8, Jamaal Rehman9, Cory Batenchuk10, Virginia Burns10, Fred R Hirsch8, Ignacio I Wistuba7. 1. Department of Pathology, Yale University School of Medicine, New Haven, Connecticut. 2. Department of Epidemiology and Biostatistics, Texas A&M University School of Public Health, College Station. 3. Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, Maryland. 4. Department of Anatomic Pathology, Mayo Clinic, Rochester, Minnesota. 5. Department of Pathology and Microbiology, University of Nebraska Medical Center, Omaha. 6. Department of Pathology, Fox Chase Cancer Center, Philadelphia, Pennsylvania. 7. Department of Translational Molecular Pathology, The University of Texas M.D. Anderson Cancer Center, Houston. 8. Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora. 9. Department of Pathology, NorthShore University Health System, Evanston, Illinois. 10. Department of Immuno-Oncology, Bristol-Myers Squibb, Plainsboro, New Jersey.
Abstract
IMPORTANCE: Four assays registered with the US Food and Drug Administration (FDA) detect programmed cell death ligand 1 (PD-L1) to enrich for patient response to anti-programmed cell death 1 and anti-PD-L1 therapies. The tests use 4 separate PD-L1 antibodies on 2 separate staining platforms and have their own scoring systems, which raises questions about their similarity and the potential interchangeability of the tests. OBJECTIVE: To compare the performance of 4 PD-L1 platforms, including 2 FDA-cleared assays, 1 test for investigational use only, and 1 laboratory-developed test. DESIGN, SETTING, AND PARTICIPANTS: Four serial histologic sections from 90 archival non-small cell lung cancers from January 1, 2008, to December 31, 2010, were distributed to 3 sites that performed the following immunohistochemical assays: 28-8 antibody on the Dako Link 48 platform, 22c3 antibody on the Dako Link 48 platform, SP142 antibody on the Ventana Benchmark platform, and E1L3N antibody on the Leica Bond platform. The slides were scanned and scored by 13 pathologists who estimated the percentage of malignant and immune cells expressing PD-L1. Statistical analyses were performed from December 1, 2015, to August 30, 2016, to compare antibodies and pathologists' scoring of tumor and immune cells. MAIN OUTCOMES AND MEASURES: Percentages of malignant and immune cells expressing PD-L1. RESULTS: Among the 90 samples, the SP142 assay was an outlier, with a significantly lower mean score of PD-L1 expression in both tumor and immune cells (tumor cells: 22c3, 2.96; 28-8, 3.26; SP142, 1.99; E1L3N, 3.20; overall mean, 2.85; and immune cells: 22c3, 2.15; 28-8, 2.28; SP142, 1.62; E1L3N, 2.28; overall mean, 2.08). Pairwise comparisons showed that the scores from the 28-8 and E1L3N tests were not significantly different but that the 22c3 test showed a slight (mean difference, 0.24-0.30) but statistically significant reduction in labeling of PD-L1 expression in tumor cells. Evaluation of intraclass correlation coefficients (ICCs) between antibodies to quantify interassay variability for PD-L1 expression in tumor cells showed high concordance between antibodies for tumor cell scoring (0.813; 95% CI, 0.815-0.839) and lower levels of concordance for immune cell scoring (0.277; 95% CI, 0.222-0.334). When examining variability between pathologists for any single assay, the concordance between pathologists' scoring for PD-L1 expression in tumor cells ranged from ICCs of 0.832 (95% CI, 0.820-0.844) to 0.882 (95% CI, 0.873-0.891) for each assay, while the ICCs from immune cells for each assay ranged from 0.172 (95% CI, 0.156-0.189) to 0.229 (95% CI, 0.211-0.248). CONCLUSIONS AND RELEVANCE: The assay using the SP142 antibody is an outlier that detected significantly less PD-L1 expression in tumor cells and immune cells. The assay for antibody 22c3 showed slight yet statistically significantly lower staining than either 28-8 or E1L3N, but this significance was detected only when using the mean of 13 pathologists' scores. The pathologists showed excellent concordance when scoring tumor cells stained with any antibody but poor concordance for scoring immune cells stained with any antibody. Thus, for tumor cell assessment of PD-L1, 3 of the 4 tests are concordant and reproducible as read by pathologists.
IMPORTANCE: Four assays registered with the US Food and Drug Administration (FDA) detect programmed cell death ligand 1 (PD-L1) to enrich for patient response to anti-programmed cell death 1 and anti-PD-L1 therapies. The tests use 4 separate PD-L1 antibodies on 2 separate staining platforms and have their own scoring systems, which raises questions about their similarity and the potential interchangeability of the tests. OBJECTIVE: To compare the performance of 4 PD-L1 platforms, including 2 FDA-cleared assays, 1 test for investigational use only, and 1 laboratory-developed test. DESIGN, SETTING, AND PARTICIPANTS: Four serial histologic sections from 90 archival non-small cell lung cancers from January 1, 2008, to December 31, 2010, were distributed to 3 sites that performed the following immunohistochemical assays: 28-8 antibody on the Dako Link 48 platform, 22c3 antibody on the Dako Link 48 platform, SP142 antibody on the Ventana Benchmark platform, and E1L3N antibody on the Leica Bond platform. The slides were scanned and scored by 13 pathologists who estimated the percentage of malignant and immune cells expressing PD-L1. Statistical analyses were performed from December 1, 2015, to August 30, 2016, to compare antibodies and pathologists' scoring of tumor and immune cells. MAIN OUTCOMES AND MEASURES: Percentages of malignant and immune cells expressing PD-L1. RESULTS: Among the 90 samples, the SP142 assay was an outlier, with a significantly lower mean score of PD-L1 expression in both tumor and immune cells (tumor cells: 22c3, 2.96; 28-8, 3.26; SP142, 1.99; E1L3N, 3.20; overall mean, 2.85; and immune cells: 22c3, 2.15; 28-8, 2.28; SP142, 1.62; E1L3N, 2.28; overall mean, 2.08). Pairwise comparisons showed that the scores from the 28-8 and E1L3N tests were not significantly different but that the 22c3 test showed a slight (mean difference, 0.24-0.30) but statistically significant reduction in labeling of PD-L1 expression in tumor cells. Evaluation of intraclass correlation coefficients (ICCs) between antibodies to quantify interassay variability for PD-L1 expression in tumor cells showed high concordance between antibodies for tumor cell scoring (0.813; 95% CI, 0.815-0.839) and lower levels of concordance for immune cell scoring (0.277; 95% CI, 0.222-0.334). When examining variability between pathologists for any single assay, the concordance between pathologists' scoring for PD-L1 expression in tumor cells ranged from ICCs of 0.832 (95% CI, 0.820-0.844) to 0.882 (95% CI, 0.873-0.891) for each assay, while the ICCs from immune cells for each assay ranged from 0.172 (95% CI, 0.156-0.189) to 0.229 (95% CI, 0.211-0.248). CONCLUSIONS AND RELEVANCE: The assay using the SP142 antibody is an outlier that detected significantly less PD-L1 expression in tumor cells and immune cells. The assay for antibody 22c3 showed slight yet statistically significantly lower staining than either 28-8 or E1L3N, but this significance was detected only when using the mean of 13 pathologists' scores. The pathologists showed excellent concordance when scoring tumor cells stained with any antibody but poor concordance for scoring immune cells stained with any antibody. Thus, for tumor cell assessment of PD-L1, 3 of the 4 tests are concordant and reproducible as read by pathologists.
Authors: D F Hayes; R C Bast; C E Desch; H Fritsche; N E Kemeny; J M Jessup; G Y Locker; J S Macdonald; R G Mennel; L Norton; P Ravdin; S Taube; R J Winn Journal: J Natl Cancer Inst Date: 1996-10-16 Impact factor: 13.506
Authors: M Elizabeth H Hammond; Daniel F Hayes; Mitch Dowsett; D Craig Allred; Karen L Hagerty; Sunil Badve; Patrick L Fitzgibbons; Glenn Francis; Neil S Goldstein; Malcolm Hayes; David G Hicks; Susan Lester; Richard Love; Pamela B Mangu; Lisa McShane; Keith Miller; C Kent Osborne; Soonmyung Paik; Jane Perlmutter; Anthony Rhodes; Hironobu Sasano; Jared N Schwartz; Fred C G Sweep; Sheila Taube; Emina Emilia Torlakovic; Paul Valenstein; Giuseppe Viale; Daniel Visscher; Thomas Wheeler; R Bruce Williams; James L Wittliff; Antonio C Wolff Journal: Arch Pathol Lab Med Date: 2010-06 Impact factor: 5.534
Authors: Edward B Garon; Naiyer A Rizvi; Rina Hui; Natasha Leighl; Ani S Balmanoukian; Joseph Paul Eder; Amita Patnaik; Charu Aggarwal; Matthew Gubens; Leora Horn; Enric Carcereny; Myung-Ju Ahn; Enriqueta Felip; Jong-Seok Lee; Matthew D Hellmann; Omid Hamid; Jonathan W Goldman; Jean-Charles Soria; Marisa Dolled-Filhart; Ruth Z Rutledge; Jin Zhang; Jared K Lunceford; Reshma Rangwala; Gregory M Lubiniecki; Charlotte Roach; Kenneth Emancipator; Leena Gandhi Journal: N Engl J Med Date: 2015-04-19 Impact factor: 91.245
Authors: Roy S Herbst; Jean-Charles Soria; Marcin Kowanetz; Gregg D Fine; Omid Hamid; Michael S Gordon; Jeffery A Sosman; David F McDermott; John D Powderly; Scott N Gettinger; Holbrook E K Kohrt; Leora Horn; Donald P Lawrence; Sandra Rost; Maya Leabman; Yuanyuan Xiao; Ahmad Mokatrin; Hartmut Koeppen; Priti S Hegde; Ira Mellman; Daniel S Chen; F Stephen Hodi Journal: Nature Date: 2014-11-27 Impact factor: 49.962
Authors: Suzanne L Topalian; F Stephen Hodi; Julie R Brahmer; Scott N Gettinger; David C Smith; David F McDermott; John D Powderly; Richard D Carvajal; Jeffrey A Sosman; Michael B Atkins; Philip D Leming; David R Spigel; Scott J Antonia; Leora Horn; Charles G Drake; Drew M Pardoll; Lieping Chen; William H Sharfman; Robert A Anders; Janis M Taube; Tracee L McMiller; Haiying Xu; Alan J Korman; Maria Jure-Kunkel; Shruti Agrawal; Daniel McDonald; Georgia D Kollia; Ashok Gupta; Jon M Wigginton; Mario Sznol Journal: N Engl J Med Date: 2012-06-02 Impact factor: 91.245
Authors: Hossein Borghaei; Luis Paz-Ares; Leora Horn; David R Spigel; Martin Steins; Neal E Ready; Laura Q Chow; Everett E Vokes; Enriqueta Felip; Esther Holgado; Fabrice Barlesi; Martin Kohlhäufl; Oscar Arrieta; Marco Angelo Burgio; Jérôme Fayette; Hervé Lena; Elena Poddubskaya; David E Gerber; Scott N Gettinger; Charles M Rudin; Naiyer Rizvi; Lucio Crinò; George R Blumenschein; Scott J Antonia; Cécile Dorange; Christopher T Harbison; Friedrich Graf Finckenstein; Julie R Brahmer Journal: N Engl J Med Date: 2015-09-27 Impact factor: 91.245
Authors: Patricia Gaule; James W Smithy; Maria Toki; Jamaal Rehman; Farah Patell-Socha; Delphine Cougot; Philippe Collin; Paul Morrill; Veronique Neumeister; David L Rimm Journal: JAMA Oncol Date: 2017-02-01 Impact factor: 31.777
Authors: Siwen Hu-Lieskovan; Srabani Bhaumik; Kavita Dhodapkar; Jean-Charles J B Grivel; Sumati Gupta; Brent A Hanks; Sylvia Janetzki; Thomas O Kleen; Yoshinobu Koguchi; Amanda W Lund; Cristina Maccalli; Yolanda D Mahnke; Ruslan D Novosiadly; Senthamil R Selvan; Tasha Sims; Yingdong Zhao; Holden T Maecker Journal: J Immunother Cancer Date: 2020-12 Impact factor: 13.751
Authors: Zuzana Kos; Elvire Roblin; Rim S Kim; Stefan Michiels; Brandon D Gallas; Weijie Chen; Koen K van de Vijver; Shom Goel; Sylvia Adams; Sandra Demaria; Giuseppe Viale; Torsten O Nielsen; Sunil S Badve; W Fraser Symmans; Christos Sotiriou; David L Rimm; Stephen Hewitt; Carsten Denkert; Sibylle Loibl; Stephen J Luen; John M S Bartlett; Peter Savas; Giancarlo Pruneri; Deborah A Dillon; Maggie Chon U Cheang; Andrew Tutt; Jacqueline A Hall; Marleen Kok; Hugo M Horlings; Anant Madabhushi; Jeroen van der Laak; Francesco Ciompi; Anne-Vibeke Laenkholm; Enrique Bellolio; Tina Gruosso; Stephen B Fox; Juan Carlos Araya; Giuseppe Floris; Jan Hudeček; Leonie Voorwerk; Andrew H Beck; Jen Kerner; Denis Larsimont; Sabine Declercq; Gert Van den Eynden; Lajos Pusztai; Anna Ehinger; Wentao Yang; Khalid AbdulJabbar; Yinyin Yuan; Rajendra Singh; Crispin Hiley; Maise Al Bakir; Alexander J Lazar; Stephen Naber; Stephan Wienert; Miluska Castillo; Giuseppe Curigliano; Maria-Vittoria Dieci; Fabrice André; Charles Swanton; Jorge Reis-Filho; Joseph Sparano; Eva Balslev; I-Chun Chen; Elisabeth Ida Specht Stovgaard; Katherine Pogue-Geile; Kim R M Blenman; Frédérique Penault-Llorca; Stuart Schnitt; Sunil R Lakhani; Anne Vincent-Salomon; Federico Rojo; Jeremy P Braybrooke; Matthew G Hanna; M Teresa Soler-Monsó; Daniel Bethmann; Carlos A Castaneda; Karen Willard-Gallo; Ashish Sharma; Huang-Chun Lien; Susan Fineberg; Jeppe Thagaard; Laura Comerma; Paula Gonzalez-Ericsson; Edi Brogi; Sherene Loi; Joel Saltz; Frederick Klaushen; Lee Cooper; Mohamed Amgad; David A Moore; Roberto Salgado Journal: NPJ Breast Cancer Date: 2020-05-12