Saud H AlDubayan1,2,3,4, Jake R Conway1,2,5, Sabrina Y Camp1,2, Leora Witkowski6, Eric Kofman1,2, Brendan Reardon1,2, Seunghun Han1,2,7, Nicholas Moore1,2, Haitham Elmarakeby1,2,8, Keyan Salari9, Hani Choudhry10, Abdullah M Al-Rubaish11, Abdulsalam A Al-Sulaiman11, Amein K Al-Ali11, Amaro Taylor-Weiner2,5, Eliezer M Van Allen1,2. 1. Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Harvard University, Boston, Massachusetts. 2. Cancer Program, Broad Institute of Massachusetts Institute of Technology and Harvard University, Cambridge. 3. Division of Genetics, Brigham and Women's Hospital, Boston, Massachusetts. 4. College of Medicine, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia. 5. Division of Medical Sciences, Department of Biomedical Informatics, Harvard University, Boston, Massachusetts. 6. Genetics Training Program, Harvard Medical School, Harvard University, Boston, Massachusetts. 7. Program in Biological and Biomedical Sciences, Division of Medical Sciences, Harvard University, Boston, Massachusetts. 8. Department of System and Computer Engineering, Al-Azhar University, Cairo, Egypt. 9. Department of Urology, Massachusetts General Hospital, Boston. 10. Department of Biochemistry, Cancer Metabolism and Epigenetic Unit, Faculty of Science, Cancer and Mutagenesis Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia. 11. College of Medicine, Imam Abdulrahman bin Faisal University, Dammam, Saudi Arabia.
Abstract
Importance: Less than 10% of patients with cancer have detectable pathogenic germline alterations, which may be partially due to incomplete pathogenic variant detection. Objective: To evaluate if deep learning approaches identify more germline pathogenic variants in patients with cancer. Design, Setting, and Participants: A cross-sectional study of a standard germline detection method and a deep learning method in 2 convenience cohorts with prostate cancer and melanoma enrolled in the US and Europe between 2010 and 2017. The final date of clinical data collection was December 2017. Exposures: Germline variant detection using standard or deep learning methods. Main Outcomes and Measures: The primary outcomes included pathogenic variant detection performance in 118 cancer-predisposition genes estimated as sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). The secondary outcomes were pathogenic variant detection performance in 59 genes deemed actionable by the American College of Medical Genetics and Genomics (ACMG) and 5197 clinically relevant mendelian genes. True sensitivity and true specificity could not be calculated due to lack of a criterion reference standard, but were estimated as the proportion of true-positive variants and true-negative variants, respectively, identified by each method in a reference variant set that consisted of all variants judged to be valid from either approach. Results: The prostate cancer cohort included 1072 men (mean [SD] age at diagnosis, 63.7 [7.9] years; 857 [79.9%] with European ancestry) and the melanoma cohort included 1295 patients (mean [SD] age at diagnosis, 59.8 [15.6] years; 488 [37.7%] women; 1060 [81.9%] with European ancestry). The deep learning method identified more patients with pathogenic variants in cancer-predisposition genes than the standard method (prostate cancer: 198 vs 182; melanoma: 93 vs 74); sensitivity (prostate cancer: 94.7% vs 87.1% [difference, 7.6%; 95% CI, 2.2% to 13.1%]; melanoma: 74.4% vs 59.2% [difference, 15.2%; 95% CI, 3.7% to 26.7%]), specificity (prostate cancer: 64.0% vs 36.0% [difference, 28.0%; 95% CI, 1.4% to 54.6%]; melanoma: 63.4% vs 36.6% [difference, 26.8%; 95% CI, 17.6% to 35.9%]), PPV (prostate cancer: 95.7% vs 91.9% [difference, 3.8%; 95% CI, -1.0% to 8.4%]; melanoma: 54.4% vs 35.4% [difference, 19.0%; 95% CI, 9.1% to 28.9%]), and NPV (prostate cancer: 59.3% vs 25.0% [difference, 34.3%; 95% CI, 10.9% to 57.6%]; melanoma: 80.8% vs 60.5% [difference, 20.3%; 95% CI, 10.0% to 30.7%]). For the ACMG genes, the sensitivity of the 2 methods was not significantly different in the prostate cancer cohort (94.9% vs 90.6% [difference, 4.3%; 95% CI, -2.3% to 10.9%]), but the deep learning method had a higher sensitivity in the melanoma cohort (71.6% vs 53.7% [difference, 17.9%; 95% CI, 1.82% to 34.0%]). The deep learning method had higher sensitivity in the mendelian genes (prostate cancer: 99.7% vs 95.1% [difference, 4.6%; 95% CI, 3.0% to 6.3%]; melanoma: 91.7% vs 86.2% [difference, 5.5%; 95% CI, 2.2% to 8.8%]). Conclusions and Relevance: Among a convenience sample of 2 independent cohorts of patients with prostate cancer and melanoma, germline genetic testing using deep learning, compared with the current standard genetic testing method, was associated with higher sensitivity and specificity for detection of pathogenic variants. Further research is needed to understand the relevance of these findings with regard to clinical outcomes.
Importance: Less than 10% of patients with cancer have detectable pathogenic germline alterations, which may be partially due to incomplete pathogenic variant detection. Objective: To evaluate if deep learning approaches identify more germline pathogenic variants in patients with cancer. Design, Setting, and Participants: A cross-sectional study of a standard germline detection method and a deep learning method in 2 convenience cohorts with prostate cancer and melanoma enrolled in the US and Europe between 2010 and 2017. The final date of clinical data collection was December 2017. Exposures: Germline variant detection using standard or deep learning methods. Main Outcomes and Measures: The primary outcomes included pathogenic variant detection performance in 118 cancer-predisposition genes estimated as sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). The secondary outcomes were pathogenic variant detection performance in 59 genes deemed actionable by the American College of Medical Genetics and Genomics (ACMG) and 5197 clinically relevant mendelian genes. True sensitivity and true specificity could not be calculated due to lack of a criterion reference standard, but were estimated as the proportion of true-positive variants and true-negative variants, respectively, identified by each method in a reference variant set that consisted of all variants judged to be valid from either approach. Results: The prostate cancer cohort included 1072 men (mean [SD] age at diagnosis, 63.7 [7.9] years; 857 [79.9%] with European ancestry) and the melanoma cohort included 1295 patients (mean [SD] age at diagnosis, 59.8 [15.6] years; 488 [37.7%] women; 1060 [81.9%] with European ancestry). The deep learning method identified more patients with pathogenic variants in cancer-predisposition genes than the standard method (prostate cancer: 198 vs 182; melanoma: 93 vs 74); sensitivity (prostate cancer: 94.7% vs 87.1% [difference, 7.6%; 95% CI, 2.2% to 13.1%]; melanoma: 74.4% vs 59.2% [difference, 15.2%; 95% CI, 3.7% to 26.7%]), specificity (prostate cancer: 64.0% vs 36.0% [difference, 28.0%; 95% CI, 1.4% to 54.6%]; melanoma: 63.4% vs 36.6% [difference, 26.8%; 95% CI, 17.6% to 35.9%]), PPV (prostate cancer: 95.7% vs 91.9% [difference, 3.8%; 95% CI, -1.0% to 8.4%]; melanoma: 54.4% vs 35.4% [difference, 19.0%; 95% CI, 9.1% to 28.9%]), and NPV (prostate cancer: 59.3% vs 25.0% [difference, 34.3%; 95% CI, 10.9% to 57.6%]; melanoma: 80.8% vs 60.5% [difference, 20.3%; 95% CI, 10.0% to 30.7%]). For the ACMG genes, the sensitivity of the 2 methods was not significantly different in the prostate cancer cohort (94.9% vs 90.6% [difference, 4.3%; 95% CI, -2.3% to 10.9%]), but the deep learning method had a higher sensitivity in the melanoma cohort (71.6% vs 53.7% [difference, 17.9%; 95% CI, 1.82% to 34.0%]). The deep learning method had higher sensitivity in the mendelian genes (prostate cancer: 99.7% vs 95.1% [difference, 4.6%; 95% CI, 3.0% to 6.3%]; melanoma: 91.7% vs 86.2% [difference, 5.5%; 95% CI, 2.2% to 8.8%]). Conclusions and Relevance: Among a convenience sample of 2 independent cohorts of patients with prostate cancer and melanoma, germline genetic testing using deep learning, compared with the current standard genetic testing method, was associated with higher sensitivity and specificity for detection of pathogenic variants. Further research is needed to understand the relevance of these findings with regard to clinical outcomes.
Authors: Kuan-Lin Huang; R Jay Mashl; Yige Wu; Deborah I Ritter; Jiayin Wang; Clara Oh; Marta Paczkowska; Sheila Reynolds; Matthew A Wyczalkowski; Ninad Oak; Adam D Scott; Michal Krassowski; Andrew D Cherniack; Kathleen E Houlahan; Reyka Jayasinghe; Liang-Bo Wang; Daniel Cui Zhou; Di Liu; Song Cao; Young Won Kim; Amanda Koire; Joshua F McMichael; Vishwanathan Hucthagowder; Tae-Beom Kim; Abigail Hahn; Chen Wang; Michael D McLellan; Fahd Al-Mulla; Kimberly J Johnson; Olivier Lichtarge; Paul C Boutros; Benjamin Raphael; Alexander J Lazar; Wei Zhang; Michael C Wendl; Ramaswamy Govindan; Sanjay Jain; David Wheeler; Shashikant Kulkarni; John F Dipersio; Jüri Reimand; Funda Meric-Bernstam; Ken Chen; Ilya Shmulevich; Sharon E Plon; Feng Chen; Li Ding Journal: Cell Date: 2018-04-05 Impact factor: 41.582
Authors: James T Robinson; Helga Thorvaldsdóttir; Aaron M Wenger; Ahmet Zehir; Jill P Mesirov Journal: Cancer Res Date: 2017-11-01 Impact factor: 12.701
Authors: Ryan Poplin; Pi-Chuan Chang; David Alexander; Scott Schwartz; Thomas Colthurst; Alexander Ku; Dan Newburger; Jojo Dijamco; Nam Nguyen; Pegah T Afshar; Sam S Gross; Lizzie Dorfman; Cory Y McLean; Mark A DePristo Journal: Nat Biotechnol Date: 2018-09-24 Impact factor: 54.908
Authors: Saud H AlDubayan; Marios Giannakis; Nathanael D Moore; G Celine Han; Brendan Reardon; Tsuyoshi Hamada; Xinmeng Jasmine Mu; Reiko Nishihara; Zhirong Qian; Li Liu; Matthew B Yurgelun; Sapna Syngal; Levi A Garraway; Shuji Ogino; Charles S Fuchs; Eliezer M Van Allen Journal: Am J Hum Genet Date: 2018-02-22 Impact factor: 11.025
Authors: Chey Loveday; Clare Turnbull; Emma Ramsay; Deborah Hughes; Elise Ruark; Jessica R Frankum; Georgina Bowden; Bolot Kalmyrzaev; Margaret Warren-Perry; Katie Snape; Julian W Adlard; Julian Barwell; Jonathan Berg; Angela F Brady; Carole Brewer; Glen Brice; Cyril Chapman; Jackie Cook; Rosemarie Davidson; Alan Donaldson; Fiona Douglas; Lynn Greenhalgh; Alex Henderson; Louise Izatt; Ajith Kumar; Fiona Lalloo; Zosia Miedzybrodzka; Patrick J Morrison; Joan Paterson; Mary Porteous; Mark T Rogers; Susan Shanley; Lisa Walker; Diana Eccles; D Gareth Evans; Anthony Renwick; Sheila Seal; Christopher J Lord; Alan Ashworth; Jorge S Reis-Filho; Antonis C Antoniou; Nazneen Rahman Journal: Nat Genet Date: 2011-08-07 Impact factor: 38.330
Authors: Yaron Gurovich; Yair Hanani; Omri Bar; Guy Nadav; Nicole Fleischer; Dekel Gelbman; Lina Basel-Salmon; Peter M Krawitz; Susanne B Kamphausen; Martin Zenker; Lynne M Bird; Karen W Gripp Journal: Nat Med Date: 2019-01-07 Impact factor: 53.440
Authors: Birke Bausch; Francesca Schiavi; Ying Ni; Jenny Welander; Attila Patocs; Joanne Ngeow; Ulrich Wellner; Angelica Malinoc; Elisa Taschin; Giovanni Barbon; Virginia Lanza; Peter Söderkvist; Adam Stenman; Catharina Larsson; Fredrika Svahn; Jin-Lian Chen; Jessica Marquard; Merav Fraenkel; Martin A Walter; Mariola Peczkowska; Aleksander Prejbisz; Barbara Jarzab; Kornelia Hasse-Lazar; Stephan Petersenn; Lars C Moeller; Almuth Meyer; Nicole Reisch; Arnold Trupka; Christoph Brase; Matthias Galiano; Simon F Preuss; Pingling Kwok; Nikoletta Lendvai; Gani Berisha; Özer Makay; Carsten C Boedeker; Georges Weryha; Karoly Racz; Andrzej Januszewicz; Martin K Walz; Oliver Gimm; Giuseppe Opocher; Charis Eng; Hartmut P H Neumann Journal: JAMA Oncol Date: 2017-09-01 Impact factor: 31.777
Authors: Monkol Lek; Konrad J Karczewski; Eric V Minikel; Kaitlin E Samocha; Eric Banks; Timothy Fennell; Anne H O'Donnell-Luria; James S Ware; Andrew J Hill; Beryl B Cummings; Taru Tukiainen; Daniel P Birnbaum; Jack A Kosmicki; Laramie E Duncan; Karol Estrada; Fengmei Zhao; James Zou; Emma Pierce-Hoffman; Joanne Berghout; David N Cooper; Nicole Deflaux; Mark DePristo; Ron Do; Jason Flannick; Menachem Fromer; Laura Gauthier; Jackie Goldstein; Namrata Gupta; Daniel Howrigan; Adam Kiezun; Mitja I Kurki; Ami Levy Moonshine; Pradeep Natarajan; Lorena Orozco; Gina M Peloso; Ryan Poplin; Manuel A Rivas; Valentin Ruano-Rubio; Samuel A Rose; Douglas M Ruderfer; Khalid Shakir; Peter D Stenson; Christine Stevens; Brett P Thomas; Grace Tiao; Maria T Tusie-Luna; Ben Weisburd; Hong-Hee Won; Dongmei Yu; David M Altshuler; Diego Ardissino; Michael Boehnke; John Danesh; Stacey Donnelly; Roberto Elosua; Jose C Florez; Stacey B Gabriel; Gad Getz; Stephen J Glatt; Christina M Hultman; Sekar Kathiresan; Markku Laakso; Steven McCarroll; Mark I McCarthy; Dermot McGovern; Ruth McPherson; Benjamin M Neale; Aarno Palotie; Shaun M Purcell; Danish Saleheen; Jeremiah M Scharf; Pamela Sklar; Patrick F Sullivan; Jaakko Tuomilehto; Ming T Tsuang; Hugh C Watkins; James G Wilson; Mark J Daly; Daniel G MacArthur Journal: Nature Date: 2016-08-18 Impact factor: 49.962
Authors: Erica K Barnell; Peter Ronning; Katie M Campbell; Kilannin Krysiak; Benjamin J Ainscough; Lana M Sheta; Shahil P Pema; Alina D Schmidt; Megan Richters; Kelsy C Cotto; Arpad M Danos; Cody Ramirez; Zachary L Skidmore; Nicholas C Spies; Jasreet Hundal; Malik S Sediqzad; Jason Kunisaki; Felicia Gomez; Lee Trani; Matthew Matlock; Alex H Wagner; S Joshua Swamidass; Malachi Griffith; Obi L Griffith Journal: Genet Med Date: 2018-10-05 Impact factor: 8.822
Authors: Jacob E Berchuck; Daniel Boiarsky; Rebecca Silver; Rajitha Sunkara; Heather M McClure; Harrison K Tsai; Stephanie Siegmund; Alok K Tewari; Jonathan A Nowak; Neal I Lindeman; Huma Q Rana; Atish D Choudhury; Mark M Pomerantz; Matthew L Freedman; Eliezer M Van Allen; Mary-Ellen Taplin Journal: JCO Precis Oncol Date: 2022-08
Authors: Qianqian Zhu; Jie Wang; Han Yu; Qiang Hu; Nicholas W Bateman; Mark Long; Spencer Rosario; Emily Schultz; Clifton L Dalgard; Matthew D Wilkerson; Gauthaman Sukumar; Ruea-Yea Huang; Jasmine Kaur; Shashikant B Lele; Emese Zsiros; Jeannine Villella; Amit Lugade; Kirsten Moysich; Thomas P Conrads; George L Maxwell; Kunle Odunsi Journal: Cancers (Basel) Date: 2022-05-10 Impact factor: 6.575
Authors: Riaz Gillani; Sabrina Y Camp; Seunghun Han; Jill K Jones; Hoyin Chu; Schuyler O'Brien; Erin L Young; Lucy Hayes; Gareth Mitchell; Trent Fowler; Alexander Gusev; Junne Kamihara; Katherine A Janeway; Joshua D Schiffman; Brian D Crompton; Saud H AlDubayan; Eliezer M Van Allen Journal: Am J Hum Genet Date: 2022-05-04 Impact factor: 11.043
Authors: Nahed Jalloul; Israel Gomy; Samantha Stokes; Alexander Gusev; Bruce E Johnson; Neal I Lindeman; Laura Macconaill; Shridar Ganesan; Judy E Garber; Hossein Khiabanian Journal: JCO Precis Oncol Date: 2021-11-17
Authors: Jett Crowdis; Sara Balch; Lauren Sterlin; Beena S Thomas; Sabrina Y Camp; Michael Dunphy; Elana Anastasio; Shahrayz Shah; Alyssa L Damon; Rafael Ramos; Delia M Sosa; Ilan K Small; Brett N Tomson; Colleen M Nguyen; Mary McGillicuddy; Parker S Chastain; Meng Xiao He; Alexander T M Cheung; Stephanie Wankowicz; Alok K Tewari; Dewey Kim; Saud H AlDubayan; Ayanah Dowdye; Benjamin Zola; Joel Nowak; Jan Manarite; Idola Henry Gunn; Bryce Olson; Eric S Lander; Corrie A Painter; Nikhil Wagle; Eliezer M Van Allen Journal: Cell Genom Date: 2022-08-19