Nova F Smedley1,2,3, Suzie El-Saden1,2, William Hsu1,2,3,4. 1. Medical & Imaging Informatics. 2. Department of Radiological Sciences. 3. Department of Bioengineering. 4. Bioinformatics IDP, University of California Los Angeles, Los Angeles, CA 90024, USA.
Abstract
MOTIVATION: Cancer heterogeneity is observed at multiple biological levels. To improve our understanding of these differences and their relevance in medicine, approaches to link organ- and tissue-level information from diagnostic images and cellular-level information from genomics are needed. However, these 'radiogenomic' studies often use linear or shallow models, depend on feature selection, or consider one gene at a time to map images to genes. Moreover, no study has systematically attempted to understand the molecular basis of imaging traits based on the interpretation of what the neural network has learned. These studies are thus limited in their ability to understand the transcriptomic drivers of imaging traits, which could provide additional context for determining clinical outcomes. RESULTS: We present a neural network-based approach that takes high-dimensional gene expression data as input and performs non-linear mapping to an imaging trait. To interpret the models, we propose gene masking and gene saliency to extract learned relationships from radiogenomic neural networks. In glioblastoma patients, our models outperformed comparable classifiers (>0.10 AUC) and our interpretation methods were validated using a similar model to identify known relationships between genes and molecular subtypes. We found that tumor imaging traits had specific transcription patterns, e.g. edema and genes related to cellular invasion, and 10 radiogenomic traits were significantly predictive of survival. We demonstrate that neural networks can model transcriptomic heterogeneity to reflect differences in imaging and can be used to derive radiogenomic traits with clinical value. AVAILABILITY AND IMPLEMENTATION: https://github.com/novasmedley/deepRadiogenomics. CONTACT: whsu@mednet.ucla.edu. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
MOTIVATION: Cancer heterogeneity is observed at multiple biological levels. To improve our understanding of these differences and their relevance in medicine, approaches to link organ- and tissue-level information from diagnostic images and cellular-level information from genomics are needed. However, these 'radiogenomic' studies often use linear or shallow models, depend on feature selection, or consider one gene at a time to map images to genes. Moreover, no study has systematically attempted to understand the molecular basis of imaging traits based on the interpretation of what the neural network has learned. These studies are thus limited in their ability to understand the transcriptomic drivers of imaging traits, which could provide additional context for determining clinical outcomes. RESULTS: We present a neural network-based approach that takes high-dimensional gene expression data as input and performs non-linear mapping to an imaging trait. To interpret the models, we propose gene masking and gene saliency to extract learned relationships from radiogenomic neural networks. In glioblastomapatients, our models outperformed comparable classifiers (>0.10 AUC) and our interpretation methods were validated using a similar model to identify known relationships between genes and molecular subtypes. We found that tumor imaging traits had specific transcription patterns, e.g. edema and genes related to cellular invasion, and 10 radiogenomic traits were significantly predictive of survival. We demonstrate that neural networks can model transcriptomic heterogeneity to reflect differences in imaging and can be used to derive radiogenomic traits with clinical value. AVAILABILITY AND IMPLEMENTATION: https://github.com/novasmedley/deepRadiogenomics. CONTACT: whsu@mednet.ucla.edu. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Authors: Philipp Kickingereder; David Bonekamp; Martha Nowosielski; Annekathrin Kratz; Martin Sill; Sina Burth; Antje Wick; Oliver Eidel; Heinz-Peter Schlemmer; Alexander Radbruch; Jürgen Debus; Christel Herold-Mende; Andreas Unterberg; David Jones; Stefan Pfister; Wolfgang Wick; Andreas von Deimling; Martin Bendszus; David Capper Journal: Radiology Date: 2016-09-16 Impact factor: 11.105
Authors: Aravind Subramanian; Pablo Tamayo; Vamsi K Mootha; Sayan Mukherjee; Benjamin L Ebert; Michael A Gillette; Amanda Paulovich; Scott L Pomeroy; Todd R Golub; Eric S Lander; Jill P Mesirov Journal: Proc Natl Acad Sci U S A Date: 2005-09-30 Impact factor: 11.205
Authors: Roel G W Verhaak; Katherine A Hoadley; Elizabeth Purdom; Victoria Wang; Yuan Qi; Matthew D Wilkerson; C Ryan Miller; Li Ding; Todd Golub; Jill P Mesirov; Gabriele Alexe; Michael Lawrence; Michael O'Kelly; Pablo Tamayo; Barbara A Weir; Stacey Gabriel; Wendy Winckler; Supriya Gupta; Lakshmi Jakkula; Heidi S Feiler; J Graeme Hodgson; C David James; Jann N Sarkaria; Cameron Brennan; Ari Kahn; Paul T Spellman; Richard K Wilson; Terence P Speed; Joe W Gray; Matthew Meyerson; Gad Getz; Charles M Perou; D Neil Hayes Journal: Cancer Cell Date: 2010-01-19 Impact factor: 31.743
Authors: Whitney B Pope; Jenny H Chen; Jun Dong; Marc R J Carlson; Alla Perlina; Timothy F Cloughesy; Linda M Liau; Paul S Mischel; Phioanh Nghiemphu; Albert Lai; Stanley F Nelson Journal: Radiology Date: 2008-10 Impact factor: 11.105
Authors: David A Gutman; Lee A D Cooper; Scott N Hwang; Chad A Holder; Jingjing Gao; Tarun D Aurora; William D Dunn; Lisa Scarpace; Tom Mikkelsen; Rajan Jain; Max Wintermark; Manal Jilwan; Prashant Raghavan; Erich Huang; Robert J Clifford; Pattanasak Mongkolwat; Vladimir Kleper; John Freymann; Justin Kirby; Pascal O Zinn; Carlos S Moreno; Carl Jaffe; Rivka Colen; Daniel L Rubin; Joel Saltz; Adam Flanders; Daniel J Brat Journal: Radiology Date: 2013-02-07 Impact factor: 11.105
Authors: D Williams Parsons; Siân Jones; Xiaosong Zhang; Jimmy Cheng-Ho Lin; Rebecca J Leary; Philipp Angenendt; Parminder Mankoo; Hannah Carter; I-Mei Siu; Gary L Gallia; Alessandro Olivi; Roger McLendon; B Ahmed Rasheed; Stephen Keir; Tatiana Nikolskaya; Yuri Nikolsky; Dana A Busam; Hanna Tekleab; Luis A Diaz; James Hartigan; Doug R Smith; Robert L Strausberg; Suely Kazue Nagahashi Marie; Sueli Mieko Oba Shinjo; Hai Yan; Gregory J Riggins; Darell D Bigner; Rachel Karchin; Nick Papadopoulos; Giovanni Parmigiani; Bert Vogelstein; Victor E Velculescu; Kenneth W Kinzler Journal: Science Date: 2008-09-04 Impact factor: 47.728
Authors: Wentian Guo; Hui Li; Yitan Zhu; Li Lan; Shengjie Yang; Karen Drukker; Elizabeth Morris; Elizabeth Burnside; Gary Whitman; Maryellen L Giger; Yuan Ji Journal: J Med Imaging (Bellingham) Date: 2015-09-23
Authors: Pascal O Zinn; Bhanu Mahajan; Bhanu Majadan; Pratheesh Sathyan; Sanjay K Singh; Sadhan Majumder; Ferenc A Jolesz; Rivka R Colen Journal: PLoS One Date: 2011-10-05 Impact factor: 3.240
Authors: Spyros Darmanis; Steven A Sloan; Ye Zhang; Martin Enge; Christine Caneda; Lawrence M Shuer; Melanie G Hayden Gephart; Ben A Barres; Stephen R Quake Journal: Proc Natl Acad Sci U S A Date: 2015-05-18 Impact factor: 11.205
Authors: Felix Corr; Dustin Grimm; Benjamin Saß; Mirza Pojskić; Jörg W Bartsch; Barbara Carl; Christopher Nimsky; Miriam H A Bopp Journal: J Pers Med Date: 2022-03-04