Rony Gelman1, Carlos Fernandez-Granda1,2. 1. Courant Institute of Mathematical Sciences, New York University, New York, New York; and. 2. Center for Data Science, New York University, New York, New York.
Abstract
PURPOSE: To analyze the effect of transfer learning for classification of diabetic retinopathy (DR) by fundus photography and select retinal diseases by spectral domain optical coherence tomography (SD-OCT). METHODS: Five widely used open-source deep neural networks and four customized simpler and smaller networks, termed the CBR family, were trained and evaluated on two tasks: 1) classification of DR using fundus photography and 2) classification of drusen, choroidal neovascularization, and diabetic macular edema using SD-OCT. For DR classification, the quadratic weighted Kappa coefficient was used to measure the level of agreement between each network and ground truth-labeled test cases. For SD-OCT-based classification, accuracy was calculated for each network. Kappa and accuracy were compared between iterations with and without use of transfer learning for each network to assess for its effect. RESULTS: For DR classification, Kappa increased with transfer learning for all networks (range of increase 0.152-0.556). For SD-OCT-based classification, accuracy increased for four of five open-source deep neural networks (range of increase 1.8%-3.5%), slightly decreased for the remaining deep neural network (-0.6%), decreased slightly for three of four CBR networks (range of decrease 0.9%-1.8%), and decreased by 9.6% for the remaining CBR network. CONCLUSION: Transfer learning improved performance, as measured by Kappa, for DR classification for all networks, although the effect ranged from small to substantial. Transfer learning had minimal effect on accuracy for SD-OCT-based classification for eight of the nine networks analyzed. These results imply that transfer learning may substantially increase performance for DR classification but may have minimal effect for SD-OCT-based classification.
PURPOSE: To analyze the effect of transfer learning for classification of diabetic retinopathy (DR) by fundus photography and select retinal diseases by spectral domain optical coherence tomography (SD-OCT). METHODS: Five widely used open-source deep neural networks and four customized simpler and smaller networks, termed the CBR family, were trained and evaluated on two tasks: 1) classification of DR using fundus photography and 2) classification of drusen, choroidal neovascularization, and diabetic macular edema using SD-OCT. For DR classification, the quadratic weighted Kappa coefficient was used to measure the level of agreement between each network and ground truth-labeled test cases. For SD-OCT-based classification, accuracy was calculated for each network. Kappa and accuracy were compared between iterations with and without use of transfer learning for each network to assess for its effect. RESULTS: For DR classification, Kappa increased with transfer learning for all networks (range of increase 0.152-0.556). For SD-OCT-based classification, accuracy increased for four of five open-source deep neural networks (range of increase 1.8%-3.5%), slightly decreased for the remaining deep neural network (-0.6%), decreased slightly for three of four CBR networks (range of decrease 0.9%-1.8%), and decreased by 9.6% for the remaining CBR network. CONCLUSION: Transfer learning improved performance, as measured by Kappa, for DR classification for all networks, although the effect ranged from small to substantial. Transfer learning had minimal effect on accuracy for SD-OCT-based classification for eight of the nine networks analyzed. These results imply that transfer learning may substantially increase performance for DR classification but may have minimal effect for SD-OCT-based classification.
Authors: Daniel Shu Wei Ting; Carol Yim-Lui Cheung; Gilbert Lim; Gavin Siew Wei Tan; Nguyen D Quang; Alfred Gan; Haslina Hamzah; Renata Garcia-Franco; Ian Yew San Yeo; Shu Yen Lee; Edmund Yick Mun Wong; Charumathi Sabanayagam; Mani Baskaran; Farah Ibrahim; Ngiap Chuan Tan; Eric A Finkelstein; Ecosse L Lamoureux; Ian Y Wong; Neil M Bressler; Sobha Sivaprasad; Rohit Varma; Jost B Jonas; Ming Guang He; Ching-Yu Cheng; Gemmy Chui Ming Cheung; Tin Aung; Wynne Hsu; Mong Li Lee; Tien Yin Wong Journal: JAMA Date: 2017-12-12 Impact factor: 56.272
Authors: Daniel S Kermany; Michael Goldbaum; Wenjia Cai; Carolina C S Valentim; Huiying Liang; Sally L Baxter; Alex McKeown; Ge Yang; Xiaokang Wu; Fangbing Yan; Justin Dong; Made K Prasadha; Jacqueline Pei; Magdalene Y L Ting; Jie Zhu; Christina Li; Sierra Hewett; Jason Dong; Ian Ziyar; Alexander Shi; Runze Zhang; Lianghong Zheng; Rui Hou; William Shi; Xin Fu; Yaou Duan; Viet A N Huu; Cindy Wen; Edward D Zhang; Charlotte L Zhang; Oulan Li; Xiaobo Wang; Michael A Singer; Xiaodong Sun; Jie Xu; Ali Tafreshi; M Anthony Lewis; Huimin Xia; Kang Zhang Journal: Cell Date: 2018-02-22 Impact factor: 41.582
Authors: Michael David Abràmoff; Yiyue Lou; Ali Erginay; Warren Clarida; Ryan Amelon; James C Folk; Meindert Niemeijer Journal: Invest Ophthalmol Vis Sci Date: 2016-10-01 Impact factor: 4.799
Authors: Stuart Keel; Pei Ying Lee; Jane Scheetz; Zhixi Li; Mark A Kotowicz; Richard J MacIsaac; Mingguang He Journal: Sci Rep Date: 2018-03-12 Impact factor: 4.379