Yi-Ting Hsieh1, Lee-Ming Chuang2, Yi-Der Jiang3, Tien-Jyun Chang3, Chung-May Yang4, Chang-Hao Yang4, Li-Wei Chan5, Tzu-Yun Kao6, Ta-Ching Chen7, Hsuan-Chieh Lin8, Chin-Han Tsai9, Mingke Chen9. 1. Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan. Electronic address: ythyth@gmail.com. 2. Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan; College of Medicine, National Taiwan University, Taipei, Taiwan. 3. Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan. 4. Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan; College of Medicine, National Taiwan University, Taipei, Taiwan. 5. Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan; Department of Ophthalmology, Taipei Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, New Taipei, Taiwan. 6. Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan; Department of Ophthalmology, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan. 7. Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan. 8. Department of Ophthalmology, National Taiwan University Hospital, Hsinchu Branch, Hsinchu, Taiwan. 9. Acer Inc., New Taipei, Taiwan.
Abstract
PURPOSE: To develop a deep learning image assessment software VeriSee™ and to validate its accuracy in grading the severity of diabetic retinopathy (DR). METHODS: Diabetic patients who underwent single-field, nonmydriatic, 45-degree color retinal fundus photography at National Taiwan University Hospital between July 2007 and June 2017 were retrospectively recruited. A total of 7524 judgeable color fundus images were collected and were graded for the severity of DR by ophthalmologists. Among these pictures, 5649 along with another 31,612 color fundus images from the EyePACS dataset were used for model training of VeriSee™. The other 1875 images were used for validation and were graded for the severity of DR by VeriSee™, ophthalmologists, and internal physicians. Area under the receiver operating characteristic curve (AUC) for VeriSee™, and the sensitivities and specificities for VeriSee™, ophthalmologists, and internal physicians in diagnosing DR were calculated. RESULTS: The AUCs for VeriSee™ in diagnosing any DR, referable DR and proliferative diabetic retinopathy (PDR) were 0.955, 0.955 and 0.984, respectively. VeriSee™ had better sensitivities in diagnosing any DR and PDR (92.2% and 90.9%, respectively) than internal physicians (64.3% and 20.6%, respectively) (P < 0.001 for both). VeriSee™ also had better sensitivities in diagnosing any DR and referable DR (92.2% and 89.2%, respectively) than ophthalmologists (86.9% and 71.1%, respectively) (P < 0.001 for both), while ophthalmologists had better specificities. CONCLUSION: VeriSee™ had good sensitivity and specificity in grading the severity of DR from color fundus images. It may offer clinical assistance to non-ophthalmologists in DR screening with nonmydriatic retinal fundus photography.
PURPOSE: To develop a deep learning image assessment software VeriSee™ and to validate its accuracy in grading the severity of diabetic retinopathy (DR). METHODS:Diabeticpatients who underwent single-field, nonmydriatic, 45-degree color retinal fundus photography at National Taiwan University Hospital between July 2007 and June 2017 were retrospectively recruited. A total of 7524 judgeable color fundus images were collected and were graded for the severity of DR by ophthalmologists. Among these pictures, 5649 along with another 31,612 color fundus images from the EyePACS dataset were used for model training of VeriSee™. The other 1875 images were used for validation and were graded for the severity of DR by VeriSee™, ophthalmologists, and internal physicians. Area under the receiver operating characteristic curve (AUC) for VeriSee™, and the sensitivities and specificities for VeriSee™, ophthalmologists, and internal physicians in diagnosing DR were calculated. RESULTS: The AUCs for VeriSee™ in diagnosing any DR, referable DR and proliferative diabetic retinopathy (PDR) were 0.955, 0.955 and 0.984, respectively. VeriSee™ had better sensitivities in diagnosing any DR and PDR (92.2% and 90.9%, respectively) than internal physicians (64.3% and 20.6%, respectively) (P < 0.001 for both). VeriSee™ also had better sensitivities in diagnosing any DR and referable DR (92.2% and 89.2%, respectively) than ophthalmologists (86.9% and 71.1%, respectively) (P < 0.001 for both), while ophthalmologists had better specificities. CONCLUSION: VeriSee™ had good sensitivity and specificity in grading the severity of DR from color fundus images. It may offer clinical assistance to non-ophthalmologists in DR screening with nonmydriatic retinal fundus photography.