Zebin Wu1,2, Zheqi Lin3, Lan Li2, Hongguang Pan2, Guowei Chen2, Yuqing Fu2, Qianhui Qiu1. 1. Department of Otolaryngology, Zhujiang Hospital, Southern Medical University, Guangzhou, China. 2. Department of Otolaryngology, Shenzhen Children's Hospital, Shenzhen, China. 3. Department of R&D, Shenzhen Accurate Technology Co., Ltd, Shenzhen, China.
Abstract
OBJECTIVES/HYPOTHESIS: To create a new strategy for monitoring pediatric otitis media (OM), we developed a brief, reliable, and objective method for automated classification using convolutional neural networks (CNNs) with images from otoscope. STUDY DESIGN: Prospective study. METHODS: An otoscopic image classifier for pediatric OM was built upon the idea of deep learning and transfer learning using the two most widely used CNN architectures named Xception and MobileNet-V2. Otoscopic images, including acute otitis media (AOM), otitis media with effusion (OME), and normal ears were obtained from our institution. Among qualified otoendoscopic images, 10,703 images were used for training, and 1,500 images were used for testing. In addition, 102 images captured by smartphone with WI-FI connected otoscope were used as a prospective test set to evaluate the model for home screening and monitoring. RESULTS: For all diagnoses combined in the test set, the Xception model and the MobileNet-V2 model had similar overall accuracies of 97.45% (95% CI 96.81%-97.94%) and 95.72% (95% CI 95.12%-96.16%). The overall accuracies of two models with smartphone images were 90.66% (95% CI 90.21%-90.98%) and 88.56% (95% CI 87.86%-90.05%). The class activation map results showed that the extracted features of smartphone images were the same as those of otoendoscopic images. CONCLUSIONS: We have developed deep learning algorithms for the successfully automated classification of pediatric AOM and OME with otoscopic images. With a smartphone-enabled wireless otoscope, artificial intelligence may assist parents in early detection and continuous monitoring at home to decrease the visit frequencies. LEVEL OF EVIDENCE: NA Laryngoscope, 131:E2344-E2351, 2021.
OBJECTIVES/HYPOTHESIS: To create a new strategy for monitoring pediatric otitis media (OM), we developed a brief, reliable, and objective method for automated classification using convolutional neural networks (CNNs) with images from otoscope. STUDY DESIGN: Prospective study. METHODS: An otoscopic image classifier for pediatric OM was built upon the idea of deep learning and transfer learning using the two most widely used CNN architectures named Xception and MobileNet-V2. Otoscopic images, including acute otitis media (AOM), otitis media with effusion (OME), and normal ears were obtained from our institution. Among qualified otoendoscopic images, 10,703 images were used for training, and 1,500 images were used for testing. In addition, 102 images captured by smartphone with WI-FI connected otoscope were used as a prospective test set to evaluate the model for home screening and monitoring. RESULTS: For all diagnoses combined in the test set, the Xception model and the MobileNet-V2 model had similar overall accuracies of 97.45% (95% CI 96.81%-97.94%) and 95.72% (95% CI 95.12%-96.16%). The overall accuracies of two models with smartphone images were 90.66% (95% CI 90.21%-90.98%) and 88.56% (95% CI 87.86%-90.05%). The class activation map results showed that the extracted features of smartphone images were the same as those of otoendoscopic images. CONCLUSIONS: We have developed deep learning algorithms for the successfully automated classification of pediatric AOM and OME with otoscopic images. With a smartphone-enabled wireless otoscope, artificial intelligence may assist parents in early detection and continuous monitoring at home to decrease the visit frequencies. LEVEL OF EVIDENCE: NA Laryngoscope, 131:E2344-E2351, 2021.