Naweed I Chowdhury1, Timothy L Smith2, Rakesh K Chandra1, Justin H Turner1. 1. Vanderbilt University School of Medicine, Otolaryngology-Head & Neck Surgery, Nashville, TN. 2. Oregon Health & Science University, Department of Otolaryngology-Head & Neck Surgery, Portland, OR.
Abstract
BACKGROUND: Convolutional neural networks (CNNs) are advanced artificial intelligence algorithms well suited to image classification tasks with variable features. These have been used to great effect in various real-world applications including handwriting recognition, face detection, image search, and fraud prevention. We sought to retrain a robust CNN with coronal computed tomography (CT) images to classify osteomeatal complex (OMC) occlusion and assess the performance of this technology with rhinologic data. METHODS: The Google Inception-V3 CNN trained with 1.28 million images was used as the base model. Preoperative coronal sections through the OMC were obtained from 239 patients enrolled in 2 prospective chronic rhinosinusitis (CRS) outcomes studies, labeled according to OMC status, and mirrored to obtain a set of 956 images. Using this data, the classification layer of Inception-V3 was retrained in Python using a transfer learning method to adapt the CNN to the task of interpreting sinonasal CT images. RESULTS: The retrained neural network achieved 85% classification accuracy for OMC occlusion, with a 95% confidence interval for algorithm accuracy of 78% to 92%. Receiver operating characteristic (ROC) curve analysis on the test set confirmed good classification ability of the CNN with an area under the ROC curve (AUC) of 0.87, significantly different than both random guessing and a dominant classifier that predicts the most common class (p < 0.0001). CONCLUSION: Current state-of-the-art CNNs may be able to learn clinically relevant information from 2-dimensional sinonasal CT images with minimal supervision. Future work will extend this approach to 3-dimensional images in order to further refine this technology for possible clinical applications.
BACKGROUND: Convolutional neural networks (CNNs) are advanced artificial intelligence algorithms well suited to image classification tasks with variable features. These have been used to great effect in various real-world applications including handwriting recognition, face detection, image search, and fraud prevention. We sought to retrain a robust CNN with coronal computed tomography (CT) images to classify osteomeatal complex (OMC) occlusion and assess the performance of this technology with rhinologic data. METHODS: The Google Inception-V3 CNN trained with 1.28 million images was used as the base model. Preoperative coronal sections through the OMC were obtained from 239 patients enrolled in 2 prospective chronic rhinosinusitis (CRS) outcomes studies, labeled according to OMC status, and mirrored to obtain a set of 956 images. Using this data, the classification layer of Inception-V3 was retrained in Python using a transfer learning method to adapt the CNN to the task of interpreting sinonasal CT images. RESULTS: The retrained neural network achieved 85% classification accuracy for OMC occlusion, with a 95% confidence interval for algorithm accuracy of 78% to 92%. Receiver operating characteristic (ROC) curve analysis on the test set confirmed good classification ability of the CNN with an area under the ROC curve (AUC) of 0.87, significantly different than both random guessing and a dominant classifier that predicts the most common class (p < 0.0001). CONCLUSION: Current state-of-the-art CNNs may be able to learn clinically relevant information from 2-dimensional sinonasal CT images with minimal supervision. Future work will extend this approach to 3-dimensional images in order to further refine this technology for possible clinical applications.
Authors: Richard R Orlandi; Todd T Kingdom; Peter H Hwang; Timothy L Smith; Jeremiah A Alt; Fuad M Baroody; Pete S Batra; Manuel Bernal-Sprekelsen; Neil Bhattacharyya; Rakesh K Chandra; Alexander Chiu; Martin J Citardi; Noam A Cohen; John DelGaudio; Martin Desrosiers; Hun-Jong Dhong; Richard Douglas; Berrylin Ferguson; Wytske J Fokkens; Christos Georgalas; Andrew Goldberg; Jan Gosepath; Daniel L Hamilos; Joseph K Han; Richard Harvey; Peter Hellings; Claire Hopkins; Roger Jankowski; Amin R Javer; Robert Kern; Stilianos Kountakis; Marek L Kowalski; Andrew Lane; Donald C Lanza; Richard Lebowitz; Heung-Man Lee; Sandra Y Lin; Valerie Lund; Amber Luong; Wolf Mann; Bradley F Marple; Kevin C McMains; Ralph Metson; Robert Naclerio; Jayakar V Nayak; Nobuyoshi Otori; James N Palmer; Sanjay R Parikh; Desiderio Passali; Anju Peters; Jay Piccirillo; David M Poetker; Alkis J Psaltis; Hassan H Ramadan; Vijay R Ramakrishnan; Herbert Riechelmann; Hwan-Jung Roh; Luke Rudmik; Raymond Sacks; Rodney J Schlosser; Brent A Senior; Raj Sindwani; James A Stankiewicz; Michael Stewart; Bruce K Tan; Elina Toskala; Richard Voegels; De Yun Wang; Erik K Weitzel; Sarah Wise; Bradford A Woodworth; Peter-John Wormald; Erin D Wright; Bing Zhou; David W Kennedy Journal: Int Forum Allergy Rhinol Date: 2016-02 Impact factor: 3.858
Authors: Zachary M Soler; John F Pallanch; Eugene Ritter Sansoni; Cameron S Jones; Lauren A Lawrence; Rodney J Schlosser; Jess C Mace; Timothy L Smith Journal: Int Forum Allergy Rhinol Date: 2015-05-26 Impact factor: 3.858
Authors: Martin Halicek; Guolan Lu; James V Little; Xu Wang; Mihir Patel; Christopher C Griffith; Mark W El-Deiry; Amy Y Chen; Baowei Fei Journal: J Biomed Opt Date: 2017-06-01 Impact factor: 3.170
Authors: Antonio Mario Bulfamante; Francesco Ferella; Austin Michael Miller; Cecilia Rosso; Carlotta Pipolo; Emanuela Fuccillo; Giovanni Felisati; Alberto Maria Saibene Journal: Eur Arch Otorhinolaryngol Date: 2022-10-19 Impact factor: 3.236
Authors: Meredith A Jones; William M MacCuaig; Alex N Frickenstein; Seda Camalan; Metin N Gurcan; Jennifer Holter-Chakrabarty; Katherine T Morris; Molly W McNally; Kristina K Booth; Steven Carter; William E Grizzle; Lacey R McNally Journal: Biomedicines Date: 2021-02-04