Kentaro Nakagawa1, Ryu Ishihara1, Kazuharu Aoyama2, Masayasu Ohmori1, Hiroko Nakahira1, Noriko Matsuura1, Satoki Shichijo1, Tsutomu Nishida3, Takuya Yamada4, Shinjiro Yamaguchi5, Hideharu Ogiyama6, Satoshi Egawa7, Osamu Kishida8, Tomohiro Tada9. 1. Department of Gastrointestinal Oncology, Osaka International Cancer Institute, Osaka, Japan. 2. AI Medical Service Inc., Tokyo, Japan. 3. Department of Gastroenterology, Toyonaka Municipal Hospital, Osaka, Japan. 4. Department of Gastroenterology, Osaka Rosai Hospital, Osaka, Japan. 5. Department of Gastroenterology, Kansai Rosai Hospital, Hyogo, Japan. 6. Department of Gastroenterology, Itami City Hospital, Hyogo, Japan. 7. Department of Gastroenterology, Osaka Police Hospital, Osaka, Japan. 8. Department of Gastroenterology, Sumitomo Hospital, Osaka, Japan. 9. AI Medical Service Inc., Tokyo, Japan; Tada Tomohiro Institute of Gastroenterology and Proctology, Saitama, Japan; Department of Surgical Oncology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Abstract
BACKGROUND AND AIMS: Cancer invasion depth is a critical factor affecting the choice of treatment in patients with superficial squamous cell carcinoma (SCC). However, the diagnosis of invasion depth is currently subjective and liable to interobserver variability. METHODS: We developed a deep learning-based artificial intelligence (AI) system based on Single Shot MultiBox Detector architecture for the assessment of superficial esophageal SCC. We obtained endoscopic images from patients with superficial esophageal SCC at our facility between December 2005 and December 2016. RESULTS: After excluding poor-quality images, 8660 non-magnified endoscopic (non-ME) and 5678 ME images from 804 superficial esophageal SCCs with pathologic proof of cancer invasion depth were used as the training dataset, and 405 non-ME images and 509 ME images from 155 patients were selected for the validation set. Our system showed a sensitivity of 90.1%, specificity of 95.8%, positive predictive value of 99.2%, negative predictive value of 63.9%, and an accuracy of 91.0% for differentiating pathologic mucosal and submucosal microinvasive (SM1) cancers from submucosal deep invasive (SM2/3) cancers. Cancer invasion depth was diagnosed by 16 experienced endoscopists using the same validation set, with an overall sensitivity of 89.8%, specificity of 88.3%, positive predictive value of 97.9%, negative predictive value of 65.5%, and an accuracy of 89.6%. CONCLUSIONS: This newly developed AI system showed favorable performance for diagnosing invasion depth in patients with superficial esophageal SCC, with comparable performance to experienced endoscopists.
BACKGROUND AND AIMS: Cancer invasion depth is a critical factor affecting the choice of treatment in patients with superficial squamous cell carcinoma (SCC). However, the diagnosis of invasion depth is currently subjective and liable to interobserver variability. METHODS: We developed a deep learning-based artificial intelligence (AI) system based on Single Shot MultiBox Detector architecture for the assessment of superficial esophageal SCC. We obtained endoscopic images from patients with superficial esophageal SCC at our facility between December 2005 and December 2016. RESULTS: After excluding poor-quality images, 8660 non-magnified endoscopic (non-ME) and 5678 ME images from 804 superficial esophageal SCCs with pathologic proof of cancer invasion depth were used as the training dataset, and 405 non-ME images and 509 ME images from 155 patients were selected for the validation set. Our system showed a sensitivity of 90.1%, specificity of 95.8%, positive predictive value of 99.2%, negative predictive value of 63.9%, and an accuracy of 91.0% for differentiating pathologic mucosal and submucosal microinvasive (SM1) cancers from submucosal deep invasive (SM2/3) cancers. Cancer invasion depth was diagnosed by 16 experienced endoscopists using the same validation set, with an overall sensitivity of 89.8%, specificity of 88.3%, positive predictive value of 97.9%, negative predictive value of 65.5%, and an accuracy of 89.6%. CONCLUSIONS: This newly developed AI system showed favorable performance for diagnosing invasion depth in patients with superficial esophageal SCC, with comparable performance to experienced endoscopists.