Chia-Hung Chen1, Yan-Wei Lee2, Yao-Sian Huang2, Wei-Ren Lan2, Ruey-Feng Chang3, Chih-Yen Tu4, Chih-Yu Chen5, Wei-Chih Liao6. 1. Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, China Medical University Hospital, Taiwan; School of Medicine, China Medical University, Taiwan; Graduate Institute of Clinical Medical Science, China Medical University, Taiwan. 2. Department of Computer Science and Information Engineering, National Taiwan University, Taiwan. 3. Department of Computer Science and Information Engineering, National Taiwan University, Taiwan; Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taiwan; Graduate Institute of Network and Multimedia, National Taiwan University, Taiwan; Department of Respiratory Therapy, China Medical University, Taiwan. Electronic address: rfchang@csie.ntu.edu.tw. 4. Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, China Medical University Hospital, Taiwan; School of Medicine, China Medical University, Taiwan; Department of Life Science, National Chung Hsing University, Taiwan. 5. Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, China Medical University Hospital, Taiwan; School of Medicine, China Medical University, Taiwan; Department of Internal Medicine, Hyperbaric Oxygen Therapy Center, China Medical University, Taiwan. 6. Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, China Medical University Hospital, Taiwan; Graduate Institute of Clinical Medical Science, China Medical University, Taiwan; Department of Internal Medicine, Hyperbaric Oxygen Therapy Center, China Medical University, Taiwan.
Abstract
BACKGROUND AND OBJECTIVE: In the United States, lung cancer is the leading cause of cancer death. The survival rate could increase by early detection. In recent years, the endobronchial ultrasonography (EBUS) images have been utilized to differentiate between benign and malignant lesions and guide transbronchial needle aspiration because it is real-time, radiation-free and has better performance. However, the diagnosis depends on the subjective judgment from doctors. In some previous studies, which using the grayscale image textures of the EBUS images to classify the lung lesions but it belonged to semi-automated system which still need the experts to select a part of the lesion first. Therefore, the main purpose of this study was to achieve full automation assistance by using convolution neural network. METHODS: First of all, the EBUS images resized to the input size of convolution neural network (CNN). And then, the training data were rotated and flipped. The parameters of the model trained with ImageNet previously were transferred to the CaffeNet used to classify the lung lesions. And then, the parameter of the CaffeNet was optimized by the EBUS training data. The features with 4096 dimension were extracted from the 7th fully connected layer and the support vector machine (SVM) was utilized to differentiate benign and malignant. This study was validated with 164 cases including 56 benign and 108 malignant. RESULTS: According to the experiment results, applying the classification by the features from the CNN with transfer learning had better performance than the conventional method with gray level co-occurrence matrix (GLCM) features. The accuracy, sensitivity, specificity, and the area under ROC achieved 85.4% (140/164), 87.0% (94/108), 82.1% (46/56), and 0.8705, respectively. CONCLUSIONS: From the experiment results, it has potential ability to diagnose EBUS images with CNN.
BACKGROUND AND OBJECTIVE: In the United States, lung cancer is the leading cause of cancer death. The survival rate could increase by early detection. In recent years, the endobronchial ultrasonography (EBUS) images have been utilized to differentiate between benign and malignant lesions and guide transbronchial needle aspiration because it is real-time, radiation-free and has better performance. However, the diagnosis depends on the subjective judgment from doctors. In some previous studies, which using the grayscale image textures of the EBUS images to classify the lung lesions but it belonged to semi-automated system which still need the experts to select a part of the lesion first. Therefore, the main purpose of this study was to achieve full automation assistance by using convolution neural network. METHODS: First of all, the EBUS images resized to the input size of convolution neural network (CNN). And then, the training data were rotated and flipped. The parameters of the model trained with ImageNet previously were transferred to the CaffeNet used to classify the lung lesions. And then, the parameter of the CaffeNet was optimized by the EBUS training data. The features with 4096 dimension were extracted from the 7th fully connected layer and the support vector machine (SVM) was utilized to differentiate benign and malignant. This study was validated with 164 cases including 56 benign and 108 malignant. RESULTS: According to the experiment results, applying the classification by the features from the CNN with transfer learning had better performance than the conventional method with gray level co-occurrence matrix (GLCM) features. The accuracy, sensitivity, specificity, and the area under ROC achieved 85.4% (140/164), 87.0% (94/108), 82.1% (46/56), and 0.8705, respectively. CONCLUSIONS: From the experiment results, it has potential ability to diagnose EBUS images with CNN.