Yingying Xu1, Lanfen Lin2, Hongjie Hu3, Dan Wang3, Wenchao Zhu3, Jian Wang4, Xian-Hua Han5, Yen-Wei Chen4. 1. College of Computer Science and Technology, Zhejiang University, Hangzhou, China. 2. College of Computer Science and Technology, Zhejiang University, Hangzhou, China. llf@zju.edu.cn. 3. Radiology Department, Sir Run Run Shaw Hospital, Medical School, Zhejiang University, Hangzhou, China. 4. College of Information Science and Engineering, Ritsumeikan University, Kusatsu, Japan. 5. Faculty of Science, Yamaguchi University, Yamaguchi, Japan.
Abstract
PURPOSE: The bag of visual words (BoVW) model is a powerful tool for feature representation that can integrate various handcrafted features like intensity, texture, and spatial information. In this paper, we propose a novel BoVW-based method that incorporates texture and spatial information for the content-based image retrieval to assist radiologists in clinical diagnosis. METHODS: This paper presents a texture-specific BoVW method to represent focal liver lesions (FLLs). Pixels in the region of interest (ROI) are classified into nine texture categories using the rotation-invariant uniform local binary pattern method. The BoVW-based features are calculated for each texture category. In addition, a spatial cone matching (SCM)-based representation strategy is proposed to describe the spatial information of the visual words in the ROI. In a pilot study, eight radiologists with different clinical experience performed diagnoses for 20 cases with and without the top six retrieved results. A total of 132 multiphase computed tomography volumes including five pathological types were collected. RESULTS: The texture-specific BoVW was compared to other BoVW-based methods using the constructed dataset of FLLs. The results show that our proposed model outperforms the other three BoVW methods in discriminating different lesions. The SCM method, which adds spatial information to the orderless BoVW model, impacted the retrieval performance. In the pilot trial, the average diagnosis accuracy of the radiologists was improved from 66 to 80% using the retrieval system. CONCLUSION: The preliminary results indicate that the texture-specific features and the SCM-based BoVW features can effectively characterize various liver lesions. The retrieval system has the potential to improve the diagnostic accuracy and the confidence of the radiologists.
PURPOSE: The bag of visual words (BoVW) model is a powerful tool for feature representation that can integrate various handcrafted features like intensity, texture, and spatial information. In this paper, we propose a novel BoVW-based method that incorporates texture and spatial information for the content-based image retrieval to assist radiologists in clinical diagnosis. METHODS: This paper presents a texture-specific BoVW method to represent focal liver lesions (FLLs). Pixels in the region of interest (ROI) are classified into nine texture categories using the rotation-invariant uniform local binary pattern method. The BoVW-based features are calculated for each texture category. In addition, a spatial cone matching (SCM)-based representation strategy is proposed to describe the spatial information of the visual words in the ROI. In a pilot study, eight radiologists with different clinical experience performed diagnoses for 20 cases with and without the top six retrieved results. A total of 132 multiphase computed tomography volumes including five pathological types were collected. RESULTS: The texture-specific BoVW was compared to other BoVW-based methods using the constructed dataset of FLLs. The results show that our proposed model outperforms the other three BoVW methods in discriminating different lesions. The SCM method, which adds spatial information to the orderless BoVW model, impacted the retrieval performance. In the pilot trial, the average diagnosis accuracy of the radiologists was improved from 66 to 80% using the retrieval system. CONCLUSION: The preliminary results indicate that the texture-specific features and the SCM-based BoVW features can effectively characterize various liver lesions. The retrieval system has the potential to improve the diagnostic accuracy and the confidence of the radiologists.
Entities:
Keywords:
Bag of visual words; Content-based image retrieval; Spatial cone matching; Texture-specific
Authors: Sandy A Napel; Christopher F Beaulieu; Cesar Rodriguez; Jingyu Cui; Jiajing Xu; Ankit Gupta; Daniel Korenblum; Hayit Greenspan; Yongjun Ma; Daniel L Rubin Journal: Radiology Date: 2010-05-26 Impact factor: 11.105
Authors: Adrien Depeursinge; Antonio Foncubierta-Rodriguez; Dimitri Van de Ville; Henning Müller Journal: Med Image Comput Comput Assist Interv Date: 2012
Authors: Michael Gadermayr; Hubert Kogler; Maximilian Karla; Dorit Merhof; Andreas Uhl; Andreas Vécsei Journal: World J Gastroenterol Date: 2016-08-21 Impact factor: 5.742
Authors: Holger R Roth; Le Lu; Ari Seff; Kevin M Cherry; Joanne Hoffman; Shijun Wang; Jiamin Liu; Evrim Turkbey; Ronald M Summers Journal: Med Image Comput Comput Assist Interv Date: 2014