Yanye Lu1,2, Markus Kowarschik2, Xiaolin Huang3, Yan Xia4, Jang-Hwan Choi5, Shuqing Chen1, Shiyang Hu1, Qiushi Ren6, Rebecca Fahrig1,2, Joachim Hornegger1, Andreas Maier1. 1. Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-University Erlangen-Nuremberg, 91058, Erlangen, Germany. 2. Advanced Therapies, Siemens Healthineers, 91301, Forchheim, Germany. 3. Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, 200240, Shanghai, P.R. China. 4. Radiological Sciences Lab, Stanford University, 94305, CA, USA. 5. Division of Mechanical and Biomedical Engineering, Ewha Womans University, 03760, Seoul, Korea. 6. Department of Biomedical Engineering, Peking University, 100871, Beijing, China.
Abstract
PURPOSE: Benefiting from multi-energy x-ray imaging technology, material decomposition facilitates the characterization of different materials in x-ray imaging. However, the performance of material decomposition is limited by the accuracy of the decomposition model. Due to the presence of nonideal effects in x-ray imaging systems, it is difficult to explicitly build the imaging system models for material decomposition. As an alternative, this paper explores the feasibility of using machine learning approaches for material decomposition tasks. METHODS: In this work, we propose a learning-based pipeline to perform material decomposition. In this pipeline, the step of feature extraction is implemented to integrate more informative features, such as neighboring information, to facilitate material decomposition tasks, and the step of hold-out validation with continuous interleaved sampling is employed to perform model evaluation and selection. We demonstrate the material decomposition capability of our proposed pipeline with promising machine learning algorithms in both simulation and experimentation, the algorithms of which are artificial neural network (ANN), Random Tree, REPTree and Random Forest. The performance was quantitatively evaluated using a simulated XCAT phantom and an anthropomorphic torso phantom. In order to evaluate the proposed method, two measurement-based material decomposition methods were used as the reference methods for comparison studies. In addition, deep learning-based solutions were also investigated to complete this work as a comprehensive comparison of machine learning solution for material decomposition. RESULTS: In both the simulation study and the experimental study, the introduced machine learning algorithms are able to train models for the material decomposition tasks. With the application of neighboring information, the performance of each machine learning algorithm is strongly improved. Compared to the state-of-the-art method, the performance of ANN in the simulation study is an improvement of over 24% in the noiseless scenarios and over 169% in the noisy scenario, while the performance of the Random Forest is an improvement of over 40% and 165%, respectively. Similarly, the performance of ANN in the experimental study is an improvement of over 42% in the denoised scenario and over 45% in the original scenario, while the performance of Random Forest is an improvement by over 33% and 40%, respectively. CONCLUSIONS: The proposed pipeline is able to build generic material decomposition models for different scenarios, and it was validated by quantitative evaluation in both simulation and experimentation. Compared to the reference methods, appropriate features and machine learning algorithms can significantly improve material decomposition performance. The results indicate that it is feasible and promising to perform material decomposition using machine learning methods, and our study will facilitate future efforts toward clinical applications.
PURPOSE: Benefiting from multi-energy x-ray imaging technology, material decomposition facilitates the characterization of different materials in x-ray imaging. However, the performance of material decomposition is limited by the accuracy of the decomposition model. Due to the presence of nonideal effects in x-ray imaging systems, it is difficult to explicitly build the imaging system models for material decomposition. As an alternative, this paper explores the feasibility of using machine learning approaches for material decomposition tasks. METHODS: In this work, we propose a learning-based pipeline to perform material decomposition. In this pipeline, the step of feature extraction is implemented to integrate more informative features, such as neighboring information, to facilitate material decomposition tasks, and the step of hold-out validation with continuous interleaved sampling is employed to perform model evaluation and selection. We demonstrate the material decomposition capability of our proposed pipeline with promising machine learning algorithms in both simulation and experimentation, the algorithms of which are artificial neural network (ANN), Random Tree, REPTree and Random Forest. The performance was quantitatively evaluated using a simulated XCAT phantom and an anthropomorphic torso phantom. In order to evaluate the proposed method, two measurement-based material decomposition methods were used as the reference methods for comparison studies. In addition, deep learning-based solutions were also investigated to complete this work as a comprehensive comparison of machine learning solution for material decomposition. RESULTS: In both the simulation study and the experimental study, the introduced machine learning algorithms are able to train models for the material decomposition tasks. With the application of neighboring information, the performance of each machine learning algorithm is strongly improved. Compared to the state-of-the-art method, the performance of ANN in the simulation study is an improvement of over 24% in the noiseless scenarios and over 169% in the noisy scenario, while the performance of the Random Forest is an improvement of over 40% and 165%, respectively. Similarly, the performance of ANN in the experimental study is an improvement of over 42% in the denoised scenario and over 45% in the original scenario, while the performance of Random Forest is an improvement by over 33% and 40%, respectively. CONCLUSIONS: The proposed pipeline is able to build generic material decomposition models for different scenarios, and it was validated by quantitative evaluation in both simulation and experimentation. Compared to the reference methods, appropriate features and machine learning algorithms can significantly improve material decomposition performance. The results indicate that it is feasible and promising to perform material decomposition using machine learning methods, and our study will facilitate future efforts toward clinical applications.
Authors: Hao Gong; Jeffrey F Marsh; Karen N D'Souza; Nathan R Huber; Kishore Rajendran; Joel G Fletcher; Cynthia H McCollough; Shuai Leng Journal: J Med Imaging (Bellingham) Date: 2021-04-19