Lili Feng1, Zhenyu Liu2, Chaofeng Li3, Zhenhui Li4, Xiaoying Lou5, Lizhi Shao6, Yunlong Wang1, Yan Huang5, Haiyang Chen7, Xiaolin Pang7, Shuai Liu7, Fang He7, Jian Zheng7, Xiaochun Meng8, Peiyi Xie8, Guanyu Yang9, Yi Ding10, Mingbiao Wei1, Jingping Yun11, Mien-Chie Hung12, Weihua Zhou13, Daniel R Wahl14, Ping Lan15, Jie Tian16, Xiangbo Wan17. 1. Department of Radiation Oncology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; Guangdong Institute of Gastroenterology, Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, Guangzhou, China. 2. CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China. 3. State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, China. 4. Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, China. 5. Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China. 6. CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Computer Science and Engineering, Southeast University, Nanjing, China. 7. Department of Radiation Oncology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China. 8. Department of Radiology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China. 9. School of Computer Science and Engineering, Southeast University, Nanjing, China. 10. Department of Radiation Oncology, Nanfang Hospital, Southern Medical University, Guangzhou, China. 11. Department of Pathology, Sun Yat-sen University Cancer Center, Guangzhou, China. 12. Department of Molecular and Cellular Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Graduate Institute of Biomedical Sciences and Research Centers for Cancer Biology and Molecular Medicine, China Medical University, Taichung, Taiwan; Department of Biotechnology, Asia University, Taichung, Taiwan. 13. Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, USA. 14. Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, USA; Rogel Cancer Center, University of Michigan, Ann Arbor, MI, USA. 15. Department of Colorectal Surgery, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; Guangdong Institute of Gastroenterology, Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, Guangzhou, China. 16. CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China. Electronic address: jie.tian@ia.ac.cn. 17. Department of Radiation Oncology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China; Guangdong Institute of Gastroenterology, Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, Guangzhou, China. Electronic address: wanxbo@mail.sysu.edu.cn.
Abstract
BACKGROUND: Accurate prediction of tumour response to neoadjuvant chemoradiotherapy enables personalised perioperative therapy for locally advanced rectal cancer. We aimed to develop and validate an artificial intelligence radiopathomics integrated model to predict pathological complete response in patients with locally advanced rectal cancer using pretreatment MRI and haematoxylin and eosin (H&E)-stained biopsy slides. METHODS: In this multicentre observational study, eligible participants who had undergone neoadjuvant chemoradiotherapy followed by radical surgery were recruited, with their pretreatment pelvic MRI (T2-weighted imaging, contrast-enhanced T1-weighted imaging, and diffusion-weighted imaging) and whole slide images of H&E-stained biopsy sections collected for annotation and feature extraction. The RAdioPathomics Integrated preDiction System (RAPIDS) was constructed by machine learning on the basis of three feature sets associated with pathological complete response: radiomics MRI features, pathomics nucleus features, and pathomics microenvironment features from a retrospective training cohort. The accuracy of RAPIDS for the prediction of pathological complete response in locally advanced rectal cancer was verified in two retrospective external validation cohorts and further validated in a multicentre, prospective observational study (ClinicalTrials.gov, NCT04271657). Model performances were evaluated using area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). FINDINGS: Between Sept 25, 2009, and Nov 3, 2017, 303 patients were retrospectively recruited in the training cohort, 480 in validation cohort 1, and 150 in validation cohort 2; 100 eligible patients were enrolled in the prospective study between Jan 10 and June 10, 2020. RAPIDS had favourable accuracy for the prediction of pathological complete response in the training cohort (AUC 0·868 [95% CI 0·825-0·912]), and in validation cohort 1 (0·860 [0·828-0·892]) and validation cohort 2 (0·872 [0·810-0·934]). In the prospective validation study, RAPIDS had an AUC of 0·812 (95% CI 0·717-0·907), sensitivity of 0·888 (0·728-0·999), specificity of 0·740 (0·593-0·886), NPV of 0·929 (0·862-0·995), and PPV of 0·512 (0·313-0·710). RAPIDS also significantly outperformed single-modality prediction models (AUC 0·630 [0·507-0·754] for the pathomics microenvironment model, 0·716 [0·580-0·852] for the radiomics MRI model, and 0·733 [0·620-0·845] for the pathomics nucleus model; all p<0·0001). INTERPRETATION: RAPIDS was able to predict pathological complete response to neoadjuvant chemoradiotherapy based on pretreatment radiopathomics images with high accuracy and robustness and could therefore provide a novel tool to assist in individualised management of locally advanced rectal cancer. FUNDING: National Natural Science Foundation of China; Youth Innovation Promotion Association of the Chinese Academy of Sciences.
BACKGROUND: Accurate prediction of tumour response to neoadjuvant chemoradiotherapy enables personalised perioperative therapy for locally advanced rectal cancer. We aimed to develop and validate an artificial intelligence radiopathomics integrated model to predict pathological complete response in patients with locally advanced rectal cancer using pretreatment MRI and haematoxylin and eosin (H&E)-stained biopsy slides. METHODS: In this multicentre observational study, eligible participants who had undergone neoadjuvant chemoradiotherapy followed by radical surgery were recruited, with their pretreatment pelvic MRI (T2-weighted imaging, contrast-enhanced T1-weighted imaging, and diffusion-weighted imaging) and whole slide images of H&E-stained biopsy sections collected for annotation and feature extraction. The RAdioPathomics Integrated preDiction System (RAPIDS) was constructed by machine learning on the basis of three feature sets associated with pathological complete response: radiomics MRI features, pathomics nucleus features, and pathomics microenvironment features from a retrospective training cohort. The accuracy of RAPIDS for the prediction of pathological complete response in locally advanced rectal cancer was verified in two retrospective external validation cohorts and further validated in a multicentre, prospective observational study (ClinicalTrials.gov, NCT04271657). Model performances were evaluated using area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). FINDINGS: Between Sept 25, 2009, and Nov 3, 2017, 303 patients were retrospectively recruited in the training cohort, 480 in validation cohort 1, and 150 in validation cohort 2; 100 eligible patients were enrolled in the prospective study between Jan 10 and June 10, 2020. RAPIDS had favourable accuracy for the prediction of pathological complete response in the training cohort (AUC 0·868 [95% CI 0·825-0·912]), and in validation cohort 1 (0·860 [0·828-0·892]) and validation cohort 2 (0·872 [0·810-0·934]). In the prospective validation study, RAPIDS had an AUC of 0·812 (95% CI 0·717-0·907), sensitivity of 0·888 (0·728-0·999), specificity of 0·740 (0·593-0·886), NPV of 0·929 (0·862-0·995), and PPV of 0·512 (0·313-0·710). RAPIDS also significantly outperformed single-modality prediction models (AUC 0·630 [0·507-0·754] for the pathomics microenvironment model, 0·716 [0·580-0·852] for the radiomics MRI model, and 0·733 [0·620-0·845] for the pathomics nucleus model; all p<0·0001). INTERPRETATION: RAPIDS was able to predict pathological complete response to neoadjuvant chemoradiotherapy based on pretreatment radiopathomics images with high accuracy and robustness and could therefore provide a novel tool to assist in individualised management of locally advanced rectal cancer. FUNDING: National Natural Science Foundation of China; Youth Innovation Promotion Association of the Chinese Academy of Sciences.