| Literature DB >> 34367946 |
Yun Qin1, Yiqi Deng2, Hanyu Jiang1, Na Hu1, Bin Song1.
Abstract
Gastric cancer (GC) is one of the most common cancers and one of the leading causes of cancer-related death worldwide. Precise diagnosis and evaluation of GC, especially using noninvasive methods, are fundamental to optimal therapeutic decision-making. Despite the recent rapid advancements in technology, pretreatment diagnostic accuracy varies between modalities, and correlations between imaging and histological features are far from perfect. Artificial intelligence (AI) techniques, particularly hand-crafted radiomics and deep learning, have offered hope in addressing these issues. AI has been used widely in GC research, because of its ability to convert medical images into minable data and to detect invisible textures. In this article, we systematically reviewed the methodological processes (data acquisition, lesion segmentation, feature extraction, feature selection, and model construction) involved in AI. We also summarized the current clinical applications of AI in GC research, which include characterization, differential diagnosis, treatment response monitoring, and prognosis prediction. Challenges and opportunities in AI-based GC research are highlighted for consideration in future studies.Entities:
Keywords: artificial intelligence; clinical applications and challenges; deep learning; gastric cancer; hand-crafted radiomics; methodologies
Year: 2021 PMID: 34367946 PMCID: PMC8335156 DOI: 10.3389/fonc.2021.631686
Source DB: PubMed Journal: Front Oncol ISSN: 2234-943X Impact factor: 6.244
Summary of published hand-crafted radiomics and deep learning studies on gastric cancer imaging.
| No. | Authors | Year | Study objectives | Study design | No. of patients | Imaging Modality | Radiomics/Deep learning | Statistical analysis (feature selection and modelling) | Segmentation |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Ba-Ssalamah et al. ( | 2013 | Gastric tumors differentiation prediction | Retrospective, Single-center | 48 | CT | Radiomics | LDA+kNN | Manual |
| 2 | Sung Hyun Yoon et al. ( | 2016 | HER2-positive and survival prediction | Retrospective, Single-center | 26 | CT | Radiomics | NA | Manual |
| 3 | Zelan Ma et al. ( | 2017 | Gastric cancer and lymphoma differentiation | Retrospective, Single-center | 70 | CT | Radiomics | LASSO | Manual |
| 4 | Song Liu et al. ( | 2017 | T and N staging prediction | Prospective, | 80 | MRI | Radiomics | ICC | Manual |
| 5 | Francesco Giganti et al. ( | 2017 | Therapy response prediction | Retrospective, Single-center | 34 | CT | Radiomics | RF,LOOCV, Univariate analysis, Multivariate analysis | Manual |
| 6 | Shunli Liu et al. ( | 2017 | Differentiation degree and Lauren classification prediction | Retrospective, Single-center | 107 | CT | Radiomics | ICC | Manual |
| 7 | Yujuan Zhang et al. ( | 2017 | Histological differentiation prediction | Retrospective, Single-center | 78 | MRI | Radiomics | AOV, Spearman correlation analysis | Manual |
| 8 | Song Liu et al. ( | 2017 | Nodal status prediction | Prospective, Single-center | 87 | MRI | Radiomics | Spearman correlation test, ICC | Manual |
| 9 | Song Liu et al. ( | 2017 | Aggressiveness assessment | Retrospective, Single-center | 64 | MRI | Radiomics | Spearman correlation test | Manual |
| 10 | Francesco Giganti et al. ( | 2017 | Association investigation between preoperative texture and OS | Retrospective, Single-center | 56 | CT | Radiomics | RSF ,Cox | Manual |
| 11 | Zhenhui Li et al. ( | 2018 | Neoadjuvant chemotherapy response prediction | Retrospective, Single-center | 47 | CT | Radiomics | RF, NB, KNN, NNET, SVM, LDA, LASSO | Manual |
| 12 | Yuming Jiang et al. ( | 2018 | Chemotherapy response and survival prediction | Retrospective, Multi-center | 1591 | CT | Radiomics | LASSO-Cox | Manual |
| 13 | Remy KlaassenI et al. ( | 2018 | Treatment response prediction | Retrospective, Single-center | 196 | CT | Radiomics | RF, Pearson correlation | Manual |
| 14 | Zhen Hou et al. ( | 2018 | Treatment response prediction | retrospective, Single-center | 43 | MRI | Radiomics | ICC, ACC, KNN, ANN | Manual |
| 15 | Yuming Jiang et al. ( | 2018 | Survival and chemotherapy benefit prediction | Retrospective, Single-center | 214 | PET/CT | Radiomics | LASSO-Cox | Manual |
| 16 | Yuan Gao et al. ( | 2019 | Metastatic lymph nodes prediction | Retrospective, Single-center | 602 | CT | Deep Learning | FR-CNN | Manual |
| 17 | Qiong Li et al. ( | 2019 | Adverse histopathological status prediction | Retrospective, Single-center | 554 | CT | Radiomics | LASSO | Semiautomatic |
| 18 | Wujie Chen et al. ( | 2019 | Metastatic lymph nodes prediction | Retrospective, Single-center | 146 | MRI | Radiomics | LASSO, LVQ | Manual |
| 19 | Yumin Jiang et al. ( | 2019 | pN stage Prediction | Retrospective, Multi-center | 1689 | CT | Radiomics | LASSO | Manual |
| 20 | Qiu-Xia Feng et al. ( | 2019 | Metastatic lymph nodes prediction | Retrospective, Single-center | 490 | CT | Radiomics | SVM | Manual |
| 21 | Yue Wang et al. ( | 2019 | Tumor invasion prediction | Retrospective, Single-center | 244 | CT | Radiomics | ICC, RF | Semiautomatic |
| 22 | Wuchao Li et al. ( | 2019 | OS prediction | Retrospective, Single-center | 181 | CT | Radiomics | ICC, LASSO-Cox | Manual |
| 23 | Xujie Gao et al. ( | 2020 | Metastatic lymph nodes prediction | Retrospective, Single-center | 463 | CT | Radiomics | ICC, LASSO | Manual |
| 24 | Di Dong et al. ( | 2020 | Prediction of the number of lymph nodes metastasis | Retrospective, Multi-center | 679 | CT | Radiomics, Deep learning | SVM, ANN, RF, DLRN | Manual |
| 25 | Xujie Gao et al. ( | 2020 | Tumor-infiltrating Treg cells and outcome prediction | Retrospective, Single-center | 165 | CT | Radiomics | ICC, LASSO | Manual |
| 26 | Xiaofeng Chen et al. ( | 2020 | Lymphovascular invasion and clinical outcome prediction | Retrospective, Single-Center | 160 | CT | Radiomics | ICC, SPM, LASSO | Manual |
| 27 | Na Wang et al. ( | 2020 | HER2 over-expression status prediction | Retrospective, Single-Center | 460 | CT | Radiomics | ICC, Logistic | Manual |
| 28 | Xujie Gao et al. ( | 2020 | Metastatic lymph nodes prediction | Retrospective, Single-center | 768 | CT | Radiomics | ICC, LASSO | Manual |
| 29 | Jing Li et al. ( | 2020 | Lymph node metastasis risk prediction | Retrospective, Single-Center | 204 | CT | Radiomics, Deep Learning | ICC, ANN, KNN, RF, SVM | Manual |
| 30 | Yue Wang et al. ( | 2020 | Lymph node metastasis prediction | Retrospective, Single-Center | 247 | CT | Radiomics | ICC, RF | Semiautomatic |
| 31 | Yue Wang et al. ( | 2020 | Intestinal-type gastric adenocarcinomas distinction | Retrospective, Single-Center | 187 | CT | Radiomics | ICC, RF | Semiautomatic |
| 32 | Shunli Liu et al. ( | 2020 | Occult peritoneal metastasis prediction | Retrospective, Single-center | 233 | CT | Radiomics | ICC, ACC, multivariate logistic regression | Manual |
| 33 | Aytul Hande Yardimci et al. ( | 2020 | T and N stages and tumor grade prediction | Retrospective, Single-center | 114 | CT | Radiomics | ICC, LDA | Manual |
| 34 | Jing Yang et al. ( | 2020 | Lymph node metastasis prediction | Retrospective, Single-center | 170 | CT | Radiomics | Pearson correlation analysis ,SFFS, logistic | Manual |
| 35 | Kai-YuSun et al. ( | 2020 | Neoadjuvant chemotherapy response and survival prediction | Retrospective, Single-center | 106 | CT | Radiomics | SVM, PCA, Cox | Manual |
| 36 | Xiaofeng Chen et al. ( | 2020 | Lymphovascular invasion and outcome prediction | Retrospective, Single-center | 160 | CT | Radiomics | ICC,SPM,LASSO | Manual |
| 37 | Wenjuan Zhang et al. ( | 2020 | Early recurrence prediction | Retrospective, Multi-center | 669 | CT | Radiomics, Deep Learning | ICC, CV, DCNN | Manual |
| 38 | Yuming Jiang et al. ( | 2020 | Tumor immune microenvironment and outcome prediction | Retrospective,Multi-center | 1778 | CT | Radiomics | Logistic | Manual |
| 39 | Liwen Zhang et al. ( | 2020 | OS prediction | Retrospective, Multi-center | 518 | CT | Radiomics, Deep Learning | Cox | Manual |
| 40 | Xiao-Xiao Wang et al. ( | 2020 | Lauren classification prediction | Retrospective, Single-center | 539 | CT | Radiomics | LASSO, logistic regression | Manual |
| 41 | Bao Feng et al. ( | 2021 | Primary gastric lymphoma and Borrmann type IV gastric cancer differentiation | Retrospective, Multi-center | 189 | CT | Radiomics, Deep Learning | U-net based DL model, ICC, LASSO logistic regression | Automated |
| 42 | Yi-Wen Sun et al. ( | 2021 | Gastric cancer and gastric lymphoma differentiation | Retrospective, Single-center | 79 | PET/CT | Radiomics | NA | Manual |
| 43 | Rui Wang et al. ( | 2021 | Gastric neuroendocrine carcinomas and gastric adenocarcinomas differentiation | Retrospective, Single-center | 63 | CT | Radiomics | LASSO | Manual |
| 44 | Rui-Jia Sun et al. ( | 2021 | Serosa invasion evaluation | Retrospective, Single-center | 572 | CT | Deep Learning | ICC, LASSO,DCNNs | Manual |
| 45 | Xiang Wang et al. ( | 2021 | Prognosis prediction | Retrospective, Single-center | 243 | CT | Radiomics | multivariate COX regression analysis, LASSO | Manual |
| 46 | Yuming Jiang et al. ( | 2021 | Occult peritoneal metastasis prediction | Retrospective, Multi-center | 1225 | CT | Deep Learning | PMetNet | Manual |
| 47 | Siwen Wang et al. ( | 2021 | Disease-free survival prediction | Retrospective, Multi-center | 353 | CT | Radiomics | LASSO, multivariate Cox regression | Manual |
LDA, Linear Discriminant Analysis; knn, k-Nearest Neighbors; NA, Not Available; LASSO, Least Absolute Shrinkage and Selection Operator; ICC, Intra-class Correlation Coefficient; RF, Random Forest; LOOCV, Leave One Out Cross Validation; AOV, Analysis Of Variance; NB, Naive Bayes; NNET, Neural Networks; SVM, Support Vector Machine; ACC, Absolute Correlation Coefficient; ANN, Artificial Neural Networks; FR-CNN, Faster Region-based Convolutional Neural Networks; LVQ, Learning Vector Quantization; DLRN, Deep Learning Radiomic Nomogram; SPM, Spearman correlation analysis; SFFS, Sequential Forward Floating Selection; PCA, Principal Component Analysis; RSF, Random Survival Forest; DCNN, Deep Convolutional Neural Networks; pmetnet, Peritoneal Metastasis Network; OS, Overall Survival.
Commonly used manual engineered features in gastric cancer.
| No. | Shape- based 3D features (n=17) | Shape- based 2D features (n=10) | Histogram features (n=19) | Textural features (n=75) | ||||
|---|---|---|---|---|---|---|---|---|
| Gray Level Co-occurrence Matrix (GLCM) Features (n=24) | Gray Level Run Length Matrix (GLRLM) Features (n=16) | Gray Level Size Zone Matrix (GLSZM) Features (n=16) | Neighbouring Gray Tone Difference Matrix (NGTDM) Features (n=5) | Gray Level Dependence Matrix (GLDM) Features (n=14) | ||||
| 1 | Mesh Volume | Mesh Surface | Energy | Autocorrelation | Short Run Emphasis (SRE) | Small Area Emphasis (SAE) | coarseness | Small Dependence Emphasis (SDE) |
| 2 | Voxel Volume | Pixel Surface | Total Energy | Joint Average | Long Run Emphasis (LRE) | Large Area Emphasis (LAE) | contrast | Large Dependence Emphasis (LDE) |
| 3 | Surface Area | Perimeter | Entropy | Cluster Prominence | Gray Level Non-Uniformity (GLN) | Gray Level Non-Uniformity (GLN) | busyness | Gray Level Non-Uniformity (GLN) |
| 4 | Surface Area to Volume ratio | Perimeter to Surface ratio | Minimum | Cluster Shade | Gray Level Non-Uniformity Normalized (GLNN) | Gray Level Non-Uniformity Normalized (GLNN) | complexity | Dependence Non-Uniformity (DN) |
| 5 | Sphericity | Sphericity | 10th percentile | Cluster Tendency | Run Length Non-Uniformity (RLN) | Size-Zone Non-Uniformity (SZN) | strength | Dependence Non-Uniformity Normalized (DNN) |
| 6 | Compactness 1 | Spherical Disproportion | 90th percentile | Contrast | Run Length Non-Uniformity Normalized (RLNN) | Size-Zone Non-Uniformity Normalized (SZNN) | Gray Level Variance (GLV) | |
| 7 | Compactness 2 | Maximum 2D diameter | Maximum | Correlation | Run Percentage (RP) | Zone Percentage (ZP) | Dependence Variance (DV) | |
| 8 | Spherical Disproportion | Major Axis Length | Mean | Difference Average | Gray Level Variance (GLV) | Gray Level Variance (GLV) | Dependence Entropy (DE) | |
| 9 | Maximum 3D diameter | Minor Axis Length | Median | Difference Entropy | Run Variance (RV) | Zone Variance (ZV) | Low Gray Level Emphasis (LGLE) | |
| 10 | Maximum 2D diameter (Slice) | Elongation | Interquartile Range | Difference Variance | Run Entropy (RE) | Zone Entropy (ZE) | High Gray Level Emphasis (HGLE) | |
| 11 | Maximum 2D diameter (Column) | Range | Joint Energy | Low Gray Level Run Emphasis (LGLRE) | Low Gray Level Zone Emphasis (LGLZE) | Small Dependence Low Gray Level Emphasis (SDLGLE) | ||
| 12 | Maximum 2D diameter (Row) | Mean Absolute Deviation (MAD) | Joint Entropy | High Gray Level Run Emphasis (HGLRE) | High Gray Level Zone Emphasis (HGLZE) | Small Dependence High Gray Level Emphasis (SDHGLE) | ||
| 13 | Major Axis Length | Robust Mean Absolute Deviation (rMAD) | Informational Measure of Correlation (IMC) 1 | Short Run Low Gray Level Emphasis (SRLGLE) | Small Area Low Gray Level Emphasis (SALGLE) | Large Dependence Low Gray Level Emphasis (LDLGLE) | ||
| 14 | Minor Axis Length | Root Mean Squared (RMS) | Informational Measure of Correlation (IMC) 2 | Short Run High Gray Level Emphasis (SRHGLE) | Small Area High Gray Level Emphasis (SAHGLE) | Large Dependence High Gray Level Emphasis (LDHGLE) | ||
| 15 | Least Axis Length | Standard Deviation | Inverse Difference Moment (IDM) | Long Run Low Gray Level Emphasis (LRLGLE) | Large Area Low Gray Level Emphasis (LALGLE) | |||
| 16 | Elongation | Skewness | Maximal Correlation Coefficient (MCC) | Long Run High Gray Level Emphasis (LRHGLE) | Large Area High Gray Level Emphasis (LAHGLE) | |||
| 17 | Flatness | Kurtosis | Inverse Difference Moment Normalized (IDMN) | |||||
| 18 | Variance | Inverse Difference (ID) | ||||||
| 19 | Uniformity | Inverse Difference Normalized (IDN) | ||||||
| 20 | Inverse Variance | |||||||
| 21 | Maximum Probability | |||||||
| 22 | Sum Average | |||||||
| 23 | Sum Entropy | |||||||
| 24 | Sum of Squares | |||||||
Figure 1The workflow of hand-crafted radiomics and deep learning methodological process.
Figure 2Clinical application of hand-crafted radiomics and deep learning in gastric cancer.