| Literature DB >> 36246393 |
Reem Ahmed Bahathiq1, Haneen Banjar1,2, Ahmed K Bamaga3, Salma Kammoun Jarraya1.
Abstract
Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder that affects approximately 1% of the population and causes significant burdens. ASD's pathogenesis remains elusive; hence, diagnosis is based on a constellation of behaviors. Structural magnetic resonance imaging (sMRI) studies have shown several abnormalities in volumetric and geometric features of the autistic brain. However, inconsistent findings prevented most contributions from being translated into clinical practice. Establishing reliable biomarkers for ASD using sMRI is crucial for the correct diagnosis and treatment. In recent years, machine learning (ML) and specifically deep learning (DL) have quickly extended to almost every sector, notably in disease diagnosis. Thus, this has led to a shift and improvement in ASD diagnostic methods, fulfilling most clinical diagnostic requirements. However, ASD discovery remains difficult. This review examines the ML-based ASD diagnosis literature over the past 5 years. A literature-based taxonomy of the research landscape has been mapped, and the major aspects of this topic have been covered. First, we provide an overview of ML's general classification pipeline and the features of sMRI. Next, representative studies are highlighted and discussed in detail with respect to methods, and biomarkers. Finally, we highlight many common challenges and make recommendations for future directions. In short, the limited sample size was the main obstacle; Thus, comprehensive data sets and rigorous methods are necessary to check the generalizability of the results. ML technologies are expected to advance significantly in the coming years, contributing to the diagnosis of ASD and helping clinicians soon.Entities:
Keywords: autism spectrum disorder (ASD); biomarkers; deep learning; machine learning; structural magnetic resonance imaging (sMRI)
Year: 2022 PMID: 36246393 PMCID: PMC9554556 DOI: 10.3389/fninf.2022.949926
Source DB: PubMed Journal: Front Neuroinform ISSN: 1662-5196 Impact factor: 3.739
ASD application review papers based on ML and DL methods with sMRI data.
| References | No. papers reviewed | Years covered | Methods covered | Diseases/disorders |
|
| 200 | 2001–2015 | ML on sMRI, fMRI, Diffusion MRI, and positron emission tomography | Schizophrenia, mild cognitive impairment, Alzheimer’s disease, depressive disorders, ASD, and ADHD. |
|
| 123 | 2007–2018 | ML and non-ML on sMRI | ASD |
|
| 48 | 2007–2018 | ML and DL: Invasive and non-invasive diagnosis approaches | ASD |
|
| 46 | 2009–2020 | ML and DL on sMRI, fMRI | ASD |
|
| 82 | 2016–2020 | DL on different autism diagnosis and rehabilitation approaches | ASD |
|
| 74 | 2011–2021 | ML and DL on different neuroimaging data | Alzheimer’s disease, Parkinson’s, major depressive disorder, schizophrenia, ADHD, and ASD. |
|
| 75 | 2010–2020 | ML and DL on different neuroimaging data | ADHD, and ASD. |
FIGURE 1A literature-based taxonomy for ML-based ASD classification.
FIGURE 2Different MRI modalities.
FIGURE 3(A) Branches of Artificial Intelligence Science. (B) An artificial neuron’s architecture. Each input × is associated with a weight w. The sum of all weighted inputs is passed onto an activation function f that leads to an output.
FIGURE 4Differences between (A) ML-based studies workflow and (B) DL-based studies workflow.
FIGURE 5The components of typical DL-based methods for diagnosing ASD (Khodatars et al., 2021).
FIGURE 6Schemes of conventional ML algorithms commonly used in MRI-based studies to diagnose ASD (A) SVM: support vector machine; (B) RF: random forest; (C) DT: decision tree; (D) KNN: k nearest neighbor.
FIGURE 7Schemes of DL algorithms are commonly used in MRI-based studies to diagnose ASD. (A) AE: autoencoder; (B) Stacked Autoencoder; (C) CNN: convolutional neural network.
Summary of 20 ML-based ASD classification studies.
| References | Modality | Biomarkers | #Subjects | Age | Preprocessing tool | Method used | Dataset | Best acc | Limitation |
|
| T1-w sMRI | Regional CT, cortical volume, and cortical SA | ASD = 46 Persons with DD = 39 | ASD: 27 ± 4 DD:28 ± 4 months | FreeSurfer | SVM; NB; RF | Private data | CT: 75.6% | Small sample size. Children with developmental problems are used as HCs, which may result in deviations in the results. |
|
| T1 sMRI | CT | ASD = 156, HC = 0 | 8–40 years | CIVET pipeline | SVM | ABIDE I | 51% | Continuation in regression models is inaccurate. The domain adaption becomes more challenging as the number of shared sites increases. |
|
| T1w sMRI | Morphological brain connectivity using a set of cortical attributes | ASD = 59, HC = 43 | − | FreeSurfer | SVM | ABIDE I | 61.76% | Unknown is the age range of the participants. Small sample size. No comparison with deep learning. |
|
| T1-w MRI | Morphological brain connectivity | ASD = 155, | ASD: 16.9 ± 6.3, | FreeSurfer | Ensemble classifier, SVM | ABIDE I | Avg left Himesphere:57.9%, Avg right Himesphere:61.6% | Imbalanced data. Using Pearson correlation to examine the link between ROIs may have ignored the non-linear nature of the relationship. Not investigated is the link between revealed cortical regions and non-cortical regions. No feature selection approach was employed. |
|
| sMRI and DTI | Thickness, area, volume, and curvature of GM, WM connectivity density | ASD = 110, HC = 83 | ASD = 12.74 ± 2.79, HC = 13.04 ± 2.95 years | LONI Pipeline, TrackVis, FreeSurfer | SVM | Private data | 93.26% | The models are lacking in transparency. |
|
| fMRI, sMRI, and DWI | ROI-based FC and set of anatomic features | ASD = 46, HC = 47 | 13.6 ± 2.8 years | FreeSurfer, FSL and AFNI | Conditional random forest | Private data | CRF on top 19 variables: 92.5% | Small sample size. In tiny samples, cohort effects cannot be ruled out. |
|
| T1 sMRI | Seven morphological features (e.g., CT, SA, GM, Local gyrification index, sulcus depth, gyrus height), and elastic network | ASD = 66, HC = 66 | ASD = 27 ± 8, HC = 27 ± 7 years | FreeSurfer, and SPM12 | SVM | ABIDE I | 78.63% | Only high-functioning ASD adults. The characteristics of participants vary considerably. In addition, the absence of key areas, such as the amygdala, may have significantly impacted categorization ability. |
|
| T1 sMRI | GM; WM | HC = 60 | 18–49 years | SPM12 and CAT12 toolbox | SVM | Private dataset | GM:69.47%, WM:66.16% | A small sample size. |
|
| T1-w sMRI | Multi-view morphological brain networks based on the maximum principal curvature, the CT, the sulcal depth, and the average curvature. | ASD = 50, HC = 150 | ASD mean age = 18.14 years, | FreeSurfer | SVM | ABIDE I | Left Hemisphere −4 views: 60%, Right Hemisphere −4 views: 59.5% | A small sample size consisting only of men. |
|
| T1-w sMRI | Cortical morphological networks | ABIDE I: ASD = 100 | − | FreeSurfer | Voting Classifier, Bagging Classifier, RF, AdaBoost, NB, Gradient boost, XGBoost, LR, SVM, DT, LDA, KNN, Quadratic Discriminant Analysis | ABIDE I and private dataset | 1st team:70% | Only conventional ML models. |
|
| sMRI (T1 +T2) | Three cortical measures CT, CA, and Cortical GM Volume | ASD:20, HC:15 | 1–4 years | FreeSurfer | LDA, RF, and SVM with Radial | ABIDE II | Without over-sampling (SVM and CA:94.28, SVM and CT:92.86, RF and CGMV :94.29) | Very small dataset. Insufficient discussion of the study results. |
|
| sMRI | 3D HOG | ASD = 119 | 5.2–34.8 Years | MRIcron, SPM12 | NB + SVM | 4 datasets from ABIDE II | Each dataset had an AUC of at least 75%, with the greatest AUC of 0.849 occurring at the ETH location. | Heterogeneous datasets. The contribution of features to the classification result is the same whether they are 0 or 1. |
|
| sMRI | CT-based networks | ASD = 100 | ASD: 17.27 ± 7.68, HC: 15.82 ± 5.93 years | FreeSurfer | SVM | Preprocessed ABIDE I | AUC = 0.6 | The SVM classifier alone was utilized. There was just one atlas used. Dataset is small and unbalanced. Only AUC is utilized as a performance metric. |
|
| T1-w sMRI | CT, SA, and subcortical features | Schizophrenia = 64, ASD = 36, HC = 106 | Schizophrenia: 14–60 years, | FreeSurfer: recon-all pipeline + Enhancing Neuroimaging Genetics | 6 Classifiers, including, SVM, DT, AdaBoost, RF, KNN, and LR | Private data | Multiclass classification: LR using CT features = 69. | ASD patients were only males. Small sample size. |
|
| rs-fMRI +sMRI | Temporal and functional connectivity | ASD = 201, HC = 251 | 6–18 years old | C-PAC pipeline | DT | Preprocessed ABIDE I | 74.8 ± 9.5% | Small and heterogeneous sample. A simplistic definition of brain topology. |
|
| T1 sMRI | Regional CT | ASD = 40, HC = 36 | 9.5 ± 3.4 years | FreeSurfer | SVM | Private data | 84.2% | small sample size. No independent test data. |
|
| sMRI | Surface morphological features of bilateral | ASD = 364, HC = 381 | 6–34 years | FIRST tool from FSL | Ensemble classifiers (boosting, subspace, bagging) + DT | ABIDE I | GentleBoost: > 80% | Cannot visualize the selected features and reduces understandability of this pipeline. Only used patch-based features. High level of heterogeneity |
|
| T1-w sMRI | 40 surface morphometric features + phenotype information such as age, VIQ, and FIQ | ASD = 26, HC = 24 | − | recon-all workflow of FreeSurfer | DT and RF | ABIDE I | RF and 10-fold | No information about the participant’s age. Very limited sample size. |
|
| Rs-fMRI + sMRI | Multimodal brain graphs | Rs-fMRI: | - | fMRI: SPM + rs-fMRI data analysis toolkit. sMRI: FreeSurfer | LDA and SVM | ABIDE I | Multimodal classification model in several nodes in template graph = 20 with depth-based alignment and soft correspondence: 53.73% | The model is unexplainable. It must establish an appropriate threshold value for each modality in hand. |
sMRI, structural MRI; fMRI, functional MRI; rs-fMRI, resting-state functional MRI; DWI, diffusion-weighted imaging; DTI, Diffusion-tensor imaging; ASD, Autism Spectrum Disorder; HC, healthy control; DD, developmental delay; GM, gray matter; WM, white matter; CT, cortical thickness; SA, surface area; CA, cortical area; FC, functional connectivity; LR, Logistic Regression; SVM, support vector machine; KNN, k-nearest neighbor; DT, decision tree; NB, naïve bayes; RF, random forest; LDA, linear discriminant analysis; M, male; F, female; HOG, histogram of oriented gradients.
#Number of subjects.
Summary of 25 DL-based ASD classification studies.
| References | Modality | Biomarkers | N participants | Age | Preprocessing | Method used | Dataset | Acc | Limitation |
|
| sMRI | Regional SA, CT, sex, and volume of intracranial | ASD- HR = 34, HC = 145 | 6–12 months | AutoSeg, CIVET | 3-stage DNN: SAE +SVM | NDAR: IBIS | 94% | Small sample and multi-stages approach |
|
| T1-w sMRI | Four different feature sets of morphometric measures | ASD experiment: ASD = 325, HC = 325 | 17.9 ± 7.4 years | FreeSurfer | SVM, KNN, and ANN | For ASD: ABIDE I | SVM:52 ± 7% | Subjects under the age of 10 are not included. The ABIDE dataset required additional iterations and time for SVM to reach convergence. |
|
| sMRI + fMRI | 8 structural features, and FC | ASD = 561, HC = 521 | Different ages | FreeSurfer | KNN, RF | ABIDE I | sMRI: 78–100 fMRI: 79–100 | Neglect of ASD heterogeneity. Need to test different neurodevelopmental conditions with ASD. |
|
| sMRI + rs-fMRI + ADOS report | Spatial features: cortical volume (CV), CT, SA, and FC | ASD = 72, HC = 113 | ASD males’ mean age = 13.07 years, and females mean age = 13.53 years HC males’ mean age = 13.04 years, and females’ mean age = 12.81 years. | FreeSurfer | SVM, KNN, RF, NB, and ANN | NDAR | RF: 80.8% | Data from multiple sources were used, which may restrict their utility in constructing a customized medicine model. This research may only apply to adults with high-functioning ASD who are between the ages of 8–18. |
|
| rs-fMRI, sMRI | Regional-based mean time series + GM + WM | ASD = 116, HCs = 69, | 5–10 years | SPM 8 | DBN of depth 3 + LR | ABIDE I and ABIDE II | 65.56% | Small sample size, Raw data is not used as input data due to high data dimensions and limited computer resources. The model is complex and consumes significant computational time and resources for the training phase |
| Regional based mean time series + GM | DBN of depth 3 + LR | 65% | |||||||
| Regional-based mean time series + WM | DBN of depth 3 + LR | 62.5% | |||||||
| WM | DBN of depth 3 + LR | 59.72% | |||||||
| GM | DBN of depth 3 + LR | 63.89% | |||||||
| Regional-based mean time series + GM + WM | DBN of depth 2 + LR | 63.03% | |||||||
| Regional-based mean time series + GM | DBN of depth 2 + LR | 61.94% | |||||||
| Regional-based mean time series + WM | DBN of depth 2 + LR | 63.89% | |||||||
| WM | DBN of depth 2 + LR | 61.11% | |||||||
| GM | DBN of depth 2 + LR | 63.06% | |||||||
|
| sMRI and fMRI | Structural textures and 45 FC features | ASD = 538, HC = 573 | 7–64 years | SPM8 and in-house MATLAB code | AEs +CNN+ linear SVM | 17 sites from ABIDE I | 64.31% | Current results are not yet clinically relevant. Only used imaging data. |
|
| T1 sMRI | Several patches were extracted from several discriminative landmarks | ASD = 55, HC = 209 | 24-months | In-house tool | Multi-channel CNNs | NDAR | 76.24% | Small sample size. Only for 24-month age. One train/test splitting for cross-validation. |
|
| T1-w sMRI | Connectivity features between each pair of ROIs | ASD = 78, HCs = 104 | The average age is about 15 years old | FreeSurfer | DNN: SSAE | NYU from ABIDE I | 90.93% | Only bi-level (ASD/HC) classification was performed. Small sample size, imbalanced classes. |
|
| sMRI and fMRI | 15 different feature sets: FC Matrix + anatomical volumes | ASD = 418HC = 497 | − | − | SVM, RNN, CNN, GCN, DT, LR, RF, MLP | IMPAC | MLP: AUC = 80% | Sensitivity, and specificity metrics have not been evaluated. |
|
| sMRI | CT, SA, Shape Complexity Index and EA-CSF | ASD = 38HC = 149 | 6-months | FSL-BET, CIVET, and ANTs | MLP + CNN | NDAR: IBIS | 89.7% | Small sample size |
|
| sMRI | Different structural features | YUM:40 high SCQ, 33 = low SCQ. ABIDE: ASD = 946, HC = 1,046. | ASD = 29.4 ± 11.6 HC = 30.1 ± 5.3 years | SPM8 | (1)3D input +2D/3D CNN, (2)2D/3D input +2D/3D CNN+2D/3D STN, (3)3D input+2D/3D CNN+ 3D STN +RNN, (4)2D/3D input +2D/3D CNN+2D/3D + CAM, (5)3D input+ RAM | Private data (YUM), ABIDE I +ABIDE II | ABIDE:2D Input + 2D CNN + 2D STN 59%. 2D Input + 3D CNN + 2D STN < 50%. 3D Input + 2D CNN + 3D STN 57%. 3D Input + 3D CNN + 3D STN 60%. 3D Input + 2D CNN + 3D STN + RNN 55%. 3D Input + 3D CNN + 3D STN+ RNN 56%. 2D Input + 2D CNN + CAM < 50%. 3D Input + 3D CNN + CAM 56%. | Inadequate accuracy to reach the level of clinical utility |
|
| sMRI | Normalized raw image | ASD = 500, HC = 500 | 7–64 years | FSL software | 3D-CNN | ABIDE I | 3D-CNN:70%, 3D-CNN + GABM:73% | Check the effect of different subsets of the regions that give different brain masks. Only one atlas is used to identify the knowledgeable brain regions; there need to try multiple atlases. |
|
| sMRI | Subcortical tissues | ASD = 30, HC = 9 | − | − | DDPG-RAM, PER-RAM | NYU of ABIDE I | DDPG- RAM:85.6%, PER-RAM:87.4% | Only one site of ABIDE was used. Unbalanced dataset. The combination of DDPG and RAM necessarily increases several parameters, resulting in a decrease in processing speed. |
|
| sMRI | 296 brain morphometric features related to the global and subcortical features and the cortical features | ASD = 1,060, HC = 1,166 | 5–64 years | FreeSurfer | AEs + LR | ABIDE I and II | On 86 subjects: AUC = 0.79 | The evaluation of the CI was limited only to 4 pairs of samples from ABIDE. |
|
| fMRI and sMRI | CT, SA, cortical volume, and singular values of fMRI connectome matrix | ASD = 537, HC = 590 | 17.01 ± 10 years | FreeSurfer and FSL | Discriminative learning + CNN | IMPAC2 | 69 ± 5.5% | Adopted only one type of CNN models |
|
| fMRI and sMRI | FC, and volumetric correspondences between cortical parcels’ GM volumes | ASD = 368, HC = 449 | Mean age 14 years | FreeSurfer | Stacked AEs + MLP | ABIDE I | Combined data: 85.06 ± 3.52% | Exclude more than 100 subjects from ABIDE I dataset because did not meet the required preprocessing criteria. |
|
| fMRI and sMRI | Brain surface morphometry and FC | ASD = 484, HC = 514 | 7–64 Years | FreeSurfer and ABIDE Preprocessed Connectome Project based on the C-PAC protocol | Geometric deep learning | ABIDE I | 68.0 ± 03.8% | No cross-validation. |
|
| T1w sMRI | Features from the segmentation and parcellation maps + sex information | IBIS: (ASD:52, HC = 195) ACE (ASD = 22, HC = 13) | IBIS (ASD = 24 ± 0.7, HC = 2 4 ± 0.89) ACE (ASD = 25 ± 1.5, HC = 24 ± 1.9) years | iBEAT V2.0 Cloud | CNN+SNN | NDAR: IBIS+ ACE | NDAR:91.5, ACE:82.9 | Small number of 24- month-old subjects. Specific cortical surface features that accurately quantify early brain development were overlooked (i.e., mean curvature) |
|
| sMRI | Set of morphological features | ASD = 505, HC = 530 | 6–64 years | FreeSurfer | LR, RF, SVM, AdaBoost, Passive Regression, and ANN | Preprocessed ABIDE I | ANN: 82% SVM:72% | No cross-validation. Un clear the final number of subjects in each class. Unclear which biomarkers contribute to models’ decision |
|
| T1 sMRI and rs-fMRI | Brain networks | ASD = 481, HC = 526 | − | C-PAC +Computational Anatomy Toolbox (CAT) | GCN for feature extraction+ MLP for classification | 17 sites from ABIDE I | 72.7% | Need to try using more ASD datasets to verify the robustness of the model. |
|
| sMRI | Individual-Level MBN | ASD = 518, HC = 567 | 7–64 years | DRAMMS | Self-Attention Neural Network Classifier | ABIDE I | 72.48% | Accuracy can be improved to be suitable for clinical use. |
|
| sMRI | Individual-Level MBN | ASD = 518, HC = 567 | 7–64 years | DRAMMS | CNN | ABIDE I | 71.8% | Not mention any harmonization process to solve the heterogeneity issue. |
|
| T1 sMRI | Raw data | ASD = 112, HC = 102 | ASD: 21 ± 8.7 HC:28.9 ± 8.5 years | FSL | SNN and Pre-trained ResNet50 | ABIDE I | 99% | Small sample size. A contrastive loss function was used. However, triple loss and quadrupole loss may perform better. |
|
| (MRI including Axial T1, T2, FLAIR, and sagittal T1/T2) +ADC | MRI sequences | ASD = 151HC = 151 Test | = 45 1–6 Years | - | CNN based on ResNet 18 architecture | Private data | On validation set &DSM: 85.5% On test set &DSM: 84.4 | It was a retrospective study. Need to explainable approach. No cross-validation. Only children younger than 7 years old. Without abnormalities in MR imaging. The mechanism of the FLAIR and ADC sequences for diagnosing ASD remains unknown. |
|
| T1-w and T2-w sMRI | − | ASD = 289, HC = 180 | 6–12 months | − | GAN | NDAR: IBIS | 69% | For training purposes, the technique requires paired longitudinal data from the same individual. The method is computationally expensive and requires high resources. |
|
| sMRI | Cortical meshes and vertex-wise cortical shape metrics. In addition to sex | Human Connectome Project: female = 505, male = 606/ABIDE = 1,994 subjects | Different ages | FreeSurfer | Pretrained ResNet-50, pretrained DenseNet-121 and XGboost models | Human Connectome Project dataset, ABIDE I, and ABIDE | ResNet = 63.04% II | Cerebellum and subcortical regions are not involved in the analysis. |
| DenseNet = 63.64% | |||||||||
| ResNet (transfer) = 65.89% | |||||||||
| DenseNet (transfer) = 65.59% | |||||||||
| ResNet (2-stage) = 67.70% | |||||||||
| DenseNet (2-stage) = 67.85% |
*sMRI, structural MRI; fMRI, functional MRI; rs-fMRI, resting-state functional MRI; ADC, apparent diffusion coefficient; SCQ, Social Communication Questionnaire; ASD, Autism Spectrum Disorder; HC, healthy control; GM, gray matter; WM, white matter; CT, cortical thickness; SA, surface area; Cx, cerebral cortex; CSF, cerebrospinal fluid; FC, functional connectivity; MBN, Morphological Brain Networks; ANN, artificial neural network; FFNN, feed forward NN; LR, Logistic Regression; SVM, support vector machine; CNN, convolutional neural network; FCNN, fully CNN; DT, decision tree; DBN, deep belief networks; RF, random forest; RNN, recurrent neural network; SAE, spares autoencoder; STN, Spatial Transformer Network; SNN, Siamese neural network; DFCN, deep fusion classification network; GCN, graph convolutional network; DDPG-RAM, Deep Deterministic Policy Gradient -RAM; PER, priority experience replay; M, male; F, female; ACE, Autism Centers of Excellence.
Summary of evaluation matrices used in ML and DL-based ASD studies.
| References | Test type | Accuracy | Sensitivity | Specificity | AUC | PPV | NPV | F1 score |
| ML-based ASD studies | ||||||||
|
| 3-fold cross validation | 75.6% | 80 ± 3% | 69.7% | 0.8 | − | − | 77.8% |
|
| 10-fold cross validation | 51% | − | − | − | − | − | − |
|
| leave-one-out cross validation | 61.76 | − | − | − | − | − | − |
|
| 5-fold cross validation | Left Hemisphere: 57.1% | ||||||
| Right Hemisphere: 61% | ||||||||
| 10-fold cross validation | Left Hemisphere: 58.3% | |||||||
| Right Hemisphere: 62% | ||||||||
|
| 10-fold cross validation | 93.26% | 97.17% | 91.67% | − | − | − | − |
|
| − | 92.5 | 97.8 | 87.2 | − | − | − | − |
|
| Leave-one-out cross-validation | 78.63% | 80.0% | 77.27% | 0.83 | − | − | − |
|
| Leave-one-out cross-validation | GM:69.47% | − | − | − | − | − | − |
| WM:66.16% | ||||||||
|
| Stratified 5-fold cross-validation | Left Hemisphere −4 views: 60% | − | − | 0.6899 | − | − | − |
| Right Hemisphere −4 | 0.6848 | |||||||
|
| − | 70% | 72.5% | 67.5% | − | − | − | − |
|
| Customized cross-validation | sMRI 75–100; fMRI 79–100 | sMRI 73–100; fMRI 78–100 | sMRI 78–100; fMRI 79–100 | Smri 0.79–1.00; fMRI 0.82–1.00 | − | − | − |
|
| Leave-One-Out-Cross-Validation | Without oversampling: SVM and CA:94.28% | −− | |||||
| SVM and CT:92.86% | − | − | − | − | − | − | ||
| RF and CGMV:94.29% | − | − | − | − | − | − | ||
| With over-sampling SVM and CA:94.29% | − | − | − | − | − | − | ||
| SVM and CT:94.28% | − | − | − | − | − | − | ||
| RF and CGMV:94.29% | − | − | − | − | − | − | ||
| SVM-RBF and CA: 94.29% | − | − | − | − | − | − | ||
|
| 10-fold stratified cross-validation | − | − | − | 0.75 in each dataset | − | − | − |
|
| Repeated nested split-half cross-validation | − | − | 0.6 | − | − | − | |
|
| 10-fold cross-validation | Multiclass classification: LR using CT features = 69% | − | − | − | − | − | − |
| Binary classification (ASD and | ||||||||
|
| Leave-one-out cross-validation | 74.8 ± 9.5% | − | − | − | − | − | − |
|
| Leave-one-out cross-validation | 84.2% | 80% | 88.9% | − | − | − | − |
|
| 10-fold cross validation | 83 ± 0.07% | 80 ± 0.1% | 85 ± 0.06% | – | 84 ± 0.06% | 82 ± 0.08% | − |
|
| 5-fold cross-validation | RF:86% | − | − | 0.91 | − | − | − |
| 10-fold cross-validation | RF:88% | 0.90 | ||||||
|
| 5-fold cross-validation | fMRI brain network with | 49.1% | 66.1% | − | − | − | − |
| Morphological brain network | 42.72% | 69.89% | − | − | − | − | ||
| Multi-modal classification | 45.68% | 61.03% | ||||||
| DL-based ASD studies | ||||||||
|
| 10-fold cross validation | 94% | 88% | 95% | − | 81% | 97% | − |
|
| 5-fold cross validation | 52 ± 7% | − | 0.54 | − | − | − | − |
|
| 4-fold cross validation | 80.8% | 84.9% | 79.2% | 81.92% | − | − | − |
|
| 10-fold cross validation | 65.56% | 84% | 32.96% | − | − | − | 74.76% |
|
| 5-fold cross validation | 64.31% | 60% | 68.32% | − | − | − | − |
|
| 10- fold cross validation | 76.24% | − | − | − | − | − | − |
|
| 10-fold cross validation | 90.39% | 84.37% | 95.88% | 0.9738 | − | − | − |
|
| 3-fold stratified cross-validation | − | − | − | 80 | − | − | − |
|
| 10-fold cross validation | 89.7% | 78.3% | 92.5% | − | 80.2% | 95.2% | − |
|
| 10-fold cross validation | 2D Input + 2D CNN + 2D STN | − | − | − | − | − | − |
| 2D Input + 3D CNN + 2D STN | − | − | − | − | − | − | ||
| 3D Input + 2D CNN + 3D STN | − | − | − | − | − | − | ||
| 3D Input + 3D CNN + 3D STN | − | − | − | − | − | − | ||
| 3D Input + 2D CNN + 3D STN | − | − | − | − | − | − | ||
| 3D Input + 3D CNN + 3D STN | − | − | − | − | − | − | ||
| 2D Input + 2D CNN + CAM¡ | − | − | − | − | − | − | ||
| 3D Input + 3D CNN + CAM | − | − | − | − | − | − | ||
|
| 5-fold cross validation | 3D-CNN :70% | − | − | − | − | − | − |
| 3D-CNN + GABM:73% | − | − | − | − | − | − | ||
|
| 5-fold cross validation | DDPG-RAM:85.6% | 93.2% | 65.7% | 0.830 | 87.7% | 78.9% | − |
| PER-RAM:87.4% | 93.7% | 69.9% | 0.937 | 89.7% | 80% | − | ||
|
| 10-fold cross-validation | − | − | − | 0.79 | − | − | − |
|
| 8-fold cross-validation | 0.690 ± 0.055 | 0.790 ± 0.049 | 0.689 ± 0.048 | 0.733 ± 0.051 | − | − | − |
| Leave-one-site-out cross-validation | over 70% for all ABIDE I | |||||||
| 10-fold cross validation | fMRI +ensemble of classifiers: | 74% | 76% | |||||
| sMRI +ensemble of classifiers: | 78% | 79% | ||||||
| Combined data + an ensemble of | 81% | 89% | ||||||
|
| − | 0.680 ± 0.038 | − | − | 0.617 ± 0.044 | − | − | − |
|
| 10-fold cross validation | NDAR :91.5% | 86.5% | 92.8% | 0.91 | − | − | − |
| ACE :82.9% | 81.8% | 84.6% | 0.86% | |||||
|
| – | SVM:72% | − | − | − | − | − | − |
| ( | 10-fold cross validation | 72.7% | 67.8% | 76.6% | – | – | – | – |
| Avg :69.42% | – | – | – | – | – | |||
|
| − | 72.48 | 75.81 | 68.09 | 0.74 | − | − | 0.7581 |
|
| 10-fold cross-validation | 71.8% | 81.25% | 68.75% | 67% | 0.6868 | ||
|
| 5-fold stratified cross-validation | 99% | − | − | − | − | − | 0.99 |
|
| 3D CSResNet-18 on Validation | 84.2% | 86.8% | 0.896 | − | − | − | |
| 3D CSResNet-18 on Test set: | 85.0% | 84.0% | 0.898 | − | − | |||
|
| 4- fold cross-validation | 69.9% | − | − | 0.671 | − | − | 0.694 |
|
| 10-fold cross-validation | ResNet = 63.04% | 52.40% | 72.51% | 0.6756 | − | − | − |
| DenseNet = 63.64% | 55.80% | 70.62% | 0.6725 | − | − | |||
| ResNet (transfer) = 65.89% | 60.28% | 70.90% | 0.6996 | − | − | |||
| DenseNet (transfer) = 65.59% | 57.29% | 72.99% | 0.7018 | − | − | |||
| ResNet (2-stage) = 67.70% | 62.73% | 72.13% | 0.7199 | − | − | |||
| 3DenseNet (2-stage) = 67.85% | 61.66% | 73.36% | 0.7237 | − | − | |||
Summary of publicly brain MRI datasets used in ASD studies.
| References | Dataset name | Date released | Num of images/classes | Link | Used in |
|
| ABIDE I | 2012 | 539 ASD (360 M,179 F), 573 non-ASD (403 M, 170 F) |
| |
|
| ABIDE II | 2017 | 521 ASD (414 M, 73 F), 593 non-ASD (382 M,175 F) |
| |
|
| NDAR | 2016 | In 2014: Data from over 77,000 subjects. Multimodal-MRI: 4,745 subjects. |
| |
|
| IMPAC | 2018 | 1,150 subjects in the public set (601 HCs, 549 ASD). |
|
ABIDE, Autism Brain Imaging Data Exchange Initiative; NDAR, National Database for Autism Research; IMPAC, Imaging Psychiatry Challenge: predicting autism.
FIGURE 8Publication by year. (A) Shows a rise in the number of papers published in the ASD diagnosis area from 2017 onward, according to the “PubMed by year”; (B) represents the number of papers published, reviewed here, by year.
FIGURE 9Reviewed studies analysis. (A) Shows a variety of ML and DL approaches used to diagnose ASD. (B) Shows a different set of CV techniques. (C) Shows the data sets used in the studies and their number. (D) Shows the imaging modality used to build the models.
FIGURE 10Shows relationships between the sample size and the accuracy of the studies.