Literature DB >> 35456359

Classification of Chemotherapy-Related Subjective Cognitive Complaints in Breast Cancer Using Brain Functional Connectivity and Activity: A Machine Learning Analysis.

Lei Wang1,2, Yanyan Zhu1,2, Lin Wu1,2, Ying Zhuang3, Jinsheng Zeng4, Fuqing Zhou1,2.   

Abstract

The aim of this study was combining multi-level resting-state functional magnetic resonance imaging (rs-fMRI) features with machine learning method to distinguish breast cancer patients with chemotherapy-related subjective cognitive complaints (SCC) from non-chemotherapy (BC) and healthy controls (HC). Forty subjects in SCC group, forty-nine in BC group and thirty-four in HC group were recruited and underwent rs-fMRI scanning. Based on the anatomical automatic labeling brain atlas, the functional metrics of all subjects included functional connectivity, amplitude of low frequency fluctuation and fractional amplitude of low frequency fluctuation, regional homogeneity, voxel-mirrored homotopic connectivity and degree centrality were calculated and extracted as features set. Then, the rs-fMRI features were selected by two-sample t-test, removing variables with a high pairwise correlation and least absolute shrinkage and selection operator regression. Finally, the support vector machine models were built for classification (SCC vs. BC, SCC vs. HC). Thirty-eight features (SCC vs. BC) and seventeen features (SCC vs. HC) were selected separately, and the accuracy of the models were 82.0% and 91.9%, respectively. These findings demonstrated a valid machine learning approach that effectively distinguished breast cancer patients with chemotherapy-related SCC from non-chemotherapy and healthy controls, providing potential neuroimaging evidence for early diagnosis and clinical intervention of chemotherapy-related SCC.

Entities:  

Keywords:  breast cancer; chemotherapy-related cognitive impairment; machine learning; resting-state functional magnetic resonance imaging; subjective cognitive complaints

Year:  2022        PMID: 35456359      PMCID: PMC9027787          DOI: 10.3390/jcm11082267

Source DB:  PubMed          Journal:  J Clin Med        ISSN: 2077-0383            Impact factor:   4.964


1. Introduction

Breast cancer is the most common malignant disease that threatens women all over the world [1], and chemotherapy is one of the most important treatments. More than 50% of breast cancer patients have cognitive impairment in many aspects, including memory, execution, attention and reaction speed, during or after chemotherapy (also known as “chemo-brain”), and more than half of them are mainly manifested as subjective cognitive impairment (SCC) [2,3], which seriously affects the ability to work and socialize [4]. With the continuous development of medical technology, the number of breast cancer survivors is increasing, and the social and economic burden brought by chemotherapy-related cognitive impairment (CRCI) is becoming heavier. Therefore, early identification of the occurrence of CRCI is crucial for early clinical intervention and prognosis of patients. Several neuroimaging studies have shown the reduced volume and density of brain gray matter and the destroyed structural integrity of white matter in CRCI [5,6,7]. Additionally, the resting-state functional magnetic resonance imaging (rs-fMRI) studies had also confirmed that there were extensive abnormalities of local functional activities and connections in breast cancer patients with CRCI [8,9,10]. Dumas et al. [11] reported that decreased functional connectivity (FC) one month after chemotherapy that partially recovered to baseline at one year in the dorsal attention network and decreased FC in the default mode network (DMN) at one month and one year following chemotherapy. A previous study on the hippocampus showed that this brain region in breast cancer patients after chemotherapy has higher FC than that of healthy controls and was associated with poor subjective cognitive performance [12]. Chen et al. [9] found older breast cancer patients have increased amplitude of low frequency fluctuation (ALFF) of bilateral subcallosal gyri and right anterior cingulate gyrus after chemotherapy, and decreased fractional ALFF (fALFF) in the left precuneus, while there was no significant difference in regional homogeneity (ReHo) analysis. However, most of these studies are carried out separately according to the brain functional connectivity or regional activity, and the result is based on the comparison of the population level. Given the multimodal characteristics of brain function, it will be a challenge to identify the distinguishing features and apply them to the individual classification of CRCI, particularly for the survivors at the period of SCC. To solve these problems, the classification models combining rs-fMRI with machine learning has been applied to the early accurate diagnosis of CRCI. Kesler et al. [13] constructed the support vector machine (SVM) with patterns of DMN connectivity, and distinguished CRCI from both survivors without chemotherapy and HCs with 90–91% accuracy, while the effect of other parameters of rs-fMRI functional connection and activity on breast cancer patients after chemotherapy was ignored. Furthermore, there were insufficient concerns for breast cancer survivors who were still experiencing chemotherapy-related SCC. Previous studies have suggested that the combination of multi-level rs-fMRI features could improve the disease diagnosis classification performance [14,15]. Based-on these, in this present study, we assumed that we can use the method of machine learning to construct the SVM models through a variety of rs-fMRI functional parameters, including FC, ALFF, fALFF, ReHo, voxel-mirrored homotopic connectivity (VMHC) and degree centrality (DC), which could effectively identify breast cancer patients with chemotherapy-related SCC from breast cancer patients before chemotherapy and HCs, and these might provide a valuable message for the accurate diagnosis of the occurrence of CRCI and clinical intervention in breast cancer patients.

2. Materials and Methods

2.1. Participants

All breast cancer patients were recruited in the First Affiliated Hospital of Nanchang University from July 2018 to May 2020. Patient inclusion criteria include the following: (1) female patients with primary invasive breast cancer confirmed by postoperative pathologically, and with no brain metastasis confirmed by MRI; (2) right-handed; (3) aged 35 to 64 years old; (4) appearance of subjective cognitive complaints that are not related to the disease and corresponding treatment after chemotherapy in post-operative chemotherapy. SCC are defined as self-reports of memory, execution, attention, processing speed and other cognitive impairment. Exclusion criteria include the following: (1) non-primary invasive breast cancer; (2) any history of brain trauma, tumor, nerve demyelination, mental illness, or alcohol and drug abuse; (3) any contraindications to MRI scanning (vertigo, claustrophobia, etc.). According to the above criteria, a total of forty-six breast cancer patients with subjective cognitive complaints after postoperative chemotherapy (SCC group) who met above inclusion criteria were recruited. Additionally, fifty-one breast cancer patients before postoperative chemotherapy (BC group) who met the above first three inclusion criteria and all exclusion criteria were recruited as control group. Meanwhile, thirty-four age- and sex-matched healthy controls (HC group) were volunteered from the local community, which according with above exclusion criteria. This study was approved by the Medical Research Ethics Committee and the Institutional Review Board of the First Affiliated Hospital of Nanchang University (Protocol number 2018039 from 1 July 2018) and was performed in accordance with the Declaration of Helsinki. Each subject signed a written informed consent before participating in this study.

2.2. Cognitive Assessment

The subjective and objective cognitive performance of breast cancer patients was measured by using neuropsychological cognitive assessments, and it was completed within the same day of MRI scanning. The subjective cognitive complaints were estimated by the questionnaire of Functional Assessment of Cancer Therapy-Cognitive Function (FACT-Cog) [16] version 3. There are four subdomains to evaluate the perceived cognitive impairment, impact of perceived cognitive impairments on quality of life, comments from others, and perceived cognitive abilities. Additionally, objective cognition would be measured from different cognitive subdomains by the following six neurophysiological tests: (1) Montreal Cognitive Assessment Beijing version [17]; (2) Trail making test [18]: it consists of parts A and B; (3) Stroop color-word test (CWT) [19]: there are three parts in this test, including word test, color test and color-word test; (4) The Chinese version of auditory verbal learning test (AVLT) [20]: it included immediate and delayed recall; (5) Symbol digital modalities test [21]; (6) Clock drawing test [22]. Moreover, the Beck Depression Inventory [23] was used to assess the severity of depression in patients, the higher scores the more severe the symptoms.

2.3. MRI Data Acquisition

All MRI data were collected on a 3.0-Tesla Siemens Trio TIM Scanner (Siemens Medical Solutions, Erlangen, Germany) using an eight-channel head coil at the Radiology Department of the First Affiliated Hospital of Nanchang University. To minimize head motion and discomfort, all participants laid supine with their head fixed using foam pads in the scanner. During the MRI data acquisition, the participants were required to keep their eyes closed without thinking anything specifically or falling into sleep. The rs-fMRI gradient-echo echo-planar imaging sequences were collected as follows: repetition time = 2000 ms, echo time = 30 ms, flip angle = 90°, matrix size = 64 × 64, field of view = 220 × 220 mm2, voxel size = 3.0 × 3.0 × 4.0 mm3, inter-slice gap = 0 mm, slice thickness = 4 mm, 30 axial slices, and 240 time points with a scan time of 8 min and 40 s. The high-resolution T1-weighted images were collected using three-dimensional magnetization-prepared rapid gradient-echo sequence with the following parameters: repetition time = 1900 ms, echo time = 2.26 ms, inversion time = 900 ms, matrix size = 240 × 256, field of view = 250 × 250 mm2, voxel size = 1.0 × 1.0 × 1.0 mm3, slice thickness = 0.5 mm, and 176 sagittal slices with a scan time of 4 min and 20 s. Each participant also underwent conventional sequences including T1-weighted, T2-weighted, T2-weighted dark fluid, and diffusion-weighted imaging sequences to analyze brain structural injury and metastasis.

2.4. MRI Data Preprocessing

The conventional sequence images and diffusion weighted imaging were checked by three experienced radiologists to weed out structural brain injury and metastasis before preprocessing. The rs-fMRI and high-resolution T1-weighted images were preprocessed by using a toolbox called Data Processing Assistant for Resting-State fMRI (http://rfmri.org/DPARSF (accessed on 20 November 2021)) [24] based on Statistical Parametric Mapping 12 (http://www.fil.ion.ucl.ac.uk/spm/ (accessed on 20 November 2021)) running on MATLAB 8.4.0. (Mathworks Inc., Sherborn, MA, USA) through the following seven steps: (1) removing the first ten time points for magnetization stabilization and adaptation the environment; (2) slice-timing correction; (3) realignment to corrected head motion (whose maximum head motions exceed 2.0 mm of displacement in any direction or 2 degrees in any angular motion should be excluded); (4) spatial normalization: the individual registration between functional images and high-resolution T1 data, then T1 images segmentation and functional data registration to Montreal Neurological Institute space, and resampling to 3 × 3 × 3 mm3 voxel; (5) smoothing by using a 6 × 6 × 6 mm3 full-width at half-maximum Gaussian kernel; (6) linear de-trending to remove nuisance signals and linear regression to obtain Friston 24-head motion parameters, cerebrospinal fluid and white matter signal; and (7) band-pass filtering at 0.01–0.08 Hz to control high-frequency physiological noise and low-frequency drift.

2.5. Feature Extraction

After data preprocessing, based on 90 brain regions of the automated anatomical labeling (AAL) atlas, we calculated the following six types of rs-fMRI measures, including FC, ALFF, fALFF, ReHo, VMHC and DC as the variables. FC can reflect the temporal correlation between neurophysiological activities in different brain regions spatially. The mean time courses of each regions of interest (ROI) were attained by averaging the rs-fMRI time series of all the voxels within the ROI. Pearson’s correlation analysis was performed on all pairs of ROIs time courses, and then the correlation coefficients were transformed into z-values with Fisher’s r-to-z transformation. Total 4005 z-transformed correlation coefficients were taken as the FCs between all pairs of ROIs. ALFF and fALFF reflect the intensity of intrinsic spontaneous brain oscillatory activity. ALFF was achieved as the averaged square root in a voxel over the preceding frequency range, while fALFF was calculated as the ratio between ALFF and the average square root of the power spectrum within the entire frequency range. We calculated individual ALFF/fALFF values within each voxel and then matched the mean to the brain maps. Fisher’s r-to-z transformation was performed to obtain zALFF/zfALFF map of the whole brain. Finally, we obtained 90 zALFF/zfALFF values using the AAL atlas. ReHo as a local brain connectivity metric is measured to detect the regional temporal homogeneity of neural intrinsic activity. After spatial normalization, all images were then band-pass filtered as described at step 7 and smoothing would be conducted. We calculated individual ReHo values within each voxel and adjacent 26 voxels, then the mean be segmented into 90 ROIs. Fisher’s r-to-z transformation was performed to obtain zReHo map of the whole brain as well. Thus, we obtained 90 zReHo values. VMHC can reflect the functional connectivity of mirrored voxels in two hemispheres. Individual VMHC values within each voxel were calculated, then segmented into 90 ROIs. After performing Fisher’s r-to-z transformation, we obtained 90 zVMHC values of brain map. DC reflects the importance of this brain region by calculating the number of functional connections directly connected with this brain region in the whole brain. Each region’s DC with positive binary values of AAL atlas would be calculated and transformed to zDC values, then we obtained 90 zDC values.

2.6. Feature Selection

First, we performed two-sample t-test on each feature between the SCC and BC group, and the features that were significantly different (p < 0.01) between the two groups were retained. Then, we eliminated the features with high pairwise correlation to weaken the multi-collinearity. If there was a high Pearson’s correlation between two features (we set 0.65 as the correlation absolute threshold), we checked the mean absolute correlation of each variable and removed the variable with a larger mean absolute correlation. Lastly, we used the least absolute shrinkage and selection operator (LASSO) logistic method with 10-fold crossing validation using classification accuracy as cost function to select the most discriminative features for classification. After LASSO, the features whose coefficients were non-zero were remained to train a model for classifying the SCC and BC group. The features for classifying the SCC and HC group were selected as per the above identical procedures. The feature selection was performed in Python 3.8.8 with packages “scikit-learn”.

2.7. SVM Classification

Based on the selected features, we constructed SVM models to discriminate the three groups (SCC vs. BC, SCC vs. HC). To enhance the interpretability of the models, the linear kernel function was considered in this study. The regularization parameter C in the linear kernel SVM models was used to find the optimal hyperplane. The hyper-parameter C was left at default setting, searched by ranging from 2−10 to 210 with 20.2 as step sizes via five-fold cross-validation. The leave-one-out cross-validation method and permutation test (5000 times) were used to build the optimal SVM model. The accuracy, sensitivity and specificity of models were calculated, and the receiver operating characteristic (ROC) curve and the area under the curve (AUC) are used to evaluate the performance of the models. The weights of all selected rs-fMRI features were calculated to quantify the contribution to the SVM models. The procedures of building the linear kernel SVM models were performed in MATLAB 8.4.0. with the libsvm version 3.24 packages (https://www.csie.ntu.edu.tw/~cjlin/libsvm/) (accessed on 30 December 2021) [25].

2.8. Statistical Analyses

Statistical analysis was performed using SPSS 26.0 software for clinical characteristics and cognitive function assessment by independent sample t-test or one-way analysis of variance (ANOVA). Prior to ANOVA, clinical data were checked for normality and homogeneity of variance. If the differences were significant, they were further compared using the least significant difference test; otherwise, non-parametric tests were employed, and p < 0.05 was considered significant.

3. Results

3.1. Demographics and Clinical Characteristics

Two patients (all in the SCC group) with brain metastasis and six patients (four in the SCC group and two in the BC group) with excessive head motion were ruled out, and this study were recruited 40 participants in the SCC group, 49 in the BC group and 34 in the HC group finally. All patients in the SCC group treated with standard-dosage chemotherapy regimens: (1) 24 patients with docetaxel (75 mg/m2) + cyclophosphamide (500 mg/m2) + doxorubicin (50 mg/m2) or epirubicin (100 mg/m2) by intravenous infusion every 3 weeks; (2) 16 patients with docetaxel (75 mg/m2) + cyclophosphamide (500 mg/m2) + fluorouracil (500 mg/m2) + doxorubicin (50 mg/m2) or epirubicin (100 mg/m2) by intravenous infusion every 3 weeks. Seventeen patients in the SCC group have completed the chemotherapy treatment at the time of the MRI scan, while the rest were still undergoing treatment (6 patients completed two cycles, 6 patients completed five cycles, 5 patients completed six cycles, and 6 patients completed seven cycles). Demographic and clinically relevant characteristics and cognitive function parameters are presented in Table 1. No significant differences in age, years of education, or head motion were found among these three groups. There were no significant differences between the SCC and BC group in the Beck Depression Inventory and objective cognitive assessment scores. However, the SCC group had significantly worse subjective cognitive performance, including the FACT-Cog total scores, perceived cognitive impairment and comments from others, compared with the BC group (Table 1).
Table 1

Comparison of clinical characteristics and cognitive function among the three groups.

SCC (N = 40)BC (N = 49)HC (N = 34)p Values
MeanSDMeanSDMeanSD
Age (years)47.856.8746.986.6446.389.880.712
Education (years)4.603.635.583.865.743.120.317
Stage of tumor (I, II, III, IV)0, 24, 15, 18, 27, 11, 3
From the start of chemotherapy (days)205.21272.17
Head motion (mm)0.110.050.100.040.100.050.585
Beck Depression Inventory scores14.637.9112.049.50 0.173
FACT-Cog total scores95.8916.44106.9410.95 <0.001
 Perceived cognitive impairment53.139.7460.796.39 <0.001
 Quality of life12.233.0213.313.40 0.120
 Comments from others14.132.6315.421.03 0.002
 Perceived cognitive abilities16.413.6617.423.80 0.210
Montreal Cognitive Assessment scores20.834.5220.514.44 0.742
Trail making test—A (s)36.2857.2320.4021.04 0.163
Trail making test—B (s)198.1089.21186.6684.47 0.638
CWT—word test (s)31.1618.2928.9511.66 0.525
CWT—color test (s)40.229.1941.0914.49 0.766
CWT—color-word test (s)78.6920.6974.5723.06 0.425
AVLT—immediate recall40.2312.3740.4511.14 0.944
AVLT—delayed recall9.883.569.163.03 0.311
Clock drawing test19.086.1520.727.84 0.284
Symbol digital modalities test29.7914.4232.7914.78 0.344

Abbreviations: SCC, breast cancer patients with postoperative chemotherapy-related subjective cognitive complaints; BC, breast cancer patients with postoperative non-chemotherapy; HC, healthy control; SD, standard deviation; FACT-Cog, Functional Assessment of Cancer Therapy-Cognitive Function; CWT, Stroop Color-Word Test; AVLT, Auditory Verbal Learning Test.

3.2. Feature Selection

Between the SCC and BC group, we finally obtained 38 rs-fMRI features, including 25 FC, 6 ALFF, 2 fALFF, 4 ReHo and 1 VMHC after the feature selection procedure (Figure 1 and Figure 2, Table 2). Between the SCC and HC group, we finally obtained 17 rs-fMRI features, including 7 FC, 2 ALFF, 4 fALFF, 3 ReHo and 1 DC after feature selection (Figure 3 and Table 3).
Figure 1

The selected FC features for discriminating the SCC from BC group. Part (a) showed the distribution of FC features in different brain network regions, and part (b) showed the spatial distribution of the FC features across the brain. Abbreviations: DMN, default mode network; FPCN, frontal-parietal control network; SN, salience network; CON, cingular-opercular network; AN, auditory network; VN, visual network; L, left; R, right.

Figure 2

The selected ALFF, fALFF, ReHo and VMHC features for discriminating the SCC from BC group. Abbreviations: ALFF, amplitude of low frequency fluctuation; fALFF, fractional ALFF; ReHo, regional homogeneity; VMHC, voxel-mirrored homotopic connectivity; L, left; R, right.

Table 2

The selected rs-fMRI features set for discriminating the SCC from BC group.

IDFeaturesBrain NetworkSCC (N = 40)BC (N = 49)p ValuesWeight
MeanSDMeanSD
1Pallidum_R–Angular_RSubcortical-DMN0.2220.1790.1150.1580.0045.629
2Temporal_Mid_R–Cingulum_Post_LDMN-DMN0.4670.2710.6020.1890.007−3.573
3Insula_R–Frontal_Inf_Tri_RCON-SN0.4390.2330.5600.1880.008−2.735
4Pallidum_L–Precuneus_LSubcortical-DMN0.2950.1910.2950.1910.0062.221
5Pallidum_L–Cingulum_Post_RSubcortical-DMN0.2640.1660.150.1580.0012.159
6Cingulum_Post_L–Frontal_Inf_Tri_RDMN-SN0.1540.2270.0230.2280.0082.144
7Putamen_L–Frontal_Inf_Orb_LSubcortical-Other regions0.3370.2080.440.1430.007−1.888
8Parietal_Inf_L–ParaHippocampal_LFPCN-Other regions0.1560.2290.2870.1670.002−1.867
9Thalamus_L–Rectus_RSubcortical-Other regions0.1250.2030.2290.1600.008−1.433
10Angular_L–Olfactory_LDMN-Subcortical0.1450.2100.2810.2240.004−1.284
11Temporal_Inf_R–Fusiform_LDMN-Other regions0.7090.2960.8640.2170.005−1.150
12Insula_R–Insula_LCON-CON1.1340.2151.2610.2320.009−1.063
13ParaHippocampal_L–Rectus_LOther regions-Other regions0.4010.2640.5430.1970.005−1.027
14Parietal_Inf_L–Frontal_Sup_Orb_RFPCN-Other regions0.2930.1910.4100.1620.002−0.993
15Temporal_Mid_R–Precuneus_LDMN-DMN0.5570.2820.6880.183<0.010−0.918
16SupraMarginal_R–Insula_RAN-CON0.5930.2410.7440.2190.003−0.880
17Cingulum_Post_L–Frontal_Sup_LDMN-DMN0.5910.2020.7120.224<0.010−0.690
18Parietal_Inf_L–Frontal_Sup_Orb_LFPCN-Other regions0.3520.2020.4630.1940.0090.678
19Temporal_Mid_R–Frontal_Mid_Orb_RDMN-DMN0.4470.2290.5880.1840.002−0.526
20Pallidum_R–Cingulum_Post_LSubcortical-DMN0.2450.1840.1440.1590.0070.481
21SupraMarginal_L–Insula_RAN-CON0.5210.2460.660.2090.0050.377
22Occipital_Mid_L–Olfactory_LVN-Subcortical0.3010.2560.4390.1870.004−0.342
23Putamen_L–Frontal_Inf_Orb_RSubcortical-AN0.3020.1940.4090.1540.005−0.337
24Temporal_Mid_L–Frontal_Sup_LDMN-DMN0.6370.2820.7910.2160.0050.243
25Occipital_Inf_R–Frontal_Sup_Medial_LVN-DMN0.3320.2800.4820.1920.0040.151
26zALFF of Frontal_Mid_RFPCN−0.0520.1490.0480.1660.004−1.345
27zALFF of Frontal_Mid_LFPCN−0.0220.1700.0790.1850.0091.064
28zALFF of Cingulum_Mid_RSN−0.0810.1690.0190.1780.008−0.965
29zALFF of Frontal_Inf_Oper_RFPCN−0.2090.123−0.1160.1320.001−0.781
30zALFF of Frontal_Inf_Tri_RSN−0.2420.118−0.1560.1150.0010.265
31zALFF of Cingulum_Post_LDMN0.4060.3690.6640.4610.0050.260
32zfALFF of Occipital_Mid_LVN0.8940.3710.690.3160.0063.148
33zfALFF of Occipital_Mid_RVN0.9270.3670.7170.3760.0090.389
34zReHo of Occipital_Sup_RVN0.5860.3000.4120.3110.009−2.314
35zReHo of Caudate_RSubcortical−0.3070.239−0.1090.253<0.001−1.966
36zReHo of Cingulum_Mid_RSN0.2270.1500.3420.1560.001−1.272
37zReHo of Cingulum_Ant_RDMN−0.0040.1880.1100.211<0.010−1.158
38zVMHC of Insula_RCON0.4140.1220.4850.130<0.010−0.542

Abbreviations: SCC, breast cancer patients with postoperative chemotherapy-related subjective cognitive complaints; BC, breast cancer patients with postoperative non-chemotherapy; SD, standard deviation; DMN, default mode network; FPCN, frontal-parietal control network; SN, salience network; CON, cingular-opercular network; AN, auditory network; VN, visual network.

Figure 3

The selected rs-fMRI features set for discriminating the SCC from HC group. Part (a) showed the FC features, and part (b) showed the ALFF, fALFF, ReHo and DC features. Abbreviations: ALFF, amplitude of low frequency fluctuation; fALFF, fractional ALFF; ReHo, regional homogeneity; DC, degree centrality; L, left; R, right.

Table 3

The selected rs-fMRI features set for discriminating the SCC from HC group.

IDFeaturesBrain NetworkSCC (N = 40)HC (N = 34)p ValuesWeight
MeanSDMeanSD
1Cingulum_Ant_R–Frontal_Mid_Orb_RDMN–DMN0.6070.2600.7830.2630.005−3.121
2Temporal_Sup_L–Insula_LAN–CON0.8220.2020.6500.2460.0012.750
3Temporal_Pole_Sup_R–ParaHippocampal_RDMN–Other regions0.6530.2150.4910.2240.0022.677
4Cingulum_Ant_R–Frontal_Sup_Medial_RDMN–DMN0.7560.1710.9220.203<0.001−2.285
5Temporal_Sup_R–Insula_LVAN–CON0.6040.2110.4570.2530.0081.639
6Frontal_Mid_Orb_L–Frontal_Sup_Orb_RDMN–Other regions0.8520.3260.7740.3030.0081.233
7Temporal_Pole_Sup_L–ParaHippocampal_RDMN–Other regions0.6060.2540.4300.2480.0040.004
8zALFF of Frontal_Inf_Oper_RFPCN−0.2090.1230.0800.1890.001−3.947
9zALFF of Frontal_Inf_Oper_LFPCN−0.1620.1290.0100.223<0.0010.633
10zfALFF of Frontal_Inf_Tri_LFPCN0.1660.2230.3270.2410.004−3.043
11zfALFF of Insula_LCON0.2200.2320.3830.2640.006−1.225
12zfALFF of Temporal_Pole_Sup_RDMN0.4710.236−0.3140.2700.0091.139
13zfALFF of Frontal_Inf_Oper_LFPCN0.0750.3670.3600.4560.004−0.546
14zReHo of Frontal_Mid_RFPCN−0.4460.250−0.2620.1960.001−3.864
15zReHo of Insula_LCON−0.4010.172−0.2790.1790.004−1.580
16zReHo of Rolandic_Oper_LAN0.3690.1820.5280.188<0.001−0.434
17zDC of Cingulum_Ant_RDMN−0.5270.110−0.4180.1480.001−3.346

Abbreviations: SCC, breast cancer patients with postoperative chemotherapy-related subjective cognitive complaints; BC, breast cancer patients with postoperative non-chemotherapy; HC, healthy control; SD, standard deviation; DMN, default mode network; AN, auditory network; CON, cingular-opercular network; VAN, ventral-attention network; FPCN, frontal-parietal control network.

3.3. SVM Classification

The regularization parameter C in the SVM models were determined as 22.6 (SCC vs. BC) and 20 (SCC vs. HC), respectively, by iterative attempts using the 5-fold cross-validation scheme. With the 38 rs-fMRI features having been chosen after the above three screening procedures, after the hyper-parameter optimization and leave-one-out cross-validation, we obtained the optimal SVM model with an accuracy of 82.0% and an AUC of 0.903 (95% confidence interval: 82.2–95.6%) for discriminating the SCC from BC group (sensitivity = 82.50%, specificity = 87.76%, and the p values was 0.0003 after 5000 times permutation test) (Figure 4). With the 17 rs-fMRI features, we built optimal SVM model for discriminating the SCC from HC group with an accuracy of 91.9% and an AUC of 0.943 (95% confidence interval: 86.3–98.3%) (sensitivity = 92.50%, specificity = 91.18%, and the p values was 0.0004 after 5000 times permutation test) (Figure 4).
Figure 4

The ROC curves of SVM models. Part (a) showed ROC curves of SVM models for discriminating the SCC from BC group, and part (b) showed ROC curves of SVM models for discriminating the SCC from HC group. Abbreviations: ROC, receiver operating characteristic; AUC, area under the curve.

4. Discussion

In the present study, we constructed the SVM models with excellent performance that combined a variety of rs-fMRI functional parameters, including FC, ALFF, fALFF, ReHo, VMHC and DC with machine learning method, which could effectively discriminate breast cancer patients with chemotherapy-related SCC from breast cancer patients before chemotherapy and HCs, and these suggested the remarkable potentialities of rs-fMRI to identify CRCI and could provide more evidence for early clinical intervention.

4.1. SVM Classification

Based on multi-level rs-fMRI features, this study utilized one of the most popular machine learning classifiers SVM to discriminate breast cancer patients with chemotherapy-related SCC in breast cancer survivors with excellent classification accuracy and reliability. Kesler et al. [13] analyzed the DMN resting-state functional connectivity patterns, combined the SVM model, and discriminated chemotherapy-treated from non-chemotherapy-treated breast cancer survivors and healthy controls with high accuracy, suggesting DMN functional connectivity might be used as a neuroimaging marker for predicting CRCI. While the features type was limited to FC, local functional activity metrics were not considered. Similarly, Hosseini et al. [26] applied the multi-variate pattern analysis method to decoding the brain functional connectivity pattern during an executive-prefrontal task fMRI and built an SVM model for distinguishing chemotherapy-treated breast cancer patients. The connectivity of frontal lobe, supplementary motor area, and inferior parietal lobule brain regions contributed significantly to the model, but the classification performance was mediocre (the accuracy was about 70%). Kesler et al. [27] combined connectome-based predictive modeling [28] with rs-fMRI, built a random forest classifier model for unsupervised machine learning, and obtained three different biotypes in the breast cancer group with chemotherapy treatment. There were significant differences in cognitive impairment types and brain functional network connection patterns among patients with different biotypes. It suggested that there may be various clinical types of CRCI in breast cancer, which could provide new insights into the heterogeneity of cognitive symptoms in CRCI, but a large sample longitudinal follow-up study design is needed in the future to track individual cognitive trajectories. In addition, brain local functional variables and white matter network characteristics were also used to classify breast cancer patients after chemotherapy. Based on rs-fMRI and generalized q-sampling imaging, Chen et al. [29] constructed multiple machine learning models separately for classification of post-chemotherapy breast cancer patients versus healthy controls. Among them, the following showed good performance, and the classification accuracies could reach more than 80%: the logistic regression characterized by ReHo, generalized fractional anisotropy and normalized quantitative anisotropy; the classification and regression tree characterized by generalized fractional anisotropy; the XGBoost classifier characterized by normalized quantitative anisotropy. Furthermore, the effectiveness of these three classifiers was also verified by functional network and structural network constructed using graph theory analysis [30]. Among the features of topological network, the classification and regression tree and XGBoost constructed with the functional global efficiency as feature and the classification and regression tree model constructed with the structural transitivity as feature still obtained good accuracies (classification accuracies could reach more than 80%). Graph theory analysis simplified the connectivity relationships of complex brain topological networks. The use of different network metrics to quantitatively assess alterations in brain integrative and isolated functions may also provide new directions for investigating neuroimaging diagnostic markers of cognitive changes underlying CRCI in breast cancer. In this study, combined with the multi-level rs-fMRI features included brain functional activity (FC and VMHC), local functional activity (ALFF, fALFF and ReHo) and graph theory analysis (DC), and selected by t-test, removal of high pairwise correlation and LASSO regression, we finally built the linear kernel SVM models with excellent classification accuracy for distinguishing breast cancer patients with chemotherapy-related SCC from breast cancer patients before chemotherapy and healthy controls.

4.2. Rs-fMRI Features

The features screened between the SCC and BC group covered a wide range of brain network areas, but they were mainly distributed in DMN and subcortical regions. DMN was a set of brain regions that included hubs around the anterior and posterior medial cortex, bilateral temporal lobes, as well as superior frontal and parietal cortices, which characterized by whose activity is high when the mind is not engaged in specific behavioral tasks and low during focused attention on the external environment. These regions played important roles in internal orientation cognition, cognitive control and self-reference cognitive processing [31], which closely associated with a variety of neuropsychiatric diseases [32]. For instance, Feng et al. [33] reported the significant alterations of hippocampal functional connectivity with DMN mainly in the left insula, temporal lobe and the left inferior frontal gyrus in breast cancer patients underwent chemotherapy. In the previous study [13], the difference of functional connectivity in DMN was used as the imaging features for identifying breast cancer patients receiving chemotherapy. These findings suggested that abnormal functional alterations in DMN may be one of the most effective biomarkers for distinguishing CRCI in breast cancer. The subcortical regions involved hippocampus, amygdala and basal ganglia (caudate nucleus, putamen, pale balloon and claustrum) and other brain regions, which were associated with cognitive, emotional and social functioning, such as emotional regulation, long-term memory and spatial orientation [34,35,36,37]. Furthermore, the other brain networks involved in this mechanism, such as the frontal-parietal control network (FPCN), salience network (SN), cingular-opercular network (CON), auditory network (AN) and visual network (VN), suggested that cognitive impairment caused by chemotherapy may involve abnormal alterations in a wide range of functional networks in the whole brain. The features screened between the SCC and HC group seldom overlapped with those between the SCC and BC group, but the engaged brain network areas were comparable. In addition to the highest proportion in DMN regions, the rs-fMRI features selected between the SCC and HC group were also mainly involved FPCN and CON related brain regions. The FPCN, also called central executive network, including prefrontal lobe, dorsolateral prefrontal lobe, dorsolateral superior frontal lobe/anterior cingulate gyrus, inferior parietal anterior lobule and anterior insular cortex, which mainly involved in executive, top-down cognitive control processes and externally oriented cognition [38]. Miao et al. [39] took anterior cingulate cortex as the seed regions, reported there were lower functional connectivity with the bilateral superior frontal gyrus and cuneus, left medial frontal gyrus and middle temporal gyrus in breast cancer patients after receiving chemotherapy, and significantly correlated with the executive function. Chen et al. [40] also demonstrated that the breast cancer survivors who had undergone chemotherapy showed significantly lower regional functional activity in prefrontal cortex regions, further presented the disorder of functional activity of FPCN brain area in breast cancer survivors. The CON involved dorsal anterior cingulate gyrus/medial superior frontal cortex, anterior insula/frontal operculum and anterior prefrontal cortex area, was generally associated with the maintenance of cognitive setting during performance of cognitive tasks of external attention [41], and played a critical and causal role in switching between the FPCN and the DMN [42]. In a visual episodic memory task-fMRI study, Pergolizzi et al. [43] reported the increased activation of prefrontal cortex regions for the breast cancer group compared to controls for both before and after chemotherapy treatment; in addition, Chen et al. [40] showed similar findings by an rs-fMRI study, remarking that the alterations of functional activity in the CON might be one of the effective biomarkers to identify breast cancer patients after chemotherapy with cognitive impairment.

4.3. Comparison of Subjective and Objective Cognition between the SCC and BC Group

In this study, there was no significant difference in objective cognitive scores between the SCC and BC group, which corresponds to the results of previous studies [2,44]; meanwhile, in the subjective questionnaire, the total score of FACT-Cog in the SCC group was significantly lower than that in the BC group, and the perceived cognitive impairment and comments from others were significantly decreased in the SCC group, which indicated that the patients in the SCC group suffered more subjective cognitive impairment. Although there were no clear diagnostic criteria for FACT-Cog to confirm the decline of subjective cognitive function, according to a previous study [45], the total score of FACT-Cog decreased by 6.9–10.6 points, which could be diagnosed as subjective cognitive impairment. It suggested that the SCC group in this study was in accordance with the diagnosis of subjective cognitive impairment than the BC group at the group level.

4.4. Limitations

The current study has some limitations. First, the number of samples was still small, so increasing the sample size and verifying the model through external data sets would be our next research direction. Then, although the brain atlas used in this study is limited to the cerebrum and did not involve the cerebellum, the performance of the models were excellent, and other brain atlas and functional activity of the cerebellum could be considered in the future. Third, we only discussed the availability of functional features for rs-fMRI in this study. Given the multi-modal characteristics of MRI, a future study that combined with other MRI features such as gray and white matter volume and white matter fiber tract connectivity for the prediction of CRCI in breast cancer would be beneficial.

5. Conclusions

In this study, our findings demonstrated a valid machine learning approach using multiple rs-fMRI features that could effectively identify breast cancer patients with chemotherapy-related SCC from breast cancer patients without chemotherapy and healthy controls, providing potential neuroimaging evidence for early diagnosis of the occurrence of CRCI and clinical intervention in breast cancer patients.
  40 in total

1.  Impairment of the executive function in breast cancer patients receiving chemotherapy treatment: a functional MRI study.

Authors:  L Tao; H Lin; Y Yan; X Xu; L Wang; J Zhang; Y Yu
Journal:  Eur J Cancer Care (Engl)       Date:  2016-07-19       Impact factor: 2.520

2.  The Trail Making Test.

Authors:  Jordi Llinàs-Reglà; Joan Vilalta-Franch; Secundino López-Pousa; Laia Calvó-Perxas; David Torrents Rodas; Josep Garre-Olmo
Journal:  Assessment       Date:  2016-07-28

Review 3.  The basal ganglia: an overview of circuits and function.

Authors:  Amy A Utter; Michele A Basso
Journal:  Neurosci Biobehav Rev       Date:  2007-01-02       Impact factor: 8.989

4.  Default mode network connectivity distinguishes chemotherapy-treated breast cancer survivors from controls.

Authors:  Shelli R Kesler; Jeffrey S Wefel; S M Hadi Hosseini; Maria Cheung; Christa L Watson; Fumiko Hoeft
Journal:  Proc Natl Acad Sci U S A       Date:  2013-06-24       Impact factor: 11.205

5.  DPARSF: A MATLAB Toolbox for "Pipeline" Data Analysis of Resting-State fMRI.

Authors:  Yan Chao-Gan; Zang Yu-Feng
Journal:  Front Syst Neurosci       Date:  2010-05-14

6.  Functional connectome biotypes of chemotherapy-related cognitive impairment.

Authors:  Shelli R Kesler; Melissa L Petersen; Vikram Rao; Rebecca A Harrison; Oxana Palesh
Journal:  J Cancer Surviv       Date:  2020-03-10       Impact factor: 4.442

7.  A comprehensive analysis of resting state fMRI measures to classify individual patients with Alzheimer's disease.

Authors:  Frank de Vos; Marisa Koini; Tijn M Schouten; Stephan Seiler; Jeroen van der Grond; Anita Lechner; Reinhold Schmidt; Mark de Rooij; Serge A R B Rombouts
Journal:  Neuroimage       Date:  2017-11-14       Impact factor: 6.556

8.  Multivariate pattern analysis of FMRI in breast cancer survivors and healthy women.

Authors:  S M Hadi Hosseini; Shelli R Kesler
Journal:  J Int Neuropsychol Soc       Date:  2013-10-18       Impact factor: 2.892

9.  Chemotherapy-induced changes of cerebral activity in resting-state functional magnetic resonance imaging and cerebral white matter in diffusion tensor imaging.

Authors:  Caiqin Mo; Hailong Lin; Fangmeng Fu; Lin Lin; Jie Zhang; Meng Huang; Chuan Wang; Yunjing Xue; Qing Duan; Weiwen Lin; Xiangjin Chen
Journal:  Oncotarget       Date:  2017-05-23

10.  Global, Regional, and National Cancer Incidence, Mortality, Years of Life Lost, Years Lived With Disability, and Disability-Adjusted Life-Years for 29 Cancer Groups, 1990 to 2017: A Systematic Analysis for the Global Burden of Disease Study.

Authors:  Christina Fitzmaurice; Degu Abate; Naghmeh Abbasi; Hedayat Abbastabar; Foad Abd-Allah; Omar Abdel-Rahman; Ahmed Abdelalim; Amir Abdoli; Ibrahim Abdollahpour; Abdishakur S M Abdulle; Nebiyu Dereje Abebe; Haftom Niguse Abraha; Laith Jamal Abu-Raddad; Ahmed Abualhasan; Isaac Akinkunmi Adedeji; Shailesh M Advani; Mohsen Afarideh; Mahdi Afshari; Mohammad Aghaali; Dominic Agius; Sutapa Agrawal; Ayat Ahmadi; Elham Ahmadian; Ehsan Ahmadpour; Muktar Beshir Ahmed; Mohammad Esmaeil Akbari; Tomi Akinyemiju; Ziyad Al-Aly; Assim M AlAbdulKader; Fares Alahdab; Tahiya Alam; Genet Melak Alamene; Birhan Tamene T Alemnew; Kefyalew Addis Alene; Cyrus Alinia; Vahid Alipour; Syed Mohamed Aljunid; Fatemeh Allah Bakeshei; Majid Abdulrahman Hamad Almadi; Amir Almasi-Hashiani; Ubai Alsharif; Shirina Alsowaidi; Nelson Alvis-Guzman; Erfan Amini; Saeed Amini; Yaw Ampem Amoako; Zohreh Anbari; Nahla Hamed Anber; Catalina Liliana Andrei; Mina Anjomshoa; Fereshteh Ansari; Ansariadi Ansariadi; Seth Christopher Yaw Appiah; Morteza Arab-Zozani; Jalal Arabloo; Zohreh Arefi; Olatunde Aremu; Habtamu Abera Areri; Al Artaman; Hamid Asayesh; Ephrem Tsegay Asfaw; Alebachew Fasil Ashagre; Reza Assadi; Bahar Ataeinia; Hagos Tasew Atalay; Zerihun Ataro; Suleman Atique; Marcel Ausloos; Leticia Avila-Burgos; Euripide F G A Avokpaho; Ashish Awasthi; Nefsu Awoke; Beatriz Paulina Ayala Quintanilla; Martin Amogre Ayanore; Henok Tadesse Ayele; Ebrahim Babaee; Umar Bacha; Alaa Badawi; Mojtaba Bagherzadeh; Eleni Bagli; Senthilkumar Balakrishnan; Abbas Balouchi; Till Winfried Bärnighausen; Robert J Battista; Masoud Behzadifar; Meysam Behzadifar; Bayu Begashaw Bekele; Yared Belete Belay; Yaschilal Muche Belayneh; Kathleen Kim Sachiko Berfield; Adugnaw Berhane; Eduardo Bernabe; Mircea Beuran; Nickhill Bhakta; Krittika Bhattacharyya; Belete Biadgo; Ali Bijani; Muhammad Shahdaat Bin Sayeed; Charles Birungi; Catherine Bisignano; Helen Bitew; Tone Bjørge; Archie Bleyer; Kassawmar Angaw Bogale; Hunduma Amensisa Bojia; Antonio M Borzì; Cristina Bosetti; Ibrahim R Bou-Orm; Hermann Brenner; Jerry D Brewer; Andrey Nikolaevich Briko; Nikolay Ivanovich Briko; Maria Teresa Bustamante-Teixeira; Zahid A Butt; Giulia Carreras; Juan J Carrero; Félix Carvalho; Clara Castro; Franz Castro; Ferrán Catalá-López; Ester Cerin; Yazan Chaiah; Wagaye Fentahun Chanie; Vijay Kumar Chattu; Pankaj Chaturvedi; Neelima Singh Chauhan; Mohammad Chehrazi; Peggy Pei-Chia Chiang; Tesfaye Yitna Chichiabellu; Onyema Greg Chido-Amajuoyi; Odgerel Chimed-Ochir; Jee-Young J Choi; Devasahayam J Christopher; Dinh-Toi Chu; Maria-Magdalena Constantin; Vera M Costa; Emanuele Crocetti; Christopher Stephen Crowe; Maria Paula Curado; Saad M A Dahlawi; Giovanni Damiani; Amira Hamed Darwish; Ahmad Daryani; José das Neves; Feleke Mekonnen Demeke; Asmamaw Bizuneh Demis; Birhanu Wondimeneh Demissie; Gebre Teklemariam Demoz; Edgar Denova-Gutiérrez; Afshin Derakhshani; Kalkidan Solomon Deribe; Rupak Desai; Beruk Berhanu Desalegn; Melaku Desta; Subhojit Dey; Samath Dhamminda Dharmaratne; Meghnath Dhimal; Daniel Diaz; Mesfin Tadese Tadese Dinberu; Shirin Djalalinia; David Teye Doku; Thomas M Drake; Manisha Dubey; Eleonora Dubljanin; Eyasu Ejeta Duken; Hedyeh Ebrahimi; Andem Effiong; Aziz Eftekhari; Iman El Sayed; Maysaa El Sayed Zaki; Shaimaa I El-Jaafary; Ziad El-Khatib; Demelash Abewa Elemineh; Hajer Elkout; Richard G Ellenbogen; Aisha Elsharkawy; Mohammad Hassan Emamian; Daniel Adane Endalew; Aman Yesuf Endries; Babak Eshrati; Ibtihal Fadhil; Vahid Fallah Omrani; Mahbobeh Faramarzi; Mahdieh Abbasalizad Farhangi; Andrea Farioli; Farshad Farzadfar; Netsanet Fentahun; Eduarda Fernandes; Garumma Tolu Feyissa; Irina Filip; Florian Fischer; James L Fisher; Lisa M Force; Masoud Foroutan; Marisa Freitas; Takeshi Fukumoto; Neal D Futran; Silvano Gallus; Fortune Gbetoho Gankpe; Reta Tsegaye Gayesa; Tsegaye Tewelde Gebrehiwot; Gebreamlak Gebremedhn Gebremeskel; Getnet Azeze Gedefaw; Belayneh K Gelaw; Birhanu Geta; Sefonias Getachew; Kebede Embaye Gezae; Mansour Ghafourifard; Alireza Ghajar; Ahmad Ghashghaee; Asadollah Gholamian; Paramjit Singh Gill; Themba T G Ginindza; Alem Girmay; Muluken Gizaw; Ricardo Santiago Gomez; Sameer Vali Gopalani; Giuseppe Gorini; Bárbara Niegia Garcia Goulart; Ayman Grada; Maximiliano Ribeiro Guerra; Andre Luiz Sena Guimaraes; Prakash C Gupta; Rahul Gupta; Kishor Hadkhale; Arvin Haj-Mirzaian; Arya Haj-Mirzaian; Randah R Hamadeh; Samer Hamidi; Lolemo Kelbiso Hanfore; Josep Maria Haro; Milad Hasankhani; Amir Hasanzadeh; Hamid Yimam Hassen; Roderick J Hay; Simon I Hay; Andualem Henok; Nathaniel J Henry; Claudiu Herteliu; Hagos D Hidru; Chi Linh Hoang; Michael K Hole; Praveen Hoogar; Nobuyuki Horita; H Dean Hosgood; Mostafa Hosseini; Mehdi Hosseinzadeh; Mihaela Hostiuc; Sorin Hostiuc; Mowafa Househ; Mohammedaman Mama Hussen; Bogdan Ileanu; Milena D Ilic; Kaire Innos; Seyed Sina Naghibi Irvani; Kufre Robert Iseh; Sheikh Mohammed Shariful Islam; Farhad Islami; Nader Jafari Balalami; Morteza Jafarinia; Leila Jahangiry; Mohammad Ali Jahani; Nader Jahanmehr; Mihajlo Jakovljevic; Spencer L James; Mehdi Javanbakht; Sudha Jayaraman; Sun Ha Jee; Ensiyeh Jenabi; Ravi Prakash Jha; Jost B Jonas; Jitendra Jonnagaddala; Tamas Joo; Suresh Banayya Jungari; Mikk Jürisson; Ali Kabir; Farin Kamangar; André Karch; Narges Karimi; Ansar Karimian; Amir Kasaeian; Gebremicheal Gebreslassie Kasahun; Belete Kassa; Tesfaye Dessale Kassa; Mesfin Wudu Kassaw; Anil Kaul; Peter Njenga Keiyoro; Abraham Getachew Kelbore; Amene Abebe Kerbo; Yousef Saleh Khader; Maryam Khalilarjmandi; Ejaz Ahmad Khan; Gulfaraz Khan; Young-Ho Khang; Khaled Khatab; Amir Khater; Maryam Khayamzadeh; Maryam Khazaee-Pool; Salman Khazaei; Abdullah T Khoja; Mohammad Hossein Khosravi; Jagdish Khubchandani; Neda Kianipour; Daniel Kim; Yun Jin Kim; Adnan Kisa; Sezer Kisa; Katarzyna Kissimova-Skarbek; Hamidreza Komaki; Ai Koyanagi; Kristopher J Krohn; Burcu Kucuk Bicer; Nuworza Kugbey; Vivek Kumar; Desmond Kuupiel; Carlo La Vecchia; Deepesh P Lad; Eyasu Alem Lake; Ayenew Molla Lakew; Dharmesh Kumar Lal; Faris Hasan Lami; Qing Lan; Savita Lasrado; Paolo Lauriola; Jeffrey V Lazarus; James Leigh; Cheru Tesema Leshargie; Yu Liao; Miteku Andualem Limenih; Stefan Listl; Alan D Lopez; Platon D Lopukhov; Raimundas Lunevicius; Mohammed Madadin; Sameh Magdeldin; Hassan Magdy Abd El Razek; Azeem Majeed; Afshin Maleki; Reza Malekzadeh; Ali Manafi; Navid Manafi; Wondimu Ayele Manamo; Morteza Mansourian; Mohammad Ali Mansournia; Lorenzo Giovanni Mantovani; Saman Maroufizadeh; Santi Martini S Martini; Tivani Phosa Mashamba-Thompson; Benjamin Ballard Massenburg; Motswadi Titus Maswabi; Manu Raj Mathur; Colm McAlinden; Martin McKee; Hailemariam Abiy Alemu Meheretu; Ravi Mehrotra; Varshil Mehta; Toni Meier; Yohannes A Melaku; Gebrekiros Gebremichael Meles; Hagazi Gebre Meles; Addisu Melese; Mulugeta Melku; Peter T N Memiah; Walter Mendoza; Ritesh G Menezes; Shahin Merat; Tuomo J Meretoja; Tomislav Mestrovic; Bartosz Miazgowski; Tomasz Miazgowski; Kebadnew Mulatu M Mihretie; Ted R Miller; Edward J Mills; Seyed Mostafa Mir; Hamed Mirzaei; Hamid Reza Mirzaei; Rashmi Mishra; Babak Moazen; Dara K Mohammad; Karzan Abdulmuhsin Mohammad; Yousef Mohammad; Aso Mohammad Darwesh; Abolfazl Mohammadbeigi; Hiwa Mohammadi; Moslem Mohammadi; Mahdi Mohammadian; Abdollah Mohammadian-Hafshejani; Milad Mohammadoo-Khorasani; Reza Mohammadpourhodki; Ammas Siraj Mohammed; Jemal Abdu Mohammed; Shafiu Mohammed; Farnam Mohebi; Ali H Mokdad; Lorenzo Monasta; Yoshan Moodley; Mahmood Moosazadeh; Maryam Moossavi; Ghobad Moradi; Mohammad Moradi-Joo; Maziar Moradi-Lakeh; Farhad Moradpour; Lidia Morawska; Joana Morgado-da-Costa; Naho Morisaki; Shane Douglas Morrison; Abbas Mosapour; Seyyed Meysam Mousavi; Achenef Asmamaw Muche; Oumer Sada S Muhammed; Jonah Musa; Ashraf F Nabhan; Mehdi Naderi; Ahamarshan Jayaraman Nagarajan; Gabriele Nagel; Azin Nahvijou; Gurudatta Naik; Farid Najafi; Luigi Naldi; Hae Sung Nam; Naser Nasiri; Javad Nazari; Ionut Negoi; Subas Neupane; Polly A Newcomb; Haruna Asura Nggada; Josephine W Ngunjiri; Cuong Tat Nguyen; Leila Nikniaz; Dina Nur Anggraini Ningrum; Yirga Legesse Nirayo; Molly R Nixon; Chukwudi A Nnaji; Marzieh Nojomi; Shirin Nosratnejad; Malihe Nourollahpour Shiadeh; Mohammed Suleiman Obsa; Richard Ofori-Asenso; Felix Akpojene Ogbo; In-Hwan Oh; Andrew T Olagunju; Tinuke O Olagunju; Mojisola Morenike Oluwasanu; Abidemi E Omonisi; Obinna E Onwujekwe; Anu Mary Oommen; Eyal Oren; Doris D V Ortega-Altamirano; Erika Ota; Stanislav S Otstavnov; Mayowa Ojo Owolabi; Mahesh P A; Jagadish Rao Padubidri; Smita Pakhale; Amir H Pakpour; Adrian Pana; Eun-Kee Park; Hadi Parsian; Tahereh Pashaei; Shanti Patel; Snehal T Patil; Alyssa Pennini; David M Pereira; Cristiano Piccinelli; Julian David Pillay; Majid Pirestani; Farhad Pishgar; Maarten J Postma; Hadi Pourjafar; Farshad Pourmalek; Akram Pourshams; Swayam Prakash; Narayan Prasad; Mostafa Qorbani; Mohammad Rabiee; Navid Rabiee; Amir Radfar; Alireza Rafiei; Fakher Rahim; Mahdi Rahimi; Muhammad Aziz Rahman; Fatemeh Rajati; Saleem M Rana; Samira Raoofi; Goura Kishor Rath; David Laith Rawaf; Salman Rawaf; Robert C Reiner; Andre M N Renzaho; Nima Rezaei; Aziz Rezapour; Ana Isabel Ribeiro; Daniela Ribeiro; Luca Ronfani; Elias Merdassa Roro; Gholamreza Roshandel; Ali Rostami; Ragy Safwat Saad; Parisa Sabbagh; Siamak Sabour; Basema Saddik; Saeid Safiri; Amirhossein Sahebkar; Mohammad Reza Salahshoor; Farkhonde Salehi; Hosni Salem; Marwa Rashad Salem; Hamideh Salimzadeh; Joshua A Salomon; Abdallah M Samy; Juan Sanabria; Milena M Santric Milicevic; Benn Sartorius; Arash Sarveazad; Brijesh Sathian; Maheswar Satpathy; Miloje Savic; Monika Sawhney; Mehdi Sayyah; Ione J C Schneider; Ben Schöttker; Mario Sekerija; Sadaf G Sepanlou; Masood Sepehrimanesh; Seyedmojtaba Seyedmousavi; Faramarz Shaahmadi; Hosein Shabaninejad; Mohammad Shahbaz; Masood Ali Shaikh; Amir Shamshirian; Morteza Shamsizadeh; Heidar Sharafi; Zeinab Sharafi; Mehdi Sharif; Ali Sharifi; Hamid Sharifi; Rajesh Sharma; Aziz Sheikh; Reza Shirkoohi; Sharvari Rahul Shukla; Si Si; Soraya Siabani; Diego Augusto Santos Silva; Dayane Gabriele Alves Silveira; Ambrish Singh; Jasvinder A Singh; Solomon Sisay; Freddy Sitas; Eugène Sobngwi; Moslem Soofi; Joan B Soriano; Vasiliki Stathopoulou; Mu'awiyyah Babale Sufiyan; Rafael Tabarés-Seisdedos; Takahiro Tabuchi; Ken Takahashi; Omid Reza Tamtaji; Mohammed Rasoul Tarawneh; Segen Gebremeskel Tassew; Parvaneh Taymoori; Arash Tehrani-Banihashemi; Mohamad-Hani Temsah; Omar Temsah; Berhe Etsay Tesfay; Fisaha Haile Tesfay; Manaye Yihune Teshale; Gizachew Assefa Tessema; Subash Thapa; Kenean Getaneh Tlaye; Roman Topor-Madry; Marcos Roberto Tovani-Palone; Eugenio Traini; Bach Xuan Tran; Khanh Bao Tran; Afewerki Gebremeskel Tsadik; Irfan Ullah; Olalekan A Uthman; Marco Vacante; Maryam Vaezi; Patricia Varona Pérez; Yousef Veisani; Simone Vidale; Francesco S Violante; Vasily Vlassov; Stein Emil Vollset; Theo Vos; Kia Vosoughi; Giang Thu Vu; Isidora S Vujcic; Henry Wabinga; Tesfahun Mulatu Wachamo; Fasil Shiferaw Wagnew; Yasir Waheed; Fitsum Weldegebreal; Girmay Teklay Weldesamuel; Tissa Wijeratne; Dawit Zewdu Wondafrash; Tewodros Eshete Wonde; Adam Belay Wondmieneh; Hailemariam Mekonnen Workie; Rajaram Yadav; Abbas Yadegar; Ali Yadollahpour; Mehdi Yaseri; Vahid Yazdi-Feyzabadi; Alex Yeshaneh; Mohammed Ahmed Yimam; Ebrahim M Yimer; Engida Yisma; Naohiro Yonemoto; Mustafa Z Younis; Bahman Yousefi; Mahmoud Yousefifard; Chuanhua Yu; Erfan Zabeh; Vesna Zadnik; Telma Zahirian Moghadam; Zoubida Zaidi; Mohammad Zamani; Hamed Zandian; Alireza Zangeneh; Leila Zaki; Kazem Zendehdel; Zerihun Menlkalew Zenebe; Taye Abuhay Zewale; Arash Ziapour; Sanjay Zodpey; Christopher J L Murray
Journal:  JAMA Oncol       Date:  2019-12-01       Impact factor: 31.777

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.