Literature DB >> 34473513

Analysis of Metabolite and Lipid Association Networks Reveals Molecular Mechanisms Associated with 3-Month Mortality and Poor Functional Outcomes in Patients with Acute Ischemic Stroke after Thrombolytic Treatment with Recombinant Tissue Plasminogen Activator.

Cristina Licari1, Leonardo Tenori1,2,3, Betti Giusti4,5,6, Elena Sticchi4, Ada Kura4,5, Rosina De Cario4, Domenico Inzitari7,8, Benedetta Piccardi7, Mascia Nesi7, Cristina Sarti9, Francesco Arba10, Vanessa Palumbo7, Patrizia Nencini7, Rossella Marcucci4,5,6, Anna Maria Gori4,5,6, Claudio Luchinat1,2,3, Edoardo Saccenti11.   

Abstract

Here, we present an integrated multivariate, univariate, network reconstruction and differential analysis of metabolite-metabolite and metabolite-lipid association networks built from an array of 18 serum metabolites and 110 lipids identified and quantified through nuclear magnetic resonance spectroscopy in a cohort of 248 patients, of which 22 died and 82 developed a poor functional outcome within 3 months from acute ischemic stroke (AIS) treated with intravenous recombinant tissue plasminogen activator. We explored differences in metabolite and lipid connectivity of patients who did not develop a poor outcome and who survived the ischemic stroke from the related opposite conditions. We report statistically significant differences in the connectivity patterns of both low- and high-molecular-weight metabolites, implying underlying variations in the metabolic pathway involving leucine, glycine, glutamine, tyrosine, phenylalanine, citric, lactic, and acetic acids, ketone bodies, and different lipids, thus characterizing patients' outcomes. Our results evidence the promising and powerful role of the metabolite-metabolite and metabolite-lipid association networks in investigating molecular mechanisms underlying AIS patient's outcome.

Entities:  

Keywords:  lipidome; metabolomics; multivariate exploratory analysis; nuclear magnetic resonance; thrombolysis

Mesh:

Substances:

Year:  2021        PMID: 34473513      PMCID: PMC8491161          DOI: 10.1021/acs.jproteome.1c00406

Source DB:  PubMed          Journal:  J Proteome Res        ISSN: 1535-3893            Impact factor:   4.466


Introduction

Acute ischemic stroke (AIS) is caused by thrombosis or embolism that occludes a cerebral vessel cutting the blood flow to an area of the brain; this results in a loss of neurological function. Usually, there is permanent and irreversible damage to part of the affected brain area and an area of penumbra where the function is lost, but the brain is not irreversibly damaged.[1] AIS is the leading cause of long-term disability in developing countries and one of the most common causes of mortality worldwide.[1] It is estimated that more than 13.7 million people suffer an AIS (i.e., one in six people will have an AIS in their life) and 5.8 million die as a consequence.[1] Substantial progress has been made in recent years in both diagnosis and treatment to minimize the impact of AIS on the patients,[1] and treatments such as intravenous thrombolysis and endovascular clot retrieval, aiming to remove blood clots and restore blood flow, have been shown to improve outcomes of AIS patients that concern mortality and disability.[2−4] Metabolic perturbations are believed to be fundamental events that contribute to the ischemic stroke and to its progression and subsequent unfavorable outcomes,[5−12] and comprehensive analytical techniques can provide a great chance to identify key metabolic features involved in the onset and progression of this disease. Nuclear magnetic resonance (NMR)-based metabolomics allows a high-throughput analysis of various types of samples (e.g., blood, urine, cells, and tissue), providing information of hundreds of different metabolites and lipid features present in biological matrices.[13,14] Multivariate and univariate analyses proved to be efficient in characterizing the metabolic signature of diseases[15−17] and in the context of molecular epidemiology,[18,19] but integrative systems biology techniques offer a comprehensive representation of the structural and functional characteristics of a certain living organism, helping in the understanding of the inter-relationships among metabolic features on the basis of the system behavior.[20] Association networks can provide interesting information to describe the status of the biological system under study or to compare the same across different conditions, and correlation among metabolite and lipid levels measured in blood can be used to model and infer, at least partially, the structure of the underlying biological network.[21] In this light, network analysis has proven to be an impressive and powerful tool to deepen the knowledge and interpret the complexity of metabolomics data.[22−26] In particular, for metabolomics studies, the exploration of association networks was revealed to be more efficient when different conditions are compared in the context of a differential network analysis.[22,25,27] In this work, using data from the Italian multicenter observational MArker bioloGici nell’Ictus Cerebrale (MAGIC) study,[28,29] we performed a systems biology investigation (combining network analysis with standard univariate, multivariate analysis and classification, see Figure ) of serum circulating metabolites, lipoproteins, and lipid fractions measured 24 h post-thrombolysis with the aim of providing insights into possible molecular mechanisms associated with the 3-month (3 M) functional outcome (FO) and mortality in a group of 248 patients with AIS treated with intravenous thrombolytic treatment with recombinant tissue plasminogen activator (rt-PA). Because 80% of acute infarctions show arterial occlusions,[30] thrombolytic canalization of occluded arteries may reduce the degree of injury to the brain if it is done before the process of infarction has been completed; treatment with rt-PA is the approved treatment for AIS.[31−33] The rt-PA is an ∼70 kDa serine protease protein, which is found in several mammalian cells, especially in endothelial cells, the cells lining the blood vessels. It specifically cleavages the arginine–valine bond in plasminogen to form plasmin, another serine protease, which is the major enzyme that dissolves fibrin blood clots.
Figure 1

Graphical illustration of the analysis followed to explore differences of metabolite and serum profiles of patients who suffered AIS. The AIS is recorded at time t, while serum samples were collected at t1, that is, 24 h after the thrombolytic intervention (post rt-PA samples). Patient’s survival and patient’s FO were evaluated after 3 months. Subjects/samples were retrospectively divided into four groups of interest samples, according to the outcome: (i) 3M-nD: patients who were alive (nondeceased nD) at three months (3 M) after AIS (n = 226); (ii) 3M-D: patients who were not alive (deceased D) at three months (3 M) after AIS (n = 22); (iii) 3M-GFO: patients with a GFO at three months (3 M) after AIS (n = 166); and (iv) 3M-PFO: patients with a PFO at three months (3 M) after AIS (n = 82). Groups were compared using a combination of univariate analysis, an unsupervised exploratory approach (PCA), classification modeling (Random Forest) and network inference, and analysis of metabolite–lipid association networks for 3M-PFO3M-GFO.

Graphical illustration of the analysis followed to explore differences of metabolite and serum profiles of patients who suffered AIS. The AIS is recorded at time t, while serum samples were collected at t1, that is, 24 h after the thrombolytic intervention (post rt-PA samples). Patient’s survival and patient’s FO were evaluated after 3 months. Subjects/samples were retrospectively divided into four groups of interest samples, according to the outcome: (i) 3M-nD: patients who were alive (nondeceased nD) at three months (3 M) after AIS (n = 226); (ii) 3M-D: patients who were not alive (deceased D) at three months (3 M) after AIS (n = 22); (iii) 3M-GFO: patients with a GFO at three months (3 M) after AIS (n = 166); and (iv) 3M-PFO: patients with a PFO at three months (3 M) after AIS (n = 82). Groups were compared using a combination of univariate analysis, an unsupervised exploratory approach (PCA), classification modeling (Random Forest) and network inference, and analysis of metabolite–lipid association networks for 3M-PFO3M-GFO. Our analysis shows that dysregulations in the connectivity of triglycerides, high-density lipoprotein (HDL), low-density lipoprotein (LDL), and very-low-density lipoprotein (VLDL) fractions and related subfractions, leucine, glycine, glutamine, tyrosine, phenylalanine, citrate, acetate, lactate, acetone, and 3-hydroxybutyrate are relevant molecular features for the characterization of post-AIS outcomes.

Materials and Methods

Study Population

The subjects and study samples considered are from the MAGIC study,[28,29] which originally comprises 327 subjects: only subjects for whom serum specimen was available for metabolomics analysis are considered here (n = 248). The study group consists of patients who had an AIS and were admitted for thrombolysis treatment with rt-PA in 14 different Italian centers, registered in the Safe Implementation of Thrombolysis in Stroke-International Stroke Thrombolysis Register (SITS-ISTR, www.sitsinternational.org), according to SITS-Monitoring Study criteria.[34] Serum samples were collected 24 h after rt-PA (t1), and outcomes were defined at evaluation as follows: (i) mortality at 3 months after AIS (t2 = t0 + 3 months) and (ii) disability (impairment) at 3 months after AIS (t2). See Figure for a graphical overview. The 248-patient group constitutes a random subset of the original cohort: all demographic and clinical characteristics and risk factors, known to affect the poststroke poor/adverse outcomes, do not statistically differ (P-value > 0.05) between the original cohort and the group considered in this study (see Table ).
Table 1

Comparison between Demographic and Clinical Characteristics of Patients Enrolled in the Original MAGIC Study (n = 327)[28,29] and Those Analyzed in the Present Study where Metabolomics Analysis Was Performed (n = 248)

demographic and clinical characteristics at baseline (mean ± standard deviation SD)this study (n = 248)original study group (n = 327)P-value
age (years)68.8 ± 11.968.9 ± 12.00.88
sex (male), n1371900.68
onset to treatment time (minutes)163.4 ± 83.7163.5 ± 75.70.86
baseline National Institute of Health stroke scale11.9 ± 6.111.9 ± 6.00.94
baseline systolic blood pressure (mmHg)147.5 ± 21.3148.2 ± 21.70.69
baseline diastolic blood pressure (mmHg)79.7 ± 12.780.1 ± 12.70.71
blood glucose (mg/dL)130.2 ± 49.5130.2 ± 47.90.99
risk factors
hypertension (m)1431970.77
diabetes (m)36500.89
hyperlipidemia (m)56810.68
current smoking (m)35510.70
atrial fibrillation (m)56730.83
congestive heart failure (m)26350.98

Definition of Patient Groups

Study subjects were divided and analyzed in four groups of interest. (i) 3M-GFO: patients with a good functional outcome (GFO) at 3 months (3 M) after AIS (n = 166). (ii) 3M-PFO: patients with a poor functional outcome (PFO) at 3 months (3 M) after AIS (n = 82). (iii) 3M-nD: patients who were alive (nondeceased, nD) at 3 months (3 M) after AIS (n = 226). (iv) 3M-D: patients who were not alive (deceased, D) at 3 months (3 M) after AIS (n = 22). The patient FO was defined according to the modified ranking scale (MRS).[35,36] The MRS measures a patient’s independence rather than performance of specific tasks and incorporates mental as well as physical adaptations to the neurological deficits.[37] The scale consists of six grades, from 0 to 5, indicating (adapted from Table from refs (35, 36)): 0: No symptoms. 1: No significant disability, despite symptoms; able to perform all usual duties and activities. 2: Slight disability; unable to perform all previous activities but able to look after own affairs without assistance. 3: Moderate disability; requires some help, but able to walk without assistance. 4: Moderately severe disability; unable to walk without assistance and unable to attend to own bodily needs without assistance. 5: Severe disability; bedridden, incontinent, and requires constant nursing care and attention. Study subjects were dichotomized into good (MRS 0–2) and poor (MRS ≥ 3–5) outcome patients as evaluated at 3 months after stroke. The PFO on the MRS was defined as ≥3 on the basis of what was observed in medical literature.[38]

Ethical Issues

The study protocol was approved in every participating center from local ethical committee. All patients gave informed consent. The study was in compliance with the Declaration of Helsinki.[39]

Sample Collection

Whole venous blood was collected in tubes without anticoagulant 24 h after thrombolysis (t1). Tubes were centrifuged at room temperature at 1500g for 15 min, and the supernatants were stored in aliquots at −80 °C until NMR measurements. Samples were analyzed in a unique NMR facility.

NMR Experiments

Serum samples were analyzed using a Bruker 600 MHz spectrometer working at 600.13 MHz proton Larmor frequency equipped with a 5 mm PATXI 1H-13C-15N and 2H decoupling probe. This includes a z axis gradient coil, an automatic tuning-matching, and an automatic and refrigerate sample changer (SampleJet). To stabilize approximately, at a level of ±0.1 K, the sample temperature (310 K), a BTO 2000 thermocouple was employed, and each NMR tube was kept for at least 5 min inside the NMR probe head to equilibrate the acquisition temperature of 310 K. The analytical preparation of serum samples and their NMR spectra acquisition followed established procedures.[13] For each serum specimen, the 1D nuclear Overhauser effect spectroscopy (NOESY) pulse sequence was applied to acquire 1H-NMR spectra. Raw NMR data were multiplied by an exponential function of 0.3 Hz line-broadening factor, before the application of Fourier transform. Phase and baseline distortions were automatically corrected, and transformed spectra were calibrated to the glucose doublet at 5.24 ppm using TopSpin 3.2 (BrukerBioSpin).

Metabolite and Lipid Identification and Quantification

One hundred twenty-eight (J = 128) analytes (18 metabolites and 110 lipoprotein and lipid fractions) were unambiguously identified and quantified using the AVANCE Bruker IVDr (Clinical Screening and In Vitro Diagnostics research, Bruker BioSpin) software using the 1D NOESY NMR spectra.[40] For each lipid main class (VLDL, LDL, intermediate-density lipoprotein (IDL), and HDL) and subclass (VLDL-1 to VLDL-5, LDL-1 to LDL-6, and HDL-1 to HDL-4), reported data consist of concentrations of lipids (total cholesterol, free cholesterol, phospholipids, and triglycerides) contained in each fraction. Concentrations of apolipoproteins Apo-A1 and ApoA2 were estimated for the HDL class and each relative subclass, while Apo-B concentrations are calculated for VLDL and IDL classes and all LDL subclasses. A complete list of quantified analytes can be found in Supplementary Tables S1–S4.

Univariate Analysis

The Mann–Whitney–Wilcoxon test[41] was used to compare the concentration of the J = 128 analytes (18 metabolites +110 lipoproteins and lipid concentrations) between patient groups (3M-PFO vs 3M-GFO, 3M-nD vs 3M-D) treated with the thrombolytic therapy. The Benjamini–Hochberg method[42] was used to correct for multiple testing; analytes for which false discovery rate (FDR) <0.01 are considered statistically significant and discussed in this paper.

Multivariate Exploratory and Classification

Principal Component Analysis (PCA)

PCA[43] was applied on all quantified analytes (metabolites + lipoproteins and lipid fractions) from serum samples collected at t1 (24 h post rt-PA, see Figure for an overview), to investigate, in an unsupervised manner, the data structure and highlight the possible presence of metabolite and lipid signatures differentiating (i) patients with the PFO (3M-PFO) from those with the GFO (3M-GFO) and (ii) patients who were alive (3M-nD) from those who were not (3M-D) at 3 months from the AIS. Analysis was performed on data scaled to unit variance.[44]

Random Forest Modeling

The Random Forest algorithm was employed for sample classification;[45] two classification models were built to discriminate 3M-GFO/3M-PFO and 3M-nD/3M-D patients using samples collected at t1 (Table ). Considering the unbalanced number of subjects in each group to be compared, Random Forest models were built after the two groups to be compared were made of the same size using a resample approach: (20 randomly sampled observations were used for the 3M-D vs 3M-nD comparison; 80 were used for the 3M-GFO vs 3M-PFO); 100 resampling iterations were performed to take into account the (re)sampling variability.
Table 2

Mean Values of Accuracy, Specificity, Sensitivity, and Corresponding 95% CIs of Random Forest Classification Models Built on the Metabolite and Lipid Profiles of Patients Who Suffered AISa

 model quality measures
RF modelaccuracy mean—95%CIspecificity mean—95%CIsensitivity mean—95%CI
3M-nD vs 3M-D53.8 (51.9, 55.6)57.5 (55.6, 59.5)50.0 (47.8, 52.2)
3M-GFO vs 3M-PFO59.8 (59.1, 60.4)60.5 (59.7, 61.4)59.1 (58.2, 59.9)

The classification models considered are (i) 3M-nD patients (alive at 3 months after AIS, n = 226) versus 3M-D patients (deceased at 3 months after AIS, n = 22) and (ii) 3M-GFO patients (with a GFO at 3 months after AIS, n = 166) vs 3M-PFO patients (with a PFO at 3 months after AIS, n = 82).

The classification models considered are (i) 3M-nD patients (alive at 3 months after AIS, n = 226) versus 3M-D patients (deceased at 3 months after AIS, n = 22) and (ii) 3M-GFO patients (with a GFO at 3 months after AIS, n = 166) vs 3M-PFO patients (with a PFO at 3 months after AIS, n = 82). Accuracy, sensitivity, and specificity of each classification model were calculated according to standard definitions.[46] Average values and 95% confidence interval (CI) are calculated over the 100 repetitions.

Network Analysis

Reconstruction of Association Networks

Metabolite–lipid correlation networks were constructed using the probabilistic context likelihood relatedness on correlation (PCLRC) algorithm.[22] This algorithm estimates correlation considering the background distribution of correlation (implementing the CLRC approach[47]) and using resampling to obtain robust estimations.[48] The algorithm outputs a J × J matrix P (with J the total number of variables/molecular features) containing the likelihood 0 ≤ p ≤ 1 of every correlation r that is used to filter background correlations. In particular, for the correlation r between two metabolites i and j:

Determining the Significance of Metabolite and Lipid Differential Connectivity

Differences in terms of connectivity among metabolic features in each couple of networks (3M-PFO vs 3M-GFO and 3M-nD vs 3M-D patients) were analyzed 24 h after rt-PA administration (t1). The connectivity of the i metabolite or i lipid is given by and differential connectivity is defined as:where χ1 and χ2 are the connectivity of metabolite or lipid i estimated from metabolite–lipid association networks calculated from data from conditions 1 and 2, respectively, (i.e., 3M-GFO and 3M-PFO, 3M-nD, and 3M-D, at t1). The statistical significance of the metabolite and lipid differential connectivity was established using a permutation test (n = 1000) according to a previously described publication.[25] Metabolites, lipoproteins, and lipid fractions that were statistically significantly connected (P-value < 0.05 after adjustment for multiple corrections with the Benjamini–Hochberg method) were considered to be related to the specific condition under study (poststroke 3-months impairment/death).

Software

All calculations were performed using R (version 3.6.2). Random Forest was performed using the R “randomForest” package,[45] using the default settings. The R code for the PCLRC algorithm and the code to perform differential connectivity analysis are available at link: semantics.systemsbiology.nl under the SOFTWARE tab.

Results and Discussion

Univariate Analysis

The concentrations of blood metabolites, lipoproteins, and lipid fractions were compared between the different patient groups (3M-D vs 3M-nD and 3M-PFO vs 3M-GFO): results are given in Tables and 4, respectively. When comparing patients with the PFO and GFO at 3 months after thrombolytic treatment (Table ), 18 out of 128 analytes have concentrations significantly different between the two groups (P-value <0.01) of which only 3 are significant after correction for multiple testing (FDR < 0.01). A similar situation is observed for the comparison between patients who survived or died at 3 months after treatment: only 5 out of 128 analytes (Table ) have concentrations significantly different between the two groups (P-value <0.01); however, these differences are not significant once correction for multiple testing is applied (FDR < 0.01).
Table 3

Results of Univariate Analysis (Mann–Whitney–Wilcoxon Test) for the Comparison of the Concentration Levels of Metabolite and Lipoproteins and Lipid Fractions in Patients with Poor (3M-PFO) and Good (3M-GFO) functional outcome at 3 months after AIS and treatment with rt-PAa

 patient groups
    
metabolite/lipid3M-GFO3M-PFOP-valueFDRLog2(FC)trend
3-hydroxybutyrate0.10 ± 0.120.24 ± 0.230.000030.00431.26
SubApoB_LDL-36.70 ± 3.448.71 ± 3.260.00010.00440.38
LDL3_PNb121.78 ± 62.42158.41 ± 59.350.00010.00440.38
SubFreeChol_LDL-33.84 ± 1.864.80 ± 1.580.00040.01180.32
SubPhosp_LDL-36.20 ± 2.978.04 ± 3.220.00050.01180.37
SubChol_LDL-39.96 ± 6.2513.54 ± 6.120.00060.01240.44
acetone0.09 ± 0.090.16 ± 0.130.00070.01290.78
phenylalanine0.08 ± 0.030.09 ± 0.030.00080.01280.17
SubTrigl_HDL-43.35 ± 0.992.91 ± 0.820.00150.0208–0.21
Apo-B100-Apo-A10.61 ± 0.150.66 ± 0.140.00160.02080.12
LMF_FreeChol_LDL27.3 ± 8.9131.43 ± 8.250.00210.02360.20
SubFreeChol_VLDL-51.12 ± 0.510.87 ± 0.440.00220.0236–0.36
SubPhosp_VLDL-51.90 ± 0.731.63 ± 0.500.00450.0442–0.22
SubChol_VLDL-51.600 ± 0.761.41 ± 0.710.00550.0502–0.19
LMF_Trigl_LDL20.53 ± 5.9123.85 ± 6.020.00590.05040.22
citric acid0.14 ± 0.040.16 ± 0.060.00730.05650.19
SubTrigl_LDL-64.51 ± 1.224.98 ± 1.360.00750.05650.14
SubFreeChol_LDL-42.24 ± 1.852.97 ± 2.240.00980.06830.41
glucose6.70 ± 1.787.40 ± 1.850.01010.06830.14
SubTrigl_LDL-22.30 ± 0.762.64 ± 0.850.01110.07000.20
LMF_Phosp_LDL51.69 ± 15.4857.27 ± 16.090.01340.07850.15
LMF_ApoB_LDL60.2 ± 20.1967.02 ± 21.550.01410.07850.15
LDL_PNb1094.52 ± 367.121218.62 ± 391.780.01410.07850.15
SubFreeChol_HDL-21.75 ± 0.51.98 ± 0.690.01660.08590.17
acetic acid0.05 ± 0.030.06 ± 0.040.01680.08590.26
SubTrigl_LDL-41.75 ± 1.252.26 ± 1.350.01830.09000.37
SubTrigl_LDL-32.64 ± 0.672.86 ± 0.550.01990.09340.11
LDL-Chol89.91 ± 29.698.16 ± 30.330.02120.09340.13
LMF_Chol_LDL89.91 ± 29.698.16 ± 30.330.02120.09340.13
LDL-HDL-Chol1.71 ± 0.631.94 ± 0.580.02470.10440.18
glutamine0.64 ± 0.160.58 ± 0.190.02560.1044–0.13
LDL2_PNb183.26 ± 63.07207.11 ± 69.980.02680.10440.18
SubApoB_LDL-210.08 ± 3.4711.39 ± 3.850.02690.10440.18
SubPhosp_LDL-29.87 ± 3.4811.43 ± 3.620.03290.12400.21
SubFreeChol_HDL-13.82 ± 1.824.15 ± 1.600.03690.13450.12
Apo-B10081.59 ± 23.0787.27 ± 23.470.04770.16480.10
TPNb1483.43 ± 419.521586.76 ± 426.770.04770.16480.10
SubFreeChol_LDL-26.23 ± 1.936.9 ± 2.580.04890.16480.15

In total, 128 blood analytes (18 metabolites and 110 lipoproteins/lipid fractions) were quantified using NMR. Only results for analytes for which the unadjusted raw P-value is <0.05 are reported: median (± MAD, median absolute deviation) in the two groups, raw P-value, Adjusted P-value (FDR, Benjamini–Hochberg false discovery rate), Log2 of the fold change, and trend (↓ decreasing trend, ↑ increasing trend referred to the 3M-PFO group). The concentrations of lipoproteins and lipid fractions are in mg/dL; the concentrations of metabolites are in mmol/L.

Particle number (PN) expressed as nmol/L. Abbreviations: Chol, cholesterol; LMF, lipoprotein main fraction; Phosp, phospholipid; PN, particle number; Sub, subfraction; and Trigl, triglycerides. A table containing results for all 128 analytes can be found in Supplementary Table S1.

Table 4

Results of Univariate Analysis (Mann–Whitney–Wilcoxon Test) for the Comparison of the Concentration Levels of Metabolite and Lipoproteins and Lipid Fractions in the Nondeceased (3M-nD) and Deceased (3M-D) Patients at 3 Months after AIS and Treatment with Rt-PAa

 patient groups
    
analyte3M-nD3M-DP-valueFDRLog2(FC)trend
SubTrigl_HDL-43.25 ± 0.992.46 ± 1.090.0010.1307–0.40
SubApoA1_HDL-469.23 ± 15.6857.14 ± 17.010.00720.2418–0.28
phenylalanine0.08 ± 0.030.10 ± 0.040.00870.24180.32
lactic acid2.3 ± 1.043.10 ± 0.890.00890.24180.43
citric acid0.15 ± 0.050.20 ± 0.080.00940.24180.38
3-hydroxybutyrate0.14 ± 0.160.26 ± 0.240.01290.27580.95
SubPhosp_HDL-423.31 ± 6.3718.48 ± 7.580.02070.3382–0.34
SubChol_VLDL-51.50 ± 0.701.27 ± 0.610.02530.3382–0.24
SubApoA2_HDL-418.45 ± 4.5714.60 ± 5.400.02990.3382–0.34
SubChol_HDL-115.45 ± 7.0617.99 ± 8.480.03070.33820.22
SubPhosp_VLDL-51.79 ± 0.661.54 ± 0.380.03120.3382–0.21
LMF_ApoA2_HDL30.81 ± 5.0928.44 ± 5.540.03620.3382–0.12
SubFreeChol_HDL-21.79 ± 0.532.24 ± 0.560.04020.33820.32
LMF_ApoA1_HDL132.35 ± 24121.96 ± 19.090.04140.3382–0.12
Apo-A230.14 ± 5.1527.89 ± 6.120.04200.3382–0.11
acetone0.12 ± 0.110.17 ± 0.120.04530.33820.44
SubChol_HDL-418.37 ± 5.0614.43 ± 7.810.04720.3382–0.35
SubChol_LDL-511.14 ± 7.866.66 ± 6.450.04820.3382–0.74

In total, 128 blood analytes (18 metabolites and 110 lipoproteins/lipid fractions) were quantified using NMR. Only results for analytes for which the unadjusted raw P-value is <0.05 are reported: median (± MAD, median absolute deviation) in the two groups, raw P-value, adjusted P-value (FDR, Benjamini-Hochberg false discovery rate), Log2 of the fold change, and trend (↓ decreasing trend, ↑ increasing trend referred to the 3M-D group). The concentrations of lipoproteins and lipid fractions are in mg/dL; the concentrations of metabolites are in mmol/L.

In total, 128 blood analytes (18 metabolites and 110 lipoproteins/lipid fractions) were quantified using NMR. Only results for analytes for which the unadjusted raw P-value is <0.05 are reported: median (± MAD, median absolute deviation) in the two groups, raw P-value, Adjusted P-value (FDR, Benjamini–Hochberg false discovery rate), Log2 of the fold change, and trend (↓ decreasing trend, ↑ increasing trend referred to the 3M-PFO group). The concentrations of lipoproteins and lipid fractions are in mg/dL; the concentrations of metabolites are in mmol/L. Particle number (PN) expressed as nmol/L. Abbreviations: Chol, cholesterol; LMF, lipoprotein main fraction; Phosp, phospholipid; PN, particle number; Sub, subfraction; and Trigl, triglycerides. A table containing results for all 128 analytes can be found in Supplementary Table S1. In total, 128 blood analytes (18 metabolites and 110 lipoproteins/lipid fractions) were quantified using NMR. Only results for analytes for which the unadjusted raw P-value is <0.05 are reported: median (± MAD, median absolute deviation) in the two groups, raw P-value, adjusted P-value (FDR, Benjamini-Hochberg false discovery rate), Log2 of the fold change, and trend (↓ decreasing trend, ↑ increasing trend referred to the 3M-D group). The concentrations of lipoproteins and lipid fractions are in mg/dL; the concentrations of metabolites are in mmol/L.

Multivariate Exploratory Analysis

PCA was applied, as a multivariate exploratory approach, on all 128 quantified analytes (metabolites and lipoproteins and lipid fractions) of all available samples, to obtain an overview of the variation in the data and to check for the presence of metabolic signatures among the different groups compared. Results are shown in Figure ; there is no obvious separation among the samples of patients with the PFO (3M-PFO) and GFO (3M-GFO) and of patients who were alive (3M-nD) or deceased (3M-D) at 3 months from the AIS.
Figure 2

Scatter plots of PCA. Each dot represents the serum metabolic profile of patients who suffered AIS at 24 h post rt-PA. (A) Analysis of 3M-nD patients (alive at 3 months after AIS, n = 226, green dots) and 3M-D patients (deceased at 3 months after AIS, n = 22, blue dots). (B) Analysis of 3M-GFO patients (with GFO at 3 months after AIS, n = 166, orange dots) and 3M-PFO patients (with PFO at 3 months after AIS, n = 82, purple dots).

Scatter plots of PCA. Each dot represents the serum metabolic profile of patients who suffered AIS at 24 h post rt-PA. (A) Analysis of 3M-nD patients (alive at 3 months after AIS, n = 226, green dots) and 3M-D patients (deceased at 3 months after AIS, n = 22, blue dots). (B) Analysis of 3M-GFO patients (with GFO at 3 months after AIS, n = 166, orange dots) and 3M-PFO patients (with PFO at 3 months after AIS, n = 82, purple dots).

Prediction of Patient Outcome with Random Forest

Because PCA analysis was not able to highlight observable differences in serum profiles of the different patient groups (3M-D and 3M-nD; 3M-GFO and 3M-PFO), we used the supervised classification method (Random Forest) to investigate whether the metabolite and lipid profiles could be employed to classify 3M-GFO/3M-PFO patient groups: all classification models (3M-D vs 3M-nD; 3M-GFO vs 3M-PFO) built on metabolite and lipoprotein/lipid fraction concentrations had low discriminating power, as shown in Table . Altogether, the common multivariate analysis of serum profiles of AIS patients proved to be unsuccessful to identify multiple spectral characteristics that are different between 3M-PFO and 3M-GFO or between 3M-nD and 3M-D.

Differential Network Analysis

We built serum metabolite–lipid association networks specific for 3M-PFO/3M-GFO and 3M-nD/3M-D patients at t1 (24 h post rt-PA) with the scope of investigating possible perturbations in patients’ metabolic status that could be captured by differential network analysis: the rationale is that metabolites participating in the same metabolic pathway tend to have higher levels of correlations and connectivity,[49] while a significantly decreased metabolite may indicate a reduced role of certain pathways where those metabolites participate.

Differential Analysis of Metabolite–Lipid Association Networks Associated with the Patient FO at 3 Months after Thrombolysis Treatment

The metabolite and lipid association networks specific to 3M-GFO and 3M-PFO patients are given in Figure A,B, respectively, while differential connectivity plots (for metabolites) are reported in Figure A. Statistically significant differences in connectivity are reported for glutamine, tyrosine, leucine, lactate, acetone, acetate, and glycine. Results of differential connectivity analysis for lipoprotein and lipid fractions are given in Supplementary Table S3.
Figure 3

Metabolite–metabolite and metabolite–lipid association networks for (A) 3M-PFO and (B) 3M-GFO patients. Networks are reconstructed using the PCLRC algorithm from serum metabolites and lipid fractions from samples collected 24 h post rt-PA (t1). The two networks show only the nodes (and corresponding edges) that are found to be significantly differentially connected (FDR < 0.05); see eqs and 3, Figure , and associated captions. Only edges corresponding to correlations between lipids and metabolites |r| > 0.6 are shown (eq ). Note that a differentially connected node can have edges to nondifferentially connected nodes which are, in consequence, also shown. Correlation networks have been reconstructed using the PCLRC algorithm. Nodes are arranged and colored (from pink to purple) according to connectivity (i.e., number of connecting edges, aka degree). Abbreviations are reported as follows: analytes: 3-HB, 3-hydroxybutyrate; Apo, Apolipoproteins; Chol, cholesterol; LMF, lipoprotein main fractions; Phosp, phospholipids; PN, particle number; Sub, subfractions; and Trigl, triglycerides. Amino acids are reported with a three letter code.

Figure 4

Differential connectivity analysis. Scatter plot of metabolite differential connectivity (see eqs and 3) against statistical significance (P-value corrected (FDR) for multiple testing using the Benjamini–Hochberg approach) obtained by means of permutation test.[25] The horizontal lines indicate the 0.01 significance threshold α on the -log(p-val) scale. (A) Comparison of metabolite–metabolite association networks for patients with poor (3M-PFO) and good functional outcome (3M-GFO) at 3 months after AIS and thrombolysis treatment. (B) Comparison of metabolite–metabolite association networks for patients deceased (3M-D) and alive (3M-nD) at 3 months after AIS and thrombolysis treatment. Results of differential connectivity analysis for lipids are given in Supplementary Tables S1 and S2.

Metabolite–metabolite and metabolite–lipid association networks for (A) 3M-PFO and (B) 3M-GFO patients. Networks are reconstructed using the PCLRC algorithm from serum metabolites and lipid fractions from samples collected 24 h post rt-PA (t1). The two networks show only the nodes (and corresponding edges) that are found to be significantly differentially connected (FDR < 0.05); see eqs and 3, Figure , and associated captions. Only edges corresponding to correlations between lipids and metabolites |r| > 0.6 are shown (eq ). Note that a differentially connected node can have edges to nondifferentially connected nodes which are, in consequence, also shown. Correlation networks have been reconstructed using the PCLRC algorithm. Nodes are arranged and colored (from pink to purple) according to connectivity (i.e., number of connecting edges, aka degree). Abbreviations are reported as follows: analytes: 3-HB, 3-hydroxybutyrate; Apo, Apolipoproteins; Chol, cholesterol; LMF, lipoprotein main fractions; Phosp, phospholipids; PN, particle number; Sub, subfractions; and Trigl, triglycerides. Amino acids are reported with a three letter code. Differential connectivity analysis. Scatter plot of metabolite differential connectivity (see eqs and 3) against statistical significance (P-value corrected (FDR) for multiple testing using the Benjamini–Hochberg approach) obtained by means of permutation test.[25] The horizontal lines indicate the 0.01 significance threshold α on the -log(p-val) scale. (A) Comparison of metabolite–metabolite association networks for patients with poor (3M-PFO) and good functional outcome (3M-GFO) at 3 months after AIS and thrombolysis treatment. (B) Comparison of metabolite–metabolite association networks for patients deceased (3M-D) and alive (3M-nD) at 3 months after AIS and thrombolysis treatment. Results of differential connectivity analysis for lipids are given in Supplementary Tables S1 and S2. The alteration of lactic acid connections observed in patients with impairment could suggest its decreased role in providing substitute energy fuel and in the metabolic pathways of neuroprotection where lactic acid is normally largely involved; in fact, the transition from aerobic to anaerobic glycolysis is enhanced to support the increasing demand of energy. As a result, the production of pyruvate and lactate increases, and this last one can be shuttled to neurons to guarantee neuron protection and survival.[50] We observed a reduction of 3-hydroxybutyrate concentration (P-value = 3 × 10–5 and FDR = 0.0043) in patients with the PFO; there are also a decreasing trend for glucose (P-value = 0.0101 and FDR = 0.0683) and an increase of acetone (P-value = 0.0007 and FDR = 0.0129) which are, however, not significant after adjustment. Changes in the connectivity of leucine, citric acid, acetate, and acetone specific to patients who developed neurological adverse outcomes treated with thrombolysis after the ischemic stroke indicate unbalances in the energy metabolism and oxidative stress-related pathways: alterations in brain energy metabolism are linked to energy deficits associated with ischemia and reperfusion injury, and downregulation of citric acid has been associated with the PFO after AIS,[11] while the metabolism of ketone bodies is upregulated to provide alternative energy sources and to maintain free radical homeostasis during ischemia–reperfusion injury.[51,52] Increased glutamine connectivity for patients with an adverse outcome suggests alterations in glutamine/glutamate metabolism. Glutamine is a main precursor of glutamate, and both are interconverted among astrocytes and neurons, guaranteeing glutamine homeostasis and glutamate generation and recycling. However, if glutamate generation and recycling are impaired, glutamate can be an excitatory and possibly toxic neurotransmitter, which can lead to glutamate-induced neurotoxicity. Alterations in glutamine/glutamate metabolism have been observed in patients with ischemic stroke, and increasing levels of serum glutamine were associated with compensatory adaptative mechanisms to counteract glutamate-induced neurotoxicity.[53] Moreover, we observed increased levels of phenylalanine (P-value = 0.0008 and FDR = 0.0128) in patients with the PFO and differential connectivity of tyrosine. This suggests that phenylalanine and its metabolite tyrosine might be associated with glutamate-induced neurotoxicity, because phenylalanine can suppress the excitatory glutamatergic synaptic transmission.[54] Summarizing, the metabolic profiles of 3M-PFO patients are consistent with the hypothesis of deregulated glutamate metabolism and subsequent glutamate-induced neurotoxicity that seems responsible for the worsening of poststroke quality of life. We observed increased glycine connectivity for 3M-PFO patients, indicating a possible role of glycine in impairment. The role of glycine for AIS is quite controversial. Recent studies demonstrated that lower levels of glycine are deleterious for ischemic neuronal injury, while higher levels of the same metabolite seem to be neuroprotective.[55,56] We found altered patterns of connectivity among almost all lipid features (see Supplementary Table S3), indicating that overall alteration and remodulation of lipid metabolism may be involved in poststroke adverse outcome and neurological disabilities. Several studies have explored the relationships between lipidic features and ischemic stroke,[6,9,57,58] demonstrating how these molecules play dual roles in the etiology and progression of the disease. Serum cholesterol has been found to be an independent predictor for long-term FOs, and higher serum total cholesterol levels have been associated with better prognosis.[59] Triacylglycerols have been significantly associated with ischemic stroke.[60] In the metabolite–lipid association network specific to 3M-PFO AIS patients, triglycerides show a decreased connectivity. Because triglycerides are hydrolyzed to fatty acids to provide alternative energy sources, we associated decreased connectivity with alterations in the triglyceride metabolism leading to a decreased role of triacylglycerols in supporting alternative energy fuel in patients who developed a PFO poststroke. This is line with previous observations regarding the general condition of energy failure that characterizes the topology of the association network of 3M-PFO patients. The metabolites and lipids highlighted by the differential network analysis are involved in the mechanisms guaranteeing energy homeostasis and show decreased connectivity in the specific network of patients who developed a PFO 3 months after the ischemic stroke.

Differential Analysis of Metabolite–Lipid Association Networks Associated with Patient Mortality at 3 Months after Thrombolysis Treatment

The metabolite–lipid association networks specific for 3M-nD and 3M-D AIS patients are shown in Figure . The networks are strikingly different, with the network built from the samples of patients who did not survive at 3 months after AIS being totally disconnected (Figure B). We shall comment that two groups (3M-nD and 3M-D) are different in size (n = 226 and n = 22, respectively), and this may have influenced the reconstruction of the networks. However, n = 22 samples is sufficient to estimate a bivariate correlation >0.5 with 80% power at the α = 0.05 significant level: the two networks shown in Figure are restricted to nodes that are differentially connected and have node–node correlation |r| > 0.6; thus the difference in the network structure is likely due to underlying biological differences rather than a bias induced by the different sample size.
Figure 5

Metabolite–metabolite and metabolite–lipid association networks for (A) 3M-nD and (B) 3M-D patients. Networks are reconstructed using the PCLRC algorithm from serum metabolites and lipid fractions from samples collected 24 h post rt-PA (t1). The two networks show only the nodes (and corresponding edges) that are found to be significantly differentially connected (FDR < 0.05); see eqs and 3, Figure , and associated captions. Only edges corresponding to correlations between lipids and metabolites |r| > 0.6 are shown (eq ). Note that a differentially connected node can have edges to nondifferentially connected nodes which are, in consequence, also shown. Correlation networks have been reconstructed using the PCLRC algorithm. Nodes are arranged and colored (from pink to purple) according to connectivity (i.e., number of connecting edges, aka degree). Abbreviations are reported as follows: analytes: 3-HB, 3-hydroxybutyrate; Apo, Apolipoproteins; Chol, cholesterol; LMF, lipoproteins main fractions; Phosp, phospholipids; PN, particle number; Sub, subfractions; and Trigl, triglycerides. Amino acids are reported with a three letter code.

Metabolite–metabolite and metabolite–lipid association networks for (A) 3M-nD and (B) 3M-D patients. Networks are reconstructed using the PCLRC algorithm from serum metabolites and lipid fractions from samples collected 24 h post rt-PA (t1). The two networks show only the nodes (and corresponding edges) that are found to be significantly differentially connected (FDR < 0.05); see eqs and 3, Figure , and associated captions. Only edges corresponding to correlations between lipids and metabolites |r| > 0.6 are shown (eq ). Note that a differentially connected node can have edges to nondifferentially connected nodes which are, in consequence, also shown. Correlation networks have been reconstructed using the PCLRC algorithm. Nodes are arranged and colored (from pink to purple) according to connectivity (i.e., number of connecting edges, aka degree). Abbreviations are reported as follows: analytes: 3-HB, 3-hydroxybutyrate; Apo, Apolipoproteins; Chol, cholesterol; LMF, lipoproteins main fractions; Phosp, phospholipids; PN, particle number; Sub, subfractions; and Trigl, triglycerides. Amino acids are reported with a three letter code. There is a statistically significant reduction in the connectivity of blood circulating citric acid and acetone and several lipid fractions in the correlation networks of patients who, after 3 months, did not survive the acute cerebral ischemia (Figure B; results of differential connectivity analysis for lipoprotein and lipid fractions are given in Supplementary Table S4). In particular, we observed a loss of structural connections between metabolites and LDL-related fractions. Citric acid showed also higher concentrations (P-value = 0.0094) in deceased patients, although significance disappears after adjustment for multiple corrections (FDR = 0.2418) As previously discussed, citric acid and ketone bodies are involved in energy metabolism, and their levels can change during and after the brain stroke to restore energy homeostasis. Our results suggest that dysregulations in energy metabolism may be associated also with underlying causes related to an increased risk of death at 3 months from the AIS. As in the previous case, we observed a statistically significant differential connectivity of several lipoproteins and lipid fractions (see Supplementary Table S4). In particular, we observed a decrease of LDL connectivity (especially VLDL and LDL-5 and LDL-6 subparticles), in the network specific to patients deceased at 3 months after AIS. Lipoproteins and lipids have been associated with IS;[61] small dense LDL (sdLDL) and small-sized HDL particles are established risk factors for this disease. It has been shown that AIS is associated with adverse distributions of LDL and HDL subclasses, and short-term mortality is linked to increased levels of sdLDL particles.[62] Because sdLDLs are more susceptible to oxidation than larger LDLs, we suggest that sdLDL particles may provide an optimal substrate for rt-PA-induced oxidative action and that alterations in the connectivity patterns of lipid subfractions reflect an increase in the rt-PA-mediated oxidative damage associated with poststroke mortality. There is evidence that ketone bodies and ketone body metabolism play a role in the pathologic and functional outcomes following stroke,[63] and changes in the metabolism of ketone bodies have been observed during stress conditions and reperfusion oxidative stress.[64] Ketone bodies are the only circulating substrates in addition to glucose known to contribute significantly to cerebral metabolism; however, the exact role of ketone bodies and the precise mechanisms whereby they can provide protection in ischemic stroke and thus being associated with reduced mortality and/or better FO in AIS patients are largely unknown.[64] During ischemic stroke, oxygen levels fall resulting in mitochondria malfunction: this induces a short-term ketosis, and increased reliance on ketone metabolism (which is enzymatically simpler and more efficient than glucose or pyruvate metabolism) seems to be a mechanism of cerebral metabolic adaptation[65] and is reported to increase global cerebral blood flow.[66,67] Our results indicate strong perturbation in the processes involving serum acetone and VLDL-related subfractions, 3-hydroxybutyrate, and free cholesterol linked to VLDL-1 subfractions. In particular, disruption of the connectivity of acetone and VLDL again suggests remodulation of energy metabolisms. Overall, the reduction of metabolite–lipid connectivity for 3 M-D patients may suggest alterations in lipid metabolism during cerebral ischemia, which can strongly affect poststroke mortality, as well as the development of poststroke PFO.

Conclusions

In this study, we have analyzed serum circulating metabolites and lipids of patients who suffered AIS with the aim of highlighting molecular mechanisms associated with the patient FO and mortality. Metabolite and lipoprotein and lipid fraction concentrations were measured on patients 24 h treatment with rt-PA using NMR and mortality, and FOs were evaluated at 3 months after stroke. We applied an integrated top-down system-biology approach deploying standard univariate and multivariate analysis together with machine learning and network analysis. While standard approaches failed to discriminate between the patient groups, network analysis was successful in detecting marked metabolic differences that could be related to the development of post-AIS PFO and mortality. Although the patterns of dysregulated metabolite and lipoprotein and lipid fraction correlation cannot be used at the patient level as prognostic markers for mortality and FO, this analysis provides a working hypothesis that warrants further investigation at both the molecular and patient levels. We showed that dysregulations of metabolic mechanisms involving triglycerides, HDL, LDL, and VLDL fractions, and related subfractions), amino acids (leucine, glycine, glutamine, tyrosine, and phenylalanine), organic acids (citric, lactic, and acetic acids), and ketone bodies (acetone, 3-hydroxybutyrate) are associated with patient mortality suggesting a role of energy failure, glutamate-induced neurotoxicity, oxidative stress, and neuroprotection in determining patient survival at 3 months after AIS. Of particular interest is the involvement of lipid and lipid metabolism with patients’ mortality and FO, which warrant further investigation in the light of expanding field of lipidomic research. Furthermore, ketone bodies emerged as largely involved in the determination of both 3-month outcomes (PFO and mortality) in ischemic stroke treated with thrombolysis, which reinforce already existing evidence. In conclusion, this study affords important information on how metabolite–metabolite and metabolite–lipid association networks of AIS patients differ according to the patient outcomes and highlight the utility of the analysis of biological networks. Finally, to be translated to predictive biomarkers one should search for markers in blood that can be measured at the patient level and are representative of metabolic perturbation. Our analysis/results, being exploratory in nature, as all network-based analyses, suggest where to search for such markers, that is, to which metabolic pathways to look at.
  59 in total

1.  Metabolic Signature of Primary Biliary Cholangitis and Its Comparison with Celiac Disease.

Authors:  Alessia Vignoli; Beatrice Orlandini; Leonardo Tenori; Maria Rosa Biagini; Stefano Milani; Daniela Renzi; Claudio Luchinat; Antonino Salvatore Calabrò
Journal:  J Proteome Res       Date:  2019-01-10       Impact factor: 4.466

2.  Age and Sex Effects on Plasma Metabolite Association Networks in Healthy Subjects.

Authors:  Alessia Vignoli; Leonardo Tenori; Claudio Luchinat; Edoardo Saccenti
Journal:  J Proteome Res       Date:  2017-11-21       Impact factor: 4.466

3.  Lipidomic analysis of plasma in patients with lacunar infarction using normal-phase/reversed-phase two-dimensional liquid chromatography-quadrupole time-of-flight mass spectrometry.

Authors:  Li Yang; Pu Lv; Wanpeng Ai; Linnan Li; Sensen Shen; Honggang Nie; Yabing Shan; Yu Bai; Yining Huang; Huwei Liu
Journal:  Anal Bioanal Chem       Date:  2017-03-01       Impact factor: 4.142

4.  1H-NMR-based metabolomics study of cerebral infarction.

Authors:  Jee Youn Jung; Ho-Sub Lee; Dae-Gill Kang; No Soo Kim; Min Ho Cha; Ok-Sun Bang; Do Hyun Ryu; Geum-Sook Hwang
Journal:  Stroke       Date:  2011-04-07       Impact factor: 7.914

5.  Local and systemic metabolic alterations in brain, plasma, and liver of rats in response to aging and ischemic stroke, as detected by nuclear magnetic resonance (NMR) spectroscopy.

Authors:  Umadevi V Wesley; Vijesh J Bhute; James F Hatcher; Sean P Palecek; Robert J Dempsey
Journal:  Neurochem Int       Date:  2019-01-30       Impact factor: 3.921

6.  A metabonomic investigation on the biochemical perturbation in post-stroke patients with depressive disorder (PSD).

Authors:  Xinghua Ding; Ruoxu Liu; Wenkai Li; Hengjia Ni; Yong Liu; Dandan Wu; Shuguang Yang; Jing Liu; Bo Xiao; Shaojun Liu
Journal:  Metab Brain Dis       Date:  2015-11-05       Impact factor: 3.584

7.  The evolution of connectivity in metabolic networks.

Authors:  Thomas Pfeiffer; Orkun S Soyer; Sebastian Bonhoeffer
Journal:  PLoS Biol       Date:  2005-06-28       Impact factor: 8.029

8.  Centering, scaling, and transformations: improving the biological information content of metabolomics data.

Authors:  Robert A van den Berg; Huub C J Hoefsloot; Johan A Westerhuis; Age K Smilde; Mariët J van der Werf
Journal:  BMC Genomics       Date:  2006-06-08       Impact factor: 3.969

9.  Lipids, Lipoproteins, and Metabolites and Risk of Myocardial Infarction and Stroke.

Authors:  Michael V Holmes; Iona Y Millwood; Christiana Kartsonaki; Michael R Hill; Derrick A Bennett; Ruth Boxall; Yu Guo; Xin Xu; Zheng Bian; Ruying Hu; Robin G Walters; Junshi Chen; Mika Ala-Korpela; Sarah Parish; Robert J Clarke; Richard Peto; Rory Collins; Liming Li; Zhengming Chen
Journal:  J Am Coll Cardiol       Date:  2018-02-13       Impact factor: 24.094

10.  Understanding and using sensitivity, specificity and predictive values.

Authors:  Rajul Parikh; Annie Mathai; Shefali Parikh; G Chandra Sekhar; Ravi Thomas
Journal:  Indian J Ophthalmol       Date:  2008 Jan-Feb       Impact factor: 1.848

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.