Literature DB >> 25409020

Influence of pistachios on performance and exercise-induced inflammation, oxidative stress, immune dysfunction, and metabolite shifts in cyclists: a randomized, crossover trial.

David C Nieman1, Johannes Scherr2, Beibei Luo3, Mary Pat Meaney1, Didier Dréau4, Wei Sha5, Dustin A Dew1, Dru A Henson6, Kirk L Pappan7.   

Abstract

OBJECTIVES: Pistachio nut ingestion (3 oz./d, two weeks) was tested for effects on exercise performance and 21-h post-exercise recovery from inflammation, oxidative stress, immune dysfunction, and metabolite shifts.
METHODS: Using a randomized, crossover approach, cyclists (N = 19) engaged in two 75-km time trials after 2-weeks pistachio or no pistachio supplementation, with a 2-week washout period. Subjects came to the lab in an overnight fasted state, and ingested water only or 3 oz. pistachios with water before and during exercise. Blood samples were collected 45 min pre-exercise, and immediately post-, 1.5-h post-, and 21-h post-exercise, and analyzed for plasma cytokines, C-reactive protein (CRP), F2-isoprostanes (F2-IsoP), granulocyte phagocytosis (GPHAG) and oxidative burst activity (GOBA), and shifts in metabolites.
RESULTS: Performance time for the 75-km time trial was 4.8% slower under pistachio conditions (2.84 ± 0.11 and 2.71 ± 0.07 h, respectively, P = 0.034). Significant time effects were shown for plasma cytokines, CRP, F2-IsoP, GPHAG, and GOBA, with few group differences. Metabolomics analysis revealed 423 detectable compounds of known identity, with significant interaction effects for 19 metabolites, especially raffinose, (12Z)-9,10-Dihydroxyoctadec-12-enoate (9,10-DiHOME), and sucrose. Dietary intake of raffinose was 2.19 ± 0.15 and 0.35 ± 0.08 mg/d during the pistachio and no pistachio periods, and metabolomics revealed that colon raffinose and sucrose translocated to the circulation during exercise due to increased gut permeability. The post-exercise increase in plasma raffinose correlated significantly with 9,10-DiHOME and other oxidative stress metabolites.
CONCLUSIONS: In summary, 2-weeks pistachio nut ingestion was associated with reduced 75-km cycling time trial performance and increased post-exercise plasma levels of raffinose, sucrose, and metabolites related to leukotoxic effects and oxidative stress. TRIAL REGISTRATION: ClinicalTrials.gov NCT01821820.

Entities:  

Mesh:

Substances:

Year:  2014        PMID: 25409020      PMCID: PMC4237504          DOI: 10.1371/journal.pone.0113725

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Prolonged and intensive exercise causes transient physiologic stress, elevations in biomarkers related to inflammation and oxidative stress, immune dysfunction, and disturbances in host pathogen defense [1]. Immunonutrition support for athletes is a burgeoning area of scientific investigation, and a variety of nutritional products have been tested as countermeasures to exercise-induced indicators of physiologic stress [2]. Carbohydrate ingestion before, during, and after heavy exercise has emerged as an effective but partial countermeasure to immune dysfunction, with favorable effects on measures related to stress hormones and inflammation, but limited effects on oxidative stress and markers of innate or adaptive immunity. Other products that have been tested with mixed utility include vitamins and minerals, glutamine and other amino acids, β-glucan, flavonoids and polyphenols, N-3 polyunsaturated fatty acids (N-3 PUFAs or fish oil), unique plant extracts, and food products (e.g., chocolate milk, bananas, and raisins) [3]. In a randomized, crossover study with 14 trained cyclists, we showed that acute ingestion of bananas (with water) or a commercial sports drink supported 75-km cycling performance and underlying metabolic processes (as measured with metabolomics) to a similar degree when the rate of carbohydrate delivery was equated [4]. Exercise-induced inflammation, oxidative stress, and changes in innate immune function were also comparable between banana and sports drink trials, and at attenuated levels during recovery when compared to previous water-only trials that we have conducted [5]. There is growing interest in using water with food products instead of sports drinks to improve nutrient intake and health while supporting performance and recovery. Pistachios (480 kcal per 3 oz serving) are nutrient-dense nuts that contain a unique nutrient profile of proteins and carbohydrates (∼30% of energy), fats (∼70% of energy), minerals (in particular, copper, iron, magnesium), potassium, vitamins B6 and thiamin, carotenoids, phytosterols, and phenolic acids [6]. Among tree nuts, pistachios are one of the best sources for water- and fat-soluble antioxidants. The nutrient mix in pistachio nuts has been associated with reductions in oxidative stress and inflammation in community trials and thus may serve as an effective countermeasure to exercise-induced inflammation and oxidative stress, but this has not yet been investigated [7], [8]. We hypothesized that ingestion of 3 ounces (85 g) of pistachio nuts per day for two weeks before and the day of cycling intensely for 75 kilometers would support performance and substrate utilization compared to water only, and attenuate inflammation, oxidative stress, and immune dysfunction during 21 hours of recovery. Metabolomics is the simultaneous measurement of all detectable small molecules or metabolites present in biological samples such as biofluids, tissues, and cellular extracts to elucidate the effect of a particular stimulus on metabolic pathways [9]. The use of metabolomics in exercise and nutritional sciences is gaining momentum [10], and global metabolomics profiling was utilized in this study to help capture the potential influence of pistachio nut supplementation in countering physiologic stress indicators associated with intense and prolonged exercise.

Materials and Methods

The protocol for this trial and supporting CONSORT checklist are available as Protocol S1 and Checklist S1.

Subjects

Subjects included 20 male cyclists (ages 27–49 years) who regularly competed in road races (category 1 to 5) and were capable of cycling 75-km at race pace. During the 6-week study, subjects maintained their typical training regimen (192±18 km cycling per week), maintained weight, and avoided the use of large-dose vitamin and mineral supplements, herbs, and medications. Subjects signed informed consent and study procedures were approved by the Institutional Review Board at Appalachian State University (ASU). The study was conducted during April to June, 2013, at the ASU Human Performance Laboratory at the North Carolina Research Campus in Kannapolis, NC.

Research Design

This study utilized a randomized (1∶1 allocation, random number generator), crossover approach, and subjects engaged in two 75-km cycling time trials after two weeks of pistachio or no pistachio supplementation (no blinding), with a 2-week washout period (Figure 1). Subjects completed both arms of the study, and data were analyzed with subjects operating as their own controls. Data were analyzed from subjects (N = 19) completing all aspects of the study using a repeated measures ANOVA, within subjects approach. One subject was unable to complete the second 75-km cycling time trial due to a schedule conflict. A full nutrient profile of the 3 oz. (85 g) daily serving size of pistachio nuts used in this study is available in Table S1.
Figure 1

Subject flow diagram.

Two weeks prior to the first 75-km time trial, athletes completed orientation and baseline testing. Demographic and training histories were acquired with questionnaires. A blood sample was collected. Maximal power, oxygen consumption, ventilation, and heart rate were measured during a graded exercise test (25 Watts increase every two minutes, starting at 150 Watts) with the Cosmed Quark CPET metabolic cart (Rome, Italy) and the Lode cycle ergometer (Lode Excaliber Sport, Lode B.V., Groningen, Netherlands). Body composition was measured with the Bod Pod body composition analyzer (Life Measurement, Concord, CA). Half of the subjects (randomized) left the lab with a 2-weeks supply of pistachio nuts (3 oz/day). Compliance to the pistachio nut supplementation regimen was assessed through weekly contact with the subjects via email, and by collecting empty plastic bags (one per day) from the subjects when reporting to the lab. During the 3-day period prior to each 75-km cycling trial, subjects were asked to reduce the volume of their exercise training as if preparing for a race, and ingested a moderate-carbohydrate diet using a food list restricting high fat foods, other nuts and visible fats. Subjects recorded all food and beverage intake during the 3-day period, with macro- and micro-nutrient intake assessed using the Food Processor dietary analysis software system (ESHA Research, Salem, OR). Two weeks following baseline testing, subjects returned to the Human Performance Laboratory at 6:45 am in an overnight fasted state (no food or beverages other than water for at least 9 hours), and provided a pre-exercise blood sample. Subjects either consumed 1.5 oz. pistachio nuts with water or water alone at 7:00 am, and rested 30 minutes. At 7:30 am, subjects warmed up and then began the 75-km cycling time trial using their own bicycles on CompuTrainer Pro Model 8001 trainers (RacerMate, Seattle, WA). A mountainous 75-km course with moderate difficulty was utilized using the CompuTrainer software system. Heart rate and rating of perceived exertion (RPE) were recorded every 30 minutes, and workload continuously monitored using the CompuTrainer MultiRider software system (version 3.0, RacerMate, Seattle, WA). Oxygen consumption and ventilation were measured using the Cosmed Quark CPET metabolic cart after 16 km and 55 km cycling. All subjects consumed 3 ml/kg water every 15 min, with subjects randomized to the pistachio condition consuming 1.5 oz pistachios after 1 h cycling. No other beverage or food containing energy or nutrients were allowed during the cycling time trials. Blood samples were taken via venipuncture immediately after completing the 75-km time trial, and then 1.5-h post-exercise. Subjects returned in an overnight fasted state the next morning to provide a 21-h post-exercise blood sample. Subjects washed out for two weeks, returned to the lab to provide a blood sample, crossed over to the opposite condition, and repeated all procedures.

Complete Blood Count, Lactate, Glucose

Complete blood counts (CBC) were performed using a Coulter Ac.TTM 5Diff Hematology Analyzer (Beckman Coulter, Inc., Miami, FL). Shifts in plasma volume due to exercise were calculated using the equation of Dill and Costill [11]. Blood glucose and lactate were measured using microfuge tubes lined with EDTA dipotassium salt (RAM Scientific Inc., Germany), and the YSI 2300 STAT Plus Glucose and Lactate analyzer (Yellow Springs, OH).

F2-isoprostanes

Plasma F2-isoprostanes (F2-IsoP) were determined using gas chromatography mass spectrometry (GC-MS) [12]. Plasma was collected from heparinized blood, immediately flash-frozen in liquid nitrogen, and stored at −80°C. Immediately prior to assay plasma samples were thawed, and free F2-IsoP extracted with deuterated [2H4] prostaglandin F2α added as an internal standard. The mixture was then added to a C18 SepPak column, followed by silica solid phase extractions. F2-IsoP were converted to pentafluorobenzyl esters, subjected to thin layer chromatography, and converted to trimethylsilyl ether derivatives. Samples were analyzed by a negative ion chemical ionization GC-MS using an Agilent 6890N gas chromatography interfaced to an Agilent 5975B inert MSD mass spectrometer (Agilent Technologies, Inc. Santa Clara, CA).

C-Reaction Protein and Cytokines

High-sensitivity C-reactive protein (CRP) was measured using an LX-20 clinical analyzer (Beckman Coulter Electronics, Brea, CA). Total plasma concentrations of six inflammatory cytokines [monocyte chemoattractant protein-1 (MCP-1), tumor necrosis factor alpha (TNFα), granulocyte colony-stimulating factor (GCSF), IL-6, IL-8, and IL-10] were determined using an electrochemiluminescence based solid-phase sandwich immunoassay (Meso Scale Discovery, Gaithersburg,MD, USA). All samples and provided standards were analyzed in duplicate, and the intra-assay CV ranged from 1.7% to 7.5% and the inter-assay CV 2.4 to 9.6% for all cytokines measured. Pre-and post-exercise samples for the cytokines were analyzed on the same assay plate to decrease inter-kit assay variability.

Granulocyte Phagocytosis (GPHAG) and Oxidative Burst Activity (GOBA)

GPHAG was measured through the uptake of Fluorescein isothiocyanate (FITC)-labeled Staphylococcus aureus bacteria and GOBA was measured through the oxidation of non-fluorescent hydroethidine (HE) to fluorescent ethidium bromide in cells stimulated with unlabeled bacteria. Samples were processed on a Q-Prep Workstation (Beckman Coulter, Inc.) and analysis was performed using a Beckman Coulter FC10 500LSR Fortessa flow cytometer (BD Biosciences, San Jose, CA). After gating on the granulocyte population using forward scatter and side scatter (FlowJo analysis Software, Tree Star Inc., Ashland, OR), the mean fluorescence intensity (MFI; x-mean) and percent positive cells for FITC (FL1) and oxidized HE (FL2) were determined.

Metabolomics

The non-targeted metabolic profiling instrumentation employed for this analysis combined three independent platforms: ultrahigh performance liquid chromatography/tandem mass spectrometry (UHPLC/MS/MS) optimized for basic species, UHPLC/MS/MS optimized for acidic species, and gas chromatography/mass spectrometry (GC/MS) [13], [14]. Blood samples were collected in EDTA tubes and centrifuged at 3,000 RPM for 10 minutes at 4°C, with the plasma aliquoted, snap frozen in liquid nitrogen, and then stored at −80°C until analysis. For each plasma sample, 100 µL was used for analyses. Using an automated liquid handler (Hamilton LabStar, Salt Lake City, UT), protein was precipitated from the plasma with methanol that contained four standards to report on extraction efficiency. The resulting supernatant was split into equal aliquots for analysis on the three platforms. Aliquots, dried under nitrogen and vacuum-desiccated, were subsequently either reconstituted in 50 µL 0.1% formic acid in water (acidic conditions) or in 50 µL 6.5 mM ammonium bicarbonate in water, pH 8 (basic conditions) for the two UHPLC/MS/MS analyses or derivatized to a final volume of 50 µL for GC/MS analysis using equal parts bistrimethyl-silyl-trifluoroacetamide and solvent mixture acetonitrile:dichloromethane: cyclohexane (5∶4∶1) with 5% triethylamine at 60°C for 1 hour. In addition, three types of controls were analyzed in concert with the experimental samples: aliquots of a well-characterized human plasma pool served as technical replicates throughout the data set, extracted water samples served as process blanks, and a cocktail of standards spiked into every analyzed sample allowed instrument performance monitoring. Standards to monitor extraction were d6-cholesterol, fluorophenylglycine, and tridecanoic acid. A standard to monitor GC/MS derivatization was 2-tert butyl-6-methylphenol (BHT). GC/MS standards to monitor GC and MS performance were C5–C18 alkylbenzenes. Experimental samples and controls were randomized across platform run days. For UHLC/MS/MS analysis, aliquots were separated using a Waters Acquity UPLC (Waters, Millford, MA) instrument with separate acid/base-dedicated 2.1 mm × 100 mm Waters BEH C18 1.7 µm particle columns heated to 40°C and analyzed using an LTQ mass spectrometer (Thermo Fisher Scientific, Inc., Waltham, MA) which consisted of an electrospray ionization (ESI) source and linear ion-trap (LIT) mass analyzer [14]. Extracts reconstituted in formic acid were gradient eluted at 350 µL/min using (A) 0.1% formic acid in water and (B) 0.1% formic acid in methanol (0% B to 70% B in 4 min, 70–98% B in 0.5 min, 98% B for 0.9 min), whereas extracts reconstituted in ammonium bicarbonate used (A) 6.5 mM ammonium bicarbonate in water, pH 8, and (B) 6.5 mM ammonium bicarbonate in 95/5 methanol/water (same gradient profile as above) at 350 µL/min. The MS instrument scanned 99–1000 m/z and alternated between MS and MS2 scans using dynamic exclusion with approximately 6 scans per second. Derivatized samples for GC/MS were separated on a 5% diphenyl/95% dimethyl polysiloxane fused silica column with helium as the carrier gas and a temperature ramp from 60°C to 340°C and then analyzed on a Thermo-Finnigan Trace DSQ MS (Thermo Fisher Scientific, Inc.) operated at unit mass resolving power with electron impact ionization and a 50–750 atomic mass unit scan range. Metabolites were identified by automated comparison of the ion features in the experimental samples to a reference library of chemical standard entries that included retention time, molecular weight (m/z), preferred adducts, and in-source fragments as well as associated MS spectra, and were curated by visual inspection for quality control using software developed at Metabolon Inc. (Durham, NC) [15]. Common and biologically abundant isomers of unsaturated fatty acids containing the n3, n6, and n9 configuration are contained in Metabolon's chemical standard library. LC/MS standards to monitor LC and MS performance were d3-leucine, chloro- and bromo-phenylalanine, d2-maleic acid, amitriptyline, and d10-benzophenone (1). Biochemical identifications were based on three criteria: retention index within a narrow window of the proposed identification, accurate mass match to the library +/- 0.005 amu, and the MS/MS forward and reverse scores between the experimental data and authentic standards. The MS/MS scores were based on a comparison of the ions present in the experimental spectrum to the ions present in the library spectrum.

Statistical Analysis

Data are expressed as mean ± SE. Food record and performance data were compared between conditions (pistachio, water) using paired t-tests. Biomarker data were analyzed using a 2 (condition) x 5 (time) repeated-measures ANOVA, within-subjects design, with changes over time within conditions contrasted between conditions using paired t-tests and significance adjusted to P<0.0125 after Bonferroni correction. For the metabolomics statistical analyses and data display purposes, any missing values were assumed to be below the limits of detection and these values were imputed with the compound minimum (minimum value imputation). Statistical analysis of log-transformed data was performed using “R” (http://cran.r-project.org/), which is a freely available, open-source software package. Two-way repeated ANOVA with post-hoc contrasts (t-tests) was performed to compare data between conditions. An estimate of the false discovery rate (Q-value) was calculated to take into account the multiple comparisons that normally occur in metabolomics-based studies, with Q<0.05 used as an indication of high confidence in a result. Fold changes across time points were calculated using group averages of the median scaled intensity values. Intensity differences between pistachio and no-pistachio trials were calculated at each time point for each metabolite and protein biomarker. Pearson's product-moment correlation coefficients was used to determine if the changes of intensity difference over time were correlated between metabolites or proteins, with FDR adjustment conducted to account for multiple tests and Q≤0.05 used as an indication of significance.

Results

The analysis included 19 of 20 competitive male cyclists (ages 27 to 49 years) who successfully adhered to all aspects of the study design (see Table 1). The aim of this study was to find outcome measures that might differ between trials with medium to large effects. At an effect size of 0.7 and alpha of 0.05, N = 19 provided a power of 0.823. The participants in this study were well-trained cyclists who exercised intensively on a regular basis. Therefore, the 75-km cycling time trials utilized in this study were unlikely to result in significant learning or training effects. Paired t-tests were used to compare pre-trial outcome measures for the pistachio and no-pistachio arms of the study, and no differences were found.
Table 1

Subject characteristics (N = 19).

VariableMean±SE
Age (years)38.0±1.6
Height (m)1.81±0.02
Weight (kg)76.8±2.3
Body fat (%)14.0±1.0
Wattsmax 304±10.5
VO2max (ml.kg.−1min−1) 51.7±1.4
HRmax (beats/min)179±2.5
Training (km/wk)192±18.0
Three-day food record nutrient data are summarized in Table 2. Energy intake was 35% higher during the pistachio compared to no-pistachio supplementation period, with significantly higher intake measured for total fat, carbohydrate, and protein intake. Total fiber intake was 63% higher during pistachio supplementation, with 3-fold and 5.3-fold higher levels measured for insoluble fiber and raffinose [16], respectively. Pistachio supplementation was also associated with higher intake of a variety of vitamins and minerals including vitamin B6, folate, potassium, iron, copper, magnesium, zinc, and molybdenum.
Table 2

Daily averages from 3-day food record data (mean±SE).

VariablePistachioWaterP-Value
Energy (kJ) 12.82±1.079.46±0.670.001
Protein (g) 121.3±12.189.1±7.50.005
Carbohydrate (g) 355±37.1296±26.20.021
Fiber (g) 35.7±3.821.9±2.7<0.001
Insoluble fiber (g) 13.2±0.93.30±0.57<0.001
Soluble fiber (g) 2.20±0.521.03±0.200.027
Raffinose (g) 2.19±0.150.35±0.08<0.001
Total fat (g) 130±10.273.0±7.3<0.001
Saturated fat (g) 33.5±3.423.5±3.00.005
Polyunsaturated fat (g) 22.7±1.89.43±1.2<0.001
Monounsaturated fat (g) 44.9±3.318.0±2.3<0.001
Cholesterol (mg) 277±31.0276±38.40.984
Vitamin A (IU) 7197±20454054±6940.120
Vitamin C (mg) 102±11.074.0±9.60.040
Vitamin E (mg αTE) 12.4±3.55.20±0.730.048
Vitamin D (IU) 129±26.1119±18.60.447
Thiamin (mg) 2.55±0.261.96±0.460.325
Vitamin B6 (mg) 3.43±0.421.74±0.150.002
Folate (µg) 499±63.2301±29.80.004
Potassium (mg) 3479±3252091±1920.001
Calcium (mg) 1082±144920±69.30.247
Iron (mg) 26.4±2.918.6±2.10.009
Copper (mg) 2.47±0.310.94±0.10<0.001
Magnesium (mg) 373±42.0236±29.30.004
Zinc (mg) 13.4±1.78.68±0.910.017
Molybdenum (µg) 41.3±4.714.5±2.9<0.001
Alcohol (g) 13.7±2.018.0±3.00.324
Caffeine (mg) 129±22.1146±20.60.433
Performance data from the 75-km mountainous cycling time trial are summarized in Table 3 and Figure 2. Performance time for the 75-km trial was 4.8% slower under pistachio compared to water-only conditions (2.84±0.11 and 2.71±0.07 h, respectively, P = 0.034) (Figure 2). Oxygen consumption (P = 0.014) and ventilation (P = 0.038) were lower in the pistachio versus water trial, with a trend towards reduced power output (P = 0.114). Blood lactate increases were similar between pistachio and water trials, with a trend for better maintenance of blood glucose levels during the pistachio trial (interaction effect, P = 0.064). Changes in plasma volume and body weight were similar between pistachio and water trials.
Table 3

Metabolic and performance data during the 75-km cycling trials under pistachio and water conditions in trained cyclists (N = 19) (mean±SE).

VariablePistachioWaterP-Value
VO2 (ml.kg.−1min−1) 34.1±1.235.6±1.10.014
VO2 (%VO2max) 66.6±2.669.3±2.10.210
Watts 201±8.5207±7.60.114
% Wattsmax 66.6±2.668.3±1.70.262
HR (beats/min) 149±3.6150±2.50.562
%HRmax 83.0±1.784.0±1.10.309
Ventilation (L/min) 71.0±4.074.9±3.50.038
RPE 13.2±0.212.9±0.30.334
RER 0.88±0.010.89±0.010.375
Plasma volume shift (%) −9.62±0.92−9.37±1.640.904
Blood lactate (mmol/L) Interaction
Pre-Exercise0.59±0.030.65±0.05P = 0.226
Post-Exercise1.95±0.301.67±0.11
Blood glucose (mmol/L)
Pre-Exercise4.16±0.124.25±0.12P = 0.064
Post-Exercise3.90±0.213.48±0.21
Body Weight (kg)
Pre-Exercise77.0±2.376.7±2.1P = 0.165
Post-Exercise76.0±4.975.3±2.1

VO2, volume of oxygen consumed; HR, heart rate; RPE, rating of perceived exertion; RER, respiratory exchange ratio (VCO2/VO2).

Figure 2

Performance time for the 75-km trial under pistachio compared to water-only conditions (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Performance time for the 75-km trial under pistachio compared to water-only conditions (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05. VO2, volume of oxygen consumed; HR, heart rate; RPE, rating of perceived exertion; RER, respiratory exchange ratio (VCO2/VO2). Plasma cytokine, CRP, F2-Isop, total blood leukocyte, and granulocyte phagocytosis and oxidative burst activity data are summarized in Table 4. Significant time effects were measured for all of the variables in Table 4, with no differences in the patterns of change assessed between pistachio and water trials except for CRP (interaction effect, P = 0.037) and F2-IsoP (P = 0.035). Two-way ANOVA contrasts indicated slightly lower CRP and higher F2-IsoP in the pistachio compared to water trial at 21-h post-exercise, but P-values were not significant after Bonferroni correction.
Table 4

Comparison between pistachio and water trials for inflammation, oxidative, and immune biomarkers in trained cyclists (N = 19) (mean±SE).

VariablePre-SupplPre-ExercisePost-Exercise1.5-h Post-Exercise21-h Post-ExerciseP-values: Time; Interaction
IL-6 (pg/ml)
Pistachio 0.70±0.060.88±0.169.37±1.675.79±0.921.25±0.39<0.001
Water 0.68±0.051.02±0.288.77±0.695.97±0.970.63±0.050.521
IL-8 (pg/ml)
Pistachio 5.04±0.375.84±0.4913.7±1.510.7±1.15.88±0.80<0.001
Water 4.81±0.395.23±0.4211.8±1.17.91±0.744.70±0.330.420
IL-10 (pg/ml)
Pistachio 2.14±0.252.21±0.2138.3±13.716.7±4.32.39±0.210.008
Water 2.08±0.202.00±0.1933.7±10.816.9±4.72.12±0.240.861
TNFα (pg/ml)
Pistachio 3.73±0.193.86±0.184.59±0.264.19±0.233.76±0.18<0.001
Water 3.67±0.163.90±0.164.30±0.204.10±0.203.62±0.160.143
MCP-1 (pg/ml)
Pistachio 249±9.3271±9.5373±19.6330±16.0245±12.7<0.001
Water 261±11.6267±9.1385±18.9340±22.5230±7.10.355
GCSF (pg/ml)
Pistachio 12.1±0.711.6±0.816.5±1.318.4±1.515.6±1.70.001
Water 11.1±0.812.8±1.017.7±1.818.7±2.215.3±1.50.431
CRP (mg/L)
Pistachio 1.12±0.281.81±0.361.92±0.401.75±0.363.77±0.470.001
Water 1.22±0.301.60±0.361.71±0.401.68±0.395.39±0.820.037
F2Isop (pg/ml)
Pistachio 33.0±2.633.9±2.157.3±3.852.6±4.540.8±3.8<0.001
Water 38.4±3.145.4±4.762.5±5.453.6±3.536.4±3.10.035
Leukocytes (109/L)
Pistachio 5.38±0.245.33±0.2516.4±0.912.7±0.65.41±0.34<0.001
Water 5.21±0.255.51±0.2816.4±0.912.7±0.75.63±0.230.900
GPHAG (MFI)
Pistachio 7133±4787948±47712098±62510615±7637079±455<0.001
Water 8122±5268156±56411761±48010733±5467491±4580.319
GOBA (MFI)
Pistachio 1028±36.31120±45.5858±31.0858±34.4896±80.4<0.001
Water 1059±27.41072±31.4902±27.1875±34.7802±98.10.604

IL  =  interleukin; TNFα = tumor necrosis factor alpha; MCP-1 = monocyte chemoattractant protein-1; GCSF = granulocyte colony-stimulating factor; CRP = C-reactive protein; F2Isop = F2-isoprostanes; GPHAG = granulocyte phagocytosis; GOBA = granulocyte oxidative burst activity; MFI = mean fluorescence intensity.

IL  =  interleukin; TNFα = tumor necrosis factor alpha; MCP-1 = monocyte chemoattractant protein-1; GCSF = granulocyte colony-stimulating factor; CRP = C-reactive protein; F2Isop = F2-isoprostanes; GPHAG = granulocyte phagocytosis; GOBA = granulocyte oxidative burst activity; MFI = mean fluorescence intensity. The metabolomics analysis revealed 423 detectable compounds of known identity with 2-way ANOVA contrasts indicating post-exercise increases for 167 metabolites (Table S2). Following log transformation and imputation with minimum observed values for each compound, 2×5 repeated measures ANOVA interaction effects were significant for the 19 metabolites listed in Table 5. File S1 contains Figures S1 to S19 depicting the box plots for these 19 metabolites. Fold differences were calculated from the median scaled intensity values for each of the five time points and then rank ordered according to post-exercise values. The greatest fold differences post-exercise were measured for raffinose, sucrose, and (Z)-9,10-dihydroxyoctadec-12-enoic acid (9,10 DiHOME), and the pattern of change over time for these three metabolites during the pistachio and water trials are compared in Figures 3, 4, and 5. Other metabolites that were increased to higher levels post-exercise in the pistachio compared to water trials included two secondary bile acids (glycodeoxycholate, glycochenodeoxycholate), a product of uric acid oxidation (allantoin), amino acids and products of amino acid metabolism (leucine, indoleacetate, 2-aminooctanoate, gamma-glutamylleucine, gamma-glutamyltyrosine, phenylacetate, isobutyrylcarnitine), products of fatty acid metabolism (2-hydroxydecanoate, azelate), two lysolipids (1- and 2-oleoylglycerophosphoethanolamine), and a food component of pistachios (myo-inositol). Pre-to-post-exercise changes of the intensity difference (between pistachio and no-pistachio trials) in raffinose were strongly correlated with sucrose (r = 0.88, Q = 0.048), 9,10-DiHOME (r = 0.95, Q = 0.033), myo-inositol (r = 0.99, Q = 0.027), allantoin (r = 0.97, Q = 0.030), and azelate (r = 0.96, Q = 0.031), but not with CRP (r = 0.45, Q = 0.311), IL-6 (r = 0.10, Q = 0.825), or F2-isoprostanes (r = 0.08, Q = 0.860).
Table 5

Metabolites with significant treatment (pistachio, water) x time (5 points) interaction effects.

MetabolitePre-SupplPre-ExercPost-Exerc1.5-h Post-Exerc21-h Post-ExercInteraction q-Value
raffinose 117.81* 7.28* 1<0.001
9,10-DiHOME 1.062.96* 5.36* 5.6* 1.66<0.001
sucrose 0.721.734.35* 3.49* 1.78<0.001
glycodeoxycholate 0.871.614.31* 1.96* 2.180.006
2-hydroxydecanoate 1.212.58* 3.21* 3.17* 2.27* <0.001
glycochenodeoxycholate 0.81.382.68* 1.64* 1.450.024
allantoin 1.361.132.55* 2.08* 1.230.016
phenylacetate 0.721.742.24* 1.81.370.032
phenylacetylglutamine 0.981.64* 2.05* 2.07* 1.53* 0.023
1-oleoylglycerophos-phoethanolamine 1.081.011.7* 1.62* 0.92<0.001
2-oleoylglycerophos-phoethanolamine 1.191.051.69* 1.61* 0.890.042
azelate 0.970.991.64* 1.43* 1.07<0.001
isobutyrylcarnitine 0.981.271.63* 1.43* 1.220.024
indoleacetate 1.041.56* 1.61* 1.53* 1.290.015
2-aminooctanoate 1.021.55* 1.58* 1.62* 1.45* 0.006
myo-inositol 1.091.021.4* 1.45* 0.990.015
gamma-glutamylleucine 1.031.081.31* 1.25* 1.070.015
gamma-glutamyltyrosine 0.961.051.2* 1.26* 0.980.023
leucine 0.991.14* 1.18* 1.14* 1.040.014

Values represent the ratio of pistachio-to-water median scaled intensity values at each time point (mean±SE).

* = Q-value 2-way ANOVA contrasts <0.05.

Figure 3

Plasma raffinose in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Figure 4

Plasma sucrose in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Figure 5

Plasma 9,10 DiHOME in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Plasma raffinose in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Plasma sucrose in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05.

Plasma 9,10 DiHOME in pistachio and water conditions (interaction effect, Q<0.001) (mean±SE).

*  =  Q-value 2-way ANOVA contrasts <0.05. Values represent the ratio of pistachio-to-water median scaled intensity values at each time point (mean±SE). * = Q-value 2-way ANOVA contrasts <0.05.

Discussion

Contrary to our hypothesis, data from this randomized, crossover study showed that 2-weeks ingestion of pistachio nuts (3 oz./day including the day of the cycling time trial) by trained cyclists impaired performance 4.8% during a 75-km cycling time trial. Although the patterns of change for traditional biomarkers for exercise-induced inflammation and oxidative stress were similar between pistachio and no-pistachio trials, metabolomics revealed trial differences for 19 metabolites highlighted by the post-exercise presence of raffinose, sucrose, myo-inositol, and the leukotoxin diol 9,10-DiHOME in the blood compartment of athletes during the pistachio trial. Pistachio nuts contain the trisaccharide raffinose, a soluble carbohydrate also found in onions and many types of legumes [16]. Raffinose family oligosaccharides have multiple functions in plants, serving as transport and storage carbohydrates, and cryoprotectants in frost-hardy plant organs [17]. The biosynthesis of raffinose is linked to primary plant metabolism via myo-inositol, sucrose, and galactose [17], [18]. Raffinose is poorly absorbed in the human small intestine which lacks α-galactosidases, but is metabolized by colon bacteria to sucrose, melibiose, fructose, galactose, and glucose [19]. Raffinose is an effective prebiotic, stimulating short-chain fatty acid production and the growth of beneficial colon bacteria such as bifidobacteria and lactobacilli that have been related to positive effects on bowel function, inflammatory bowel disease, cancer risk, and intestinal epithelial and dendritic cell function [20]. Pistachio nuts also contain phytates in a concentration that varies from 0.29 to 2.83 g/100 g [21]. Phytic acid (inositol hexakisphosphate or phytate when in salt form) is the principal storage form of phosphorus in many plant tissues, especially bran, legumes, seeds, and nuts. Most phytate hydrolysis occurs in the large intestine by means of microbial phytases, resulting in myo-inositol and other inositol phosphates [21]. The athletes in this study ingested 3 oz./day shelled pistachios for the 2-week period before the 75-km cycling time trial, and then ingested a total of 3 oz. pistachios before and during exercise after arriving in the lab in an overnight fasted state. The trial differences seen in this study for post-exercise metabolite shifts were more than likely due to chronic pistachio ingestion because of the multiple hours needed for transit time to the colon for undigested components. Prolonged and intensive exercise is associated with hyperthermia, splanchnic hypoperfusion, loss of intestinal barrier integrity, and increased intestinal permeability or the so-called ‘leaky gut’ syndrome [22]–[24]. Although not previously reported, the significant post-exercise increase in plasma raffinose, sucrose, and myo-inositol in athletes during the pistachio arm of the study suggests that these biochemicals translocated from the colon due to exercise-induced increases in gut permeability. Plasma sucrose is widely used as a marker of increased gastrointestinal permeability [22]. The athletes came to the lab having ingested high levels of pistachios for two weeks, and their colons more than likely contained substantial pistachio raffinose and sucrose (from bacterial degradation of raffinose) and myo-inositol (from bacterial phytase hydrolysis of phytate). Post-exercise increases in plasma levels of two secondary bile acids were also measured during the pistachio trial, suggesting that pistachio raffinose and phytates may have amplified exercise-induced increases in gut permeability. We previously reported in another metabolomics-based study that supplementation with a blueberry and green tea polyphenol-rich soy protein-based product for 17 days caused a distinct gut-derived phenolic signature in long distance runners following a 3-day period of intensified running [25]. Metabolomics is ideally suited as a methodology to investigate shifts in gut-derived metabolites following supplementation with dietary supplements or whole foods, and human trials are revealing an increasing number of metabolites that appear at high levels in the colon and systemic circulation [26]. The biological relevance for most of these gut-derived metabolites that increase transiently in athletes following intensive exercise bouts is still being explored. The dominant phenolics in pistachios are gallic acid, protocatechuic acid, catechins and epicatechins, rutin, eriodictyol, quercetin, luteolin, myricetin, and cyanidin-3-galactoside [27]. However, we were unable to detect a gut-derived phenolic signature when comparing metabolite shifts following 75-km cycling under pistachio and no-pistachio conditions, and this was more than likely related to the relatively modest phenolic intake in this study compared to the study with the blueberry and green tea polyphenol-rich soy protein-based product [25]. The transient increase in plasma 9,10-DiHOME following exercise in the pistachio trial was strongly correlated with increases in plasma raffinose. 9,10-DiHOME is a leukotoxin derivative of linoleic acid diol that has been reported to be toxic in human's tissue preparations, and is produced by inflammatory leukocytes such as neutrophils and macrophages [28], [29]. Mitochondrial dysfunction, suppression of neutrophil respiratory burst activity, increased cell oxidative stress, vasodilation, and apoptosis are features of 9,10-DiHOME toxicity [29], [30]. Mitochondria are a cellular target of 9,10-DiHOME and other leukotoxin diols [31]. In cell culture studies, Sisemore et al. [32] showed that 9,10-DiHOME disrupts mitochondrial function by altering inner membrane integrity and increasing cytochrome C release. The enhanced post-exercise increase in lysolipids (1- and 2-oleoylglycerophosphoethanolamine) during the pistachio arm of the study may reflect 9,10-DiHOME toxic effects on membrane integrity. ’The adverse effect of pistachio ingestion on performance may be related in part to the linkage between raffinose release from the colon, increased 9,10 DiHOME generation, and altered mitochondrial function. Urate, a product of nucleotide degradation, is a potent scavenger of reactive oxygen species (ROS). Upon reaction with hydroxyl radicals, urate can be oxidized to a number of oxidation products including allantoin, and this has been observed in human skeletal muscle during supramaximal intensity exercise [33]. Elevated urine allantoin levels have been reported after intensive exercise and are considered to be an oxidative stress biomarker [34]. In this study, plasma allantoin was 2.55-fold higher post-exercise in the pistachio versus no pistachio trial, and was highly correlated with plasma raffinose. Taken together, these data indicate that colon-derived raffinose when combined with intensive and prolonged exercise induced significant ROS that was scavenged by urate. In a previous metabolomics-based study with mice, azelaic acid was found to be an indicator of toxin exposure [35]. Azelaic acid is a byproduct of lipid oxidation of unsaturated fatty acids, and may interact with PPARs in the regulation of inflammatory processes [36]. Azelaic acid can be considered as an early marker of lipoprotein oxidation and subclinical atherosclerosis [37]. The 1.64-fold higher levels of azelaic acid post-exercise in the pistachio trial and high correlation with plasma raffinose is another indicator that raffinose was related to elevated oxidative stress and perhaps leukotoxin effects from 9,10-DiHOME. F2-IsoP was slightly elevated in the pistachio compared to water trial at 21-h post-exercise, but the P-value was not significant after Bonferroni correction. The allantoin and azelaic acid data support elevated oxidative stress in the pistachio trial immediately and 1.5-h post 75-km cycling, but not 21-h post-exercise. Despite the mismatch in timing, these data taken together support elevated oxidative stress in the pistachio trial. There was a tendency for blood glucose levels to be maintained during the pistachio trial compared to a slight decrease during the no-pistachio trial. The 85 g serving of pistachios given to the cyclists before and during 75-km cycling provided 23 g carbohydrate, but only 8 g of pistachio carbohydrate is in the form of sugars and starches. In most studies where carbohydrate supplementation has been found to have influences on performance and exercise-induced changes in stress hormone and inflammation measures, athletes ingest 40–60 g carbohydrate (sugars) per hour of exercise [4], [5]. Thus the 8 g dose of sugars and starches provided in this study during the pistachio trial was too small to influence performance or any of the outcome measures, and this interpretation is supported by the lack of trial differences for the respiratory exchange ratio. The pistachio trial was related to elevations in several metabolites related to amino acid metabolism (leucine, indoleacetate, 2-aminooctanoate, gamma-glutamylleucine, gamma-glutamyltyrosine, phenylacetate, isobutyrylcarnitine) and fatty acid metabolism (2-hydroxydecanoate), and may have reflected the ingestion of pistachio nuts before and during exercise. Except for 2-hydroxydecanoate, trials differences were small and unlikely to have influenced high intensity cycling performance. To summarize, in this metabolomics-based study we report an entirely novel finding that gut-derived raffinose, sucrose, and myo-inositol were present in the circulation of endurance athletes following the combination of 2-weeks pistachio nut ingestion and prolonged and intensive exertion. Pistachio ingestion was related to impaired 75-km cycling performance in overnight fasted cyclists, and could be due to raffinose associated increases in 9,10-DiHOME, a leukotoxin that may negatively impact mitochondrial function. No measure of mitochondrial function was measured in this study, and additional research is needed to test this hypothesis more carefully. Plasma raffinose following pistachio ingestion and 75-km cycling was also strongly correlated with oxidative stress indicators including allantoin and azelaic acid, but not the well-established lipid peroxidation biomarker, F2-isoprostanes, or cytokine inflammatory biomarkers. Together, these data support the value of utilizing metabolomics-based procedures in sports nutrition studies, and call into question the dietary practice of ingesting foods high in raffinose prior to long duration, intense exercise. CONSORT Checklist. (DOC) Click here for additional data file. Figures S1 to S19 depict box plots for the 19 metabolites in with significant treatment (pistachio, water) x time (5 points) interaction effects. (XLSX) Click here for additional data file. Trial Protocol. (PDF) Click here for additional data file. Nutrient profile of the 3 oz. (85 g) daily serving size of pistachio nuts used in this study. (XLSX) Click here for additional data file. Metabolomics analysis for detectable compounds of known identity. (XLSX) Click here for additional data file.
  36 in total

1.  Cellular characterization of leukotoxin diol-induced mitochondrial dysfunction.

Authors:  M F Sisemore; J Zheng; J C Yang; D A Thompson; C G Plopper; G A Cortopassi; B D Hammock
Journal:  Arch Biochem Biophys       Date:  2001-08-01       Impact factor: 4.013

2.  Cytotoxicity of linoleic acid diols to renal proximal tubular cells.

Authors:  J H Moran; R Weise; R G Schnellmann; J P Freeman; D F Grant
Journal:  Toxicol Appl Pharmacol       Date:  1997-09       Impact factor: 4.219

3.  Allantoin formation and urate and glutathione exchange in human muscle during submaximal exercise.

Authors:  Y Hellsten; M Svensson; B Sjödin; S Smith; A Christensen; E A Richter; J Bangsbo
Journal:  Free Radic Biol Med       Date:  2001-12-01       Impact factor: 7.376

4.  The nutriceutical bovine colostrum truncates the increase in gut permeability caused by heavy exercise in athletes.

Authors:  Tania Marchbank; Glen Davison; Jemma R Oakes; Mohammad A Ghatei; Michael Patterson; Mary Pat Moyer; Raymond J Playford
Journal:  Am J Physiol Gastrointest Liver Physiol       Date:  2010-12-09       Impact factor: 4.052

5.  Effects of pistachio nuts consumption on plasma lipid profile and oxidative status in healthy volunteers.

Authors:  A Kocyigit; A A Koylu; H Keles
Journal:  Nutr Metab Cardiovasc Dis       Date:  2006-02-09       Impact factor: 4.222

6.  Involvement of CYP 2C9 in mediating the proinflammatory effects of linoleic acid in vascular endothelial cells.

Authors:  Saraswathi Viswanathan; Bruce D Hammock; John W Newman; Purushothaman Meerarani; Michal Toborek; Bernhard Hennig
Journal:  J Am Coll Nutr       Date:  2003-12       Impact factor: 3.169

7.  Discovery of metabolomics biomarkers for early detection of nephrotoxicity.

Authors:  Kurt J Boudonck; Matthew W Mitchell; László Német; Lilla Keresztes; Abraham Nyska; Doron Shinar; Moti Rosenstock
Journal:  Toxicol Pathol       Date:  2009-04       Impact factor: 1.902

8.  myo-Inositol and sucrose concentrations affect the accumulation of raffinose family oligosaccharides in seeds.

Authors:  Ute Karner; Thomas Peterbauer; Victor Raboy; David A Jones; Cliff L Hedley; Andreas Richter
Journal:  J Exp Bot       Date:  2004-07-30       Impact factor: 6.992

9.  Bananas as an energy source during exercise: a metabolomics approach.

Authors:  David C Nieman; Nicholas D Gillitt; Dru A Henson; Wei Sha; R Andrew Shanely; Amy M Knab; Lynn Cialdella-Kam; Fuxia Jin
Journal:  PLoS One       Date:  2012-05-17       Impact factor: 3.240

10.  Influence of a polyphenol-enriched protein powder on exercise-induced inflammation and oxidative stress in athletes: a randomized trial using a metabolomics approach.

Authors:  David C Nieman; Nicholas D Gillitt; Amy M Knab; R Andrew Shanely; Kirk L Pappan; Fuxia Jin; Mary Ann Lila
Journal:  PLoS One       Date:  2013-08-15       Impact factor: 3.240

View more
  23 in total

1.  Skeletal muscle interstitial fluid metabolomics at rest and associated with an exercise bout: application in rats and humans.

Authors:  Jie Zhang; Sudeepa Bhattacharyya; Robert C Hickner; Alan R Light; Christopher J Lambert; Bruce K Gale; Oliver Fiehn; Sean H Adams
Journal:  Am J Physiol Endocrinol Metab       Date:  2018-11-06       Impact factor: 4.310

2.  Identification of a select metabolite panel for measuring metabolic perturbation in response to heavy exertion.

Authors:  David C Nieman; Nicholas D Gillitt; Wei Sha
Journal:  Metabolomics       Date:  2018-11-01       Impact factor: 4.290

3.  Measuring Granulocyte and Monocyte Phagocytosis and Oxidative Burst Activity in Human Blood.

Authors:  Mary Pat Meaney; David C Nieman; Dru A Henson; Qi Jiang; Fu-Zhang Wang
Journal:  J Vis Exp       Date:  2016-09-12       Impact factor: 1.355

4.  Exercise plasma metabolomics and xenometabolomics in obese, sedentary, insulin-resistant women: impact of a fitness and weight loss intervention.

Authors:  Dmitry Grapov; Oliver Fiehn; Caitlin Campbell; Carol J Chandler; Dustin J Burnett; Elaine C Souza; Gretchen A Casazza; Nancy L Keim; John W Newman; Gary R Hunter; Jose R Fernandez; W Timothy Garvey; Charles L Hoppel; Mary-Ellen Harper; Sean H Adams
Journal:  Am J Physiol Endocrinol Metab       Date:  2019-09-17       Impact factor: 4.310

5.  No positive influence of ingesting chia seed oil on human running performance.

Authors:  David C Nieman; Nicholas D Gillitt; Mary Pat Meaney; Dustin A Dew
Journal:  Nutrients       Date:  2015-05-15       Impact factor: 5.717

Review 6.  Nuts and Dried Fruits: An Update of Their Beneficial Effects on Type 2 Diabetes.

Authors:  Pablo Hernández-Alonso; Lucía Camacho-Barcia; Mònica Bulló; Jordi Salas-Salvadó
Journal:  Nutrients       Date:  2017-06-28       Impact factor: 5.717

7.  Metabolic recovery from heavy exertion following banana compared to sugar beverage or water only ingestion: A randomized, crossover trial.

Authors:  David C Nieman; Nicholas D Gillitt; Wei Sha; Debora Esposito; Sivapriya Ramamoorthy
Journal:  PLoS One       Date:  2018-03-22       Impact factor: 3.240

Review 8.  Potential Impact of Nutrition on Immune System Recovery from Heavy Exertion: A Metabolomics Perspective.

Authors:  David C Nieman; Susan Hazels Mitmesser
Journal:  Nutrients       Date:  2017-05-18       Impact factor: 5.717

9.  Metabolomic Biomarkers in Urine of Cushing's Syndrome Patients.

Authors:  Alicja Kotłowska; Tomasz Puzyn; Krzysztof Sworczak; Piotr Stepnowski; Piotr Szefer
Journal:  Int J Mol Sci       Date:  2017-01-29       Impact factor: 5.923

10.  Turkish Guideline for Diagnosis and Treatment of Allergic Rhinitis (ART).

Authors:  Mustafa Cenk Ecevit; Müge Özcan; İlknur Haberal Can; Emel Çadallı Tatar; Serdar Özer; Erkan Esen; Doğan Atan; Sercan Göde; Çağdaş Elsürer; Aylin Eryılmaz; Berna Uslu Coşkun; Zahide Mine Yazıcı; Mehmet Emre Dinç; Fatih Özdoğan; Kıvanç Günhan; Nagihan Bilal; Arzu Yasemin Korkut; Fikret Kasapoğlu; Bilge Türk; Ela Araz Server; Özlem Önerci Çelebi; Tuğçe Şimşek; Rauf Oğuzhan Kum; Mustafa Kemal Adalı; Erdem Eren; Nesibe Gül Yüksel Aslıer; Tuba Bayındır; Aslı Çakır Çetin; Ayşe Enise Göker; Işıl Adadan Güvenç; Sabri Köseoğlu; Gül Soylu Özler; Ethem Şahin; Aslı Şahin Yılmaz; Ceren Güne; Gökçe Aksoy Yıldırım; Bülent Öca; Mehmet Durmuşoğlu; Yunus Kantekin; Süay Özmen; Gözde Orhan Kubat; Serap Köybaşı Şanal; Emine Elif Altuntaş; Adin Selçuk; Haşmet Yazıcı; Deniz Baklacı; Atılay Yaylacı; Deniz Hancı; Sedat Doğan; Vural Fidan; Kemal Uygur; Nesil Keleş; Cemal Cingi; Bülent Topuz; Salih Çanakçıoğlu; Metin Önerci
Journal:  Turk Arch Otorhinolaryngol       Date:  2021-05
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.