Literature DB >> 30739462

Differentiation between young adult Internet addicts, smokers, and healthy controls by the interaction between impulsivity and temporal lobe thickness.

András N Zsidó1, Gergely Darnai1,2,3, Orsolya Inhóf1, Gábor Perlaki3,4,5, Gergely Orsi3,4,5, Szilvia Anett Nagy3,4,5,6, Beatrix Lábadi1, Kata Lénárd1, Norbert Kovács2,3, Tamás Dóczi3,5, József Janszky2,3.   

Abstract

BACKGROUND AND AIMS: Internet addiction is a non-substance-related addiction disorder with progressively growing prevalence. Internet addiction, like substance-related addictions, has been linked with high impulsivity, low inhibitory control, and poor decision-making abilities. Cortical thickness measurements and trait impulsivity have been shown to have a distinct relationship in addicts compared to healthy controls. Thus, we test whether the cortical correlates of trait impulsivity are different in Internet addicts and healthy controls, using an impulsive control group (smokers).
METHODS: Thirty Internet addicts (15 females) and 60 age- and gender-matched controls (30 smokers, all young adults aged 19-28 years) were scanned using a 3T MRI scanner and completed the Barratt Impulsiveness Scale.
RESULTS: Internet addicts had a thinner left superior temporal cortex than controls. Impulsivity had a significant main effect on the left pars orbitalis and bilateral insula, regardless of group membership. We identified divergent relationships between trait impulsivity and thicknesses of the bilateral middle temporal, right superior temporal, left inferior temporal, and left transverse temporal cortices between Internet addicts and healthy controls. Further analysis with smokers revealed that the left middle temporal and left transverse temporal cortical thickness change might be exclusive to Internet addiction. DISCUSSION: The effects of impulsivity, combined with a long-term exposure to some specific substance or stimuli, might result in different natures of relationships between impulsivity and brain structure when compared to healthy controls.
CONCLUSION: These results may indicate that Internet addiction is similar to substance-related addictions, such that inefficient self-control could result in maladaptive behavior and inability to resist Internet use.

Entities:  

Keywords:  BIS-11; Barratt Impulsiveness Scale; cortical thickness; middle temporal cortex; problematic Internet use; smokers

Mesh:

Year:  2019        PMID: 30739462      PMCID: PMC7044605          DOI: 10.1556/2006.8.2019.03

Source DB:  PubMed          Journal:  J Behav Addict        ISSN: 2062-5871            Impact factor:   6.756


Introduction

Internet addiction (IA; other proposed terms are “problematic Internet use,” “pathological Internet use,” or “excessive Internet use”) is a non-substance-related addiction disorder that is becoming increasingly common among adolescents and young adults, and has become an epidemic worldwide (Block, 2008). According to recently proposed diagnostic criteria, it is characterized by preoccupation, withdrawal, craving, loss of control, excessive use, loss of interests, and escape or relief from a dysphoric mood (Kuss & Lopez-Fernandez, 2016). The prevalence of IA before 2010 was estimated to range from approximately 1% to 14% (Aboujaoude, 2010; Block, 2008), while less than a decade later the prevalence of IA had risen drastically and was estimated to range from 4% to as much as 46% in some countries (Islam & Hossin, 2016; Mak et al., 2014). However, the true prevalence is hard to estimate because of high cross-cultural variance. Studies have identified severe consequences of IA, such as sleep deprivation, academic under-achievement, decreased ability to concentrate, obesity, symptoms similar to those of attention-deficit hyperactivity disorder, self-injuring behavior, suicidal attempts, substance misuse, and short-term goal orientation (Aboujaoude, 2017; Durkee et al., 2016; Park, Hong, Park, Ha, & Yoo, 2013; Wu, Cheung, Ku, & Hung, 2013). The majority of these negative outcomes could be seen, at least partly, as the results of deficient self-regulation [i.e., high impulsivity, low inhibitory control, and poor decision-making abilities (Billieux, 2012; Choi et al., 2014)]. In recent years, it has been shown that trait impulsivity is often displayed by Internet addicts (IAs; Lee et al., 2012; Yau, Potenza, & White, 2012). Indeed, a large body of research have investigated the role of individual differences in self-regulation, such as trait impulsivity (Chen et al., 2015; Park, Han, & Roh, 2017), among the various psychological factors that potentially lead to excessive use and addiction. Shapira et al. (2003) suggested that IA should be conceptualized as an impulse control disorder. This has been supported by behavioral studies using tasks related to impulse control (Billieux, 2012). For instance, IAs scored higher than controls on the failure to inhibit responses of the GoStop Impulsivity Paradigm (Cao, Su, Liu, & Gao, 2007). Moreover, in a gambling task, IAs selected significantly fewer net decks, and were slower at selecting a strategy (Sun et al., 2009). Nonetheless, IA is often categorized as an addiction, and trait impulsivity has been shown to play a crucial role in developing and maintaining such behavior (Dawe & Loxton, 2004; Schulte, Grilo, & Gearhardt, 2016). Hence, for a better understanding of IA, it is crucial to explore the underlying mechanisms and cortical correlates. It has been shown that trait impulsivity is related to multiple cortical regions in healthy subjects (Muhlert & Lawrence, 2015; Schilling et al., 2012) and also in several substance addictions (Crews & Boettiger, 2009; Kreek, Nielsen, Butelman, & LaForge, 2005). These studies suggest that the frontal and temporal cortices and the structure of the insula play a crucial role in impulsivity (Du et al., 2016; Matsuo et al., 2009; Moccia et al., 2017) and in the development and maintenance of substance-related addictive behavior. For instance, impulsivity has been shown to have a pivotal role in the onset of and craving for smoking – one of the most common substance addictions. Thus, smokers as a broadly available group in young adults could serve well as a control group in assessing the general features of impulsivity in addictions and the specific influences of impulsivity in IA. Furthermore, other recent studies (Jaworska et al., 2017; Kaag et al., 2014) also emphasize the relevance of the reduction of the cortical surface for impulsiveness-related disorders such as substance use. Smoking, for instance, could lead to overall cortical thinning (Karama et al., 2015) – especially in the frontal regions and the cingulum (Almeida et al., 2008) – and gray matter reduction in the frontal and temporal cortices (Gallinat et al., 2006). These results indicate that the progressive thinning of multiple cortical regions could also play an important role in mediating greater impulsivity in IA. To this date, to our knowledge, no studies have directly investigated the relationship between cortical thickness and trait impulsivity in IAs compared to healthy controls (HCs). This study aims to fill this gap by evaluating the distinct relationships between trait impulsivity and cortical thickness of the gray matter regions related to addictive behavior in IAs and controls. We tested group differences and group by impulsivity interactions regarding the frontal and temporal cortices and the insula. We hypothesized that regions that show a similar distinct relationship in the two addictive groups (smokers and IAs) compared to HCs would tap into the general effects of impulsivity, whereas regions that occur only for IAs would be the result of the overlap of two different mechanisms – impulsivity and the special characteristics of IA.

Methods

Participants

Thirty IAs (15 males and 15 females), 30 age- and gender-matched (15 males and 15 females) HCs, and 30 age- and gender-matched (15 males and 15 females) impulsive control group subjects [smokers, all young adults aged 19–28 years; see Table 1 for mean age and standard deviation (SD)] were recruited through the Internet, using university mailing lists. IAs were identified according to the Problematic Internet Use Questionnaire (PIUQ; Demetrovics, Szeredi, & Rózsa, 2008); see further details below. Inclusion criteria for the impulsive control group were smoking at least five cigarettes a day and scoring more than four points (moderate dependence) in the Fagerström Test for Nicotine Dependence (FTND; Fagerstrom & Schneider, 1989; Prokhorov, Pallonen, Fava, Ding, & Niaura, 1996). None of the HC group or the IA members reported smoking. One Internet addict and one control were excluded because they reached the clinical cut-off on the Beck Depression Inventory (BDI), and one more Internet addict was excluded because of failure to understand the questionnaire instructions. Five smokers were also excluded: three of them did not meet our a priori criteria on the FTND, one reached the clinical cut-off on the BDI, and one reached the clinical cut-off on the State and Trait Anxiety Inventory (STAI).
.

Sample characteristics of healthy controls (HCs), Internet addicts (IAs), and smokers

HCs (n = 29)IAs (n = 28)Smokers (n = 25)Differences*
Age21.86 ± 2.0521.93 ± 2.0923.12 ± 3.13n.s.
Trait impulsivity (BIS)55.52 ± 9.7967.30 ± 9.1863.68 ± 10.28Smokers and IAs > HCs
Internet addiction (PIUQ)23.70 ± 2.4947.73 ± 5.6423.38 ± 11.04IAs > HCs and smokers
Depression (BDI)4.97 ± 5.6811.13 ± 7.178.33 ± 7.42IAs > smokers > HCs
Anxiety (STAI)34.60 ± 10.1945.53 ± 10.5138.88 ± 11.22IAs > HCs and smokers
Fragerstörm5.65 ± 1.07

Note. Data are presented as means ± standard deviations where appropriate. BIS: Barratt Impulsiveness Scale; PIUQ: Problematic Internet Use Questionnaire; BDI: Beck Depression Inventory; STAI: State and Trait Anxiety Inventory.

*Differences were considered significant at p < .05 with pairwise Bonferroni corrections.

Sample characteristics of healthy controls (HCs), Internet addicts (IAs), and smokers Note. Data are presented as means ± standard deviations where appropriate. BIS: Barratt Impulsiveness Scale; PIUQ: Problematic Internet Use Questionnaire; BDI: Beck Depression Inventory; STAI: State and Trait Anxiety Inventory. *Differences were considered significant at p < .05 with pairwise Bonferroni corrections. All of the participants were right-handed Caucasian individuals and had a normal body mass index. None of the participants reported alcohol, or other substance- or behavior-related addiction; there were no cross-addictions. Exclusion criteria were any major medical, psychiatric, or neurological disorders.

Assessments

IA was documented prior to inclusion in the study, using the PIUQ (Demetrovics et al., 2008). The questionnaire consists of 18 items and 3 subscales: obsession, neglect, and control disorder. All items are answered on a 5-point Likert-type scale (never, rarely, sometimes, often, and always). The three subscales add up to the total score, where a higher score signifies a higher level of addiction. The test has excellent psychometric properties, with a Cronbach’s α of .87 (Demetrovics et al., 2008). In this study, we used the total score. The inclusion criterion for IA was a minimum of 41 points, based on the cut-off suggested by the original authors of the questionnaire (Demetrovics et al., 2008). The Barratt Impulsiveness Scale (BIS-11; Patton, Stanford, & Barratt, 1995) was used to assess trait impulsivity. The scale consists of 30 items; all items are answered on a 4-point Likert-type scale (rarely/never, occasionally, often, and almost always/always). The items add up to the total score, where a higher score signifies higher impulsivity. As in previous studies (Du et al., 2016; Kaag et al., 2014; Tu, Kuan, Li, & Su, 2017), the total score for BIS-11 was used in this study for statistical testing. The BIS-11 has excellent psychometric properties (Cronbach’s α is greater than .8; Patton et al., 1995). We also assessed individual levels of depression and anxiety. Depression was measured using the BDI (Beck & Steer, 1984), while STAI (Spielberger, 2010) served as an indicator of anxiety. Handedness was measured using the Edinburgh Handedness Inventory (Oldfield, 1971). The FTND (Fagerstrom & Schneider, 1989; Prokhorov et al., 1996) was also administered to the group of smokers to test for nicotine dependence. To exclude possible neurological and psychiatric disorders, substance abuse, and chronic illnesses, the subjects also completed an exploratory questionnaire about lifestyle factors and mental and physical health.

MRI data collection and analysis

MRI measurements were performed on a 3 Tesla MR scanner (Siemens Magnetom Trio Tim System, Siemens AG, Erlangen, Germany) with a 12-channel head coil. For the volumetric analysis, isotopic 3D T1-weighted sagittal magnetization-prepared rapid acquisition with gradient echo images were used: FOV = 256 × 256 mm2, TR = 2,530 ms, TE = 3.37 ms, TI = 1,100 ms, slice thickness = 1 mm, slice number = 176, FA = 7°, bandwidth = 200 Hz/pixel, 256 × 256 matrix. Freesurfer v6.0 was used for the cortical reconstruction and volumetric segmentation of the images (http://surfer.nmr.mgh.harvard.edu/). Freesurfer software is one of the most reliable automated brain segmentation methods for cortical and subcortical structures. It also allows us to assess the volume of predefined brain structures in a large number of subjects (Fischl et al., 2004; Pardoe, Pell, Abbott, & Jackson, 2009). Freesurfer’s semi-automatic anatomical processing scripts (autorecon 1, 2, and 3) were executed on all the subjects’ data. Visual verifications were performed for all the subjects, and error corrections were applied when indicated. On the basis of previous studies concerning the relationship between impulsivity and cortical measures in addictions (Du et al., 2016; Limbrick-Oldfield, Van Holst, & Clark, 2013; Matsuo et al., 2009; Moccia et al., 2017), we defined 15 regions of interest (ROIs) using the Desikan–Killiany–Tourville atlas (Klein & Tourville, 2012) implemented in Freesurfer. The ROIs were the left and right frontal cortex [superior frontal cortex, pars opercularis, pars triangularis and pars orbitalis (POrb), the caudal and rostral middle frontal cortex, the lateral and medial orbitofrontal cortex, and the caudal and rostral anterior cingulate cortex (aCC)], the temporal cortex (the inferior-, middle-, and superior temporal cortices and the transverse temporal gyrus), and the insula. The cortical thickness of these predefined cortical ROIs and the total intracranial volume (ICV) was calculated for each participant. Left and right ROIs were entered separately into the analyses.

Statistical analyses

Data analysis was performed using IBM SPSS Statistics for Windows, version 22.0 (IBM Corp., Armonk, NY, USA). First, we assessed group differences in demographic and clinical characteristics using one-way analyses of variance (ANOVAs). A p value less than .05 was considered statistically significant. ANOVAs for the sample characteristics were followed up by Bonferroni corrected pairwise comparisons. After the p value, the partial η2 values were reported. IAs and smokers were compared to HCs separately. The sections “Results” and “Discussion” focus on IA. We tested the effect of impulsivity on cortical thickness using an analysis of covariance (ANCOVA). The cortical thicknesses of the ROIs were entered as dependent variables, the group as the independent variable, and the BIS-11 score as a covariate in the ANCOVA. Furthermore, in accordance with previous studies (Perlaki et al., 2014) and to avoid possible confounding effects, the ICV, BDI, and STAI were also included as nuisance covariates. To test whether the correlation between trait impulsivity and the cortical thickness of the ROIs differed between HCs and IAs, the impulsivity by group interaction was also modeled in a separate analysis. We conducted similar ANCOVAs comparing smokers and HCs. The Benjamini–Hochberg (Benjamini & Hochberg, 1995; Glickman, Rao, & Schultz, 2014; Verhoeven, Simonsen, & McIntyre, 2005) false discovery rate (BH FDR) procedure was used to correct for multiple comparison. Significant main effects and interactions were followed by partial correlations (correcting for ICV, BDI, and STAI), the latter conducted separately for the two groups to test for the direction of the correlation between cortical thickness and trait impulsivity. The significance value of a correlation analysis is highly dependent on the sample size, such that the probability of type II error increases when the sample size is low (Ellis, 2010). Therefore, the advice in such cases is to interpret results based on the effect size of the correlation. Since our sample size was relatively small (the control group consisted of 29 people and the IA group of 28), we focused on correlation coefficients rather than p values. An r value of .1 was considered as weak, a coefficient of .3 as medium, and a coefficient of .5 as strong correlation between the variables (Cohen, 1992).

Ethics

The research was approved by the local ethical review committee and was carried out in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki); informed consent was obtained from all of the participants involved in the study.

Results

Sample characteristics

The BIS-11 scores were significantly higher in IAs and smokers than in the controls (F2, 79 = 11.001, p < .01, η2p = 0.22), while IAs scored higher on the PIUQ than the two control groups (F2, 79 = 49.962, p < .01, η2p = 0.57). Regarding BDI, IAs achieved higher scores than the two control groups, who also differed, with smokers scoring higher than HCs (F2, 79 = 5.763, p = .01, η2p = 0.13). IAs reported higher levels of anxiety (STAI) than the two control groups (F2, 79 = 8.073, p < .01, η2p = 0.17). Table 1 shows the mean scores, SDs, and group differences.

Cortical thickness comparison between groups

The thickness of the left superior temporal cortex (STC; F1, 52 = 6.578, p = .013, η2p = 0.11) was significantly greater in the HC group (M = 2.884, SD = 0.117) than in the IA group (M = 2.825, SD = 0.108). The between-group comparisons of thicknesses of the other ROIs were not significant. Table 2 depicts the mean thicknesses, SDs, and statistical results between IAs and HCs. Similarly, the thickness of the bilateral STC (left: F1, 47 = 4.576, p = .041, η2p = 0.09; right: F1, 47 = 6.002, p = .018, η2p = 0.11) was significantly greater in HCs than in smokers (left: M = 2.805, SD = 0.141). However, the left STC did not survive the BH FDR correction. Table 3 depicts the mean thicknesses, SDs, and statistical results for the comparison between HCs and smokers.
.

Between- and within-group MANCOVA and post-hoc partial correlation results between IAs and HCs

Name of ROIGroup main effect (ANCOVA)aImpulsivity main effect (ANCOVA)aGroup by impulsivity interaction (ANCOVA)a
SizebStatisticsStatisticsStatistics
HCsIAsFpη2Fpη2rb,cFpη2r (HCs)b,dr (IAs)b,d
Left superior frontal cortex2.799 ± 0.1182.795 ± 0.092F1, 52 = 0.023n.s.0.00F1, 51 = 0.169n.s.0.00F1, 50 = 0.270n.s.0.00
Left pars opercularis2.648 ± 0.0992.681 ± 0.116F1, 52 = 0.708n.s.0.01F1, 51 = 0.577n.s.0.01F1, 50 = 0.047n.s.0.00
Left pars triangularis2.524 ± 0.0982.530 ± 0.117F1, 52 = 0.663n.s.0.01F1, 51 = 0.169n.s.0.01F1, 50 = 0.163n.s.0.00
Left pars orbitalis2.729 ± 0.1442.749 ± 0.128F1, 52 = 0.689n.s.0.01F1, 51 = 8.429.005*0.14−.29F1, 50 = 0.253n.s.0.00
Left caudal middle frontal cortex2.637 ± 0.1252.642 ± 0.082F1, 52 = 0.796n.s.0.01F1, 51 = 0.273n.s.0.00F1, 50 = 0.503n.s.0.01
Left rostal middle frontal cortex2.446 ± 0.1072.452 ± 0.080F1, 52 = 0.036n.s.0.00F1, 51 = 0.333n.s.0.01F1, 50 = 0.003n.s.0.00
Left lateral orbitofrontal cortex2.709 ± 0.0932.713 ± 0.091F1, 52 = 0.110n.s.0.00F1, 51 = 0.081n.s.0.00F1, 50 = 0.659n.s.0.01
Left medial orbitofrontal cortex2.454 ± 0.0922.467 ± 0.105F1, 52 = 0.928n.s.0.02F1, 51 = 0.001n.s.0.00F1, 50 = 0.024n.s.0.00
Left caudal anterior cingulate cortex2.717 ± 0.2062.656 ± 0.215F1, 52 = 0.217n.s.0.00F1, 51 = 2.156n.s.0.04F1, 50 = 2.650n.s.0.05
Left rostal anterior cingulat e cortex2.911 ± 0.1562.861 ± 0.125F1, 52 = 2.045n.s.0.04F1, 51 = 1.093n.s.0.02F1, 50 = 1.071n.s.0.02
Left superior temporal cortex2.884 ± 0.1172.825 ± 0.108F1, 52 = 6.578.013*0.11F1, 51 = 0.063n.s.0.00F1, 50 = 3.236n.s.0.06
Left middle temporal cortex2.840 ± 0.1052.842 ± 0.123F1, 52 = 0.001n.s.0.00F1, 51 = 0.053n.s.0.00F1, 50 = 6.553.014*0.12.35−.35
Left inferior temporal cortex2.752 ± 0.1432.736 ± 0.154F1, 52 = 0.012n.s.0.00F1, 51 = 0.178n.s.0.00F1, 50 = 4.126.048**0.08.29−.26
Left transverse temporal gyrus2.605 ± 0.0392.502 ± 0.040F1, 52 = 1.900n.s.0.03F1, 51 = 0.059n.s.0.00F1, 50 = 6.738.012*0.12.32−.34
Left insula3.062 ± 0.0763.077 ± 0.109F1 ,52 = 0.228n.s.0.00F1, 51 = 5.435.024*0.09.32F1, 50 = 3.129n.s.0.06
Right superior frontal cortex2.748 ± 0.1092.733 ± 0.098F1, 52 = 0.006n.s.0.00F1, 51 = 0.022n.s.0.00F1, 50 = 0.614n.s.0.01
Right pars opercularis2.626 ± 0.0802.658 ± 0.127F1, 52 = 2.448n.s.0.04F1, 51 = 0.438n.s.0.01F1, 50 = 0.159n.s.0.00
Right pars triangularis2.500 ± 0.0942.525 ± 0.100F1, 52 = 0.712n.s.0.01F1, 51 = 1.676n.s.0.03F1, 50 = 1.503n.s.0.03
Right pars orbitalis2.643 ± 0.1382.708 ± 0.154F1, 52 = 2.002n.s.0.04F1, 51 = 0.270n.s.0.00F1, 50 = 0.037n.s.0.00
Right caudal middle frontal cortex2.605 ± 0.1122.630 ± 0.072F1, 52 = 1.971n.s.0.04F1, 51 = 0.000n.s.0.00F1, 50 = 0.149n.s.0.00
Right rostal middle frontal cortex2.366 ± 0.0822.355 ± 0.075F1, 52 = 0.010n.s.0.00F1, 51 = 0.178n.s.0.00F1, 50 = 2.178n.s.0.04
Right lateral orbitofrontal cortex2.603 ± 0.0952.607 ± 0.123F1, 52 = 0.473n.s.0.01F1, 51 = 1.905n.s.0.04F1, 50 = 0.034n.s.0.00
Right medial orbitofrontal cortex2.434 ± 0.1292.430 ± 0.110F1, 52 = 0.217n.s.0.00F1, 51 = 1.450n.s.0.03F1, 50 = 0.008n.s.0.00
Right caudal anterior cingulate cortex2.488 ± 0.1832.492 ± 0.177F1, 52 = 0.142n.s.0.00F1, 51 = 0.884n.s.0.02F1, 50 = 0.088n.s.0.00
Right rostal anterior cingulate cortex2.827 ± 0.1562.838 ± 0.164F1, 52 = 0.672n.s.0.01F1, 51 = 0.580n.s.0.01F1, 50 = 0.053n.s.0.00
Right superior temporal cortex2.908 ± 0.1302.876 ± 0.105F1, 52 = 1.120n.s.0.02F1, 51 = 1.224n.s.0.02F1, 50 = 4.176.046**0.08.35−.21
Right middle temporal cortex2.936 ± 0.1062.912 ± 0.111F1, 52 = 0.058n.s.0.00F1, 51 = 0.649n.s.0.01F1, 50 = 6.099.017*0.11.39−.25
Right inferior temporal cortex2.832 ± 0.0762.814 ± 0.107F1, 52 = 0.009n.s.0.00F1, 51 = 0.139n.s.0.00F1, 50 = 2.135n.s.0.04
Right transverse temporal gyrus2.532 ± 0.1552.504 ± 0.149F1, 52 = 0.739n.s.0.01F1, 51 = 0.167n.s.0.00F1, 50 = 0.000n.s.0.00
Right insula3.107 ± 0.0893.091 ± 0.091F1, 52 = 0.506n.s.0.01F1, 51 = 11.425.001*0.18.41F1, 50 = 0.188n.s.0.00

Note. MANCOVA: multivariate analysis of covariance; HC: healthy control; IAs: Internet addicts; ANCOVA: analysis of covariance; ROI: region of interest.

aAdjusted for ICV, BDI, and STAI. bValues represent means ± standard deviations. cValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score) for IAs and HCs together. dValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score).

*Significant p value Benjamini–Hochberg adjusted for multiple comparisons. **Did not survive Benjamini–Hochberg correction.

.

Between- and within-group MANCOVA and post-hoc partial correlation results between smokers and HCs

Name of ROIGroup main effect (ANCOVA)aImpulsivity main effect (ANCOVA)aGroup by impulsivity interaction (ANCOVA)a
SizebStatisticsStatisticsStatistics
HCsSmokersFpη2Fpη2rb,cFpη2r (HCs)b,dr (IAs)b,d
Left superior frontal cortex2.799 ± 0.1182.725 ± 0.124F1, 47 = 3.767n.s.0.07F1, 47 = 0.060n.s.0.00F1, 46 = 0.994n.s.0.02
Left pars opercularis2.648 ± 0.0992.612 ± 0.111F1, 47 = 0.955n.s.0.02F1, 47 = 0.037n.s.0.00F1, 46 = 0.014n.s.0.00
Left pars triangularis2.524 ± 0.0982.471 ± 0.129F1, 47 = 0.606n.s.0.01F1, 47 = 0.692n.s.0.02F1, 46 = 2.089n.s.0.04
Left pars orbitalis2.729 ± 0.1442.689 ± 0.097F1, 47 = 0.459n.s.0.01F1, 47 = 2.004n.s.0.02F1, 46 = 1.316n.s.0.03
Left caudal middle frontal cortex2.637 ± 0.1252.606 ± 0.123F1, 47 = 0.062n.s.0.00F1, 47 = 0.045n.s.0.00F1, 46 = 2.629n.s.0.05
Left rostal middle frontal cortex2.446 ± 0.1072.392 ± 0.118F1, 47 = 2.334n.s.0.05F1, 47 = 0.248n.s.0.01F1, 46 = 1.171n.s.0.03
Left lateral orbitofrontal cortex2.709 ± 0.0932.657 ± 0.118F1, 47 = 3.334n.s.0.07F1, 47 = 0.006n.s.0.00F1, 46 = 0.394n.s.0.01
Left medial orbitofrontal cortex2.454 ± 0.0922.423 ± 0.122F1, 47 = 1.021n.s.0.02F1, 47 = 0.105n.s.0.00F1, 46 = 0.146n.s.0.00
Left caudal anterior cingulate cortex2.717 ± 0.2062.603 ± 0.154F1, 47 = 9.838.003*0.17F1, 47 = 5.376.025*0.10.245F1, 46 = 1.032n.s.0.02
Left rostal anterior cingulate cortex2.911 ± 0.1562.837 ± 0.188F1, 47 = 4.593.037**0.09F1, 47 = 0.002n.s.0.00F1, 46 = 0.040n.s.0.00
Left superior temporal cortex2.884 ± 0.1172.805 ± 0.141F1, 47 = 4.576.041**0.09F1, 47 = 0.082n.s.0.00F1, 46 = 2.705n.s.0.03
Left middle temporal cortex2.840 ± 0.1052.845 ± 0.147F1, 47 = 0.012n.s.0.00F1, 47 = 0.454n.s.0.01F1, 46 = 4.372.04**0.09.35−.17
Left inferior temporal cortex2.752 ± 0.1432.699 ± 0.156F1, 47 = 1.342n.s.0.03F1, 47 = 0.739n.s.0.02F1, 46 = 1.556n.s.0.03
Left transverse temporal gyrus2.605 ± 0.0392.497 ± 0.133F1, 47 = 9.806.003*0.17F1, 47 = 3.032n.s.0.06F1, 46 = 0.925n.s.0.03
Left insula3.062 ± 0.0762.977 ± 0.162F1, 47 = 0.929n.s.0.02F1, 47 = 2.108n.s.0.04F1, 46 = 0.936n.s.0.03
Right superior frontal cortex2.748 ± 0.1092.676 ± 0.112F1, 47 = 3.641n.s.0.07F1, 47 = 0.189n.s.0.00F1, 46 = 1.214n.s.0.03
Right pars opercularis2.626 ± 0.0802.618 ± 0.151F1, 47 = 0.008n.s.0.00F1, 47 = 0.453n.s.0.01F1, 46 = 0.001n.s.0.00
Right pars triangularis2.500 ± 0.0942.451 ± 0.103F1, 47 = 1.730n.s.0.04F1, 47 = 1.986n.s.0.04F1, 46 = 0.342n.s.0.01
Right pars orbitalis2.643 ± 0.1382.626 ± 0.127F1, 47 = 0.794n.s.0.02F1, 47 = 0.022n.s.0.00F1, 46 = 0.160n.s.0.00
Right caudal middle frontal cortex2.605 ± 0.1122.586 ± 0.117F1, 47 = 0.010n.s.0.00F1, 47 = 0.175n.s.0.00F1, 46 = 0.188n.s.0.00
Right rostal middle frontal cortex2.366 ± 0.0822.313 ± 0.089F1, 47 = 4.385.042**0.09F1, 47 = 0.131n.s.0.00F1, 46 = 1.705n.s.0.04
Right lateral orbitofrontal cortex2.603 ± 0.0952.583 ± 0.125F1, 47 = 1.174n.s.0.04F1, 47 = 0.329n.s.0.01F1, 46 = 1.991n.s.0.04
Right medial orbitofrontal cortex2.434 ± 0.1292.364 ± 0.121F1, 47 = 2.683n.s.0.05F1, 47 = 0.022n.s.0.00F1, 46 = 0.825n.s.0.02
Right caudal anterior cingulate cortex2.488 ± 0.1832.428 ± 0.094F1, 47 = 1.425n.s.0.03F1, 47 = 0.067n.s.0.00F1, 46 = 0.157n.s.0.00
Right rostal anterior cingulate cortex2.827 ± 0.1562.734 ± 0.159F1, 47 = 3.620n.s.0.07F1, 47 = 0.044n.s.0.00F1, 46 = 0.138n.s.0.00
Right superior temporal cortex2.908 ± 0.1302.827 ± 0.133F1, 47 = 6.002.018*0.11F1, 47 = 1.392n.s.0.03F1, 46 = 9.010.001*0.16.35−.33
Right middle temporal cortex2.936 ± 0.1062.871 ± 0.119F1, 47 = 3.050n.s.0.06F1, 47 = 0.470n.s.0.01F1, 46 = 10.622.01*0.18.39−.39
Right inferior temporal cortex2.832 ± 0.0762.800 ± 0.145F1, 47 = 0.272n.s.0.01F1, 47 = 0.001n.s.0.00F1, 46 = 0.086n.s.0.00
Right transverse temporal gyrus2.532 ± 0.1552.566 ± 0.210F1, 47 = 0.002n.s.0.00F1, 47 = 0.502n.s.0.01F1, 46 = 2.035n.s.0.04
Right insula3.107 ± 0.0892.987 ± 0.163F1, 47 = 0.983n.s.0.02F1, 47 = 1.596n.s.0.03F1, 46 = 0.533n.s.0.01

Note. MANCOVA: multivariate analysis of covariance; HCs: healthy controls; IAs: Internet addicts; ANCOVA: analysis of covariance; ROI: region of interest.

aAdjusted for ICV, BDI, and STAI. bValues represent means ± standard deviations. cValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score) for HCs and smokers together. dValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score).

*Significant p value Benjamini–Hochberg adjusted for multiple comparisons. **Did not survive Benjamini–Hochberg correction.

Between- and within-group MANCOVA and post-hoc partial correlation results between IAs and HCs Note. MANCOVA: multivariate analysis of covariance; HC: healthy control; IAs: Internet addicts; ANCOVA: analysis of covariance; ROI: region of interest. aAdjusted for ICV, BDI, and STAI. bValues represent means ± standard deviations. cValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score) for IAs and HCs together. dValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score). *Significant p value Benjamini–Hochberg adjusted for multiple comparisons. **Did not survive Benjamini–Hochberg correction. Between- and within-group MANCOVA and post-hoc partial correlation results between smokers and HCs Note. MANCOVA: multivariate analysis of covariance; HCs: healthy controls; IAs: Internet addicts; ANCOVA: analysis of covariance; ROI: region of interest. aAdjusted for ICV, BDI, and STAI. bValues represent means ± standard deviations. cValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score) for HCs and smokers together. dValues represent Pearson’s partial correlation coefficients between CT and impulsivity (BIS-11 total score). *Significant p value Benjamini–Hochberg adjusted for multiple comparisons. **Did not survive Benjamini–Hochberg correction.

Relationship between cortical thickness and trait impulsivity

The ANCOVAs revealed that impulsivity has a significant main effect on two ROIs: the left POrb (F1, 51 = 8.429, p = .005, η2p = 0.14), and the bilateral insula (right: F1, 51 = 11.425, p = .001, η2p = 0.18; left: F1, 51 = 5.435, p = .024, η2p = 0.09). The within-group comparisons of the thicknesses of the other ROIs were not significant. The follow-up partial correlation analyses showed that a higher level of impulsivity is associated with a thinner cortex in the left POrb (r = −.29). Furthermore, trait impulsivity and cortical thickness of both the right (r = .41) and the left (r = .32) insula are positively correlated. Table 2 demonstrates all the ANCOVAs and post-hoc test statistics.

Relationship between cortical thickness and addiction severity

To see whether addiction severity had any further effect on the cortical thickness of the ROIs, Pearson’s correlations were used. For the IA group, the correlation analyses revealed only one significant relationship between the cortical thickness of the left rostral aCC and the PIUQ total score (r = .4, p = .03). This result did not survive the HB FDR correction for multiple comparisons. For the smokers, we did not find a significant relationship between the cortical thickness of the ROIs and the Fagerström scores. Supplementary Table 1 demonstrates all the correlational test statistics.

Relationship between cortical thickness and trait impulsivity between groups

The ANCOVAs showed a group by impulsivity interaction across the following ROIs: right STC (F1, 50 = 4.176, p = .05, η2p = 0.08), bilateral middle temporal cortex (MTC; left: F1, 50 = 6.553, p = .01, η2p = 0.12; right: F1, 50 = 6.099, p = .02, η2p = 0.11), left inferior temporal cortex (ITC; F1, 50 = 4.126, p = .05, η2p = 0.08), and left transverse temporal cortex (TTC; F1, 50 = 6.738, p = .01, η2p = 0.12). However, the right STC and left ITC interactions did not survive the BH FDR correction. Table 2 shows all within-group ANCOVA test statistics. The post-hoc partial correlation analyses revealed positive relationships with medium power between cortical thickness and impulsivity across all four ROIs in HCs: left MTC r = .35, left TTC r = .32, and right MTC r = .39. As expected, in the IA group, the correlation coefficients were found to be negative. The correlation between the left MTC (r = −.35) and left TTC (r = −.34) and impulsivity had medium power, whereas for the right MTC (r = −.25), it had weak power. Table 2 depicts the correlation coefficients and Figure 1 shows group-wise comparisons.
Figure 1.

Correlations between BIS-11 total scores and cortical thickness measures. There was a significant interaction between the total score of the Barrat Impulsiveness Scale (BIS-11) and group in cortical thicknesses of the left transverse temporal cortex (panel A: r = .32 for controls; r = −.34 for Internet addicts), cortical thickness of the left middle temporal cortex (panel B: r = .35 for controls; r = −.35 for Internet addicts), and cortical thickness of the right middle temporal cortex (panel C: r = .39 for controls; r = −.25 for Internet addicts). Please note that the cortical thickness values displayed here are uncorrected for covariates

Correlations between BIS-11 total scores and cortical thickness measures. There was a significant interaction between the total score of the Barrat Impulsiveness Scale (BIS-11) and group in cortical thicknesses of the left transverse temporal cortex (panel A: r = .32 for controls; r = −.34 for Internet addicts), cortical thickness of the left middle temporal cortex (panel B: r = .35 for controls; r = −.35 for Internet addicts), and cortical thickness of the right middle temporal cortex (panel C: r = .39 for controls; r = −.25 for Internet addicts). Please note that the cortical thickness values displayed here are uncorrected for covariates We conducted similar ANCOVAs comparing smokers and HCs, including only the ROIs that showed significant interaction when comparing IAs and HCs. We found significant interaction in the right STC (right: F1, 47 = 9.01, p < .01, η2p = 0.16) and bilateral MTC (left: F1, 47 = 4.372, p = .04, η2p = 0.09; right: F1, 47 = 10.622, p < .01, η2p = 0.18), but not in the left ITC (F1, 47 = 1.556, p = .22, η2p = 0.03) or the left TTC (F1, 47 = 0.925, p = .34, η2p = 0.03). Furthermore, the left MTC correlation did not survive the BH FDR correction. In this study, post-hoc correlations revealed that, concerning the IA group, the correlation coefficients were negative. The correlation between the right STC (r = −.33) and the right MTC (r = −.39) had medium power.

Discussion

Summary

To our knowledge, this is the first study investigating the relationship between impulsivity and cortical thickness in IAs. The IAs and controls differed in the cortical thickness of the left STC. Moreover, there was a main effect of impulsivity on cortical morphology observed in the left POrb and bilateral insula. In addition, we identified distinct relationships between impulsivity and cortical thickness in IAs and controls regarding the left TTC and bilateral MTC.

Group differences

As in our previous study (Altbäcker et al., 2016) and those of others (Park et al., 2017; Yuan et al., 2013), we found differences between IAs and controls. The left STC was found to be thicker for controls. The medial temporal cortex is associated with urges and craving (Ko et al., 2009) and, along with the STC, is involved in regulatory control over reward-seeking behavior (Chiamulera, 2005). This is consistent with our results: the changes in the cortical thickness of the left STC were found to be significant when comparing the addiction groups (IAs and smokers) and the HCs. Furthermore, the present research suggests that the differences between IAs and HCs are already present in young adults. It should also be noted that we found additional group differences between smokers and HCs, the most prominent being in the left caudal aCC. This difference might be due to the fact that smoking is a substance-related addiction, whereas IA is not. Nevertheless, previous studies (Lee, Park, Namkoong, Kim, & Jung, 2018; Van Rooij & Prause, 2014) have shown similar cortical changes of the aCC in IA.

The relationship between impulsivity and cortical thickness

Impulsivity had a significant main effect, regardless of group, on the left POrb and the bilateral insula. The post-hoc correlation revealed a negative relationship between the thickness of the POrb and impulsivity. Interestingly, trait impulsivity was positively correlated with the thickness of the insula. There are pieces of evidence suggesting that the left IFC (Aron, Robbins, & Poldrack, 2014) and the POrb in particular (Swick, Ashley, & Turken, 2008) are involved in inhibitory mechanisms. In an fMRI study with healthy adults, Xue, Lu, Levin, and Bechara (2010) suggest that activation in the insula signals a gambling urge (Tényi, Gyimesi, Kovács, Tényi, & Janszky, 2016). Moreover, it has been proposed (Brevers, Noël, He, Melrose, & Bechara, 2016; Verdejo-García & Bechara, 2009) that this urge might facilitate the seeking of immediate rewards.

The distinctive connection between trait impulsivity and cortical thickness in IAs

The distinct relationships between cortical thickness and impulsivity in IAs compared to controls could be identified as either a predisposition to or a consequence of IA, or even a combination of both, as found in patients with major depression (Fradkin, Khadka, Bessette, & Stevens, 2017) and cocaine addicts (Kaag et al., 2014). Consistent with previous studies (Park et al., 2017; Yuan et al., 2013), we found negative correlations in IAs between several cortical areas that are involved in impulsivity and executive functions, such as impaired decision-making and poor response inhibition. The positive correlation in controls is in line with previous studies (Antonucci et al., 2006; Aron, Robbins, & Poldrack, 2004; Schilling et al., 2012). A possible interpretation of the present findings might be that a normal trait impulsivity is essential for intact functioning (Doran, Spring, McChargue, Pergadia, & Richmond, 2004) but that, nevertheless, overly high levels of impulsivity might lead to negative consequences. Impulsivity has been shown (Crews & Boettiger, 2009; Du et al., 2016; Kreek et al., 2005; Limbrick-Oldfield et al., 2013; Matsuo et al., 2009; Moccia et al., 2017) to be among the most influential underlying factors in developing an addiction of any kind. Moreover, addictive behavior could further increase impulsivity (de Wit, 2009). Furthermore, a large body of research (Altbäcker et al., 2016; Kühn & Gallinat, 2015; Park et al., 2017; Yuan et al., 2013) have shown that IA has an influence on the morphology of several brain regions. Thus, it seems plausible to claim that the effects of impulsivity, combined with long-term exposure to some specific substance or stimuli, might result in different natures of the relationships between impulsivity and brain structure when compared to HCs. It has been shown (Balogh, Mayes, & Potenza, 2013; Blum et al., 2014; Grant, Potenza, Weinstein, & Gorelick, 2010) that substance-related and behavioral addictions often lead to similar morphological or functional changes of the brain. In this study, we found similar interactions in the right STC and MTC when comparing IAs and HCs to those we found when comparing smokers and HCs. A previous study by Kaag et al. (2014) also found the same interaction in cocaine users and HCs in the STC. Importantly, our results also suggest that the left MTC and TTC might be distinct areas that are unique for IA, as these interactions were not present when comparing smokers and HCs. As previous studies (Ding et al., 2014; Dong, Huang, & Du, 2012; Feng et al., 2013) have claimed, temporal areas are involved in audio–visual processing – a function that is frequently activated during screen media activity like computer and Internet use. It has been suggested that long-term hyperactivity in such regions could lead to impaired auditory–visual abilities (Ding et al., 2014), language-processing impairment (Söderström, Horne, Mannfolk, van Westen, & Roll, 2017), and learning problems (Cone-Wesson, 2005). The negative relationship between impulsivity and the thickness of the left POrb observed in the whole sample could lend further support to the possible involvement of language processing. We argue that this is a possible interpretation of the overlapping networks of impulsivity alterations in cortical thickness. Although the temporal cortex has been shown to be impaired in both chronic drug abuse (Robbins, Ersche, & Everitt, 2008) and IA (Hahn & Kim, 2014; Weinstein & Lejoyeux, 2010), it is still possible that our results are due to the fact that we compared a substance-related to a behavioral addict group. Overall, our findings suggest that changes in cortical thickness in IAs, in a similar way to substance-related addictions, are at least partly mediated by trait impulsivity. These findings may have clinically relevant implications as well. Previous research has shown that impulsivity plays a crucial role in treatment sensitivity and predicting absence outcomes in, for instance, smoking, marijuana, cocaine, heroin, and methamphetamine addicts (see Stevens et al., 2014 for a review). Our results show that impulsivity is a relevant factor in IA and therefore that it is plausible that, as for other addictions, special focus might be needed during therapy to help individuals overcome this issue. More research is needed to discover the manner in which clinicians might tailor treatment for individuals who are more prone to impulsivity, which may also be connected to the duration of the addiction disorder. Some limitations of this study should be noted. First, we relied on self-reported measures of IA and impulsivity. Despite this limitation, to date, IA can only be assessed by questionnaires, and the PIUQ has been proved to be a well-established and reliable measure of IA. The BIS-11 is also a widely used and validated measure for trait impulsivity. However, it would be interesting for further studies to include a behavioral measure of impulsivity, as this might lead to more accurate results. Furthermore, the modest sample size may limit the generalization of our findings, as it was particularly noticeable in relation to partial correlations. On the whole, the interaction of impulsivity and excessive Internet use in the context of thickness changes in the temporal cortex is unclear. It may be noted that both impulsivity and Internet overuse independently lead to alterations in the cortical thickness of the temporal cortex, or that the presence of both impulsivity and Internet overuse has a supra-additive effect on cortical thickness, or that cortical thickness changes are primarily driven by impulsivity. Only larger studies will help to disentangle these possibilities.

Conclusions

Notwithstanding these limitations, our results, in sum, provide additional insights into the etiology of IA and the underlying cortical correlates of impulsive behavior in IAs that are similar to what has been observed in substance-related addictions. This study provides additional evidence of the importance of including measures of cortical thickness for detecting and understanding the origin of cortical abnormalities in IA. Moreover, our results provide further evidence that IA has shared characteristics with other addictive behaviors. Furthermore, the current findings may foreshadow some clinically relevant implications for future treatment, such as developing complex strategies to address IAs with different levels of trait impulsivity. Finally, future studies will be necessary to test these implications in clinical practice to clarify the present findings and to translate them into successful IA prevention and cessation outcomes.
  75 in total

Review 1.  The role of impulsivity in the development of substance use and eating disorders.

Authors:  Sharon Dawe; Natalie J Loxton
Journal:  Neurosci Biobehav Rev       Date:  2004-05       Impact factor: 8.989

2.  Problematic Internet use: an overview.

Authors:  Elias Aboujaoude
Journal:  World Psychiatry       Date:  2010-06       Impact factor: 49.548

Review 3.  Shared and unique mechanisms underlying binge eating disorder and addictive disorders.

Authors:  Erica M Schulte; Carlos M Grilo; Ashley N Gearhardt
Journal:  Clin Psychol Rev       Date:  2016-02-04

Review 4.  Cue reactivity in nicotine and tobacco dependence: a "multiple-action" model of nicotine as a primary reinforcement and as an enhancer of the effects of smoking-associated stimuli.

Authors:  Christian Chiamulera
Journal:  Brain Res Brain Res Rev       Date:  2005-02

5.  Issues for DSM-V: internet addiction.

Authors:  Jerald J Block
Journal:  Am J Psychiatry       Date:  2008-03       Impact factor: 18.112

Review 6.  Impulsivity as a vulnerability factor for poor addiction treatment outcomes: a review of neurocognitive findings among individuals with substance use disorders.

Authors:  Laura Stevens; Antonio Verdejo-García; Anna E Goudriaan; Herbert Roeyers; Geert Dom; Wouter Vanderplasschen
Journal:  J Subst Abuse Treat       Date:  2014-02-10

7.  Internet addiction and problematic Internet use: A systematic review of clinical research.

Authors:  Daria J Kuss; Olatz Lopez-Fernandez
Journal:  World J Psychiatry       Date:  2016-03-22

8.  Orbitofrontal correlates of aggression and impulsivity in psychiatric patients.

Authors:  Ami Sheth Antonucci; David A Gansler; Simon Tan; Rafeeque Bhadelia; Sam Patz; Carl Fulwiler
Journal:  Psychiatry Res       Date:  2006-09-06       Impact factor: 3.222

9.  Altered Structural Correlates of Impulsivity in Adolescents with Internet Gaming Disorder.

Authors:  Xin Du; Xin Qi; Yongxin Yang; Guijin Du; Peihong Gao; Yang Zhang; Wen Qin; Xiaodong Li; Quan Zhang
Journal:  Front Hum Neurosci       Date:  2016-01-28       Impact factor: 3.169

10.  Voxel-level comparison of arterial spin-labeled perfusion magnetic resonance imaging in adolescents with internet gaming addiction.

Authors:  Qi Feng; Xue Chen; Jinhua Sun; Yan Zhou; Yawen Sun; Weina Ding; Yong Zhang; Zhiguo Zhuang; Jianrong Xu; Yasong Du
Journal:  Behav Brain Funct       Date:  2013-08-12       Impact factor: 3.759

View more
  6 in total

1.  Reciprocal modulation between cigarette smoking and internet gaming disorder on participation coefficient within functional brain networks.

Authors:  Xianxin Qiu; Xu Han; Yao Wang; Weina Ding; Yawen Sun; Hao Lei; Yan Zhou; Fuchun Lin
Journal:  Brain Imaging Behav       Date:  2022-08-26       Impact factor: 3.224

2.  Problematic Relationships with Smartphones of Spanish and Colombian University Students.

Authors:  Verónica Marín-Díaz; Juan Manuel Muñoz-González; Begoña-Esther Sampedro-Requena
Journal:  Int J Environ Res Public Health       Date:  2020-07-25       Impact factor: 3.390

3.  Internet Addiction and Burnout in A Single Hospital: Is There Any Association?

Authors:  Gabor Toth; Krisztian Kapus; David Hesszenberger; Marietta Pohl; Gabor Kosa; Julianna Kiss; Gabriella Pusch; Eva Fejes; Antal Tibold; Gergely Feher
Journal:  Int J Environ Res Public Health       Date:  2021-01-13       Impact factor: 3.390

4.  Psychosocial Intervention for Youth With High Externalizing Behaviors and Aggression Is Associated With Improvement in Impulsivity and Brain Gray Matter Volume Changes.

Authors:  Nathan J Kolla; Areti Smaragdi; George Gainham; Karolina H Karas; Colin Hawco; Justin Haas; Tracey A Skilling; Margaret Walsh; Leena Augimeri
Journal:  Front Psychiatry       Date:  2022-01-06       Impact factor: 4.157

5.  Structural gray matter differences in Problematic Usage of the Internet: a systematic review and meta-analysis.

Authors:  Jeremy E Solly; Roxanne W Hook; Jon E Grant; Samuele Cortese; Samuel R Chamberlain
Journal:  Mol Psychiatry       Date:  2021-10-12       Impact factor: 13.437

6.  Prevalence and Risk Factors of Internet Addiction among Hungarian High School Teachers.

Authors:  Gábor Tóth; Krisztian Kapus; David Hesszenberger; Marietta Pohl; Gábor Kósa; Julianna Kiss; Gabriella Pusch; Éva Fejes; Antal Tibold; Gergely Feher
Journal:  Life (Basel)       Date:  2021-03-03
  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.