Evidence in cortical folding patterns for prenatal predispositions to hallucinations in schizophrenia.

All perception is a construction of the brain from sensory input. Our first perceptions begin during gestation, making fetal brain development fundamental to how we experience a diverse world. Hallucinations are percepts without origin in physical reality that occur in health and disease. Despite longstanding research on the brain structures supporting hallucinations and on perinatal contributions to the pathophysiology of schizophrenia, what links these two distinct lines of research remains unclear. Sulcal patterns derived from structural magnetic resonance (MR) images can provide a proxy in adulthood for early brain development. We studied two independent datasets of patients with schizophrenia who underwent clinical assessment and 3T MR imaging from the United Kingdom and Shanghai, China (n = 181 combined) and 63 healthy controls from Shanghai. Participants were stratified into those with (n = 79 UK; n = 22 Shanghai) and without (n = 43 UK; n = 37 Shanghai) hallucinations from the PANSS P3 scores for hallucinatory behaviour. We quantified the length, depth, and asymmetry indices of the paracingulate and superior temporal sulci (PCS, STS), which have previously been associated with hallucinations in schizophrenia, and constructed cortical folding covariance matrices organized by large-scale functional networks. In both ethnic groups, we demonstrated a significantly shorter left PCS in patients with hallucinations compared to those without, and to healthy controls. Reduced PCS length and STS depth corresponded to focal deviations in their geometry and to significantly increased covariance within and between areas of the salience and auditory networks. The discovery of neurodevelopmental alterations contributing to hallucinations establishes testable models for these enigmatic, sometimes highly distressing, perceptions and provides mechanistic insight into the pathological consequences of prenatal origins.

Introduction

All perception is a construct of the brain. Yet occasionally, sensory constructions emerge without origin in the physical world and are experienced as hallucinations. Despite over 20 years of active neuroimaging research on hallucinations[1-3], the neural systems supporting anomalous perceptual experiences remain disputed. Hallucinations occur transdiagnosticallly, cross-culturally, and in all sensory modalities[4,5]. In a recent meta-analysis and systematic review, we characterized multiple brain mechanisms supporting the diversity of hallucinations, including fronto-temporal deficits associated with hallucination status in patients with a psychiatric disorder[6]. Our prior work established the role of cingulate and temporal lobe sulcal topology, products of early neurodevelopment[7], in reality monitoring and the experience of hallucinations associated with schizophrenia[8-11], suggesting that variants in fetal brain development might confer later vulnerability to hallucinations.

The characteristic morphological features of the brain’s surface emerge in a specific order during the perinatal period, with the primary convolutions occurring in the second trimester, and dramatic growth of sulci and gyri in the third[12,13]. Gyral and sulcal architecture is intrinsically related to the brain’s functional organization[14]. Functional neuroimaging studies have consistently reported alterations in the brain’s resting state networks in people who experience hallucinations, particularly in the salience network, which engages the anterior cingulate and anterior insula to determine the origin and salience of internal and external stimuli[15,16]. The salience network equally coordinates the transition between functional networks related to self- and task-processing, suggesting cross-network abnormalities in the manifestation of hallucinations[17]. The topography of large-scale networks is partially recapitulated in patterns of interregional cortical associations[18]. Mounting evidence suggests that structural covariance networks reflect developmental coordination between brain regions, such that areas with highly correlated anatomical properties, like gyrification, result from similarities in their maturational trajectories[18,19]. Although the cellular mechanisms that underlie patterns of cortical covariance remain poorly understood, neurodevelopmental events that influence structural covariance networks significantly affect postnatal outcomes and higher cognitions in adult life[20,21]. Structural covariance networks have previously predicted transition to psychosis among individuals at high clinical risk[22], have demonstrated reduced salience and fronto-parietal control networks in schizophrenia patients compared to healthy controls[23], and have been shown to have a positive association between frontal–temporal grey matter and auditory hallucination severity in schizophrenia[24]. These results suggest that structural covariance networks offer insights into the emergence of functional connectivity and index large-scale network integrity, specifically in relation to the pathophysiology of schizophrenia.

The paracingulate sulcus (PCS) is a complex structure on the medial prefrontal cortical surface, found only in humans and chimpanzees[25], that lies dorsal to the cingulate sulcus. It is characterized by high inter-individual and inter-hemispheric variability, including fragmentation, intersection by other sulci, and even absence (Fig. 1). The PCS shows a notable leftward asymmetry among the general population that is reduced in individuals with a diagnosis of schizophrenia[26-28]. We have previously shown that the bilateral absence of the PCS is associated with impairments in reality monitoring in healthy individuals[8] and a shorter PCS is associated with a predisposition to hallucinations in a study of 113 patients with schizophrenia[9].

Fig. 1

Variability in paracingulate sulcus (PCS) morphology.

The PCS may be absent (A), fragmented by other sulci (B), or continuous (C). Sulci can be quantified through different shape measurements, such as depth and length (D). Illustrative examples of PCS organization are shown in E for n = 9 participants.

Sulcal contributions to hallucinations are not limited to the PCS. Localized deviations in the superior temporal sulcus (STS) in schizophrenia patients with auditory hallucinations have been reported[10,29], as well as global decreases in cortical sulcation in patients with auditory and visual hallucinations[11]. The PCS and STS overlap in their temporal emergence during sulcal ontogenesis at the fetal stage: the central sulcus forms around 19–25 weeks of gestation, with its secondary branches and the PCS appearing around 30 weeks[13] and the STS forms near 26 weeks, with the right STS emerging one week prior to that on the left[30]. The STS displays a robust rightward depth asymmetry at the base of Heschl’s gyrus, regardless of language dominance and certain atypical conditions[30], though this asymmetry has not been investigated in schizophrenia. Due to the stability of sulci patterns during brain maturation[7], their topological variants in adulthood imply deviations in early brain development resulting in an intransient structural marker for a reality monitoring network[31], and a risk factor for experiencing hallucinations. This aligns with the developmental risk model of schizophrenia, which integrates perinatal hazards and neurodevelopmental processes along with postnatal experiences like urban upbringing or childhood trauma into the disorder’s pathogenesis[32].

Structural asymmetries in the human brain are ubiquitous, functionally significant, and linked to disease processes in schizophrenia. Certain asymmetries become recognizable perinatally, during the third trimester of gestation[12,33,34]. Despite these observations, along with hemisphere-specific effects associated with hallucinations, as well as schizophrenia more broadly, sulcal asymmetries have not been investigated in the context of hallucinations in schizophrenia.

Here we studied two ethnically independent structural MRI datasets of patients with schizophrenia (n = 181) and healthy controls (n = 63) to empirically test theoretical predictions linking hallucinations, cortical folding patterns, and salience and auditory brain network congruity. We first directly replicated, in this larger sample, the reduced left PCS length in schizophrenia patients with hallucinations compared to those without[9,35], showing ethnic invariance[36] of a prenatally determined structural marker for hallucinations. To render this tractable for large datasets, a semi-automated method was used to detect and characterize the PCS and STS from T1-weighted MRI, which we validated against the prior, gold standard manual approach. Sulcal 3D-segmentations allowed visualization of their geometry, illustrating a focal displacement in curvature of the PCS and STS associated with hallucinations that is strikingly similar to the sulcal kink previously observed in the STS of patients with hallucinations[29]. With the local gyrification index (LGI) as a validated proxy for local sulcal shape, we exploited the sensitivity of structural covariance of functional resting-state networks. We hypothesized based on previous accounts[22-24,37] that deviations in frontal and temporal sulcal anatomy would reflect more general alterations in the topographical organization of large-scale networks; specifically, that patients with and without hallucinations would diverge in the inter-regional structural covariance within and between the salience and auditory networks. Extending reported structural asymmetry reductions in schizophrenia, we evaluated the relationship between sulcal asymmetries and hallucination status. Additionally, we complemented our analysis of cortical sulcation and gyrification with more usually studied metrics of cortical thickness and gray matter volume, which are plastic to aging, learning, and experience.

Materials and methods

Participants and study design

Two MRI datasets were re-purposed from independent studies of patients with recent-onset schizophrenia who underwent clinical assessment and 3T structural neuroimaging: (1) a predominantly White British sample assessed at multiple sites in the UK[38] and; (2) a Han Chinese sample assessed in Shanghai, China[39]. See Supplementary Tables S1 and S2 for the eligibility criteria and scanning sequence details. Patients were grouped into those with hallucinations (H+; n = 79 UK sample, n = 22 Shanghai sample) defined by a score > 2 on the PANSS P3 item for hallucinatory behaviour at the time of scanning, and those not experiencing hallucinations (H−; n = 43 UK sample, n = 37 Shanghai sample), as has been used previously[40,41]. Additionally, 63 healthy controls (HC) were recruited into the Shanghai study. Together, the sample was larger than previous samples detecting an effect of PCS length on hallucination status[9]. Studies were approved by the North West Manchester NHS Research Ethics Committee and Shanghai Mental Health Centre and the Institute of Psychology, respectively. Written, informed consent was obtained from all participants.

MRI processing and measurement of sulcal patterns

Although primary sulci like the cingulate sulcus are relatively stable cortical landmarks across the population, secondary sulci, such as the PCS, exhibit substantial phenotypic complexity and interindividual and interhemispheric variability (Fig. 1), hindering techniques for their accurate identification and measurement. Paus et al.[42] proposed a qualitative 3-category classification of the PCS as prominent, present, or absent that has been widely deployed. However, ambiguities in PCS patterns pose boundary definition problems that introduce subjectivity into this classification scheme, and other nomenclatures and sulcal definitions have been proposed[43]. Differences between measurement techniques, and even between experts using the same technique, are a cause of discrepancies in sulcal measurements[43]. The current gold standard method for measuring the length of the PCS remains manual segmentation, a method that has proven sensitive to differences in hallucination occurrence[9]. However, manual methods become increasingly intractable for large datasets and are unable to provide other biologically meaningful sulcal metrics, such as depth[30]. Semi-automated methods show success in extracting detailed 3-dimensional sulcal curves, and even in identifying the primary sulci[44,45], yet the open challenge lies in labeling variable sulci such as the PCS, which to date can only be completed with manual intervention. Accurate labeling of sulci is necessary to meaningfully determine the functional significance of sulcal architecture diversity in health and disease.

We used BrainVISA’s Morphologist 2015 pipeline (http://brainvisa.info/web/morphologist.html) to segment all cortical sulci. The superior temporal sulcus (STS) was automatically labeled with BrainVISA, while the paracingulate sulcus (PCS) was manually identified from whole-brain sulcal segmentations due to its high morphological variability. STS and PCS length and depth measurements in native participant space were calculated from the resultant labels. Length measurements were validated against manual measurements resulting in an intra-class correlation coefficient, ICC = 0.933 (95% CI: 0.922–0.941) for the left hemisphere and ICC = 0.943 (95% CI: 0.937–0.947) for the right. Details of the validation are given in Supplementary Fig. S1 and Supplementary Tables S3 and S4. To visualize the average morphology of the sulci of interest in each group (H+, H−, HC), we created 3D maps of the PCS and STS after linear spatial normalization to a common stereotactic space. To interrogate the locus of sulcal shifts, we applied the Human Connectome Project (HCP)-MMP1.0 multimodal surface-based anatomical atlas[46]. See Supplementary Methods for further detail.

Cortical thickness (CT) and local gyrification index (LGI) were calculated using the FreeSurfer analysis package (v.6.0, http://surfer.nmr.mgh.harvard.edu/). Structural MRI data were analyzed with FSL-VBM (v.5.0.10, http://fsl.fmrib.ox.ac.uk/fsl), an optimized VBM protocol carried out with FSL tools.

Sulcal asymmetries related to hallucination status

The PCS has consistently been characterized to show a leftward asymmetry, wherein it is more often prominent or present in the left hemisphere than in the right[25,36,42]. This leftward asymmetry is reduced in patients with schizophrenia[26-28]. The superior temporal sulcus displays a robust rightward depth asymmetry that has not been investigated in schizophrenia, though reductions in volume, gyrification, and cortical thickness have all been observed in the superior temporal gyrus[6]. Length and depth asymmetry indexes (AI) were computed for both the PCS and STS: AI = 2 × (R − L)/(R + L), for left (L) and right (R) measures, with a positive AI representing a longer or deeper sulci in the right hemisphere.

Structural covariance networks for local gyrification index between and within auditory and salience networks

To succinctly estimate cortical topology over spatially extended resting-state networks, we computed the regional local gyrification index (LGI) as a proxy of sulcal morphology. The LGI is the ratio of the pial area, including sulcal folds, to the outer cortical surface, excluding sulci. A higher LGI indicates a more involuted cortical surface and is reduced by having fewer and shorter sulci. LGI is sensitive to cortical development[47], differentiates schizophrenia patients from healthy controls[37], and predicts transition to psychosis from clinical high-risk states[22]. In our sample, the LGI across regions corresponding to the PCS and STS (Supplementary Fig. S2AB) was significantly correlated to both left and right PCS and STS length and depth (p < 0.05) (Supplementary Fig. S3). We constructed inter-regional structural covariance matrices of LGI for 360 parcellated brain regions (180 per hemisphere) according to the HCP-MMP1.0 multimodal surface-based anatomical atlas[46] for each group: H+ n = 101; H− n = 80; HC n = 63, adjusted for age, sex, scanning site, and TIV. Matrices were re-organized into eight well-established and replicable resting-state networks (Supplementary Table S5) and LGI values between regions located within the same network were averaged, resulting in an 8 × 8 matrix for each group of network level LGI synchrony. Following our hypotheses that deviations in sulcal anatomy would reflect alterations in the organization of specific large-scale networks, we evaluated the group differences in the inter-regional structural LGI covariance within and between the salience and auditory networks.

Statistical analysis

Demographic and clinical differences between groups by sample (UK H+, UK H−, Shanghai H+, Shanghai H−, Shanghai HC) were examined with one-way ANOVAs or chi-square tests for categorical data, and t tests or Mann–Whitney U test for continuous variables, according to their distributions. To address hypotheses concerning PCS and STS length and depth differences, we performed per hemisphere linear regression analyses for PCS length by group, controlling for potential effects of age, sex, scanning center, and total intracranial volume (TIV). We performed this analysis in each dataset separately and in both combined. The homogeneity between UK and Shanghai samples and the ethnic invariance of sulcal morphology[36] enabled us to merge the datasets for subsequent analyses. Sulcal AIs were assessed within each group using one-sample t-tests and between groups (H+, H−, HC) using one-way ANOVAs (Supplementary Table S6). Planned comparisons for group differences in PCS length, and PCS length and STS depth asymmetries in healthy controls, were evaluated at p < 0.05. Exploratory analyses for PCS depth, STS length and depth, and asymmetry indices were corrected by FDR (FDR < 0.05). Residual analysis plots were generated to assess the assumptions of linear regression. To test the statistical significance between group-wise gyrification-based structural covariance networks, we performed nonparametric permutation testing with 5000 repetitions. For each iteration, the LGI parcellations of each participant were randomly assigned to one of three new groups with equivalent sample size to the original study groups (H+, H−, HC) and the between group differences in the average correlation within and between the salience and auditory networks were re-computed to sample the null distributions against which significance of the observed correlations was computed. This approach maintains the LGI values and covariates for each participant, but shuffles group assignment across individuals. The observed differences in means were evaluated against the obtained permutation distributions, and a two-tailed p-value was calculated based on its percentile position (<5%). Resultant p-values were corrected by FDR (FDR < 0.05). To investigate the potential influence of laterality, we further decomposed the eight networks into their hemisphere-specific component regions and repeated the analysis for the resultant 16 × 16 structural covariance matrices (Supplementary Table S7 and Supplementary Fig. S4). Analyses were conducted in RStudio (v.1.0.136) and Matlab (v.2017b). To reproduce prior cortical morphology analyses related to hallucinations (see ref. [6] for a review), we conducted whole-brain analyses of cortical gyrification, thickness, and gray matter volume within each sample separately, corrected for multiple comparisons across each hemisphere with Monte Carlo simulation (10 000 iterations) and a cluster-forming threshold of p < 0.05 for surface-based analyses, and nonparametric two-sample t-tests using 5000 permutations and threshold-free cluster enhancement to identify areas in which gray matter volume differed between groups (p < 0.05) within the medial prefrontal cortex.

Results

Multi-ethnic samples of schizophrenia patients with and without hallucinations, and healthy controls

Demographic and clinical differences between groups by sample (UK H+, UK H−, Shanghai H+, Shanghai H−, Shanghai HC) showed no significant group differences for gender, years of education, or olanzapine equivalent doses (Table 1). Post hoc comparisons using Tukey HSD indicated no differences in mean age, but the 5-group one-way ANOVA showed a significant main effect (F(4,236) = 2.44, p = 0.048). Individuals from the UK and Shanghai samples did not differ in their group-respective hallucination symptom scores (PANSS P3). However, the datasets differed in the ratio of patients with hallucinations to those without, with 65% of patients experiencing hallucinations in the UK sample, similar to that previously reported[11], but only 37% in the Shanghai sample. This could reflect recruitment differences between the two studies and/or cultural variation in the reporting or diagnosis of hallucinations[48]. All participants in the UK sample and 93% of patients in the Shanghai sample were on stable antipsychotic medication at the time of scanning.

Table 1

Characteristics of study participants.

	United Kingdom, multi-centre		Shanghai			Test statistic	p value
	H+	H−	H+	H−	HC
Total N	79	43	22	37	63
Scanning site 1 (Manchester), n	51	34
Scanning site 2 (Cambridge), n	19	5
Scanning site 3 (Edinburgh), n	9	4
Male/Female (% Female)	54/25 (31.6)	30/13 (30.2)	15/7 (31.8)	21/16 (43.2)	36/27 (42.9)	χ2(4) = 3.56	0.47
Mean age (SD)	25.65 (5.21)	26.23 (5.96)	22.04 (6.00)	23.89 (5.21)	24.70 (7.35)	F(4,236) = 2.44	0.048
Years education (SD)	12.57 (1.95)	12.72 (2.07)	11.73 (2.62)	13.16 (2.78)	13.34 (2.49)	F(4,189) = 2.19	0.07
IQ (SD)	99.65 (11.11)	99.26 (12.22)	93.57 (18.82)	94.84 (18.90)	116.20 (15.02)	F(4,231) = 19.19	<0.001
PANSS positive (SD)	18.68 (4.47)	14.20 (3.81)	19.32 (5.56)	10.68 (3.29)		F(3,156) = 34.53	<0.001
PANSS positive minus P3 (SD)	14.70 (4.20)	12.94 (3.76)	15.14 (5.01)	9.65 (3.24)		F(3,156) = 14.36	<0.001
PANSS negative (SD)	15.70 (4.82)	18.51 (6.61)	21.77 (6.14)	15.54 (6.60)		F(3,157) = 7.50	<0.001
PANSS general (SD)	18.68 (4.46)	14.20 (3.81)	19.31 (5.56)	10.67 (3.29)		F(3,156) = 34.53	<0.001
PANSS P3 Hallucination (SD)	3.96 (0.97)	1.21 (0.47)	4.18 (1.01)	1.03 (0.16)		F(3,177) = 211.1	<0.001
PANSS P3 Hallucination year average (SD)	3.45 (0.98)	1.23 (0.34)				F(1,120) = 205.1	<0.001
PANSS P1 Delusion	3.57 (1.45)	2.35 (1.43)	3.18 (1.62)	2.24 (1.48)		F(3,177) = 10.09	<0.001
Total intracranial volume, cm3 (SD)	1428442.31 (211693.61)	1413089.45 (218905.50)	1548539.26 (132577.00)	1555656.63 (183253.56)	1544055.08 (152890.23)	F(4,239) = 10.09	<0.001
Olanzapine equivalent dose	10.76 (5.43)	10.78 (5.59)	13.97 (9.04)	10.26 (8.35)		F(3,156) = 1.345	0.262

Olanzapine equivalent doses were calculated based on daily-defined doses presented by the World Health Organization’s Collaborative Center for Drug Statistics Methodology. Dosing information required for olanzapine equivalent calculations was missing for n = 4 H+; n = 3 H− from the UK sample and n = 5 H+; n = 7 H− from the Shanghai sample.

H+ hallucinations, H− no hallucinations, HC healthy controls, PANSS Positive and Negative Syndrome Scale.

Left paracingulate sulcus length is reduced in schizophrenia patients with hallucinations in ethnically independent samples

We began by replicating, in independent samples involving a larger number of patients, our previous finding[9] that the length of the left hemisphere PCS calculated from structural MRI is reduced in schizophrenia patients with hallucinations compared to those without in both UK (t(114) = 2.293, p = 0.0237, β = 0.197) and Shanghai (t(109) = 2.332, p = 0.0215, β = 0.280), samples separately, and combined (t(227) = 3.264, p = 0.0013, β = 0.222). In the Shanghai sample, left PCS was also shorter in patients with hallucinations compared to healthy controls (t(109) = 2.716, p = 0.0077, β = 0.327) (Fig. 2). These tests survived correction for additional covariates that were not included in the final model; i.e. years of education, IQ, global gyrification, total cortical surface area, olanzapine equivalent dose, PANSS P1 Delusion score, and PANSS positive symptoms minus P3 Hallucination score. There were no significant effects in the right hemispheric PCS (t(227) = −0.306, p = 0.760, β = −0.021), or in average PCS length (t(226) = 1.801, p = 0.0731, β = 0.121). The length of the right STS was reduced in patients with hallucinations compared to those without, but this reduction was not significant when controlling for age, sex, scanner site, and TIV t(227) = 1.240, q = 0.349, β = 0.090). Mean depth, however, was significantly reduced in the H+ group compared to HCs (t(227) = 2.381, q = 0.0465, β = 0.209), and at trend for H− individuals (p-unadjusted = 0.098, q = 0.189). The depth of the PCS was not significantly different between groups for either hemisphere. Bilateral PCS and STS length and depth measurements are reported in Supplementary Fig. S5 and Supplementary Table S6.

Fig. 2

Local sulcal deviations associated with hallucinations.

The length of the left PCS is significantly reduced in patients with hallucinations compared to those without and to HCs for both the Shanghai and UK multi-centre datasets (B). The mean depth of the right STS is significantly reduced in patients with hallucinations compared to HCs (G). Group-wise average sulcal maps after linear spatial normalization for A the left hemisphere paracingulate sulcus (PCS) (C–E) and F the right hemisphere superior temporal sulcus (STS) (H–J) display local curvature shifts between patients with (H+; n = 101) and without hallucinations (H−; n = 80) and healthy controls (HC; n = 63). This displacement makes the sulcus more direct and less arched for the H+ group compared to H– and explains the reduced length of the left PCS. A parallel sulcal shift is present in the right STS. Arrows pointing to white circles indicate the area of maximum difference between the average sulcal maps of participants with and without hallucinations, which occurs in HCP area a32pr for the PCS and area STSdp for the STS. Average sulcal maps are linearly projected onto the MNI template. The colour bar represents the degree of overlap of sulci between participants in each group (H+, H−, HC), with red indicating higher overlap and thus the typical shape within group. Error bars denote the standard error of the mean. *p < 0.05; **p < 0.01.

Reduced PCS length relates to a local displacement in curvature that emulates sulcal deviations in the STS

Although a shorter left PCS is a marker for hallucination status in patients with schizophrenia, the morphological features of the sulcus that lead to this observation have not previously been explored. We observed a focal displacement in the sulcal curvature such that the PCS of H+ participants was straighter, yet broken, in comparison to the more arched and continuous PCS characteristic of H− and HC participants (Fig. 2). In the right STS, a consistent pattern was observed, with less arching in schizophrenia patients with hallucinations compared to those without. This observation is strikingly similar to the displacement of the sulcal junction between the right STS and its anterior branch in schizophrenia patients with hallucinations heard inside compared to outside the head[29]. The left PCS shift mapped to area a32pr and the right STS shift to area STSdp (Fig. 2). As both the anterior cingulate[49] and STS[50] show fine-grained gradients in functional organization, the detailed subdivisions of the HCP allowed us to interpret structural differences by their mapping to functional specializations. To increase the level of spatial detail within these focal and network-wide sulcal alterations, we visualized the correlations between left a32pr and right STSdp, the respective locations of the PCS and STS kinks, to all other cortical parcellations (Supplementary Fig. S2).

One-sample t-tests revealed that the STS was significantly deeper in the right hemisphere than the left, but longer in the left hemisphere than the right, within all groups (p < 0.05). The PCS was significantly longer and deeper in the left hemisphere than the right for HCs and H− (FDR < 0.05), but the AI was not significant for H+. A 3-group one-way ANOVA showed a significant main effect of group on PCS length AI (F(2,229) = 4.25, q = 0.0404). Post hoc comparisons using Tukey HSD revealed that the PCS length AI of patients with hallucinations was significantly reduced compared to those without (p = 0.0264), and trend level to HC (p = 0.0629), but was not different between HC and H− (p = 0.992). Previous reports of reduced PCS leftward asymmetry in schizophrenia, the majority in Western samples, thus appear to be likely driven by patients with hallucinations. AI for PCS depth and STS depth and length were not significant between groups. Results are reported in Fig. 3 and Supplementary Table S6.

Fig. 3

Asymmetry of length and depth measurements of the paracingulate and superior temporal sulci.

3D representations of the left hemisphere paracingulate sulcus (PCS) (A) and right hemisphere superior temporal sulcus (STS) (B). Asymmetry indices for the length and depth of the PCS (C), and STS (D). Positive values represent longer or deeper sulci in the right hemisphere compared to the left. Bilateral length and depth measurements for the PCS (E) and STS (F). Error bars denote the standard error of the mean. Dagger indicates sulcal AI assessed within each group using one-sample t-test. Asterisk indicates sulcal metrics assessed between groups using one-way ANOVA for asymmetry indices and linear regression for hemisperic PCS and STS length and depth measurements, controlling for age, sex, scanner site, and total intracranial volume. *p < 0.05; **p < 0.01.

Structural covariance networks for local gyrification index show increased gyral synchrony between auditory and salience networks

Having established convergent sulcal deviations in the PCS and STS, we sought to investigate their covariance in the context of resting-state networks to gain insights into their developmental coordination, and how they might enable or reflect the emergence of functional networks that result in the experience of hallucinations. Structural covariance matrices organized by established large-scale functional resting-state networks[51] showed that mean (M) cross-correlation of the local gyrification index (LGI) for regions corresponding to the intersection of salience and auditory networks was significantly greater for H+ compared to H– individuals (MH+ = 0.501, MH− = 0.355, MHC = 0.375, q = 0.0084) (Fig. 4). The mean LGI cross-correlation was also significantly increased within each network (salience: MH+ = 0.493, MH− = 0.371; MHC = 0.375, q = 0.0147; auditory: MH+ = 0.631, MH− = 0.532; MHC = 0.523, q = 0.0292) after correcting for FDR < 0.05. Decomposing networks by hemisphere showed that these results were driven by increased mean LGI within the intra-hemispheric right and inter- (left-right) salience network, the intra- left auditory network, and between intra- and inter- salience and auditory networks (Supplementary Table S7, Supplementary Figure S4). It is typical in structural covariance testing to discard low values of correlations between parcellated regions, attributing them to noise. Results were stable across a range of thresholds, but the greatest difference was observed with no threshold, suggesting that weak correlations, large in number, are important contributors to inter-regional cortical synchronization (Fig. 4d).

Fig. 4

Stages in construction and analysis of gyrification-based correlation matrices.

A Local gyrification index (LGI) was computed for 360 parcellated brain regions (180 per hemisphere) according to the HCP-MMP1.0 atlas and was used to construct interregional Pearson’s correlation (360 × 360), adjusted for age, gender, scanning site, and intracranial volume for each of the three study groups (H+, H−, HC). Matrices were re-ordered according to eight well-established and replicable resting-state networks. B Each brain region was assigned a corresponding network and the LGI values between regions located within the same network were averaged, resulting in 8 × 8 group-wise matrices. C Nonparametric permutation testing with 5000 resamplings was employed to test the significance of differences in patients with and without hallucinations in the mean LGI covariance within, and between, the salience and auditory networks. The observed differences in means were evaluated against the permutation null-distributions, and a two-tailed p-value calculated based on its percentile position (significance <5%). D Mean regional LGI partial correlation within brain regions corresponding to the salience, salience-auditory interaction, and auditory networks for correlation thresholds ranging from −0.2 to 1. Error bars represent the 95% bootstrap confidence intervals generated by resampling 5000 times with replacement across participants within each group. *FDR < 0.05.

Compared to patients without hallucinations, cortical statistical maps displayed decreased gyrification in H+ in the rostral middle frontal cortex and increased cortical thickness in the left inferior parietal and bilateral precuneus for the UK sample, and increased thickness in H+ for left lingual gyrus for both UK and Shanghai datasets (Supplementary Fig. S6). There was greater gray matter volume in H+ across both datasets, as has been found previously[9], but the difference was only significant for the larger UK sample (Supplementary Table S8).

Discussion

In this study, we discover mechanistic evidence for the development of hallucinations in schizophrenia. Bearing in mind that sulcal patterns are established during gestation and are fixed across the first decades of life, our results indicate a structural risk factor for hallucinations arising in early life that we suspect is sensitive to subsequent life experiences and culturally-acquired expectations that are known to color hallucination content. We first replicated the association of reduced left PCS length with hallucinations in two independent samples representing British and Han Chinese ethnicities, collectively comprising a larger sample than previously studied. We then demonstrated, for the first time, that PCS and STS length and depth differences correspond to focal, geometric deviations and to increased LGI covariance within and between regions relating to salience and auditory networks, suggesting that perinatal alterations to the structural integrity of developing salience and auditory networks are related to experiencing hallucinations in early adulthood. Our results converge with previous research demonstrating differences in local folding patterns in cingulate and temporal regions[9,10,37,52] and empirically integrates these spatially localized differences in support of hypotheses of aberrant fronto-temporal and salience network connectivity underpinning the experience of hallucinations in schizophrenia[15-17,53]. We advance prior research on sulcal asymmetries in the general population and in developmental and psychiatric disorders[21,25-28,30,36], showing a reduction of the typical leftward PCS asymmetry in schizophrenia patients with hallucinations, due to a shorter left hemisphere PCS, compared to patients without hallucinations and to healthy controls. The rightward STS asymmetry was also lower, with a significantly diminished mean depth of the right STS in H+ patients compared to HCs. This supports empirical evidence that the reduction in structural and functional brain asymmetries in schizophrenia correlate with the severity of auditory hallucinations[34]. Interestingly, certain genetic determinants of schizophrenia also modulate brain asymmetries in the auditory system, and it has recently been shown that there are lateralized genetic influences on frontal and temporal sulci[54], suggesting that sulcal descriptors offer insight into brain lateralization processes that relate to hallucinations in schizophrenia. We partially reproduce findings of abnormal surface-based morphology and gray matter volume related to hallucinations[6,9,24,40,41]. While these (non-sulcal) structural patterns were not wholly consistent between UK and Shanghai datasets, gray matter and cortical thickness are more subject to plastic changes as a function of aging, learning, experience, and medication, suggesting that sulcal topology presents a more robust and specific indicator of hallucinations. As sulcal patterns are established in utero and stable across the lifespan[7], these results pinpoint fetal brain features that predispose to hallucinations in later illness, and may influence the way in which people experience their environment. The interaction between early neurodevelopment and experiential diversity helps explain, for instance, why trauma plays a major role in some hallucinations, but a minor or no role in others[55].

We localized group differences in sulcal curvature to subdivisions of the STS and PCS. Each of these regions show heterogeneous functional specialization; the STS supports a range of social processes regionally specialized across a posterior-to-anterior axis, from language to theory of mind, to voice and face recognition[50], while the anterior cingulate encompasses heterogeneous cytoarchitecture, neurotransmitter receptors, and functional subdivisions that are associated with diverse cognitions of emotional reactivity, attention, fear, theory of mind, memory, and bodily sensations[49,56]. The sulcal kink identified in the STS mapped to STSdp, a region responsive to voice perception tasks and tasks engaging face and biological motion perception; and to midcingulate area a32pr, bordering area d32, for the PCS. Area a32pr has functional connections primarily with other medial prefrontal regions, cingulate and insular regions, while d32 has additional functional connections to temporal and lateral parietal lobes[57]. In rhesus monkeys, anterograde and retrograde tracing techniques have shown that despite regional heterogeneity in their projections, the medial prefrontal cortices are unified by bidirectional connections with the superior temporal cortex and neighboring auditory association cortices[58]. One such connection, the arcuate fasciculus, shows reduced fractional anisotropy in the left hemisphere of schizophrenia patients with hallucinations compared to healthy controls[59], and left-lateralized reduced mean and radial diffusivity in children reporting psychotic experiences[60], suggesting a relationship between developmental changes to fronto-temporal association tracts and the increased LGI synchrony between salience and auditory regions observed here. This converges with previous work illustrating a positive association between auditory hallucination severity in schizophrenia and structural covariance of grey matter volume in frontal–temporal regions[24].

What is the mechanism by which reduced morphological congruity between auditory and cingulate cortices develops and could it represent a structural presage of later-life hallucinations? The challenge in interpreting structural covariance networks lies in an incomplete understanding of their cellular, genetic, and experience-dependent plasticity underpinnings. Studies on the microstructural basis of sulcal macrostructure suggest that neuronal density changes, dendritic arborisation, synaptic pruning, and organization of axonal connections, individually or together, drive gyrification. A recent study using neurite orientation dispersion and density imaging, a novel multi-compartment diffusion MRI model of cortical microstructure, showed that neurite orientation dispersion is leftward asymmetric in frontal areas and rightward asymmetric in early auditory areas in two independent samples of healthy adults[61]. The geometric effects of dendritic arborisation as a driver of cortical folding may therefore contribute to the sulcal asymmetries observed here. The evidence accumulating with regard to prenatal inflammatory exposure[62], maternal stress, obstetric complications[63], and expression of schizophrenia risk genes in fetal life as factors conferring vulnerability to schizophrenia would be of major relevance to how the intrauterine environment contributes to the variations in cortical folding that impact postnatal pathology. We hypothesize that auditory hallucinations in schizophrenia patients, and the accompanying patterns of brain function, result from alterations to the maturational trajectories in temporal and cingulate regions, and thus their structural covariance. Mechanistic predictions follow, including the role of genes involved in driving the maturational trajectories of cortical patterning[64] and the impact of events that disrupt fetal neurodevelopment[20,21,62,63]. Longitudinal studies following prenatal cohorts until adult life will be required to establish such predictions.

Current theories of hallucinations in psychosis include those that propose perception is instantiated in a cortical hierarchy, mediated by feedforward and feedback processes that have layer-specific targets[65]. Recently, layer-specific dynamics of neuronal activity by optogenetic stimulation have been shown to induce visual hallucinations in mice[66]. That sulcal organization influences laminar gradations[67] links our findings to predictive processing accounts of perception and hallucinations[65]. We speculate that the increased cortical folding covariance between and within salience and auditory networks reported here could be a source, for instance, of the development of prior expectations with overly strong influence on perceptual inferences, or shifts in the weighting of external and internal information, such as inner speech. Another mechanistic avenue relates our results to neurochemical mechanisms of hallucinations. Cortical folding contributes to the specification of the cytoarchitecture of different cortical regions[67]. That cytoarchitecture relates to the distribution of neurotransmitter receptor binding sites and local concentrations of neurotransmitters and modulators is relevant in light of recent research linking dopamine release capacity and D2 receptor density to the severity of hallucinations in schizophrenia[68] and theories on the role of excitatory and inhibitory neurotransmitters in hallucinations[69].

Hallucinations are a universal human experience, but are liable to local cultural variation. Whereas in Western countries voices are reported as commanding, violent and critical, and are attributed with diagnostic labels, in Eastern countries people are more likely to report rich relationships with their voices and ascribe positive meaning[70]. Despite robust findings that ethnic milieu influences the content of hallucinations, no study has explored the impact of ethnic characteristics on the neuroanatomical basis for hallucinations. We show for the first time a common anatomical substrate associated with hallucinations in two ethnically distinct (British White vs. Han Chinese) groups of people with schizophrenia. As salience networks monitor the environment and direct attention, common anomalies to these networks in utero may interact with cultural expectations to influence how people attend to their environment[70], and experience hallucinations. Our findings hold clinical relevance. Although culture scaffolds perception, there is also evidence that the way in which people focus their attention on their environment can be changed through cultural priming, a technique to manipulate a person’s cultural value system[71]. Although the mosaic of sulcal features of the brain are intransient and not appropriate targets for therapy, cultural priming of Eastern values proffers a novel opportunity for treatments to mitigate the distressing experience of hallucinations that is a common feature in Western cultures. At the very least, an individual’s cultural background should be considered in diagnosis and treatment.

The PANSS P3 measures current symptoms as opposed to lifetime history and does not distinguish between hallucination modality. The results could therefore be interpreted as a marker for treatment resistance, though the P3 score available for the UK dataset at 2, 4, 6, 9, and 12 months showed convergence with cross-sectional scores (Table 1). Our results may not be specific to auditory hallucinations, though these are the most common modality reported among schizophrenia patients. Future studies should employ more fine-grained assessments of hallucinations. We additionally controlled for PANSS P1 Delusion score, and PANSS positive symptoms minus P3 Hallucination score for the sulcal length/depth analyses, which were not significant, indicating that our findings are specific to hallucinations, as opposed to overall psychosis severity. Though the two datasets were reasonably matched for key demographic and clinical characteristics, limited information was available for duration of untreated illness. The definition of the cortical folds in BrainVISA provides a stable and robust sulcal surface definition that is not affected by variations in cortical thickness or gray matter/white matter contrast[44], and is stable across the lifespan[7]. Thus, we would not expect our results to be influenced by duration of illness or medication; in fact, medication did not differ between hallucinations status. However, longitudinal studies characterizing quantitative features of sulci linking structural development from fetal to adult life periods will be important in establishing whether the present risk factor has predictive value for conversion to psychosis or stratification for clinical interventions. Finally, the voxel-based morphometry analysis for whole-brain comparisons of gray matter volume is sensitive to scanner or MR sequence differences. For this reason, a multi-center reproducibility protocol was developed to standardize MRI acquisition across sites and manufacturers for the UK sample (Supplementary Table S2)[38,72], and whole-brain analyses of cortical gyrification, thickness, and gray matter volume were conducted within UK and Shanghai samples separately.

Our findings of a sulcal network associated with hallucinations raise questions concerning their nosology and relationship to environmental factors. Do PCS-STS deviations selectively present in schizophrenia patients who develop hallucinations, or do they confer vulnerability to aberrant perceptions in other disorders, both with strong neurodevelopmental influences (ie. borderline personality disorder) and neurodegenerative causes (ie. Parkinson’s disease)? Are sulcal anomalies a modality-specific or general risk factor for hallucinations[73]? A recent study showing general sulcal deviations in schizophrenia patients with visual hallucinations suggests the latter[11]. Does the prenatally formed sulcal pattern offer predictive value for identifying individuals who might develop hallucinations, for instance following bereavement or trauma, and are there any interventions that could mitigate the increased risk for hallucinations conferred by prenatally determined sulcal patterns?

The current findings embed hemisphere-specific sulcal anomalies into a broader neurodevelopmental framework of cortical folding synchrony between salience and auditory networks that confers vulnerability to develop hallucinations in people with a psychotic disorder, invariant to ethnic origin. These results suggest that hallucinations, a complex aspect of psychopathology in adulthood, are in part the reflection of intrauterine neurodevelopmental changes. Defining these perinatal brain changes that are sensitive to subsequent life experiences offers empirical opportunities to test aetiological models of schizophrenia and provides a new understanding of the consequences of cortical folding variation to large-scale, interacting functional networks. Future work will investigate the ubiquity of these markers to other diagnoses and modalities of hallucinations on large datasets[74]. Assessing brain development in the late fetal period and the interaction between sulcal architecture, functional connectivity, and behavioral experiences will generate greater knowledge of the mechanisms supporting hallucinations, and holds synergistic prospects of novel treatment strategies and preventive interventions for mitigating risk of future hallucinations. Our observations offer an interesting window to understanding normal perception, the boundaries between self and other, and the processes underlying how we construct our consciously experienced reality.

Supplemental Material