Current concepts of cortical information processing and most cortical network models largely rest on the assumption that well-studied properties of local synaptic connectivity are sufficient to understand the generic properties of cortical networks. This view seems to be justified by the observation that the vertical connectivity within local volumes is strong, whereas horizontally, the connection probability between pairs of neurons drops sharply with distance. Recent neuroanatomical studies, however, have emphasized that a substantial fraction of synapses onto neocortical pyramidal neurons stems from cells outside the local volume. Here, we discuss recent findings on the signal integration from horizontal inputs, showing that they could serve as a substrate for reliable and temporally precise signal propagation. Quantification of connection probabilities and parameters of synaptic physiology as a function of lateral distance indicates that horizontal projections constitute a considerable fraction, if not the majority, of inputs from within the cortical network. Taking these non-local horizontal inputs into account may dramatically change our current view on cortical information processing.
Current concepts of cortical information processing and most cortical network models largely rest on the assumption that well-studied properties of local synaptic connectivity are sufficient to understand the generic properties of cortical networks. This view seems to be justified by the observation that the vertical connectivity within local volumes is strong, whereas horizontally, the connection probability between pairs of neurons drops sharply with distance. Recent neuroanatomical studies, however, have emphasized that a substantial fraction of synapses onto neocortical pyramidal neurons stems from cells outside the local volume. Here, we discuss recent findings on the signal integration from horizontal inputs, showing that they could serve as a substrate for reliable and temporally precise signal propagation. Quantification of connection probabilities and parameters of synaptic physiology as a function of lateral distance indicates that horizontal projections constitute a considerable fraction, if not the majority, of inputs from within the cortical network. Taking these non-local horizontal inputs into account may dramatically change our current view on cortical information processing.
Temporal Precision and its Possible Role for Cortical Processing
Triggered by early theories on coding in neural networks (for an overview, see Perkel and Bullock, 1968), it has been hypothesized that temporal precision of neuronal spiking activity may play an important role for cortical information processing. However, data from early neurophysiological experiments recording responses to stimuli in primary sensory areas suggested that information is contained in the graded elevation of firing rates of cells responding to certain features of the stimulus (e.g., Adrian, 1928; Barlow, 1972). The idea of a rate code henceforth dominated the conceptual thinking about cortical coding and influenced the experimental designs. Experimental evidence supporting more intricate theories based on temporally precise spiking remained, for a long time, relatively rare.More recently, doubts have been raised whether the above mentioned recordings from strongly responding units are representative for the majority of neocortical cells (Shoham et al., 2006). Both, the refinement of recording techniques and the application of more sophisticated sensory stimuli have provided new insights concerning firing rates and activity dynamics of single neurons in primary sensory areas. Examples include intracellular recordings from anesthetized (Brecht et al., 2003) and awake, behaving mice (Margrie et al., 2002), revealing surprisingly low spike rates in the barrel cortex, even during free exploratory activity. When mice changed from quiet wakefulness to active whisking, excitatory cells in that area displayed a clear reduction of firing rates (Crochet and Petersen, 2006) and phase locking to whisker movements (Poulet and Petersen, 2008).In the auditory cortex, firing rates are particularly low (DeWeese et al., 2003; Hromádka et al., 2008) and decreased even when weak tones were presented against a slowly fluctuating noise background (Las et al., 2005). In fact, neurons in the auditory cortex suppress their spike responses when the animal is engaged in an auditory task (Otazu et al., 2009). In this brain area, neurons have been suggested to operate far away from firing threshold, requiring strongly correlated, transient input for spike generation (DeWeese and Zador, 2006). Functionally, the auditory system seems to be in a position to exploit timing differences as small as 3 ms between two artificially introduced action potentials for decision making (Yang et al., 2008).In the visual system, traditionally known for high firing rates during presentation of optimal stimuli, careful considerations of aspects like energy constraints, representation of high numbers of stimulus features, and measurement biases have led to the notion that primary visual cortex may, in fact, use a sparse code (Olshausen and Field, 1996, 2005). A sparse population code had already been implicated earlier in inferotemporal cortex (Young and Yamane, 1992). Support for this view also came from studies showing that responses of single cells become sparser and more reliable when stimulated with natural scenes, especially if the surround of a cell's classical receptive field is included in the stimulation (Vinje and Gallant, 2000; Yen et al., 2006; Haider et al., 2010).Together, these findings revived the discussion about sparseness of the cortical code and, as a closely related issue, about the possible importance of timing of individual action potentials for information processing (for a review see Wolfe et al., 2010). The concept behind sparse coding is that information is represented with the minimum number of tokens. For populations of spiking neurons, this implies that only very few active neurons code for a specific state, e.g., a particular stimulus configuration (population sparseness), and that each neuron represents information over time with only a small number of spikes per unit time (lifetime sparseness). This, in turn, leads to low firing rates and low noise levels, as were described in the above mentioned experimental studies. In theoretical work, sparse coding has, for instance, been suggested to underlie the processing of complex natural scenes (Field, 1987; Levy and Baxter, 1996; Olshausen and Field, 1996, 2005; Simoncelli, 2003) and in the neural implementation of associative memory (Palm, 1982). Temporal precision of single spikes, on the other hand, is a pre-requisite for concepts like latency coding, with information thought to be contained in differences between timings of action potentials in a population of cells (van Rullen and Thorpe, 2002; Gollisch and Meister, 2008; Jacobs et al., 2009), or theories based on assemblies of synchronized cells (Gerstein et al., 1989; Abeles, 1991; for recent reviews see Harris, 2005; Kumar et al., 2010). Here, precise timing relates to the millisecond or even sub-millisecond range, i.e., a precision in the order of the action potential duration or even higher. It can be argued whether the experimentally observed temporal spike locking to time-varying stimuli in primary sensory areas with a precision that merely reflects the stimulus dynamics should be considered a substrate for temporal coding at all, or whether it might rather be a pre-requisite for it at later processing stages (Aertsen et al., 1979; Harris, 2005; Tiesinga et al., 2008).Taken together, these considerations have triggered the experimental search for precisely correlated activity of pairs or groups of neurons in higher brain areas. The initially weak evidence was restricted to pairwise correlations (e.g., Aertsen et al., 1989; Vaadia et al., 1995; Alonso et al., 1996), but improved with advances in recording techniques and analysis methods. In particular, a number of studies in awake, behaving monkeys provided strong evidence for a possible relation between spike synchronization and cognitive function (Riehle et al., 1997; Super et al., 2003; Samonds et al., 2004; Maldonado et al., 2008). At the same time, however, it is not clear whether neocortical networks can operate with such precision, also in view of physiological findings on ion channel noise, synaptic variability and non-linear properties of dendritic integration (Häusser et al., 2000; Gulledge et al., 2005). While the necessary steps for precise information transmission in neocortical networks (see Figure 1) have been studied separately, it has not been demonstrated if, and under which conditions, reliable and precise signal propagation in cortical networks is at all possible (Kumar et al., 2010).
Figure 1
Steps of information transmission in neuronal networks. Convergent feed-forward connected neurons (A) are a basic motif for many theories of cortical information processing. A certain degree of convergence is necessary, due to the fact that postsynaptic potentials from single cortical connections are usually too weak to elicit an action potential in the postsynaptic cell. For theories that build on temporally precise signal integration and action potential generation in single neurons, three main steps in activity transfer are critical: synaptic transmission (B), which can show considerable amplitude variability, high failure rates, and temporal jitter (see main text), dendritic integration (C), which has been found to be highly non-linear under certain conditions, and action potential generation (D), the temporal precision of which has been shown to depend on rise time and amplitude of membrane potential deflections, prior to the action potential initiation.
Steps of information transmission in neuronal networks. Convergent feed-forward connected neurons (A) are a basic motif for many theories of cortical information processing. A certain degree of convergence is necessary, due to the fact that postsynaptic potentials from single cortical connections are usually too weak to elicit an action potential in the postsynaptic cell. For theories that build on temporally precise signal integration and action potential generation in single neurons, three main steps in activity transfer are critical: synaptic transmission (B), which can show considerable amplitude variability, high failure rates, and temporal jitter (see main text), dendritic integration (C), which has been found to be highly non-linear under certain conditions, and action potential generation (D), the temporal precision of which has been shown to depend on rise time and amplitude of membrane potential deflections, prior to the action potential initiation.
Horizontal Cortical Networks Can Work Temporally Precise and Reliable
Experimental assessment of the precision and reliability of neocortical network activity is a difficult task. One possible approach is to record membrane potential fluctuations or spiking output of cells in the intact animal, preferably in response to repeated stimulus presentation or in relation to identical repetitions of a behavioral task. Even though the above-mentioned studies show that under certain conditions responses can be sparse, highly precise and reliable, others have stressed the high variability, presumably caused by activity unrelated to the stimulus, the so-called ongoing activity (Arieli et al., 1996; Tsodyks, 1999; Ohl et al., 2001; Nawrot, 2010).A novel experimental approach to precision and reliability in the neocortex, albeit somewhat reduced in terms of complexity of the network involved and regarding the possible sources of variability, was recently established in our lab (Boucsein et al., 2005). This method, dynamic photo stimulation, is especially suited to study reliability and precision of neuronal responses, because it enables tight control of timing and amount of synaptic input to a single cell. Providing repeated, “frozen noise”-type spatiotemporal sequences of synaptic input to a postsynaptic pyramidal neuron in an acute slice, we probed a reduced sub-network of converging excitatory inputs (Figure 1A), which can be considered a basic building block of neocortical networks and models thereof (Abeles, 1991; Diesmann et al., 1999; Kumar et al., 2010). In these experiments, we found that neocortical layer V pyramidal neurons possess remarkably precise integration capabilities (Figure 2; Nawrot et al., 2009). At first, these results seemed puzzling since a number of previous studies reported unreliable synaptic transmission in the neocortex: Different classes of connections can exhibit high variability in PSP amplitude and high failure rates of up to 70% (Koester and Johnston, 2005; Bremaud et al., 2007). Other authors reported more reliable synapses with less amplitude variability (Mason et al., 1991; Feldmeyer et al., 1999, 2006; Frick et al., 2008). But even compared with these latter studies, quantification of the physiological properties of synaptic connections probed in our study revealed a strikingly high temporal precision with a temporal jitter of less than 1 ms (Figure 3C) and close to 100% reliability in almost all synaptic connections studied (Figure 3A). At the same time, the amplitude variability was moderate (Figure 3B), and accounted for most of the variability observed during postsynaptic signal integration, as shown by a simple model of sub-threshold signal integration (Nawrot et al., 2009). Taken together, these findings suggested that synaptic physiology, not action potential propagation or dendritic integration, is the key factor determining amplitude variability and temporal precision in this cortical sub-network of converging excitatory inputs.
Figure 2
Mapping connectivity utilizing photostimulation: (A) Presynaptic neurons (black) are stimulated sequentially in the slice-preparation to fire action potentials by focused uncaging of glutamate via short pulses of UV-light. These APs, in turn, evoke synaptic potentials in the postsynaptic neuron (red), the membrane potential of which is monitored via a patch-clamp electrode (for detailed methods, see Boucsein et al., 2005). (B) Overlay of a picture of a neocortical brain slice and the results from scanning the tissue for functional connections to the postsynaptic neuron (reconstruction shown in red). Squares denote the positions of presynaptic sites, the stimulation of which elicited a postsynaptic current. Colored squares refer to selected sites, highlighted in the corresponding color in (C,D). (C) Principle of dynamic photostimulation (DPS). Using the fast DPS-system (Boucsein et al., 2005; Nawrot et al., 2009), presynaptic neurons can be activated dynamically to produce patterns of spatiotemporal synaptic input to the postsynaptic cell (red). (D) Dendritic integration in the postsynaptic neuron. Three repetitions of the same stimulation sequence (tics, bottom) resulted in repeated sub-threshold membrane potential fluctuations. Voltage traces for selected presynaptic sites are colored for the first 80 ms following presynaptic photostimulation, corresponding to the sites, indicated in (B,C). Note the remarkable reproducibility of the voltage fluctuations across trials. The gray trace shows the response to the same stimulation after application of TTX, confirming the purely synaptic origin of the recorded potentials.
Figure 3
Quantitative, physiological parameters of horizontal connections, determined by dynamic photostimulation (DPS). Presynaptic cells (n = 82) were stimulated by laser uncaging of caged glutamate (for details see Nawrot et al., 2009) to fire action potentials. Excitatory postsynaptic currents (EPSCs) were quantified in the cells receiving the projections. (A) Most projections were highly reliable, with failures only apparent in low amplitude EPSCs. (B) Relative amplitude variability, expressed as the coefficient of variation (CV) of the EPSC amplitude, had a clear tendency to decrease with increasing amplitude. (C) Temporal jitter, measured as the standard deviation of EPSC threshold crossing times after stimulation onset, scales with the delay between stimulation onset and EPSC onset. Quantification of timing of action potential generation for a set of directly stimulated cells (putative presynaptic cells) revealed that most of the jitter in EPSC timing was due to the variability in spike generation. Comparison of regression lines for presynaptic (gray) and postsynaptic (black) jitter suggests that only about 0.5 ms jitter is actually due to synaptic physiology. (D–G) Lateral distance from the stimulation site to the soma of the postsynaptic cells was extracted for each tested connection to evaluate possible distance dependence of physiological connection parameters. Failure rate (D), amplitude variability (E), and synaptic jitter (normalized to the total delay) (F) did not show any distance dependence, whereas amplitude (G) scaled negatively with distance. Colors correspond to cylindrical volumes, sketched in Figure 4 (H). To evaluate the lateral distance dependence of connection probability, we re-analyzed 17 mapping experiments, which were initially performed to find presynaptic sites for dynamic stimulation (compare to Figure 2B). Width of the scanning raster was 100 μm, and for each horizontal distance, we collected the number of sites, stimulation of which resulted in a postsynaptic EPSC. The ratio of this number relative to the total number of stimulations at the corresponding distance was taken as the estimated connection probability at that distance (n = 674 EPSCs in total). When stimulation sites were close to the soma or apical dendrite, EPSCs were often masked by large currents from uncaged glutamate impinging directly on the postsynaptic cell (direct responses). Probed distances where more than 20% of stimulated sites showed such direct responses were excluded from the analysis. Since it remains unknown how many neurons we stimulated at each target site and it was, thus, only possible to extract relative connection probabilities, we defined P100 = 0.1 at a distance of 100 μm, as suggested by paired recording studies (see Table 1). Our model of exponential decay is, thus, constrained as P(d) = P0 ·exp(−d/λ). Single fits were performed for each experiment, and length constants λ were extracted. The panel shows an exponential decay with a length constant equal to the median of all extracted λ-values (black trace), upper and lower shaded regions mark the 75 and 25% quantile, respectively. (I) Accumulated number of connected cells as a function of lateral distance d from the soma: we estimated the number of connected neurons within a cylindric volume with radius d as, with ρ = 60,000/mm3 (black trace) defining the cell density per cortex volume, fE = 0.85 representing the relative fraction of excitatory connections (Braitenberg and Schüz, 1998), and h = 1.3 mm defining the thickness of the gray matter. The estimated total number of presynaptic cells then amounts to Ntotal∞ ~ 6,100 with λ of 330 μm (black trace; shaded regions mark total cell numbers for respective λ taken from the shaded region in H).
Mapping connectivity utilizing photostimulation: (A) Presynaptic neurons (black) are stimulated sequentially in the slice-preparation to fire action potentials by focused uncaging of glutamate via short pulses of UV-light. These APs, in turn, evoke synaptic potentials in the postsynaptic neuron (red), the membrane potential of which is monitored via a patch-clamp electrode (for detailed methods, see Boucsein et al., 2005). (B) Overlay of a picture of a neocortical brain slice and the results from scanning the tissue for functional connections to the postsynaptic neuron (reconstruction shown in red). Squares denote the positions of presynaptic sites, the stimulation of which elicited a postsynaptic current. Colored squares refer to selected sites, highlighted in the corresponding color in (C,D). (C) Principle of dynamic photostimulation (DPS). Using the fast DPS-system (Boucsein et al., 2005; Nawrot et al., 2009), presynaptic neurons can be activated dynamically to produce patterns of spatiotemporal synaptic input to the postsynaptic cell (red). (D) Dendritic integration in the postsynaptic neuron. Three repetitions of the same stimulation sequence (tics, bottom) resulted in repeated sub-threshold membrane potential fluctuations. Voltage traces for selected presynaptic sites are colored for the first 80 ms following presynaptic photostimulation, corresponding to the sites, indicated in (B,C). Note the remarkable reproducibility of the voltage fluctuations across trials. The gray trace shows the response to the same stimulation after application of TTX, confirming the purely synaptic origin of the recorded potentials.Quantitative, physiological parameters of horizontal connections, determined by dynamic photostimulation (DPS). Presynaptic cells (n = 82) were stimulated by laser uncaging of caged glutamate (for details see Nawrot et al., 2009) to fire action potentials. Excitatory postsynaptic currents (EPSCs) were quantified in the cells receiving the projections. (A) Most projections were highly reliable, with failures only apparent in low amplitude EPSCs. (B) Relative amplitude variability, expressed as the coefficient of variation (CV) of the EPSC amplitude, had a clear tendency to decrease with increasing amplitude. (C) Temporal jitter, measured as the standard deviation of EPSC threshold crossing times after stimulation onset, scales with the delay between stimulation onset and EPSC onset. Quantification of timing of action potential generation for a set of directly stimulated cells (putative presynaptic cells) revealed that most of the jitter in EPSC timing was due to the variability in spike generation. Comparison of regression lines for presynaptic (gray) and postsynaptic (black) jitter suggests that only about 0.5 ms jitter is actually due to synaptic physiology. (D–G) Lateral distance from the stimulation site to the soma of the postsynaptic cells was extracted for each tested connection to evaluate possible distance dependence of physiological connection parameters. Failure rate (D), amplitude variability (E), and synaptic jitter (normalized to the total delay) (F) did not show any distance dependence, whereas amplitude (G) scaled negatively with distance. Colors correspond to cylindrical volumes, sketched in Figure 4 (H). To evaluate the lateral distance dependence of connection probability, we re-analyzed 17 mapping experiments, which were initially performed to find presynaptic sites for dynamic stimulation (compare to Figure 2B). Width of the scanning raster was 100 μm, and for each horizontal distance, we collected the number of sites, stimulation of which resulted in a postsynaptic EPSC. The ratio of this number relative to the total number of stimulations at the corresponding distance was taken as the estimated connection probability at that distance (n = 674 EPSCs in total). When stimulation sites were close to the soma or apical dendrite, EPSCs were often masked by large currents from uncaged glutamate impinging directly on the postsynaptic cell (direct responses). Probed distances where more than 20% of stimulated sites showed such direct responses were excluded from the analysis. Since it remains unknown how many neurons we stimulated at each target site and it was, thus, only possible to extract relative connection probabilities, we defined P100 = 0.1 at a distance of 100 μm, as suggested by paired recording studies (see Table 1). Our model of exponential decay is, thus, constrained as P(d) = P0 ·exp(−d/λ). Single fits were performed for each experiment, and length constants λ were extracted. The panel shows an exponential decay with a length constant equal to the median of all extracted λ-values (black trace), upper and lower shaded regions mark the 75 and 25% quantile, respectively. (I) Accumulated number of connected cells as a function of lateral distance d from the soma: we estimated the number of connected neurons within a cylindric volume with radius d as, with ρ = 60,000/mm3 (black trace) defining the cell density per cortex volume, fE = 0.85 representing the relative fraction of excitatory connections (Braitenberg and Schüz, 1998), and h = 1.3 mm defining the thickness of the gray matter. The estimated total number of presynaptic cells then amounts to Ntotal∞ ~ 6,100 with λ of 330 μm (black trace; shaded regions mark total cell numbers for respective λ taken from the shaded region in H).
Figure 4
Distribution of presynaptic cells within the cortical volume. (A) Graphical representation of connection probability as a function of lateral distance, comparing results from different studies. Methodological problems prevent direct numerical comparison. We, thus, normalized the maximum Pcon found in each study to unity and plotted one representative curve from each study into a single summary plot. Clearly, the length constant of the spatial decay of Pcon(d) derived from our data (black trace, cf. Figure 3H) fits well within the range reported by these previous studies. (B) Morphological reconstruction of a layer V pyramidal cell from a recording in an acute slice of 300 μm thickness with dendritic (blue) and axonal (red) arborizations. Following earlier work (Stepanyants et al., 2009), two definitions of locality can be derived from the neuronal morphology: either the volume covered by the dendrites (diameter of approximately 500 μm, gray), or, alternatively, by the dense axonal plexus around the somato-dendritic axis (diameter of approximately 1000 μm, blue). (C) The number of possible presynaptic partners (Ncells) increases substantially with distance, due to the quadratic increase of the volume covered by cylinders with increasing radius. This implies that the number of connected cells does not necessarily decrease with increasing distance, even if connection probability drops substantially. (D) To emphasize the consequences of the described distance dependence of Pcon for the total number of actually connected presynaptic cells within a certain distance, we calculated the numbers of these synaptically connected cells for the three different ranges depicted in (C). For all volumes, e used our exponential decay model with λ = 330 μm and P0 = 0.135 and, again, assumed a thickness of cortical gray matter of 1.3 mm. Surprisingly, even with a strong decay in Pcon(d) with increasing distance, the majority of presynaptic cells are located outside the local volume. Depending on the definition of locality, at least half of the synapses on each cell (local = diameter of 1000 μm), or more than 80% (local = diameter of 500 μm) originate from cells not considered to be within the local volume. The total number of presynaptic cells is slightly higher than what can be expected to be contained in a cylinder of 4000 μm diameter [cf. extent of the bar in (D) does not account for 100%].
Table 1
Overview of studies on lateral distance dependence of connection probability .
Range (μm)
Pcon*
Method
Measure
Species
Reference
0–200
0.1–0.01
Paired recordings in acute slices
Connection probability (tested pairs)
Rat V1/S1 cat V1 all layers
Markram et al. (1997); Thomson et al. (2002); Holmgren et al. (2003); Song et al. (2005); Lefort et al. (2009)
0–300
0.1–0.01
Two-photon Laser uncaging
Responding sites normalized to putative presynaptic cells
Rat V1 layer 2/3
Matsuzaki et al. (2008)
0–400
1–0.13
Laser uncaging
Integral of postsynaptic currents
Rat barrel cortex layer 2/3
Bureau et al. (2004)
0–1500
0.21–0.12
Laser uncaging
% of responding sites
Ferret V1 all layers
Dalva and Katz (1994)
300–1500
0.45–0.028
Laser uncaging
% of responding sites
Rat S1 all layers
This study
0–500
0.86–0.12
Computing possible synapses from reconstructions
Connection probability (anatomical)
Rat V1 layer 12/3
Hellwig (2000)
0–500
0.75–0.06
Computing possible synapses from reconstructions
Connection probability (anatomical)
Cat V1 all layers
Stepanyants et al. (2008)
Only a few studies have focused on this issue, most of them being limited to distances up to 300 μm from the somato-dendritic axis of the cells. Note that methodologies in these studies were quite diverse, and quantitative measures of connectivity cannot easily be compared. The most direct quantification was obtained by paired recordings (magenta), when experimenters kept track of the total numbers of tested cells and related these to the numbers of connected cells found. Interestingly, most studies performed with paired recordings within the neocortex yielded a maximum P.
*Non-normalized values.
What could be the reason for the high precision and reliability observed in this system? Potentially, the method used to find the connections within the acute slice, namely functional mapping with the help of laser-induced glutamate uncaging (Callaway and Katz, 1993; Dodt et al., 2003; Kötter et al., 2005) could have introduced a bias toward exposing especially reliable connections. Performing mapping experiments, covering large areas of the slice, is time consuming, accounting for a low number of trials per location during the phase where putative presynaptic sites are identified (up to four in our experiments; for a discussion, see Boucsein et al., 2005). Thus, unreliable connections might be overlooked. Another striking and important difference to earlier studies on the physiology of synaptic connections is that in our study we focused on horizontal connections (∼200–1500 μm distance in the direction parallel to the pia), whereas classical paired recording experiments were almost exclusively performed within the local range around the postsynaptic neuron (<250 μm distance), where strong vertical connectivity across laminae dominates (Lorento De Nó, 1949; Thomson and Bannister, 2003). To clarify this issue, we re-analyzed the lateral distance dependence of physiological parameters of the synaptic connections studied in our experimental paradigm. We found that the only parameter showing a systematic decrease with lateral distance was the excitatory postsynaptic current (EPSC) amplitude (Figure 3G), whereas other parameters of synaptic physiology did not show such systematic dependence at all (Figures 3D–F).As a result, our findings raised two main questions: Can horizontal connections be considered to play an important role in cortical processing and, if so, what is actually known about their physiological properties (apart from the limited data available from our previous study)? Here we will undertake first steps to answer these questions.
The Fraction of Horizontal Projections onto Pyramidal Cells
Since the seminal work of Mountcastle (1955, 1957) and Hubel and Wiesel (1962), showing that neurons along a path perpendicular to the cortical surface share functional properties of stimulus selectivity, the idea of a columnar structure defining generic building blocks for larger cortical networks has attracted many scientists (for recent reviews see da Costa and Martin, 2010; Rockland, 2010; and other contributions to the special issue on “The Neocortical Column” in Frontiers in Neuroanatomy). In the attempt to understand information processing in local cortical circuits, a well-established and ever more detailed description of the underlying functional architecture has been generated (for reviews see Thomson and Bannister, 2003; Markram, 2006; Douglas and Martin, 2007). In the course of these attempts, the original concept of columnar organization has been interpreted in quite different ways. While initially, common functional tuning properties in cat visual cortex were used to assign cells to the same column, later the intricate anatomical structures in layer IV of the somatosensory cortex in rodents (so-called barrels) were also utilized to define column boundaries. It has been debated whether both assignments refer to the same conceptual idea (for a review see Horton and Adams, 2005), especially since in visual areas of rat cortex the clustering of similarly tuned cells is not apparent (Ohki et al., 2005). In contrast to these various considerations on the vertical organization of cortical circuits, horizontal connections received much less attention in experimental and theoretical work (for a recent review see Voges et al., 2010b).The experimental confinement to a projection range of approximately 250 μm around the somato-dendritic axis of the pyramidal neurons (Deuchars et al., 1994; Markram et al., 1997; Lefort et al., 2009) and to vertical projections across laminae (for a review see Thomson and Lamy, 2007) is not solely due to a conceptual focus on local connections. In addition, the strong drop in connection probability with increasing somatic distance between cell pairs (Hellwig, 2000; Thomson and Bannister, 2003) imposes experimental constraints that make the physiological characterization of synaptic connections with paired recordings increasingly difficult at longer distances (however, see Yoshimura et al., 2000). This effect is augmented by the fact that paired recordings are usually conducted in acute brain slices, where sizeable portions of axonal arbors are cut, lowering the chances of finding distant pairs of connected cells even further (Stepanyants et al., 2009).At first glance, low connection probabilities to distant neurons might imply that connections from more distant cells are rare and, thus, might not play a major role in cortical processing. However, in their extensive study comparing neuronal subtypes in cat V1 with respect to their laminar distributions of dendrites and synapses, Binzegger et al. (2004) reported large numbers of excitatory synapses, especially in layers I (93%) and VI (70%), that remained “unaccounted for.” Presumably, these synapses reflect the bulk of extra-columnar input which could not be allocated to any of the cells within their model, as the anatomical reconstructions used in their study only contained the local axonal arborization (diameter: ∼1000 μm), whereas projections of longer distance were cut. Other studies recognized that, despite low connection probabilities, the total number of potential presynaptic cells still might increase for larger distances, simply due to the quadratic increase in the number of potential partners (Hellwig, 2000; Holmgren et al., 2003). In another recent study, estimates of the fractions of local (columnar) and non-local connections suggested that up to 82% of the synapses a neuron receives may originate from cells outside the cortical column, i.e., a cylindrical volume with a diameter of ∼500 μm (Stepanyants et al., 2009; see also Figure 4). The same study suggested that even if the cortical volume covered by the dense axon plexus around the somato-dendritic axis is considered (a cylinder with diameter ∼1000 μm), the fraction of synapses originating from outside this volume may amount to 75%.Distribution of presynaptic cells within the cortical volume. (A) Graphical representation of connection probability as a function of lateral distance, comparing results from different studies. Methodological problems prevent direct numerical comparison. We, thus, normalized the maximum Pcon found in each study to unity and plotted one representative curve from each study into a single summary plot. Clearly, the length constant of the spatial decay of Pcon(d) derived from our data (black trace, cf. Figure 3H) fits well within the range reported by these previous studies. (B) Morphological reconstruction of a layer V pyramidal cell from a recording in an acute slice of 300 μm thickness with dendritic (blue) and axonal (red) arborizations. Following earlier work (Stepanyants et al., 2009), two definitions of locality can be derived from the neuronal morphology: either the volume covered by the dendrites (diameter of approximately 500 μm, gray), or, alternatively, by the dense axonal plexus around the somato-dendritic axis (diameter of approximately 1000 μm, blue). (C) The number of possible presynaptic partners (Ncells) increases substantially with distance, due to the quadratic increase of the volume covered by cylinders with increasing radius. This implies that the number of connected cells does not necessarily decrease with increasing distance, even if connection probability drops substantially. (D) To emphasize the consequences of the described distance dependence of Pcon for the total number of actually connected presynaptic cells within a certain distance, we calculated the numbers of these synaptically connected cells for the three different ranges depicted in (C). For all volumes, e used our exponential decay model with λ = 330 μm and P0 = 0.135 and, again, assumed a thickness of cortical gray matter of 1.3 mm. Surprisingly, even with a strong decay in Pcon(d) with increasing distance, the majority of presynaptic cells are located outside the local volume. Depending on the definition of locality, at least half of the synapses on each cell (local = diameter of 1000 μm), or more than 80% (local = diameter of 500 μm) originate from cells not considered to be within the local volume. The total number of presynaptic cells is slightly higher than what can be expected to be contained in a cylinder of 4000 μm diameter [cf. extent of the bar in (D) does not account for 100%].To test these various predictions on our data, we carefully re-analyzed the photostimulation experiments in which we scanned acute brain slices for neurons projecting onto a single postsynaptic cell (Nawrot et al., 2009). For each horizontal distance from the cell soma, probed in bin-wise intervals of 100 μm, we measured the number of sites, the stimulation of which resulted in an EPSC measured at the soma. Then, for each of these distances, we estimated the connection probability as the ratio of this number of effective stimulation sites relative to the total number of stimulations at this distance. To the collection of these connection probability estimates as a function of lateral distance we then fitted an exponential decay function for each mapping experiment separately. From this fit, we determined the associated space constant for each experiment. The resulting space constants of connectivity decay with distance varied between 165 and 665 μm. Using the median value of 330 μm (Figure 3H) and constraining our model of exponential decay by introducing a fixed value for the local connection probability of 0.1 at 100 μm (derived from the literature on paired recordings), we then calculated the potential numbers of presynaptic neurons as a function of somatic distance (Figure 3I). Under the simplifying assumptions of homogeneity and isotropy and adopting a cylindrical layout of the connectivity (cf. Figure 4C), the number of neurons at a certain distance providing input to a postsynaptic cell at the center of the cylinder is proportional to the product of the cell density (∼60–90,000 neurons/mm3 in rat V1; Peters et al., 1985; Gabbott and Stewart, 1987; Skoglund et al., 1996; Miki et al., 1997), multiplied by the fraction of excitatory cells, the thickness of the gray matter, the distance itself, and the respective connection probability (Figure 3I). Integration over the distance from 0 (soma) outward to a certain distance d from the soma then leads to an estimate of the total number of presynaptic neurons within that distance, that is, the number of neurons that provide synaptic input to the recorded cell (Figure 3I). Interestingly, from this calculation it follows that the local volume around a layer V pyramidal cell (r = 250 μm) contains less than 25% of its presynaptic partners. Even if a larger distance of 500 μm is considered (as in Stepanyants et al., 2009), this fraction still amounts to less than 50% (Figure 4D).These results are somewhat difficult to relate to other studies reporting on distance dependence of connection probability in neocortical networks, mostly because in the experimental studies on horizontal connectivity available to date, very different methods were employed, ranging from paired recordings over laser scanning approaches to modeling studies using morphological reconstructions (for references, see Table 1). In addition, most studies were restricted to distances of less than 250 μm, while our data span a range almost ten times as big. One exception is the study of Shepherd et al. (2005), where the authors combined connectivity measures derived from functional mapping via photostimulation and 3D morphological reconstructions for distances of up to 700 μm to assess whether it is sufficient to rely on anatomical data to determine the connectivity in rat barrel cortex. They concluded that neuronal specificity (e.g., type and position of pre- and postsynaptic neuron, amongst other factors) prevented direct comparability of these two measures. However, in their study, the authors largely focused on specific connections from L4/L5A to L2/3 pyramidal neurons across the laminar borders. For this reason, we included a previous study from the same group (Bureau et al., 2004), dealing with horizontal connectivity in L2/3 in our Figure 4. To compare results across studies, we normalized the various experimental findings on distance-dependent connection probabilities to the maximum connection probability in each case. This enabled us to include results from all these different studies within a single graphical representation (Figure 4A). Apparently, connection probability decay functions vary considerably, but they all seem to follow a similar law, reasonably well approximated by an exponential decay, as fitted to our data. Moreover, the calculations above suggest that, also in other preparations, non-local (i.e., from beyond 250 μm lateral distance) presynaptic cells account for more than 70% of the total number of synaptic inputs onto a pyramidal cell (Figure 4D; see also Voges et al., 2010b). Possible sources for unaccounted synapses include horizontal projections connecting neighboring columns, e.g., via L2/3 pyramidal neurons in primary visual cortex (Tucker and Katz, 2003; Buzás et al., 2006) or barrel cortex (Brecht et al., 2003; Lübke and Feldmeyer, 2007; Bruno et al., 2009), as well as far-reaching axon collaterals from L5/L6 neurons within the same cortical area (Larsen et al., 2007). In the present study, we are focusing on these intra-cortical, horizontal projections. In addition, projections connecting different sensory areas and, e.g., thalamo-cortical, cortico-cortical, or inter-hemispheric connections (Cauller et al., 1998; Petreanu et al., 2007; Rubio-Garrido et al., 2009) need to be taken into account when referring to the total number of synaptic contacts a neuron receives. These connections have been shown to link stimulus features across columnar boundaries or sensory areas for different modalities and in different species (Mitchison and Crick, 1982; Weliky and Katz, 1994; Singer, 1999; Staiger et al., 2004; Buzás et al., 2006; Huber et al., 2008).Overview of studies on lateral distance dependence of connection probability .Only a few studies have focused on this issue, most of them being limited to distances up to 300 μm from the somato-dendritic axis of the cells. Note that methodologies in these studies were quite diverse, and quantitative measures of connectivity cannot easily be compared. The most direct quantification was obtained by paired recordings (magenta), when experimenters kept track of the total numbers of tested cells and related these to the numbers of connected cells found. Interestingly, most studies performed with paired recordings within the neocortex yielded a maximum P.*Non-normalized values.The fact that only a small fraction of the axons synapsing onto a neuron originate from cells within the local volume implies that, by concentrating on the local circuit alone, one is likely to ignore important aspects of cortical processing. In fact, the concept that information processing within the neocortex is based on columnar microcircuits has been challenged by studies showing that the lack of a columnar architecture does not impede the functionality of cortical neurons (Purves et al., 1992), and that the extent to which a columnar structure can be observed may vary substantially, even between individuals of the same species (Horton and Adams, 2005; Rockland, 2010). In addition, many studies on local connectivity have been performed in acute slices of rats and mice, where the concept of columns consisting of similarly tuned cells is, at least in the visual cortex, not easily applicable (Ohki et al., 2005). Thus, it is of key importance to gain more insight into the nature (both, physiological and anatomical) of horizontal connections in neocortical networks. The investigation of these connections is merely beginning.
Physiological Characterization of Horizontal Projections
So far, details about horizontal connections in cortex have mainly been revealed by tracer injection studies (Burkhalter, 1989; Kisvárday et al., 1989; Kisvárday and Eysel, 1992; Lund et al., 1993; Van Hooser et al., 2006; Aronoff et al., 2010; reviewed in Voges et al., 2010b). These anatomical studies, however, did not deliver any information about the physiological properties of these connections. More recently, voltage-sensitive dyes (Laaris and Keller, 2002; Petersen et al., 2003; Tucker and Katz, 2003) and Ca2+-imaging (Göbel et al., 2007) have been used to study the role of long-range connections in vitro and in vivo, again providing only limited information on the physiology of single connections. Only few physiological studies, using electrical stimulation, report on selected physiological aspects of horizontal connections (Chagnac-Amitai and Connors, 1989; Ichinose and Murakoshi, 1996). The only studies that focused on the physiological properties of putative horizontal projections in the neocortex were performed either in vivo with the help of intracellular recordings in combination with extracellular stimulation (Matsumura et al., 1996) or in acute slices with a combination of intracellular recordings and juxtacellular stimulation (Yoshimura et al., 2000). In both these studies, synaptic connections between sites with a distance of up to 2 mm were characterized by spike-triggered averaging or paired recordings, and, in line with our findings (Figure 3G), they reported that synaptic PSP amplitude dropped slightly with increasing distance between connected cells. However, their finding of a decrease in synaptic reliability with increasing distance is in contrast with our finding of reliable horizontal connections (Figure 3D). Moreover, the results of the in vivo studies need to be interpreted with caution, because it is difficult to extract information about mono-synaptic connections in a recurrent, densely connected, active network from spike-triggered averages. Here, network effects can lead to responses that resemble PSPs from mono-synaptic connections, even though the respective cells are not directly connected. Actually, such PSP-shaped responses with sometimes negative latency with respect to the trigger unit have been experimentally observed (Matsumura et al., 1996), as well as theoretically predicted (Aertsen et al., 1989, 1994; Kumar et al., 2008). Yoshimura et al. (2000) focused on short-term plasticity of long-distance synaptic connections and reported only limited data on other parameters, like PSP amplitudes or synaptic reliability, and no information at all on connection probability. Photostimulation of selected subsets of neurons in acute brain slices (Callaway and Katz, 1993; Dodt et al., 2003; Kötter et al., 2005; Fino et al., 2009), as used in our study (Nawrot et al., 2009), seems to be one of the few methods available today that has been employed successfully to study the physiology of horizontal connections in greater detail (Shepherd et al., 2005; Matsuzaki et al., 2008). The methodological limitations of this technique are mainly that it is technically challenging to acquire maps with cellular resolution, that the number of stimulations of the same presynaptic site is limited due to detrimental side-effects of the short-wavelength light used for uncaging, and that the identity of the presynaptic cell is usually not recovered, except for its coarse location and the inhibitory or excitatory nature of its synapses (for a discussion see Nawrot et al., 2009). More quantitative experimental data will be necessary to judge whether horizontal connections can also show high failure rates, or if the comparatively high reliability found in our data may indeed be due to special physiological properties, such as multiple synaptic contacts for these connections, or extraordinarily strong single synapses, which would render these connections a suitable substrate for reliable and precise signal propagation in neocortical networks.
Functional Implications
Horizontal connections within the neocortex are likely to play a pivotal role for cortical processing, purely due to their relative abundance. As is evident from the small number of studies thus far concerned with the physiological properties of horizontal connections, the interest in this large fraction of intra-cortical projections is just beginning. In recent modeling studies, it has been demonstrated that the implementation of horizontal connections can dramatically reduce wiring costs (Voges et al., 2010a) and has a strong impact on network dynamics (Kriener et al., 2009). These studies, however, focused on a related class of connections, the so-called long-range patchy connections (for a review see Voges et al., 2010b), which recently received more attention compared to non-patchy, long-distance horizontal connections. Patchy connections can be observed after bulk-loading of small volumes, preferentially in primary visual areas of higher mammals, as petal-like clusters of cells presumably receiving functional synaptic input from the injection site. It could be argued that the horizontal connections described in our study might serve the same purpose as patchy connections in higher mammals, but on a different spatial scale. However, detailed comparison of long-range patchy and non-patchy connections has cast doubt on this idea: while correlation strength was found to be high in pairs of similarly tuned neurons connected via long-range patchy connections in cat visual cortex, this was not true for the non-columnar cortex of gray squirrels (Van Hooser et al., 2006; Van Hooser, 2007). Similarly, it was described that the sub-threshold membrane potential fluctuations display tuning similar to that of the spiking response in cells within orientation columns, while this has not been found in cells of non-columnar tissue.What could be the functional relevance of excitatory horizontal connections in the neocortex? A recent study using light-activated cells in vivo suggested that they might be the substrate for a competition between neighboring cortical domains, where strong activity in superficial layers inhibits neighboring domains within the same layer, while spreading excitation to a wide spatial range in deeper layers (Adesnik and Scanziani, 2010). Our findings emphasize that these connections might be especially reliable, strong, and temporally precise (Figure 3). Moreover, they indicate that precisely timed horizontal inputs are faithfully represented in the temporal dynamics of the integrated membrane potential of postsynaptic cells (Figure 2; Nawrot et al., 2009). Thus, horizontal connections and precise postsynaptic signal integration can subserve the fast and reliable propagation of correlated spiking over larger intra-cortical distances, at least in a low-firing regime. This combination of anatomy and physiology provides a potential neuronal substrate for neural computations with high temporal precision in the millisecond range, as is required for the realization of various temporal coding schemes (Gerstein et al., 1989; Abeles, 1991; van Rullen and Thorpe, 2002; Gollisch and Meister, 2008; Jacobs et al., 2009; for recent reviews see Harris, 2005; Kumar et al., 2010). Even though conclusive evidence for the presence of such coding strategies in the brain is still lacking, several studies demonstrated the brain's ability of remarkably fast and precise information processing. When confronted with a classification task, monkeys can signal their correct choice within 140–160 ms after stimulus onset (Fabre-Thorpe et al., 1998), and this short reaction time includes not only cortical processing, but also peripheral vision as well as motor execution. In the same line of evidence, it has been shown that already 150–250 ms after stimulus presentation, intended movements for the proper trained direction can be extracted from signals from the motor cortex (Rickert et al., 2009). It is unknown in how far horizontal connections are involved in this kind of rapid sensory–motor transformation and decision making, but it seems rather unlikely that the neocortex could process and transfer information in such short times over such large distances, mainly based on local connectivity. In conclusion, therefore, it seems important to incorporate horizontal connections in our considerations for concepts of cortical processing and cortical neural network models.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Authors: Roozbeh Kiani; Christopher J Cueva; John B Reppas; Diogo Peixoto; Stephen I Ryu; William T Newsome Journal: Neuron Date: 2015-02-26 Impact factor: 17.173
Authors: Christoph W U Leuze; Alfred Anwander; Pierre-Louis Bazin; Bibek Dhital; Carsten Stüber; Katja Reimann; Stefan Geyer; Robert Turner Journal: Cereb Cortex Date: 2012-10-25 Impact factor: 5.357