| Literature DB >> 23049495 |
Anton Ilango1, Jason Shumake, Wolfram Wetzel, Henning Scheich, Frank W Ohl.
Abstract
Learning from punishment is a powerful means for behavioral adaptation with high relevance for various mechanisms of self-protection. Several studies have explored the contribution of released dopamine (DA) or responses of DA neurons on reward seeking using rewards such as food, water, and sex. Phasic DA signals evoked by rewards or conditioned reward predictors are well documented, as are modulations of these signals by such parameters as reward magnitude, probability, and deviation of actually occurring from expected rewards. Less attention has been paid to DA neuron firing and DA release in response to aversive stimuli, and the prediction and avoidance of punishment. In this review, we first focus on DA changes in response to aversive stimuli as measured by microdialysis and voltammetry followed by the change in electrophysiological signatures by aversive stimuli and fearful events. We subsequently focus on the role of DA and effect of DA manipulations on signaled avoidance learning, which consists of learning the significance of a warning cue through Pavlovian associations and the execution of an instrumental avoidance response. We present a coherent framework utilizing the data on microdialysis, voltammetry, electrophysiological recording, electrical brain stimulation, and behavioral analysis. We end by outlining current gaps in the literature and proposing future directions aimed at incorporating technical and conceptual progress to understand the involvement of reward circuit on punishment based decisions.Entities:
Keywords: aversive stimuli; avoidance learning; dopamine; dorsal vs. ventral striatum; intracranial self-stimulation; lateral habenula; reward and punishment; ventral tegmental area
Year: 2012 PMID: 23049495 PMCID: PMC3442182 DOI: 10.3389/fnins.2012.00132
Source DB: PubMed Journal: Front Neurosci ISSN: 1662-453X Impact factor: 4.677
Effect of aversive stimuli on mid brain DA neurons.
| Citation | Methodological details | Aversive stimuli (US) or Aversive conditioned stimuli (CS) | Regions recorded | % Neuron response to aversive stimuli | % Neuron response to offset of aversive stimuli | Notes |
|---|---|---|---|---|---|---|
| Brown et al. ( | Extracellular recording in urethane anesthetized rats | Pinches of 15 s duration to the hindpaw | SNc | 18% inhibition to aversive stimuli | Other recorded neurons did not respond to either pinch or electrical shock | |
| Footshocks (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 100 trials to the hind paw | 20% inhibition to aversive stimuli | |||||
| Brischoux et al. ( | Extracellular recording and juxtacellular labeling in urethane anesthetized rats | Footshocks (20 Hz, 5 mA) and 4 s trains | VTA: dorsal parabrachial nucleus | 55% of labeled were inhibited | Others did not respond to shock | |
| VTA: ventral paranigral nucleus | Labeled DA neurons excited by footshock was reported | |||||
| Cohen et al. ( | Extracellular recording (Tetrode) in DAT-Cre mice identification using optical stimulation of channelrhodopsin | Air puff to the face | VTA | All optogenetically identified DA neurons were inhibited for the aversive stimuli | <50% of optogenetically identified DA neurons were excited by reward predicting CS | |
| Coizet et al. ( | Extracellular recording in urethane anesthetized rats | Footshock (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 60 trials | SNc | 72% inhibited | ||
| 12% excited | ||||||
| Coizet et al. ( | Extracellular recording in urethane anesthetized rats | Footshock (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 100 trials | Dorsal SNc | <80% showed inhibition of firing | Inactivation of parabrachial nucleus abolished the nociceptive responses | |
| Gao et al. ( | Extracellular recording in chloral hydrate anesthetized rats | Peripheral nociceptive stimulation (shock to the tail) of 1 ms and 15–20 mA | SNc | 78% inhibited | Stimulation of LHb increased the inhibitory responses | |
| 15% excited | ||||||
| Gao et al. ( | Extracellular recording in chloral hydrate anesthetized rats | Peripheral nociceptive stimulation (shock to the tail) of 1 ms and 15–20 mA | SNc | <90% inhibited | LHb neurons showed opposite patterns | |
| Mantz et al. ( | Extracellular recording and antidromic identification in ketamine anesthetized rats | Tail pinch for 10 s using forceps | Ventromedial mesencephalic tegmentum | mPFC projecting neurons: 65% excited and 25% inhibited | ||
| NAc projecting neurons: 4% inhibited | ||||||
| Matsumoto and Hikosaka ( | Extracellular recording in behaving monkeys | Airpuff to the face | SNc and VTA | US | Similar responses for reward omission All, aversive CS inhibited neurons were excited for the reward conditioned CS Medial VTA and medial SNc neurons are predominantly inhibited by CS predicting air puff | |
| Mirenowicz and Schultz ( | Extracellular recording in behaving monkeys | CS predicting air puff to the hand | SNc, VTA, and retrorubral field | 31% inhibited <14% excited | <70% excited by the CS predicting juice reward | |
| Mileykovskiy and Morales ( | Extracellular recording and juxtacellular labeling in awake rats | Fear conditioning: tone paired with tail shock (0.5–1.2 mA, 60 Hz, 1 s) | VTA | In fear conditioned rats | Correlations between inhibitory response and rats which discriminates the fear CS | |
| Type 1 (60%): inhibited for onset of CS+ | ||||||
| Type 2 (20%): inhibited for onset and offset of CS+ | ||||||
| Type 3 (20%): biphasic excitatory or inhibitory responses followed by inhibitory pause | ||||||
| Tsai et al. ( | Extracellular recording in urethane anesthetized rats | Single shock stimulation to sciatic nerve (square pulse of 4–10 V intensity and 0.3 ms duration | SNc | <85% inhibited 6% excited Prolonged duration of inhibition | Rebound excitation Rebound excitation | |
| Repeated footshocks (10–50 Hz) | ||||||
| Ungless et al. ( | Extracellular recording and juxtacellular labeling in urethane anesthetized rats | VTA | 83% are inhibited Others are non-responsive | |||
| Wang and Tsien ( | Extracellular recording (Tetrode) in behaving mice | 20 trials of fearful events (Free fall from 10 to 30 cm height and shake from 0.2–1 s) with 1–2 min inter-trial interval | VTA | Type 1 (59%): Suppression of firing in response to both events | Type 1:offset-rebound excitation | 96% of the type 1 and type 2 DA neurons excited by the CS signaling reward |
| Type 2 (13%): Suppression of firing in response to both events | No effect |
Figure 1Effect of VTA vs. LHb stimulation on the acquisition of avoidance. Upper and lower panels indicate the Mean and SEs of successful avoidance trials and avoidance latency. Asterisks indicate significant differences between stimulated vs. control group (Modified from “Shumake et al., 2010”).