| Literature DB >> 28808316 |
Fan Zuo1, Priyadarshini Panda2, Michele Kotiuga3, Jiarui Li4, Mingu Kang4, Claudio Mazzoli5, Hua Zhou6, Andi Barbour5, Stuart Wilkins5, Badri Narayanan7, Mathew Cherukara6, Zhen Zhang1, Subramanian K R S Sankaranarayanan7, Riccardo Comin4, Karin M Rabe3, Kaushik Roy8, Shriram Ramanathan9.
Abstract
A central characteristic of living beings is the ability to learn from and respond to their environment leading to habit formation and decision making. This behavior, known as habituation, is universal among all forms of life with a central nervous system, and is also observed in single-cell organisms that do not possess a brain. Here, we report the discovery of habituation-based plasticity utilizing a perovskite quantum system by dynamical modulation of electron localization. Microscopic mechanisms and pathways that enable this organismic collective charge-lattice interaction are elucidated by first-principles theory, synchrotron investigations, ab initio molecular dynamics simulations, and in situ environmental breathing studies. We implement a learning algorithm inspired by the conductance relaxation behavior of perovskites that naturally incorporates habituation, and demonstrate learning to forget: a key feature of animal and human brains. Incorporating this elementary skill in learning boosts the capability of neural computing in a sequential, dynamic environment.Habituation is a learning mechanism that enables control over forgetting and learning. Zuo, Panda et al., demonstrate adaptive synaptic plasticity in SmNiO3 perovskites to address catastrophic forgetting in a dynamic learning environment via hydrogen-induced electron localization.Entities:
Year: 2017 PMID: 28808316 PMCID: PMC5556077 DOI: 10.1038/s41467-017-00248-6
Source DB: PubMed Journal: Nat Commun ISSN: 2041-1723 Impact factor: 14.919
Fig. 1Quantum material showing habituation behavior observed in neural and non-neural organisms. a Nonassociative habituation learning observed in Physarum polycephalum. When exposed to stimulus, a diminished response is observed indicative of habituation. b Schematic showing the habituation process in a perovskite SmNiO3 (SNO). Between repeated stimuli (H2), the dynamics of carrier localization subsides, showing both non-neural habituation and neural synaptic plasticity. c Associative spike-timing based learning observed in a biological neural system (brain) responsible for memory formation. In the brain, synaptic plasticity is modulated by chemical transmitters, and is a function of the relative timing difference between the post and pre-neuronal spikes. The biological neural system is implemented as a Spiking Neural Network (SNN) that consists of a fully connected array of pre-neurons and post-neurons. The pre-neuronal voltage spike (V pre) is modulated by the synaptic weight (w) to generate the resulting post-synaptic current (I post). The post-neuron integrates the current that results in an increase in its membrane potential (V mem) and spikes when the potential exceeds a certain threshold (θ). d In environment 1, the SNN was presented with different images of digit 2 and learnt several patterns corresponding to the given image. In environment 2, the SNN was presented with images of digits 0 and 1. Incorporating habituation-based nonassociative learning with standard associative spike-timing dependent plasticity (STDP) enables the SNN to learn new patterns without catastrophic forgetting in a resource-constrained dynamic input environment. The color intensity of the patterns are representative of the value of synaptic weights with lowest intensity (white) corresponding to a weight value of −0.5 and highest intensity (black) corresponding to 0.5
Fig. 2Mechanism of habituation in a perovskite nickelate. a In situ visualization of habituation phenomenon, i.e., exponential decrease of conductivity change upon environmental exposure (the dots represent the experimental data and the solid lines are fits.). σ 0 and σ are initial and dynamical conductivity, respectively. b The conductance changes in response to different environments (decrease in H2 and increase in air) showing inherent plasticity similar to what is observed in biological synapses. G 0 and G t represent initial and dynamical conductance, respectively. c Structural lattice breathing monitored by in situ synchrotron X-ray diffraction. The integrated intensities of x-ray diffraction peak at q z = 2.98 Å−1 related to H-SmNiO3 (H-SNO) are shown (see Supplementary Fig. 4). d First-principles calculation of electron-doped SNO. The upper figure shows density of states (DOS), in gray, at different doping levels from 0-1 added e − per Ni site. The unoccupied projected DOS (PDOS) on each nickel site is shown in orange and purple. The difference in the total DOS and the PDOS is due to the strong hybridization of the Ni and O states resulting from the covalent nature of the NiO6 octahedra. The lower figure shows the occupied Ni e g levels for the corresponding doping levels. Same color legend is used and the darker colors indicate Ni with two occupied e g states. e Atomic-scale pathway, and the associated energy barriers for proton migration between two neighboring O atoms labeled as O1 and O2 in (i) within a NiO6 octahedron in a monoclinic SNO crystal. The potential energy along the most preferred diffusion pathway (as obtained from nudged-elastic band density functional theory (DFT) calculation) is shown on the left, while selected configurations along this pathway labeled (i)–(v) are depicted on the right
Fig. 3Learning by forgetting. a, b Digit representations learnt with digits 0 through 2 shown sequentially to an Spiking Neural Network (SNN) (with nine excitatory neurons) trained with standard spike-timing dependent plasticity (STDP) (a) and adaptive synaptic plasticity (ASP) that integrates habituation (b). Presenting the digits one-by-one sequentially i.e., first all the images for digit 0 followed digit 1, and so on can be treated as a dynamic learning environment. No particular digit instance or class is re-shown to the network. SNN trained with STDP tried to learn the new digit representation (for instance, digit 1) while retaining a portion of the old data (for instance, digit 0). However, fixed network size and absence of data reinforcement (i.e., no old data or digit showing with the new data) resulted in accumulation causing new weight updates to coalesce with already learnt patterns rendering the network incapable of categorizing the digits. In sharp contrast, ASP-learnt SNN, with identical resource constraints in place, gracefully forgets old patterns and adapts to learn new inputs effectively without catastrophically erasing old data. Supplementary Fig. 10 shows the representations learnt for a larger network when all digits 0 through 9 are presented. The color intensity of the patterns are representative of the value of synaptic weights with lowest intensity (white) corresponding to a weight value of −0.5 and highest intensity (black) corresponding to 0.5