| Literature DB >> 35641608 |
Sunwoo Lee1, Jaeyoung Jeon2,3, Kitae Eom4, Chaehwa Jeong5, Yongsoo Yang5, Ji-Yong Park2,3, Chang-Beom Eom4, Hyungwoo Lee6,7.
Abstract
Resistive switching devices have been regarded as a promising candidate of multi-bit memristors for synaptic applications. The key functionality of the memristors is to realize multiple non-volatile conductance states with high precision. However, the variation of device conductance inevitably causes the state-overlap issue, limiting the number of available states. The insufficient number of states and the resultant inaccurate weight quantization are bottlenecks in developing practical memristors. Herein, we demonstrate a resistive switching device based on Pt/LaAlO3/SrTiO3 (Pt/LAO/STO) heterostructures, which is suitable for multi-level memristive applications. By redistributing the surface oxygen vacancies, we precisely control the tunneling of two-dimensional electron gas (2DEG) through the ultrathin LAO barrier, achieving multiple and tunable conductance states (over 27) in a non-volatile way. To further improve the multi-level switching performance, we propose a variance-aware weight quantization (VAQ) method. Our simulation studies verify that the VAQ effectively reduces the state-overlap issue of the resistive switching device. We also find that the VAQ states can better represent the normal-like data distribution and, thus, significantly improve the computing accuracy of the device. Our results provide valuable insight into developing high-precision multi-bit memristors based on complex oxide heterostructures for neuromorphic applications.Entities:
Year: 2022 PMID: 35641608 PMCID: PMC9156742 DOI: 10.1038/s41598-022-13121-4
Source DB: PubMed Journal: Sci Rep ISSN: 2045-2322 Impact factor: 4.996
Figure 1Resistive switching device based on a Pt/LAO/STO heterostructure. (a) Schematic depicting the mechanism for the resistive switching in the oxide heterostructure. The spatial distribution of oxygen vacancies determines the tunneling probability of the 2DEG between the LAO/STO interface and the top Pt electrode. (b) Thickness-dependent evolution of the in situ RHEED intensity oscillation during the PLD deposition of LAO thin films. The insets show the RHEED patterns before and after the film growth. (c) AFM topography image measured on the surface of a thermally-treated STO (001) substrate. (d) AFM topography image measured on the surface of an as-grown LAO thin film. (e) HAADF-STEM image of the LAO/STO heterostructure. (f) Intensity of a line profile along (001) obtained from the STEM image. (g) XRD θ–2θ scan of the LAO/STO heterostructure.
Figure 2Multi-level switching behavior of the 2DEG memristor. (a) I–V characteristics of the 2DEG memristor. The arrows represent the directions of the voltage sweep. Note that the initially applied negative voltage switches the device to the on-state (step (1)), while the subsequent positive voltage switches the device back to the off-state (step (2)). (b) Sequentially programmed conductance states, showing the representative 27 states. (c) The standard deviation (red squares) and the averaged conductance values (blue squares) at all individual conductance states. (d) Current power spectral density of output currents at the representative 3 different states and the off-state.
Figure 3Variance-aware weight quantization for the 2DEG memristors. (a) Schematics showing the conventional uniform quantization and the variance-aware quantization methods. (b) Conductance histogram of uniformly-separated 12 conductance states. The black lines represent the normal distribution fitting curves. (c) Simulated heatmap of measurement error, calculated based on the uniformly-separated states. (d) Conductance histogram of the nonuniformly-separated 12 conductance states. The separation between each state is set small in the low current regime, while it is expanded as the current increases. (e) Simulated heatmap of measurement error, calculated based on the nonuniformly-separated states. Note that the error is significantly reduced by the variance-aware quantization method.
Figure 4Variance-aware weight quantization for image classification problems. (a) An illustration of basic matrix operations for neural network training. The output activation matrix (10 × 32) is computed by multiplying the weight matrix (10 × 64) by the input activation matrix (64 × 32). We collected the data from a neural network designed for image classification tasks (ResNet20 output layer). (b) Histograms of the input data (i.e., activations from the previous layer) at the ResNet-20 output layer during training on CIFAR-10 dataset. (c) Histograms of the weight values at the same ResNet-20 output layer during training on CIFAR-10. (d) Histograms of the number of correct/wrong element-wise uniform quantization of the output matrix. We first get the ground-truth output matrix by quantizing the product of the two floating-point input matrices. We consider the quantization is correct if the quantized output element is the same as the corresponding ground-truth element. (e) Histograms of the number of correct/wrong element-wise variance-aware quantization of the output matrix. (f) Mean Absolute Error (MAE) of the output matrix. The error is calculated for 12 states separately.
Figure 5Variance-aware weight quantization for the convolution operation. (a) The training sample image (image #1888) of Fashion-MNIST dataset. The image consists of 28 × 28 gray-colored pixels. We apply a 3 × 3 convolution filter (stride of 1 × 1) to the input image and compare the output. (b) Normalized original input pixel values (top), the input pixel values quantized using the uniform states (middle), and the input pixel values quantized using the variance-aware states (bottom). (c) The original output of the convolution operations without quantization. (d) The output obtained by applying the uniform quantization. (e) The output obtained by applying the VAQ.