| Literature DB >> 35811307 |
Ruofan Li1, Min Song2, Zhe Guo1, Shihao Li1, Wei Duan2, Shuai Zhang1, Yufeng Tian3, Zhenjiang Chen1, Yi Bao1, Jinsong Cui1, Yan Xu1, Yaoyuan Wang1, Wei Tong4, Zhe Yuan5, Yan Cui6, Li Xi7, Dan Feng4, Xiaofei Yang1, Xuecheng Zou1, Jeongmin Hong1, Long You1,8,9.
Abstract
Analog arithmetic operations are the most fundamental mathematical operations used in image and signal processing as well as artificial intelligence (AI). In-memory computing (IMC) offers a high performance and energy-efficient computing paradigm. To date, in-memory analog arithmetic operations with emerging nonvolatile devices are usually implemented using discrete components, which limits the scalability and blocks large scale integration. Here, a prototypical implementation of in-memory analog arithmetic operations (summation, subtraction and multiplication) is experimentally demonstrated, based on in-memory electrical current sensing units using spin-orbit torque (SOT) devices. The proposed structures for analog arithmetic operations are smaller than the state-of-the-art complementary metal oxide semiconductor (CMOS) counterparts by several orders of magnitude. Moreover, data to be processed and computing results can be locally stored, or the analog computing can be done in the nonvolatile SOT devices, which are exploited to experimentally implement the image edge detection and signal amplitude modulation with a simple structure. Furthermore, an artificial neural network (ANN) with SOT devices based synapses is constructed to realize pattern recognition with high accuracy of ≈95%.Entities:
Keywords: analog mathematical computing; image and signal processing; in-memory computing; neural network; spin-orbit torque
Year: 2022 PMID: 35811307 PMCID: PMC9443454 DOI: 10.1002/advs.202202478
Source DB: PubMed Journal: Adv Sci (Weinh) ISSN: 2198-3844 Impact factor: 17.521
Figure 1Basic in‐memory sensing unit. a) Schematic of the SOT device with a stack consisting of W(5)/CoFeB (1.1)/MgO (2)/Ta (2) (from the substrate side, unit is nm). b) R H as a function of an external in‐plane field (H x) with and without a collinear enable current I EN. c) MOKE images captured after the application of I x together with H x. Note that the device is saturated by +200 Oe magnetic field first. d) Schematic of the basic in‐memory electrical current sensing unit and circuits for measurements. I SE represents the current flowing in the sensed current path and H x’ denotes the generated in‐plane field in the SOT device by I SE. I RE is the reading current for offline sense case. e) R H as a function of I SE for the real‐time (black dots) and offline (red dots) sensing cases.
Figure 2In memory analog summation/subtraction based on interconnected SOT units. a(i)) Schematic of the interconnected network with three basic units for implementing in‐memory analog summation, where the sensed current paths of the three units are connected to a node. (ii) Schematic of summation computing architecture with much more connected units. b) Optical microscopy image of the connected three units following the architecture described in the schematic. c) R H as a function of input current I in1 for the individual SOT devices in the three units (R H(in1), R H(in2), and R H(out)). d) The comparison between the ideal I out (i.e., I in1 + I in2) values (black dots) and the I out (red dots) extracted from the measured R H(out) through the relationship I = R H/k, for the network with three connected units. e) Optical microscopy image of the network with three input currents. f) In this network, the summation of collected R H (R H(in1), R H(in2), and R H(in3)) as a function of I in3 (black dots). The red and blue dots denote the collected R H(out) and R H’. g) The comparison between the ideal I out (I in1 + I in2 + I in3) values (black dots) and the extracted I out (red dots) for the network with three inputs.
Figure 3Edge detection by the in‐memory analog summation/subtraction computing. a) The principle of obtaining the edge pixels in a 2D image by Robert operator. 𝑓(x,y) denotes the grayscale value at location (x,y) in the original image while 𝛻𝑓(x,y) represents the obtained gradient magnitude. b) Schematic of the process to realize the edge detection by our adder/subtractor. c) The original image and d) Output image after edge detection. “cameraman” image reproduced with permission from MIT under a Creative Commons Attribution Non‐Commerical license (https://creativecommons.org/licenses/by‐nc/4.0/).
Figure 4In‐memory multiplication based on a basic unit. a) Schematic of the four‐quadrant analog multiplication scheme. b) At a given constant I RE, U H is plotted as a function of I SE × I RE with I SE changes in a range of ±100 mA with a step of 10 mA, when I RE varies from −10 to 10 mA with a step of 2 mA. c) Linear fitting between U H and I SE × I RE to all observed data shown in b) with an R‐square of 0.99 599. d) Implementation of amplitude modulation utilizing in‐memory four‐quadrant analog multiplication.
Figure 5Fully connected neural network simulations for handwritten digit recognition based on MAC operations. a) MAC operations implemented in a crossbar array based on AHE structures. b) The fully‐connected neural network structure consists of 784 input neurons, 100 hidden neurons, and 10 output neurons. c) Experimentally measured R H‐I SE data points of an SOT‐based synapse with a step of 0.5 mA. d) Pattern recognition accuracy as a function of training iteration where a batch size of 300 images is used. Defect‐free SOT‐based synaptic devices reduce accuracy slightly (blue line), comparing to the software‐based ones (red line). Moreover, the variation in SOT‐based synaptic devices will degrade accuracy (green line). e) Evolution of the SOT synapse weights of input‐hidden synaptic matrix before and after in situ training. f) Evolution of the SOT synapse weights of hidden‐output synaptic matrix before and after in situ training.