Literature DB >> 35811307

In-Memory Mathematical Operations with Spin-Orbit Torque Devices.

Ruofan Li1, Min Song2, Zhe Guo1, Shihao Li1, Wei Duan2, Shuai Zhang1, Yufeng Tian3, Zhenjiang Chen1, Yi Bao1, Jinsong Cui1, Yan Xu1, Yaoyuan Wang1, Wei Tong4, Zhe Yuan5, Yan Cui6, Li Xi7, Dan Feng4, Xiaofei Yang1, Xuecheng Zou1, Jeongmin Hong1, Long You1,8,9.   

Abstract

Analog arithmetic operations are the most fundamental mathematical operations used in image and signal processing as well as artificial intelligence (AI).  In-memory computing (IMC) offers a high performance and energy-efficient computing paradigm. To date, in-memory analog arithmetic operations with emerging nonvolatile devices are usually implemented using discrete components, which limits the scalability and blocks large scale integration. Here, a prototypical implementation of in-memory analog arithmetic operations (summation, subtraction and multiplication) is experimentally demonstrated, based on in-memory electrical current sensing units using spin-orbit torque (SOT) devices. The proposed structures for analog arithmetic operations are smaller than the state-of-the-art complementary metal oxide semiconductor (CMOS) counterparts by several orders of magnitude. Moreover, data to be processed and computing results can be locally stored, or the analog computing can be done in the nonvolatile SOT devices, which are exploited to experimentally implement the image edge detection and signal amplitude modulation with a simple structure. Furthermore, an artificial neural network (ANN) with SOT devices based synapses is constructed to realize pattern recognition with high accuracy of ≈95%.
© 2022 The Authors. Advanced Science published by Wiley-VCH GmbH.

Entities:  

Keywords:  analog mathematical computing; image and signal processing; in-memory computing; neural network; spin-orbit torque

Year:  2022        PMID: 35811307      PMCID: PMC9443454          DOI: 10.1002/advs.202202478

Source DB:  PubMed          Journal:  Adv Sci (Weinh)        ISSN: 2198-3844            Impact factor:   17.521


Introduction

A major criticality of current digital computing based on complementary metal oxide semiconductor (CMOS) transistors, is related to the required computational area/power, which does not scale well with the problem complexity.[ ] In addition, the scaling trend of CMOS performance has slowed down because of the power wall and slower voltage scaling.[ , ] Moreover, the constant data shuttling between the information processing and memory units in the traditional von‐Neumann architecture also significantly limits the speed, area, and energy efficiency.[ , ] Along with the unprecedented development of artificial intelligence (AI) and the Internet of Things (IoT), an exponential growth in the amount of data requires new insight into high area/energy efficiency and powerful computing paradigm.[ ] Many works have focused on beyond CMOS devices and beyond von‐Neumann architectures like in‐memory computing (IMC) based on nonvolatile memory (NVM) that executes computing tasks directly within the memory array.[ , , , , ] Meanwhile, under error‐tolerant circumstance, compared to the digital processor, analog computing presents a promising and possibly revolutionary paradigm in recent years, as it does not need analog‐to‐digital conversion and can allow massively parallel operations.[ , , ] Therefore, it is crucial to explore in‐memory analog computing (IMAC), offering an attractive solution to the energy consumption and area issues. The key challenge of IMC is to realize it without impacting the desirability of the resulting design as a standard memory.[ ] Due to these constraints, conventional IMC based on NVM is typically limited to perform simple specific operations, for example, currently focusing on the parallel multiply‐accumulate (MAC) operations, which are the primary calculations used in AI, with a crossbar memristors array network.[ , , ] Specifically, the current at each cross point is the product of input voltage and memristive conductance which can be modulated in an analog manner and are widely used as synaptic weight in neuromorphic computing, following Ohm's law for multiplication, and the total current at each column is a summation of the current at each cross point according to Kirchhoff's current law.[ ] However, in this IMC scheme, it is impossible to realize analog arithmetic multiplication of the same kind of signals and real‐time storing of the computational results, which limits the application scenarios of IMAC. In addition, these memristive devices suffer from deficiencies, including nonlinear and asymmetric weight‐update characteristics with an additional reset operation, constraining the performance of artificial neural networks (ANNs) for neuromorphic computing.[ , ] Here, we introduce spin‐orbit torque (SOT) devices to experimentally realize in‐memory analog mathematical operations such as summation, subtraction, and four‐quadrant multiplication, to implement the general purpose applications such as image or signal processing for edge computing. The possible circuits composed of discrete components, for performing such analog arithmetic operations, have been designed in the past based on memristor.[ , ] But these proposals have suffered from substantial limitations, including relatively large size and slow response. Our main idea is to exploit the SOT devices with perpendicular magnetic anisotropy (PMA) to linearly sense and store (in‐memory sense) the electrical currents as anomalous Hall resistance (AHR). In addition to nonvolatility and scalability, the CMOS‐compatible SOT technique further possesses low energy consumption, high speed and endurance. Thus, SOT devices offer an avenue for dense IMAC paradigms. The summation or subtraction of the currents, is realized by Kirchhoff's law, and thus, an in‐memory of analog summation/subtraction in the SOT devices is configured. If the other input current (reading current) is applied into the SOT device, its anomalous Hall voltage would be proportional to the multiplication of the reading current and sensed current which is proportional to AHR, thereby implementing the analog four‐quadrant multipliers. Meanwhile, the SOT devices whose AHR is linearly changed with sensed current, can be used as artificial synapses to construct an ANN with initialization‐free MAC operations for pattern recognition.

Results and Discussion

In‐Memory Electrical Current Sensing Unit

The SOT heterostructure device (W/CoFeB/MgO/Ta from the bottom, Figure ) shows hysteresis of anomalous Hall effect (AHE) loop with sharp switching, indicating a strong PMA (Section S1, Supporting Information). The magnetization can be switched by an in‐plane current I x with the assistance of a collinear magnetic field H via SOT (Section S1, Supporting Information). Moreover, as found in our previous work,[ ] the coercive field of the AHE loop (AHR R H vs H) decreases with I increases. Here, at I  = 30 mA, R H varies linearly with applied H within the range of −12 to +12 Oe (orange points in Figure 1b). It means the SOT device can sense the magnetic field along x direction, under the assistance of I (named enable current I EN, I EN is 30 mA/0.5 s unless otherwise specified). In contrast, without I EN, a more than 3 kOe in‐plane field is needed to drive the demagnetization and thus changes R H to ≈0 (blue points in Figure 1b). The mechanism of magnetic field sensing can be understood that the I EN causes the demagnetization state of device, and thus a domain nucleation‐dominated magnetization reversal is very sensitive to the collinear magnetic field, either direction or magnitude, caused by SOT.[ , ] It was proved by the magneto‐optical Kerr effect (MOKE) microscopy investigation. The MOKE images (Figure 1c) depict that the proportion of −M z domains (shown in black) grows in a dispersed manner when scanning H x from +40 to −40 Oe, together with I x = 30 mA, after initializing the magnetization to the saturated state under +200 Oe. The nonvolatile variation of magnetic domain structure makes the SOT device feasible to memorize the sensed magnetic field. Correspondingly, the SOT device is possible to sense and memorize the electrical current as R H of the heterostructure, via the magnetic field generated by itself. Indeed, in our basic in‐memory electrical current sensing unit (here named SOT unit), the SOT device with a current path (consisting of a 60 nm thick gold metal track) on the top surface separated by 50 nm thick Al2O3 insulating layer, R H varies linearly with the sensed current I SE (flowing in the Au path) scanning backward and forward from +100 to −100 mA, under the I EN. It is noted that I SE only generates a magnetic field along the x direction (H x′) (Section S2, Supporting Information), with the corresponding range of −12 to +12 Oe in the heterostructure (Section S3, Supporting Information). On the contrary, without the I EN, the in‐plane magnetic field generated by the sensed current is too small to affect the R H as discussed above. Thus, when I EN is switched on, I SE can be real‐time sensed and stored as R H in the heterostructure. Otherwise, the heterostructure offline stores I SE at the moment when I EN is switched off and the memorized R H can be readout by applying a small reading current (named I RE, I RE is 0.1 mA 0.1/s unless otherwise noted). Figure 1e shows the R H versus I SE curves with a linear relationship for the real‐time (black dots) and offline (red dots) cases, respectively. Therefore, R H can be expressed as R H = k × I SE for both cases, where k is the slope of the R H–I SE curve by linear fitting, if we neglect the AHR offset mainly resulting from contact misalignment and sample inhomogeneity.[ ] Noting that, in general, in the real‐time sensing case, k is lower than that in the offline case for the same I EN, due to the Joule heating effect caused by lasting relatively high current I EN in the former case, for example, k is 4.6 Ω A−1 (offline) and 4.4 Ω A−1 (real‐time) under I EN = 30 mA (Section S4, Supporting Information). As expected, with increasing I EN, the k difference would become more distinct (Section S4, Supporting Information).
Figure 1

Basic in‐memory sensing unit. a) Schematic of the SOT device with a stack consisting of W(5)/CoFeB (1.1)/MgO (2)/Ta (2) (from the substrate side, unit is nm). b) R H as a function of an external in‐plane field (H x) with and without a collinear enable current I EN. c) MOKE images captured after the application of I x together with H x. Note that the device is saturated by +200 Oe magnetic field first. d) Schematic of the basic in‐memory electrical current sensing unit and circuits for measurements. I SE represents the current flowing in the sensed current path and H x’ denotes the generated in‐plane field in the SOT device by I SE. I RE is the reading current for offline sense case. e) R H as a function of I SE for the real‐time (black dots) and offline (red dots) sensing cases.

Basic in‐memory sensing unit. a) Schematic of the SOT device with a stack consisting of W(5)/CoFeB (1.1)/MgO (2)/Ta (2) (from the substrate side, unit is nm). b) R H as a function of an external in‐plane field (H x) with and without a collinear enable current I EN. c) MOKE images captured after the application of I x together with H x. Note that the device is saturated by +200 Oe magnetic field first. d) Schematic of the basic in‐memory electrical current sensing unit and circuits for measurements. I SE represents the current flowing in the sensed current path and H x’ denotes the generated in‐plane field in the SOT device by I SE. I RE is the reading current for offline sense case. e) R H as a function of I SE for the real‐time (black dots) and offline (red dots) sensing cases.

In‐Memory Analog Summation/Subtraction and Edge Detection

Many SOT units can be correlated to perform useful functions by building an interconnected network where their sensed current paths are connected to a node. Following this architecture, a simple configuration for connecting three SOT units is schematically shown in Figure . The electrical currents in the sensed current paths meeting at the common node have to satisfy Kirchhoff's current law stating the sum of the currents flowing into the node (Input current I in(1,2)) is equal to the sum of the currents flowing out of the node (output current I out), I out = I in1 + I in2, thereby realizing analog current summation function. Of course, the current subtraction operation can be also easily obtained as I in1(2) = I out − I in2(1). Meanwhile, the branch (input/output) electrical current in the network can be sensed and memorized by the corresponding SOT device (as R H) under the branch current path at each SOT unit, that is, R H(in/out) = k × I (in/out). These indicate one SOT‐device's R H can tell us not only the value of its corresponding branch current but also the calculation result of other two branch currents, if we know their operation relationship among the currents, for example, R H(out) = k × I out = k × (I in1+I in2). If we detect every individual SOT‐device's R H, we can immediately know every branch current and also their operation relationship. These are also true for much more connected SOT units (Figure 2a(ii)). Therefore, in‐memory analog summation/subtraction can be performed in such interconnected SOT units.
Figure 2

In memory analog summation/subtraction based on interconnected SOT units. a(i)) Schematic of the interconnected network with three basic units for implementing in‐memory analog summation, where the sensed current paths of the three units are connected to a node. (ii) Schematic of summation computing architecture with much more connected units. b) Optical microscopy image of the connected three units following the architecture described in the schematic. c) R H as a function of input current I in1 for the individual SOT devices in the three units (R H(in1), R H(in2), and R H(out)). d) The comparison between the ideal I out (i.e., I in1 + I in2) values (black dots) and the I out (red dots) extracted from the measured R H(out) through the relationship I = R H/k, for the network with three connected units. e) Optical microscopy image of the network with three input currents. f) In this network, the summation of collected R H (R H(in1), R H(in2), and R H(in3)) as a function of I in3 (black dots). The red and blue dots denote the collected R H(out) and R H’. g) The comparison between the ideal I out (I in1 + I in2 + I in3) values (black dots) and the extracted I out (red dots) for the network with three inputs.

In memory analog summation/subtraction based on interconnected SOT units. a(i)) Schematic of the interconnected network with three basic units for implementing in‐memory analog summation, where the sensed current paths of the three units are connected to a node. (ii) Schematic of summation computing architecture with much more connected units. b) Optical microscopy image of the connected three units following the architecture described in the schematic. c) R H as a function of input current I in1 for the individual SOT devices in the three units (R H(in1), R H(in2), and R H(out)). d) The comparison between the ideal I out (i.e., I in1 + I in2) values (black dots) and the I out (red dots) extracted from the measured R H(out) through the relationship I = R H/k, for the network with three connected units. e) Optical microscopy image of the network with three input currents. f) In this network, the summation of collected R H (R H(in1), R H(in2), and R H(in3)) as a function of I in3 (black dots). The red and blue dots denote the collected R H(out) and R H’. g) The comparison between the ideal I out (I in1 + I in2 + I in3) values (black dots) and the extracted I out (red dots) for the network with three inputs. Figure 2b shows the three fabricated identical SOT units following the above interconnected architecture. In this configuration, we applied simultaneously two pulse currents with 0.5 s pulse duration serving as input currents, which are on the left side of the node, and then the R H (R H(in1), R H(in2), and R H(out)) were measured after I EN is switched off (offline sensing case). Here, I in1 scans forward and backward between 80 and −40 mA with a step of 10 mA, while I in2 remains constant of −60 mA. As we found in the independent SOT unit, R H(in1) is proportional to its corresponding I in1 and the proportional coefficient k is ≈5 Ω A−1 (Figure 2c). It is also observed that, the curve of R H(out) as a function of I in1 is nearly parallel to the curve of R H(in1) versus I in1 with an offset equal to R H(in2), indicating that the three R H values manifest a perfect summation relationship, R H(out) = R H(in1) + R H(in2). This summation relationship also holds for different I in2 values (for example, 0, −20 and −40 mA), indicating the stability of the scheme (Section S5, Supporting Information). On the other hand, once we know the k, the summation of two input currents, i.e., I out, can be derived from R H(out) measurement. The obtained I out using this scheme are in good agreement with the theoretical calculated value of the two input currents summation (Figure 2d). For further investigating the extendibility of the scheme, we fabricated an interconnected network with three input currents (I in1,2,3) (Figure 2e). The I in1 and I in2 remain constant (I in1 = 10 mA, I in2 = −30 mA), while I in3 is scanned between +80 and −80 mA. From the measurement results, the R H(out) is equal to the summation of three independently collected R H values (R H(in1), R H(in2), and R H(in3)), which corresponds to those input currents (Figure 2f). Similarly, the I out obtained from R H(out) coincides well with the theoretical summation of three input currents (Figure 2g). It is worthwhile to mention that the intermediate R H’, monitoring output of I in1 and I in2, remains nearly constant and equals to the intercept of R H(out) versus I in3 curve, i.e., R H(in1)+R H(in2). The same behaviors are observed for different combinations of (I in1, I in2), including (20, 30 mA), (−10, 30 mA), (10, −10 mA), and (−20, −30 mA) (Section S6, Supporting Information). These results indicate our in‐memory analog computation scheme can be extended for much more inputs. Then, we exploit our adder/subtractor to experimentally realize edge detection, one of the fundamental operations in image processing, for an original 8‐bit grayscale image with 256 × 256 pixels. Gradient‐based Robert operator is used to find edge pixels (or detect edge lines) in the image (Figure ). The approximate gradient magnitude (𝛻𝑓) based on the Robert operator is obtained by computing the summation of the absolute values of the differences between diagonally adjacent pixels in the surrounding 2 × 2 grayscale matrix, that is, 𝛻𝑓 = |𝑓(𝑥,𝑦)−𝑓(𝑥+1,𝑦+1)| + | 𝑓(𝑥,𝑦+1)−𝑓(𝑥+1,𝑦)|, where 𝑓(𝑥,𝑦) denotes the grayscale value at location (x,y) (Section S7, Supporting Information). To obtain the gradient magnitude by the current analog computation scheme, the grayscale values of the original image (Figure 3c) are linearly mapped to current values from 0 to 50 mA as inputs of the adder/subtractor. For simplicity, we assigned positive (negative) signs to the larger (smaller) values in the diagonal positions for each 2 × 2 input current matrix. By applying the processed 2 × 2 current matrix to a four‐input computing configuration, the gradient magnitude in current form is sensed and memorized in the output SOT device as R H(out) (Figure 3b). We sequentially processed this image from the top‐left to the bottom‐right corner. As a result, an R H(out) matrix and thus the corresponding current matrix with dimensions of 255 × 255 were obtained. The edge extraction image obtained by remapping the current to a grayscale matrix is shown in Figure 3d. We investigated the pixel differences between the ideal output and the output from our scheme. The output obtained with our analog adder/subtractor computations scheme closely matches the ideal output, with a standard deviation of 2.95% in the pixel values (Section S8, Supporting Information). The small deviation is mainly due to the nonideal linearity between R H and I SE.
Figure 3

Edge detection by the in‐memory analog summation/subtraction computing. a) The principle of obtaining the edge pixels in a 2D image by Robert operator. 𝑓(x,y) denotes the grayscale value at location (x,y) in the original image while 𝛻𝑓(x,y) represents the obtained gradient magnitude. b) Schematic of the process to realize the edge detection by our adder/subtractor. c) The original image and d) Output image after edge detection. “cameraman” image reproduced with permission from MIT under a Creative Commons Attribution Non‐Commerical license (https://creativecommons.org/licenses/by‐nc/4.0/).

Edge detection by the in‐memory analog summation/subtraction computing. a) The principle of obtaining the edge pixels in a 2D image by Robert operator. 𝑓(x,y) denotes the grayscale value at location (x,y) in the original image while 𝛻𝑓(x,y) represents the obtained gradient magnitude. b) Schematic of the process to realize the edge detection by our adder/subtractor. c) The original image and d) Output image after edge detection. “cameraman” image reproduced with permission from MIT under a Creative Commons Attribution Non‐Commerical license (https://creativecommons.org/licenses/by‐nc/4.0/).

In‐Memory Analog Multiplication and Amplitude Modulation

For a single SOT unit, the anomalous Hall voltage U H is expressed as U H = R H × I c, where I c is the current applied along terminals 3 and 4 (Figure ). Additionally, as established above, R H can represent the current I SE flowing in the sensed current path, R H = k × I SE, as I SE varies between −100 and 100 mA. Therefore, U H can be defined as an analog product of the two current signals I SE and I c, U H = k × I SE × I c, if k is a constant and independent of I SE and I c. Corresponding to real‐time and offline current‐sensing case, I c is I EN and I RE, respectively. In the real‐time case, k slightly varies with applied I EN ranging from 30 to 37 mA, but the variation is insignificant (less than 5%) in our measurements (Section S4, Supporting Information). Thus, this approach can still be used for analog multiplication in cases that allow a small reduction in precision. On the contrary, in the offline case, it is found k can remain constant for I RE ranging from −10 to +10 mA (Section S9, Supporting Information). We plot U H as a function of I SE × I RE, while both I RE and I SE are variable. At a given I RE, one straight line was obtained, when I SE was scanned between −100 and 100 mA with the 10 mA step, denoting U H is proportional to the product of I SE and I RE. With the different I RE varying from −10 to 10 mA with 2 mA step, a group of parallel straight lines were obtained. The negligible deviations from a linear fitting between U H and I SE × I RE to the entire measurement data confirm that the proportional coefficient k is indeed a constant (Figure 4c).
Figure 4

In‐memory multiplication based on a basic unit. a) Schematic of the four‐quadrant analog multiplication scheme. b) At a given constant I RE, U H is plotted as a function of I SE × I RE with I SE changes in a range of ±100 mA with a step of 10 mA, when I RE varies from −10 to 10 mA with a step of 2 mA. c) Linear fitting between U H and I SE × I RE to all observed data shown in b) with an R‐square of 0.99 599. d) Implementation of amplitude modulation utilizing in‐memory four‐quadrant analog multiplication.

In‐memory multiplication based on a basic unit. a) Schematic of the four‐quadrant analog multiplication scheme. b) At a given constant I RE, U H is plotted as a function of I SE × I RE with I SE changes in a range of ±100 mA with a step of 10 mA, when I RE varies from −10 to 10 mA with a step of 2 mA. c) Linear fitting between U H and I SE × I RE to all observed data shown in b) with an R‐square of 0.99 599. d) Implementation of amplitude modulation utilizing in‐memory four‐quadrant analog multiplication. Once we know the k, the product of any I SE and I RE ranging within [−100 mA, +100 mA] and [−10 mA, +10 mA], respectively, can be easily achieved from the detection of U H. Therefore, in‐memory four‐quadrant analog multiplier is realized in a single SOT unit. The four‐quadrant analog multiplier is an important building block for many analog signal processing applications, such as filters, modulators, and mixers.[ , ] Here, we experimentally implement amplitude modulation (AM), which is a widely used modulating form in wireless communications, by our multiplier where the input signal is used as I RE and the carrier signal without modulation is considered as I SE (Figure 4d). In our experiment, the amplitude variations of both the input (I RE) and carrier (I SE) signals follow cosine waveforms, whose expression are and , respectively. Upon imposing I RE and I SE on the SOT unit, the analog multiplication of these two current signal is directly obtained by measured U H divided by k (U H/k), which displays a signal whose amplitude is modulated by the input signal but whose frequency is consistent with that of the carrier signal. In addition, the experimental results agree well with the calculated products of I SE and I RE ().

ANN Simulations for Handwritten Digit Recognition

Since the SOT device can sense I SE as the R H form, the R H of the SOT device is possible to be continuously modulated by I SE. Therefore, we can consider the SOT devices as artificial synapses (named SOT synapses), whose weights are tuned by I SE flowing in the Au layer of the SOT unit, to construct an ANN for IMC. We simulated the ANN with experimentally measured characteristics of the SOT synapse to perform image recognition using the MNIST (Modified National Institute of Standards and Technology) database of handwritten digits, whose image size is 28 × 28. The crossbar array based on AHE structures of SOT synapse is illustrated in Figure . At each cross point, the R H of the SOT device is locally stored as a synaptic weight and U H is the product of I RE (serving as inputs of the ANN) and R H, as discussed above. In each column, the Hall voltage detection terminals are connected in series, and the summation can be obtained according to Kirchhoff's voltage law. As shown in Figure 5b, the network has 784, 100, and 10 neurons in the input layer, hidden layer, and output layer, respectively. The 8‐bit grayscale values of the input test images are encoded by the I RE amplitudes, while the connection weights are extracted from the I SE‐modulated R H, which has 200 resistance states (Figure 5c). The highly linear modulation of R H by the I SE in a wide range (±100 mA) provides great advantages in MAC operations without initialization and high accuracy for neuromorphic computing. The training process was performed with 60 000 images, and another 10 000 images were used for the test process (see Section S10 for the corresponding flowchart, Supporting Information). Figure 5d shows the simulated pattern recognition accuracy as a function of training iteration. An ANN with ideal software synapses that has high linearity was used for accuracy comparison.[ ] Our simulation demonstrates that the ANN based on our scheme can reach a pattern recognition accuracy of ≈95%, which is close to the accuracy of ideal software‐based training (97.95%). Figure 5e,f illustrate the evolution of the SOT synaptic weights of input‐hidden and hidden‐output synaptic matrix, respectively, before and after in situ training. With the in situ training of the SOT synapses, the weights of the entire network have modified significantly. If we take account of the influence of noise in our neural network arising from the nonideal characteristics of our SOT synapses, including device‐to‐device, cycle‐to‐cycle, and reading variations (see Section S11, Supporting Information), the recognition accuracy is slightly reduced to ≈91%, indicating that the noise may have a small effect on the SOT synapse. For practical applications, a magnetic tunnel junction (MTJ) is generally used to replace the Hall bar structure, to enhance the magneto‐resistance (MR) ratio, which is helpful in increasing the recognition accuracy.
Figure 5

Fully connected neural network simulations for handwritten digit recognition based on MAC operations. a) MAC operations implemented in a crossbar array based on AHE structures. b) The fully‐connected neural network structure consists of 784 input neurons, 100 hidden neurons, and 10 output neurons. c) Experimentally measured R H‐I SE data points of an SOT‐based synapse with a step of 0.5 mA. d) Pattern recognition accuracy as a function of training iteration where a batch size of 300 images is used. Defect‐free SOT‐based synaptic devices reduce accuracy slightly (blue line), comparing to the software‐based ones (red line). Moreover, the variation in SOT‐based synaptic devices will degrade accuracy (green line). e) Evolution of the SOT synapse weights of input‐hidden synaptic matrix before and after in situ training. f) Evolution of the SOT synapse weights of hidden‐output synaptic matrix before and after in situ training.

Fully connected neural network simulations for handwritten digit recognition based on MAC operations. a) MAC operations implemented in a crossbar array based on AHE structures. b) The fully‐connected neural network structure consists of 784 input neurons, 100 hidden neurons, and 10 output neurons. c) Experimentally measured R H‐I SE data points of an SOT‐based synapse with a step of 0.5 mA. d) Pattern recognition accuracy as a function of training iteration where a batch size of 300 images is used. Defect‐free SOT‐based synaptic devices reduce accuracy slightly (blue line), comparing to the software‐based ones (red line). Moreover, the variation in SOT‐based synaptic devices will degrade accuracy (green line). e) Evolution of the SOT synapse weights of input‐hidden synaptic matrix before and after in situ training. f) Evolution of the SOT synapse weights of hidden‐output synaptic matrix before and after in situ training.

Power and Area Performance

In the in‐sensor memory SOT unit, the magnetic field produced by I SE increases with the reduction of their distance and the lateral line dimensions, and also using magnetic cladding layer on the sensed current line can increase the created field on the magnet.[ , ] Therefore, with the optimized structure for SOT unit, the field generated by I SE can reach typical values of several tens Oe/mA,[ , ] and thus maximum detectable or required current in the sensed current line could be only several hundred microampere. On the other hand, the amplitude of I EN needed in our experiments was 30 mA with a tungsten wire of width 30 µm and thickness 5 nm. But the I EN scales with the width of the magnet, making the IMC scheme scalable. For example, from the experimental observation, I EN decreases from 30 to 11 mA when the width decreases from 30 to 7 µm, respectively (Section S12, Supporting Information). It should be mentioned that the device cannot be unrestricted scaled down, as the magnet should guarantee to be multidomain and domain structure continuously varies with the in‐plane field under the assistance of I EN. In a SOT‐device (or unit) with the lateral size of 0.6 × 1 µm2, which exhibits a good linear relationship between R H and H x, the current amplitude is reduced to 1.2 mA (Section S12, Supporting Information). The current amplitude can be further decreased by reducing the thickness of the wire. In the metallic SOT units, the dominant mechanism for power dissipation is Joule heating (I 2 R loss). The resistivity of the SOT device is 186 µΩ cm, as measured in our experiments and similar to the values reported by Zhang et al.[ ] As discussed above, the Joule heating mostly caused by I EN was experimentally estimated to be ≈552 µW without optimization for the device with the lateral size of 0.6 × 1 µm2. Accordingly, our in‐memory analog adder with two input currents and multiplier consumes ≈1.7 mW (552 µW × 3) and 552 µW, respectively, which are comparable to the analog implementation of arithmetic operations by the state‐of‐the‐art CMOS‐based technologies (2.7 mW for adder using 0.25 µm technology node and 232 µW for multiplier using 0.18 µm node). In contrast, a reduction in area overhead of more than one to two orders of magnitude is obtained for the demonstrated scheme compared with CMOS‐based technologies. The details of the calculation as well as comparative charts can be found in Section S13 (Supporting Information). Moreover, the enable current and consequently power dissipation could be further lowered by using small anisotropy field magnet or/and other heavy metals with larger spin Hall angles, such as CuIr.[ ]

Conclusion

To summarize, we have reported a spin‐based IMAC scheme, which provides the area and energy efficient strategy for on‐chip mathematical computation, signal and image processing, and neuromorphic computing. Besides, the divider could be implemented using our scheme with the help of operational amplifier.[ ] Our proposed architecture of in‐sensor electrical current computing is also possible to real‐time monitor the currents in the conductive paths and nodes for the power management of integrated circuits. For practical applications, MTJs would be utilized to replace the Hall bar structures, consequently, the noncontact current is sensed and memorized in the free layer of MTJ. Therefore, present proposed in‐memory sensing unit would evolve into the magnetic field‐assist SOT magnetic random access memory (SOT‐MRAM) cell structure (Section S14, Supporting Information). It indicates our proposed IMAC architecture can take advantage of the developed MRAM technologies, such as optimizing individual SOT unit and their interconnected structure to lower area overhead.

Experimental Section

Sample Preparation

Magnetron sputtering process was used to deposit a film structure of W (5 nm)/CoFeB (1.1 nm)/MgO (2 nm)/Ta (2 nm) on a thermally oxidized Si substrate at room temperature. Then the fabrication of the devices was carried out as the following descriptions. Step 1: photolithography and etching. The thin‐film stack was fabricated into Hall bars (so‐called SOT devices in the main text) by photolithography (using a deep ultraviolet lithography machine) and argon‐ion milling (using MIBE 150A etching machine) after the cleaning procedure. The dimension of the core area for the SOT device is 30 × 30 µm2. Step 2: Al2O3 film deposition. Atomic layer deposition (ALD) was used to deposit 50 nm Al2O3 on the prepared SOT devices array as the insulation layer. Step 3: expose the electrodes of the SOT devices. First, a photolithography was done to expose the areas of all the electrodes, and the other areas were covered with photoresist. Next, the argon‐ion milling (MIBE 150A) was used to etch the Al2O3 about 40 nm. Then, the buffer oxide etch (BOE) was utilized to etch the remaining Al2O3 (about 10 nm). Finally, the photoresist was removed. Step 4: deposit Au. In order to fabricate the Au paths that can generate a planar magnetic field and cap on electrodes with Au at the same time, electron beam evaporation (EBE) was used to grow a Ti (10 nm)/Au (60 nm) bilayer. The width of the channel in the Au paths were 50 µm, and the dimension of the device electrodes is 100 × 100 µm2.

Electrical Characterization

For the AHR measurements, a d.c. current source (Keithley model 6221) was used to apply currents, a nanovoltmeter (Keithley model 2182A) to measure the Hall voltage, and Keithley model 2400 (or 2410) to apply currents in the Au paths.

MOKE Imaging

MOKE images were used to magnetically image the domain nucleation dominated switching mode in the CoFeB layer. After saturating the magnet in the +z direction, then an image was taken to serve as the reference image. Different external magnetic field H x under a writing current of 30 mA for 0.5 s was next applied, another image was taken. The first reference image was subtracted from the second image to get the final MOKE image.

Conflict of Interest

The authors declare no conflict of interest.

Author Contributions

R.L., M.S., Z.G., and S.L. contributed equally to this work. L.Y. conceived the project and designed the experiments. R.L., S.L., and Y.T. fabricated the samples. R.L. and S.L. implemented the experimental set‐up and measurements. R.L. and S.Z. performed the MOKE measurements. M.S., Z.C., W.D., and L.Y. performed the simulations. R.L., L.Y., M.S., Z.G., and S.Z. analyzed the results. M.S., X.Y., Y.W., J.H., Y.C., Z.Y., and W.T. provided the theoretical support. L.Y., R.L., Z.G., and M.S. wrote the manuscript. All authors discussed the data and contributed to the manuscript. Supporting Information Click here for additional data file.
  10 in total

1.  Modelling: Build imprecise supercomputers.

Authors:  Tim Palmer
Journal:  Nature       Date:  2015-10-01       Impact factor: 49.962

2.  The chips are down for Moore's law.

Authors:  M Mitchell Waldrop
Journal:  Nature       Date:  2016-02-11       Impact factor: 49.962

3.  Memory leads the way to better computing.

Authors:  H-S Philip Wong; Sayeef Salahuddin
Journal:  Nat Nanotechnol       Date:  2015-03       Impact factor: 39.213

4.  Memristive devices for computing.

Authors:  J Joshua Yang; Dmitri B Strukov; Duncan R Stewart
Journal:  Nat Nanotechnol       Date:  2013-01       Impact factor: 39.213

Review 5.  Memory devices and applications for in-memory computing.

Authors:  Abu Sebastian; Manuel Le Gallo; Riduan Khaddam-Aljameh; Evangelos Eleftheriou
Journal:  Nat Nanotechnol       Date:  2020-03-30       Impact factor: 39.213

6.  Fully hardware-implemented memristor convolutional neural network.

Authors:  Peng Yao; Huaqiang Wu; Bin Gao; Jianshi Tang; Qingtian Zhang; Wenqiang Zhang; J Joshua Yang; He Qian
Journal:  Nature       Date:  2020-01-29       Impact factor: 49.962

7.  Demonstration of Ru as the 4th ferromagnetic element at room temperature.

Authors:  P Quarterman; Congli Sun; Javier Garcia-Barriocanal; Mahendra Dc; Yang Lv; Sasikanth Manipatruni; Dmitri E Nikonov; Ian A Young; Paul M Voyles; Jian-Ping Wang
Journal:  Nat Commun       Date:  2018-05-25       Impact factor: 14.919

8.  In-Memory Mathematical Operations with Spin-Orbit Torque Devices.

Authors:  Ruofan Li; Min Song; Zhe Guo; Shihao Li; Wei Duan; Shuai Zhang; Yufeng Tian; Zhenjiang Chen; Yi Bao; Jinsong Cui; Yan Xu; Yaoyuan Wang; Wei Tong; Zhe Yuan; Yan Cui; Li Xi; Dan Feng; Xiaofei Yang; Xuecheng Zou; Jeongmin Hong; Long You
Journal:  Adv Sci (Weinh)       Date:  2022-07-10       Impact factor: 17.521

9.  A 15-channel 30-V Neural Stimulator for Spinal Cord Repair.

Authors:  YongHong Tao; Andreas Hierlemann
Journal:  IEEE Trans Very Large Scale Integr VLSI Syst       Date:  2018-05-11       Impact factor: 2.312

  10 in total
  1 in total

1.  In-Memory Mathematical Operations with Spin-Orbit Torque Devices.

Authors:  Ruofan Li; Min Song; Zhe Guo; Shihao Li; Wei Duan; Shuai Zhang; Yufeng Tian; Zhenjiang Chen; Yi Bao; Jinsong Cui; Yan Xu; Yaoyuan Wang; Wei Tong; Zhe Yuan; Yan Cui; Li Xi; Dan Feng; Xiaofei Yang; Xuecheng Zou; Jeongmin Hong; Long You
Journal:  Adv Sci (Weinh)       Date:  2022-07-10       Impact factor: 17.521

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.