In-memory computing using resistive memory devices is a promising non-von Neumann approach for making energy-efficient deep learning inference hardware. However, due to device variability and noise, the network needs to be trained in a specific way so that transferring the digitally trained weights to the analog resistive memory devices will not result in significant loss of accuracy. Here, we introduce a methodology to train ResNet-type convolutional neural networks that results in no appreciable accuracy loss when transferring weights to phase-change memory (PCM) devices. We also propose a compensation technique that exploits the batch normalization parameters to improve the accuracy retention over time. We achieve a classification accuracy of 93.7% on CIFAR-10 and a top-1 accuracy of 71.6% on ImageNet benchmarks after mapping the trained weights to PCM. Our hardware results on CIFAR-10 with ResNet-32 demonstrate an accuracy above 93.5% retained over a one-day period, where each of the 361,722 synaptic weights is programmed on just two PCM devices organized in a differential configuration.
Lead-halide perovskites increasingly mesmerize researchers because they exhibit a high degree of structural defects and dynamics yet nonetheless offer an outstanding (opto)electronic performance on par with the best examples of structurally stable and defect-free semiconductors. This highly unusual feature necessitates the adoption of an experimental and theoretical mindset and the reexamination of techniques that may be uniquely suited to understand these materials. Surprisingly, the suite of methods for the structural characterization of these materials does not commonly include nuclear magnetic resonance (NMR) spectroscopy. The present study showcases both the utility and versatility of halide NMR and NQR (nuclear quadrupole resonance) for probing the structure and structural dynamics of CsPbX 3 (X = Cl, Br, I), in both bulk and nanocrystalline forms. The strong quadrupole couplings, which originate from the interaction between the large quadrupole moments of, e.g., the 35 Cl, 79 Br, and 127 I nuclei, and the local electric-field gradients, are highly sensitive to subtle structural variations, both static and dynamic. The quadrupole interaction can resolve structural changes with accuracies commensurate with synchrotron X-ray diffraction and scattering. It is shown that space-averaged site-disorder is greatly enhanced in the nanocrystals compared to the bulk, while the dynamics of nuclear spin relaxation indicates enhanced structural dynamics in the nanocrystals. The findings from NMR and NQR were corroborated by ab initio molecular dynamics, which point to the role of the surface in causing the radial strain distribution and disorder. These findings showcase a great synergy between solid-state NMR or NQR and molecular dynamics simulations in shedding light on the structure of soft lead-halide semiconductors.
In-memory computing is an emerging computing paradigm where certain computational tasks are performed in place in a computational memory unit by exploiting the physical attributes of the memory devices. Here, we present an overview of the application of in-memory computing in deep learning, a branch of machine learning that has significantly contributed to the recent explosive growth in artificial intelligence. The methodology for both inference and training of deep neural networks is presented along with experimental results using phase-change memory (PCM) devices.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.