Cross-layer Designs against Non-ideal Effects in ReRAM-based Processing-in-Memory System

Nie, Chen; Wang, Zongwu; Tang, Qidong; Lv, Chenyang; Jiāng, Lì; He, Zhezhi

doi:10.1109/isqed54688.2022.9806294

2022 23rd International Symposium on Quality Electronic Design (ISQED) 2022

DOI: 10.1109/isqed54688.2022.9806294

|View full text |Cite

Cross-layer Designs against Non-ideal Effects in ReRAM-based Processing-in-Memory System

Chen Nie

Zongwu Wang

Qidong Tang

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

SwitchX: Gmin-Gmax Switching for Energy-efficient and Robust Implementation of Binarized Neural Networks on ReRAM Xbars

Bhattacharjee

Panda

2023

ACM Trans. Des. Autom. Electron. Syst.

View full text Add to dashboard Cite

Memristive crossbars can efficiently implement Binarized Neural Networks (BNNs) wherein the weights are stored in high-resistance states (HRS) and low-resistance states (LRS) of the synapses. We propose SwitchX mapping of BNN weights onto ReRAM crossbars such that the impact of crossbar non-idealities, that lead to degradation in computational accuracy, are minimized. Essentially, SwitchX maps the binary weights in such manner that a crossbar instance comprises of more HRS than LRS synapses. We find BNNs mapped onto crossbars with SwitchX to exhibit better robustness against adversarial attacks than the standard crossbar-mapped BNNs, the baseline. Finally, we combine SwitchX with state-aware training (that further increases the feasibility of HRS states during weight mapping) to boost the robustness of a BNN on hardware. We find that this approach yields stronger defense against adversarial attacks than adversarial training, a state-of-the-art software defense. We perform experiments on a VGG16 BNN with benchmark datasets (CIFAR-10, CIFAR-100 & TinyImagenet) and use Fast Gradient Sign Method (ϵ = 0.05 to 0.3) and Projected Gradient Descent ( \(\epsilon =\frac{2}{255} \) to \(\frac{32}{255},~\alpha =\frac{2}{255} \) ) adversarial attacks. We show that SwitchX combined with state-aware training can yield upto \(\sim 35\% \) improvements in clean accuracy and \(\sim 6-16\% \) in adversarial accuracies against conventional BNNs. Furthermore, an important by-product of SwitchX mapping is increased crossbar power savings, owing to an increased proportion of HRS synapses, that is furthered with state-aware training. We obtain upto \(\sim 21-22\% \) savings in crossbar power consumption for state-aware trained BNN mapped via SwitchX on 16 × 16 & 32 × 32 crossbars using the CIFAR-10 & CIFAR-100 datasets.

show abstract

SwitchX: Gmin-Gmax Switching for Energy-efficient and Robust Implementation of Binarized Neural Networks on ReRAM Xbars

Bhattacharjee

Panda

2023

ACM Trans. Des. Autom. Electron. Syst.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Cross-layer Designs against Non-ideal Effects in ReRAM-based Processing-in-Memory System

Cited by 1 publication

References 16 publications

SwitchX: Gmin-Gmax Switching for Energy-efficient and Robust Implementation of Binarized Neural Networks on ReRAM Xbars

SwitchX: Gmin-Gmax Switching for Energy-efficient and Robust Implementation of Binarized Neural Networks on ReRAM Xbars

Contact Info

Product

Resources

About