Quantitative Annotations of T-Cell Repertoire Specificity

Luo, Jiaqi; Zou, Yiping; Chen, Lingxi; Liu, Wei; Zhang, Wei; Li, Shuai Cheng

doi:10.1101/2023.01.29.526145

Cited by 1 publication

(1 citation statement)

References 62 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The core is the key computational element of the PE. The design of our core is inspired by traditional deep learning accelerators (Luo et al, 2017;Moreau et al, 2018) and adopts a decoupled accessexecute model (Smith, 1982). As shown in Figure 2C, It consists of three key modules: the load, compute, and store modules.…”

Section: Corementioning

confidence: 99%

A TTFS-based energy and utilization efficient neuromorphic CNN accelerator

Xiang

Srivatsa

et al. 2023

Front. Neurosci.

View full text Add to dashboard Cite

Spiking neural networks (SNNs), which are a form of neuromorphic, brain-inspired AI, have the potential to be a power-efficient alternative to artificial neural networks (ANNs). Spikes that occur in SNN systems, also known as activations, tend to be extremely sparse, and low in number. This minimizes the number of data accesses typically needed for processing. In addition, SNN systems are typically designed to use addition operations which consume much less energy than the typical multiply and accumulate operations used in DNN systems. The vast majority of neuromorphic hardware designs support rate-based SNNs, where the information is encoded by spike rates. Generally, rate-based SNNs can be inefficient as a large number of spikes will be transmitted and processed during inference. One coding scheme that has the potential to improve efficiency is the time-to-first-spike (TTFS) coding, where the information isn't presented through the frequency of spikes, but instead through the relative spike arrival time. In TTFS-based SNNs, each neuron can only spike once during the entire inference process, and this results in high sparsity. The activation sparsity of TTFS-based SNNs is higher than rate-based SNNs, but TTFS-based SNNs have yet to achieve the same accuracy as rate-based SNNs. In this work, we propose two key improvements for TTFS-based SNN systems: (1) a novel optimization algorithm to improve the accuracy of TTFS-based SNNs and (2) a novel hardware accelerator for TTFS-based SNNs that uses a scalable and low-power design. Our work in TTFS coding and training improves the accuracy of TTFS-based SNNs to achieve state-of-the-art results on the MNIST and Fashion-MNIST datasets. Meanwhile, our work reduces the power consumption by at least 2.4×, 25.9×, and 38.4× over the state-of-the-art neuromorphic hardware on MNIST, Fashion-MNIST, and CIFAR10, respectively.

show abstract

Section: Corementioning

confidence: 99%