A Survey of Neuromorphic Computing and Neural Networks in Hardware

Abstract

Neuromorphic computing has come to refer to a variety of brain-inspired computers, devices, and models that contrast the pervasive von Neumann computer architecture. This biologically inspired approach has created highly connected synthetic neurons and synapses that can be used to model neuroscience theories as well as solve challenging machine learning problems. The promise of the technology is to create a brainlike ability to learn and adapt, but the technical challenges are significant, starting with an accurate neuroscience model of how the brain works, to finding materials and engineering breakthroughs to build devices to support these models, to creating a programming framework so the systems can learn, to creating applications with brain-like capabilities. In this work, we provide a comprehensive survey of the research and motivations for neuromorphic computing over its history. We begin with a 35-year review of the motivations and drivers of neuromorphic computing, then look at the major research areas of the field, which we define as neuro-inspired models, algorithms and learning approaches, hardware and devices, supporting systems, and finally applications. We conclude with a broad discussion on the major research topics that need to be addressed in the coming years to see the promise of neuromorphic computing fulfilled. The goals of this work are to provide an exhaustive review of the research conducted in neuromorphic computing since the inception of the term, and to motivate further work by illuminating gaps in the field where new research is needed.

Lean Neural Networks for Autonomous Radar Waveform Design

“…For this reason, neural networks are often only applied to problems without classical or procedural solutions, and which can tolerate inaccuracy. Expensive hardware accelerators [13,14], creative model definitions [15], and entirely new models of computation [16] have been developed and improved to suit neural networks, which perform poorly using general purpose CPUs. Furthermore, neural networks rarely achieve 100% accuracy on even conceptually simple problems given the vague definitions of problems they solve and the variability of acceptable inputs.…”

Tripartite entanglement in quantum memristors

“…Neuromorphic computing is the brain-inspired computational paradigm where digital or analog systems mimic neural systems [1]. Its most prominent structures are artificial neural networks [2], which have shown remarkable breakthrough applications in recent years [3].…”

Towards Single Atom Computing via High Harmonic Generation

“…The best known example of a physical computerthe brain -has inspired a number of approaches collectively known as neuromorphic computing [12]. Within this paradigm, the most relevant framework is that of reservoir computing [13,14].…”