Quantum-noise-limited optical neural networks operating at a few quanta per activation

Abstract

A practical limit to energy efficiency in computation is ultimately from noise, with quantum noise [1] as the fundamental floor. Analog physical neural networks [2], which hold promise for improved energy efficiency and speed compared to digital electronic neural networks, are nevertheless typically operated in a relatively high-power regime so that the signal-to-noise ratio (SNR) is large (>10). We study optical neural networks [3] operated in the limit where all layers except the last use only a single photon to cause a neuron activation. In this regime, activations are dominated by quantum noise from the fundamentally probabilistic nature of single-photon detection. We show that it is possible to perform accurate machine-learning inference in spite of the extremely high noise (signal-to-noise ratio ~1). We experimentally demonstrated MNIST handwritten-digit classification with a test accuracy of 98% using an optical neural network with a hidden layer operating in the single-photon regime; the optical energy used to perform the classification corresponds to 0.008 photons per multiply-accumulate (MAC) operation, which is equivalent to 0.003 attojoules of optical energy per MAC. Our experiment also used >40× fewer photons per inference than previous state-of-the-art low-optical-energy demonstrations [4, 5] to achieve the same accuracy of >90%. Our training approach, which directly models the system’s stochastic behavior, might also prove useful with non-optical ultra-low-power hardware.

Harnessing optical advantages in computing: a review of current and future trends

“…Furthermore, specialized optical systems designed for specific signal or image processing operations could be less versatile and adaptable than electrical processors with software installed. An optical system's adaptability for applications requiring frequent adjustments or shifting dynamic processing requirements may be limited if incorporating functional improvements requires physical setup changes [93]. However, recent research looks at novel designs that may capitalize on these different advantages while reducing the complexity of setups and increasing flexibility.…”