An Optoneuronic Device with Realistic Retinal Expressions for Bioinspired Machine Vision

Abstract

Machine vision systems rely on communication between cameras and processor modules to capture and analyze visual information. This arrangement renders them as bulky and inefficient in terms of speed and power dissipation for futuristic big data applications that involve artificial intelligence algorithms. An apparatus able to imitate the operation of biologic eyes and function as a standalone platform would therefore present the next evolutional step in machine visual perception. Neuromorphic computing is an alternative approach to the Von Neumann architecture that carries the potential for implementing such intelligent cameras. In this regard, artificial synaptic devices have been widely used in recent years to construct hardware‐based neural networks mainly due to their adjustable electric parameters. Herein, a bioinspired, hybrid electrophotonic responsive neuronic device that mimics the combined functionality of retinal cones and bipolar cells is demonstrated. Under illumination, it features a hyperpolarization‐like current response in an OFF state and a complementary depolarized reaction when toggled to an ON state. Furthermore, electrical pulsing done in conjunction with light stimulation can emulate the horizontal cell neurotransmitter release in center‐surround biologic configurations. These devices may thus serve as building blocks for advanced visual systems, integrating self‐healing sensory and neuromorphic computing into an artificial cognitive retina.

Photonic synapses with ultralow energy consumption for artificial visual perception and brain storage

“…Photonic synapses, coupling optical sensing and synaptic plasticity, are expected to reduce power consumption and achieve ultrafast signal transmission 23,24 . The light-sensitive photosensors are similar to the photoreceptors of biological retina because they both can convert light signals to electrical signals 25 . This kind of devices, which could mimic the biologic eyes and work as a standalone platform, would pave the way for machine vision systems in the future 26 .…”

“…The classical Pavlovian conditioning can also be verified by our synaptic device. In addition, back-gate bias could enhance or reduce memory function exhibiting similar effects of emotions 25 . Positive emotions offer a positive effect and vice versa.…”

Programmable Photoelectric Memristor Gates for In Situ Image Compression

“…[ 37 ] The memristive device was fabricated over a transparent glass substrate that allows visible radiation (light input) to reach the dielectric layer to affect defect stoichiometry. [ 23 ] The TE takes the role of the electric input, whereas the common BEs are connected to a pull‐down resistor and serve as the gate's output.…”

“…More recently, memristive devices have been reported to produce a response to both electric and light stimulations. [ 19 − 24 ] In this context, Tan et al [ 25 ] proposed a hardware‐reconfigurable logic gate based on a single light‐gated memristor and demonstrated both logical disjunction (OR) and conjunction (AND) operations. However, these gates lack an inherent logical negation (NOT) function, an essential part of the spanning set for a complete logic vector space.…”

Bioinspired Robotic Vision with Online Learning Capability and Rotation‐Invariant Properties

“…In this manner, horizontalcell neurotransmitter releases under "center-surround" configurations allow for better accuracy and resolution during real-time image acquisition. This functionality was emulated, through spiking based operation, in the device proposed by Berco et al [13] as opposed to nonvolatile-state transitions. As for data processing, Hubel and Wiesel showed that mammalian neurons in the visual cortex are in fact stimulated by small regions of the visual field known as the Receptive Field.…”