Environment‐Adaptable Artificial Visual Perception Behaviors Using a Light‐Adjustable Optoelectronic Neuromorphic Device Array

Abstract

Emulating the biological visual perception system typically requires a complex architecture including the integration of an artificial retina and optic nerves with various synaptic behaviors. However, self‐adaptive synaptic behaviors, which are frequently translated into visual nerves to adjust environmental light intensities, have been one of the serious challenges for the artificial visual perception system. Here, an artificial optoelectronic neuromorphic device array to emulate the light‐adaptable synaptic functions (photopic and scotopic adaptation) of the biological visual perception system is presented. By employing an artificial visual perception circuit including a metal chalcogenide photoreceptor transistor and a metal oxide synaptic transistor, the optoelectronic neuromorphic device successfully demonstrates diverse visual synaptic functions such as phototriggered short‐term plasticity, long‐term potentiation, and neural facilitation. More importantly, the environment‐adaptable perception behaviors at various levels of the light illumination are well reproduced by adjusting load transistor in the circuit, exhibiting the acts of variable dynamic ranges of biological system. This development paves a new way to fabricate an environmental‐adaptable artificial visual perception system with profound implications for the field of future neuromorphic electronics.

Ion‐Gated Transistor: An Enabler for Sensing and Computing Integration

“…Reproduced with permission. [ 184 ] Copyright 2019, John Wiley & Sons. d) Optoelectronic synapse and electronic neuromuscular system.…”

“…Sung et al provide an artificial visual device to emulate the light‐adaptable functions of visual systems (Figure 9c). [ 184 ] This artificial visual system consists of a photovoltaic divider and an IGT, which play the roles of artificial retina and optic synapse, respectively. Particularly, the photovoltaic divider consisting of CdSe photosensor and an IGZO load transistor is designed to transform the visible light information into electrical output signals.…”

“…Because the IGT itself can be regarded as a synaptic device to process the collected data directly, it can greatly reduce the power consumption (≈nW μm −2 ) of the whole system. [ 184 ] However, the computing speed, integration, and endurance of IGT‐based near‐sensor computing systems are still far from the level of CMOS‐based near‐sensor computing systems and need to be further improved.…”

Neuromorphic Engineering for Hardware Computational Acceleration and Biomimetic Perception Motion Integration

“…To this end, photoelectric memristive neuromorphic devices and arrays have been developed to simulate the photopic and scotopic modulation and mixed color recognition capabilities of visual perception. [ 194 ]…”

Run-off election-based decision method for the training and inference process in an artificial neural network

“…The artificial neural network (ANN), which consists of a synaptic device unit capable of both processing and memory functions, has attracted great interest as a brain-inspired analog computing architecture that can efficiently address unstructured complex tasks [1][2][3][4][5][6][7][8][9] . Particularly, the ANN-based computing system for big data processing covers various application ranges, such as for image 10,11 or voice 12 recognition, signal spectrum analysis 13,14 , convolution filtering 15 and use in visual perception systems 16,17 . The conductance modulation capability of a constitutive artificial synaptic node in the ANN can reconfigure the synaptic weight matrix under a learning rule, which is analogous to the essentials of neural plasticity in the human brain.…”