Photoelectric memristor has attracted many attentions thanks to their promising potential in optical communication chips and artificial vision systems. However, the implementation of an artificial visual system based on memristive devices remains a considerable challenge because most photoelectric memristors cannot recognize color. Herein, multi‐wavelength recognizable memristive devices based on silver(Ag) nanoparticles (NPs) and porous silicon oxide (SiOx) nanocomposites are presented. Rely on the effects of localized surface plasmon resonance (LSPR) and optical excitation of Ag NPs in SiOx, the set voltage of the device can be gradually reduced. Moreover, the current overshoot problem is alleviated to suppress conducting filament overgrowth after visible light irradiation with different wavelengths, resulting in diverse low resistance states (LRS). Taking advantage of the characteristics of controlled switching voltage and LRS resistance distribution, color image recognition is finally realized in the present work. X‐ray photoelectron spectroscopy (XPS) and conductive atomic force microscopy (C‐AFM) show that the light irradiation plays an important role on resistive switching (RS) process: the photo‐assisted Ag ionization leads to a significant reduction of set voltage and overshoot current. This work provides an effective method toward the development of multi‐wavelength‐recognizable memristive devices for future artificial color vision system.