The purpose is to convert the contents of the grotto murals into a digital vision based on deep learning (DL) and virtual reality (VR) technology to protect the precious grotto murals. The grotto murals are analyzed and modeled by introducing the related concepts of the digital library, using VR technology, and taking the cultural relics data acquisition technology as the basic framework. Then, the cultural relics information collection technology under DL is combined with VR technology, the color and materialization concepts of grotto murals are integrated, and a digital recognition model of grotto mural restoration and simulation is constructed. The color analysis scheme of grotto murals is established. Through the analysis of color and material, the comprehensive recognition rate of this color model can reach 70%, and the material recognition of color painting can also ensure one-to-one restoration. Besides, the model can be applied to the simulation and restoration of grotto murals and provide some help for the protection of grotto murals. This paper has practical application value for the protection and restoration of mural art.