In this paper, a multistage rain removal optimization algorithm based on residual networks is proposed. The relationship between pixels and the intensity of corresponding background pixels is deduced from the physical process of the image, and the intrinsic features of rainy day images are utilized to form an architecture using a multilevel residual ring to construct a network model for function training, so as to achieve the purpose of rain removal. Through the deep extraction of feature information, combined with the combination of densely connected networks, the rain morphology in the image is captured separately through joint training, so as to obtain rain removal images with different visual effects. The algorithm proposed in this paper is experimentally compared with existing rain removal algorithms, and the subjective and objective evaluation indexes prove that the method proposed in this paper is superior to the existing rain removal methods, which proves that the method proposed in this paper improves the performance of rain removal and the practicality of the existing rain removal task.