This paper summarizes the background of the construction of campus video security monitoring system, points out that deep learning has an important impact on the development of campus security monitoring system, and puts forward the design principles and ideas of campus video security system. On the whole, the architecture of campus security monitoring system is constructed. The application of deep learning algorithm to campus security monitoring system will realize the precision of campus security management, improve the ability of campus security emergency command and decision, realize the intelligence of campus security operation, improve the efficiency of campus security work, improve the level of campus security management, and ensure the campus more safe and stable.