In the mining process of underground metal mines, the misjudgment of rock types by on-site technicians will have a serious negative impact on the stability evaluation of rock mass and the formulation of support schemes, which will result in the loss of economic benefits and potential safety hazards of mining enterprises. In order to realize the precise and intelligent identification of rock types, the image data of peridotite, basalt, marble, gneiss, conglomerate, limestone, granite, magnetite quartzite are amplified. Under the target detection framework of Faster R-CNN deep learning, the extraction network based on simplified VGG16 is used to extract and learn features of rock images, and finally the rock type identification system is successfully trained. The experimental verification shows that the system is correct for single-type rock image recognition and the accuracy is more than 96%. In order to realize accurate and intelligent identification of the surrounding rock surface under complex lithological conditions, the multi-type rocks hybrid images are also identified. The results show that the recognition effect is great and the accuracy rate is over 80%. Therefore, this system can accurately identify rock types with similar image features, which proves that the model has strong robustness and generalization ability. It has broad application prospects in rock mass stability evaluation and rock classification in underground mining.