Remote sensing image open-pit mine monitoring is usually affected by speckle noise, multi-scale and other factors due to the limitations of landform and other conditions, and faces the problem of low availability of monitoring area effect. Therefore, this paper introduces an improved regional convolution neural network method. The network thinning process and the improved conditional random field are proposed respectively as a circular neural network, and the accurate classification and coordinate positioning of the target are completed by establishing the network thinning process in the output part to increase the classification and regression thinning of the target features; Remove the influence of color vector for the fully connected conditional random field and improve it and construct a recurrent neural network for the conditional random field. The experiment shows that the target detection accuracy of the improved Faster-RCNN network has achieved a breakthrough in the mine image detection details, with the overall recognition accuracy of 94.67% and the detection speed of 24.03 fps. Compared with Faster-RCNN, SPP-NET and YOLOV7, it effectively improves the accuracy and provides technical support for ecological restoration monitoring of open pit.