In the production and manufacturing industry, factors such as rolling equipment and processes may cause various defects on the surface of the steel plate, which greatly affect the performance and subsequent machining accuracy. Therefore, it is essential to identify defects in time and improve the quality of production. An intelligent detection system was constructed, and some improved algorithms such as dataset enhancement, annotation and lightweight convolution neural network are proposed in this paper. (1) Compared with the original YOLOV5 (You Only Look Once), the precision is 0.924, and the inference time is 29.8 ms, which is 13.8 ms faster than the original model. Additionally, the parameters and calculations are also far less than YOLOV5. (2) Ablation experiments were designed to verify the effectiveness of the proposed algorithms. The overall accuracy was improved by 0.062; meanwhile, the inference time was reduced by 21.7 ms. (3) Compared with other detection models, although RetinaNet has the highest accuracy, it takes the longest time. The overall performance of the proposed method is better than other methods. This research can better meet the requirements of the industry for precision and real-time performance. It can also provide ideas for industrial detection and lay the foundation for industrial automation.