To improve the intelligent operation and maintenance of large public building refrigeration stations, various automatic reading methods for pointer meters used in inspection robots have been developed. However, most methods exhibit low detection accuracy for pointer meters in refrigeration stations and poor segmentation of pointers and scale lines, ultimately leading to inaccurate readings. To address the challenges posed by the complex environments of refrigeration stations, this study proposes a deep learning-based image recognition method for precise pointer meter readings. Firstly, the pointer meters in the environment are detected and located by the YOLOV8-CBAM-Wise-IoU model. Secondly, an improved Fast Semantic Segmentation Network (Fast-SCNN) is used for image segmentation of the pointers and scale lines of the pointer meters, and a perspective transformation method is employed to correct images of tilted meters. Then, the image is transformed into a rectangular image using polar coordinate transformation. Finally, the accurate reading is calculated using the distance method, based on the relative distances between the pointers and scale lines. This research conducted experimental tests using an inspection robot in the actual environment of a large public building's refrigeration station. The results demonstrate that the proposed method for pointer meter reading recognition achieves a fiducial error within 0.41%, which can realize the inspection task of the pointer meter in refrigeration stations.