The bolt loosening detection method has been paid attention by engineering and academic scholars. The presented methods only focus on the identification of the bolt based on deep learning, and the problem of bolt localization and the influence of shadow on distortion correction is seldom studied. In this paper, a bolt self-localization method based on YOLOv4 deep learning algorithm is proposed. A bolt numbering rule is established and the deep learning is introduced to identify the number and locate the bolt. A new square bolt gasket is proposed and four corner points are used for distortion correction. In order to reduce the influence of shadows, a grayscale enhancement strategy is proposed to improve the correction stability. Finally, a laboratory flange joint is used to verify the proposed method. The results show that the bolt self-localization method is feasible and the new bolt gasket can effectively improve the stability of distortion correction and bolt loosening detection.