Vehicle-mounted inspection systems have been developed to perform daily inspections of tunnel lining. However, it is difficult to continuously scan images at the desired target angle with the camera’s limited visual field because the vehicle does not always maintain the same position in the car lane while it runs. In this study, we propose a calibration-free optical self-localization method based on white line recognition, which can stabilize the scanning angle and thus enable the scanning of the entire tunnel lining surface. Self-localization based on the present method has a processing time of 27.3 ms, making it valid for real-time view angle compensation inside tunnels, where global positioning systems cannot operate. It is robust against changes in brightness at tunnel entrances and exits and capable of dealing with car lanes with dotted lines and regular white lines. We confirmed that it is possible to perform self-localization with 97.4% accuracy using the scanned data of white lines captured while the vehicle is running. When this self-localization was combined with an inspection system capable of motion blur correction, we were able to sequentially scan the tunnel lining surface at a stable camera angle at high speed, and it was shown that the acquired images could be stitched together to produce an expansion image that can be used for inspection.