Identifying bridge damage using a movable test vehicle is highly regarded for its mobility, cost-effectiveness, and broad monitoring coverage. Previous studies have shown that the residual contact-point (CP) response between connected vehicles is free of the impact of vehicle self-vibrations and road roughness, making it particularly suitable for the indirect extraction of bridge modal properties. However, most experimental campaigns regarding contact-point (CP) responses focus on a single-axle testing vehicle within a non-moving state. This study aims to theoretically and experimentally identify bridge damage using the instantaneous amplitude squared (IAS) extracted from the residual CP response of a two-axle passing vehicle. First, the closed-form solution of the residual CP acceleration was derived for a two-axle vehicle interacting with a simply supported beam. The IAS index was constructed from the driving frequency of the residual CP acceleration. Then, numerical investigations using finite element simulation were conducted to validate using the IAS index for indirect bridge damage identification. The application scope of the approach under various vehicle speeds and road roughness grades was examined. Finally, a laboratory vehicle–bridge interaction system was tested to validate the approach. Numerical studies demonstrated that bridge damage could be directly determined by observing the IAS abnormalities, which were baseline-free. The IAS from the residual CP response outperformed the IAS from CP responses in identifying bridge damage. However, it was better to use the IAS when the vehicle speed was no greater than 2 m/s and the grade of the road surface roughness was not high. Laboratory tests showed that it was possible to identify bridge damage using the IAS extracted from the residual CP acceleration under perfect road surfaces. However, it fell short under rough road surfaces. Hence, further experiments are required to fully examine the capacity of the IAS for bridge damage identification in practical applications.