Continuous Scanning Laser Doppler Vibrometry (CSLDV) enables fast and full-field vibration measurement in an intact area of a structure. This paper further proposes a novel adaptive CSLDV method that can obtain the Operational Deflection Shapes (ODS) and mode shape of structures with holes. Firstly, an adaptive path planning method is applied to the surface of the tested structure, which can automatically adapt to the size and position of round and square holes, as well as the resolution requirements for the measurement. Secondly, based on the symmetry and other characteristics of the planned path, the time domain signal is processed by delay optimization and demodulation to obtain the ODS of each vibration mode. Finally, a modal test is conducted on a flat structure with a square and circle holes as an example. A validation experiment is also performed using SLDV. The results show that the mode shapes obtained from both methods are consistent and the Modal Assurance Criterion (MAC) between them are all above 0.96. The method can realize CSLDV of flat plate structures with arbitrary square and round holes, and has the advantages of high efficiency and dense measurement points, which enhances its engineering applicability.