Due to the inconsistent color tones of ancient buildings, the accuracy of model construction is low. In order to improve the fine reconstruction effect of ancient buildings, a multi-angle LiDAR measurement data adaptive fusion model for fine virtual reconstruction of ancient buildings is proposed. Obtain fine data through data collection, preprocess the fine data of the ancient building, set judgment conditions based on the processing results, extract fine feature information of the ancient building from multi angle LiDAR measurement data, and achieve fine virtual reconstruction of the ancient building. The experimental results show that the fine virtual reconstruction scene under the proposed algorithm is clear and complete, and the reconstruction results of the length, width, and height of ancient buildings are consistent with the actual measurement results, with high accuracy and good results.