To enhance the continuity of character in the preservation of architectural heritage, this approach focuses on the horizontal self-similarity characteristics of architectural texture. A method using K-means and the Bhattacharyya approach for color selection in architectural repairs is proposed. It quantifies the visual coherence between the repaired structure and the original structure. Analyzing 12 images (A–L), with the original façade (image 0) as a reference, demonstrates that repairs using color-matched materials significantly improve visual coherence. Image A, created using the Visual Enhancement Through Adaptive Repair (VETAR) method, achieves the highest visual alignment with the original image. VETAR, grounded in Gestalt psychology, moves away from traditional materials to concentrate on visual consistency. Its successful implementation in the restoration of Mengzhong Fort illustrates a complex approach to material use in heritage conservation. After comparison, this method is deemed superior to traditional techniques, integrating modern interventions with historical aesthetics. The study suggests that VETAR may offer a referential method for architectural conservation, potentially facilitating a balanced integration of historical and contemporary elements in architectural renovation.