Remote sensing and computer vision technologies are increasingly leveraged for rapid post-disaster building damage assessment, becoming a crucial and practical approach. In this context, the accuracy of employing various AI models in pixel-level change detection methods is significantly dependent on the consistency between pre- and post-disaster building images, particularly regarding variations in resolution, viewing angle, and lighting conditions; in object-level feature recognition methods, the low richness of semantic details of damaged buildings in images leads to a poor detection accuracy. This paper proposes a novel method, OCD-BDA (Object-Level Change Detection for Post-Disaster Building Damage Assessment), as an alternative to pixel-level change detection and object-level feature recognition methods. Inspired by human cognitive processes, this method incorporates three key steps: an efficient sample acquisition for object localization, labeling via HGC (Hierarchical and Gaussian Clustering), and model training and prediction for classification. Furthermore, this study establishes a change detection dataset based on Google Earth imagery of regions in Hatay Province before and after the Turkish earthquake. This dataset is characterized by pixel inconsistency and significant differences in photographic angles and lighting conditions between pre- and post-disaster images, making it a valuable test dataset for other studies. As a result, in the experiments of comparative generalization capabilities, OCD-BDA demonstrated a significant improvement, achieving an accuracy of 71%, which is twice that of the second-ranking method. Moreover, OCD-BDA exhibits superior performance in tasks with small sample amounts and rapid training time. With only 1% of the training samples, it achieves a prediction accuracy exceeding that of traditional transfer learning methods with 60% of samples. Additionally, it completes assessments across a large disaster area (450 km²) with 93% accuracy in under 23 min.