In this study, we addressed the difficulty of systematic and accurate identification and early warning of secondary disaster events after natural disasters. We analyzed the causes of common secondary disaster events, established the correlation between common everyday items and the types of secondary disasters, and constructed six secondary disaster factor datasets, namely, fire, flammable objects, explosive objects, toxic substances, trapped personnel, and dangerous buildings. We proposed a multi-model cluster decision method to extract the secondary disaster factors’ visual features, and we created a ResNet-CDMV image classification algorithm with higher accuracy recognition performance than the traditional single model. The experimental results show that the ResNet-CDMV algorithm in this study has an identification mAP value of 87% for secondary disaster factors. For this algorithm, Faster-RCNN, SSD, CornerNet, and CenterNet, the mAP value of the YOLOv7 object detection algorithm is increased by 9.333%, 11.833%, 13%, 11%, and 8.167%, respectively. Based on the systematic analysis of the formation mechanism of secondary disasters, the high-precision identification method built in this study is applied to the identification and early warning of secondary disasters, which is of great significance in reducing the occurrence of secondary disasters and ensuring the protection of life and property.