Interferometric synthetic aperture radar (InSAR) technology has become one of the mainstream techniques for active landslide identification over a large area. However, the method for interpreting anomalous deformation areas derived from InSAR data is still mainly manual delineation through human–computer interaction. This study focuses on using a deep learning semantic segmentation model to identify the boundaries of anomalous deformation areas automatically. We experimented with the delineation results based on an InSAR deformation map, hot spot map, and different combinations of topographic datasets to build the optimal model. The result indicates that the hot spot map, aspect, and Google Earth image as input features based on the U-Net model can achieve the best performance, with the precision, recall, F1 score, and intersection over union (IoU) being 0.822, 0.835, 0.823, and 0.705, respectively. Our method promotes the development of identifying active landslides using InSAR technology automatically and rapidly at a regional scale. Moreover, applying a new method for automatically and rapidly identifying potential landslides in susceptible areas is necessary for landslide hazard mitigation and risk management.