Wall bulge maintenance and repairing is an essential task for autonomous decoration robots. The problem of the wall bulge endpoints regression refers to identifying the position of the wall bulge endpoints in spatial coordinates. This problem is of significant importance for autonomous decoration robots as these robots target automatic maintenance and repairing of wall bulges, they must automatically recognize where to start and stop the repairing process. Training deep convolutional neural networks for supervised computer vision tasks requires a large number of annotated images. Since gathering annotated images for this task is difficult, laborious, and time-consuming, we proposed a model for detecting the wall bulge endpoints position based on deep transfer learning. Our proposed model is capable of classifying the wall bulge into one of four classes according to its orientation. Deep transfer learning transfers the knowledge acquired by deep learning models trained for a specific task and domain to another different but related task and domain. Our proposed model is mainly based on deep convolutional neural networks pre-trained on large datasets for tasks of object classification and detection. We transfer the knowledge acquired by the model from these tasks to solve both problems in our new task.