“…Because of practical applications, such as industrial inspection or medical diagnosis, defect detection [9,5] has received lots of attention. The initial steps have been taken with methods including autoencoding [9,7,25,59], generative adversarial networks [48,3], using pretrained models on ImageNet [38,45,6,14,43,44], and self-supervised learning by solving different proxy tasks with augmentations [61,47,57,15]. The proposed CutPaste prediction task is not only shown to have strong performance on defect detection, but also amenable to combine with existing methods, such as transfer learning from pretrained models for better performance or patch-based models for more accurate localization, which we demonstrate in Section 4.…”