Vision Transformers for Anomaly Detection and Localisation in Leather Surface Defect Classification Based on Low-Resolution Images and a Small Dataset

Abstract

Genuine leather manufacturing is a multibillion-dollar industry that processes animal hides from varying types of animals such as sheep, alligator, goat, ostrich, crocodile, and cow. Due to the industry’s immense scale, there may be numerous unavoidable causes of damages, leading to surface defects that occur during both the manufacturing process and the bovine’s own lifespan. Owing to the heterogenous and manifold nature of leather surface characteristics, great difficulties can arise during the visual inspection of raw materials by human inspectors. To mitigate the industry’s challenges in the quality control process, this paper proposes the application of a modern vision transformer (ViT) architecture for the purposes of low-resolution image-based anomaly detection for defect localisation as a means of leather surface defect classification. Utilising the low-resolution defective and non-defective images found in the opensource Leather Defect detection and Classification dataset and higher-resolution MVTec AD anomaly benchmarking dataset, three configurations of the vision transformer and three deep learning (DL) knowledge transfer methods are compared in terms of performance metrics as well as in leather defect classification and anomaly localisation. Experiments show the proposed ViT method outperforms the light-weight state-of-the-art methods in the field in the aspect of classification accuracy. Besides the classification, the low computation load and low requirements for image resolution and size of training samples are also advantages of the proposed method.

An Anomaly Detection Approach to Determine Optimal Cutting Time in Cheese Formation

“…Attention mechanisms and transformer models, initially proposed for natural language processing tasks, have been adapted for CV and AD. These models can focus on relevant parts of the input data, improving the detection of anomalies in complex scenes [46]. Transformers, with their self-attention layers, have shown remarkable success in modeling dependencies and identifying anomalies in highdimensional data [47].…”

Comparative study on deep-learning-based leather surface defect identification

“…The classification accuracy exceeded 90%. Antony et al [39] proposed the application of modern vision transformer architecture for the purposes of low-resolution image-based anomaly detection for leather surface defect classification.…”

“…Through unified evaluation of each model, a common benchmark is established, which strives to lay a foundation for researchers and engineers to select, design, or implement new schemes for the visual inspection and recognition of leather surface defects. The following classical deep learning models were mainly selected for performance evaluation: AlexNet [32], VGG [39], ReNet [30], GoogleNet [40], DenseNet [41], SqueezeNet [42], and ShuffleNet [43,44]. AlexNet won the 2012 ImageNet competition.…”

Enhancing Anomaly Detection Models for Industrial Applications through SVM-Based False Positive Classification

“…The recent contributions underscore the array of approaches and techniques deployed in the realm of unsupervised visual anomaly detection for industrial applications, laying the foundation for more robust and efficient anomaly detection solutions across diverse industrial settings [24][25][26][27][28][29][30][31][32][33][34][35][36][37]. It is essential to emphasize that, distinct from unsupervised learning in other vision tasks, unsupervised anomaly detection tasks leverage anomaly-free images for training, leading to a paradigm where models inherently operate under the out-of-distribution concept.…”