A Vision Transformer network SeedViT for classification of maize seeds

Abstract

Maize is a crop that is widely cultivated all over the world. Thus, the classification of maize seeds quality is important, while the traditional methods based on the texture, shape, and color which require repeated work is not efficient. Recently, deep learning reached the goal in the field of image processing, and a deep convolutional neural network (DCNN) is often used to do the image classification task. Here, we explored another neural network called Vision Transformer (ViT), which originally was applied to the natural language processing. Based on the self‐attention mechanism, ViT discards the convolutional structure. But when trained from scratch on medium‐sized datasets, ViT performed poorly compared to CNN. Due to the lack of local structure within the input image, tokenization cannot be used to generate a valid training set in the original ViT model. As a result, we proposed an improved ViT model SeedViT. Compared with the original ViT which could only train large datasets, SeedViT can train small and medium datasets to achieve SOTA (State of the Art) in vision classification with only 2,500 images in our study. The feasibility of SeedViT to classify maize seeds’ quality was studied in this article, and we compared it with DCNN and traditional machine learning algorithms. The accuracy, sensitivity, specificity, and precision were 97.6%, 94.1%, 98.9%, and 97%, respectively. In addition, we employed ViT and VGG (Visual Geometry Group, a convolutional neural network) to extract image features, and SVM (support vector machine) was used as the classifier to classify them, with the result that ViT‐SVM was stable around 96.6% on the test set and VGG‐SVM was stable around 94.6%. At last, a visual attention map was generated by visualization technology. It showed that SeedViT can be a new and novel way for maize seed manufacturing. Practical applications An algorithm for classifying and sorting out high‐quality maize seeds. Use the Transformer algorithm from the field of natural language processing instead of the convolutional neural network algorithm. Use GeLU function for activation and soft split with images to improve Vision Transformer model so that it can achieve great performance with small and medium datasets.

A Comprehensive Survey of Transformers for Computer Vision

“…The model achieved an accuracy of 83% with 77% precision, 76% recall, and 77% F1-score. In [47], the authors modified the classical ViT and proposed SeedViT for the classification of maize seed quality. They used a custom dataset.…”

Progress in the Application of CNN-Based Image Classification and Recognition in Whole Crop Growth Cycles

“…To address this, researchers have employed self-built or enhanced classification networks using RGB images or MSI of the same crop seeds to identify and screen damaged or imperfect seeds. For instance, five different CNN models [23], an improved VGG model [24], a self-built CNN [25], and an enhanced ResNet model [26] were utilized to identify damaged and imperfect seeds of rice, corn, and wheat, respectively. The classification network effectively screened seed phenotypes during breeding activities.…”

Deep Learning‐Based Classification of Image Data Sets Containing 111 Different Seeds

“…[11] It has been shown that morphological characteristics are more effective than color characteristics in wheat varieties classification. As seen in Table 1, wheat, [12][13][14][15][16] soybean, [17][18][19] rice, [20][21][22][23][24] weed, [9] corn, [25][26][27] and classification of seeds belonging to different plants [10,28] were studied with high classification accuracy. Olgun et al [13] proposed an automated system for wheat grain classification.…”