The Detection Method of Potato Foliage Diseases in Complex Background Based on Instance Segmentation and Semantic Segmentation

Abstract

Potato early blight and late blight are devastating diseases that affect potato planting and production. Thus, precise diagnosis of the diseases is critical in treatment application and management of potato farm. However, traditional computer vision technology and pattern recognition methods have certain limitations in the detection of crop diseases. In recent years, the development of deep learning technology and convolutional neural networks has provided new solutions for the rapid and accurate detection of crop diseases. In this study, an integrated framework that combines instance segmentation model, classification model, and semantic segmentation model was devised to realize the segmentation and detection of potato foliage diseases in complex backgrounds. In the first stage, Mask R-CNN was adopted to segment potato leaves in complex backgrounds. In the second stage, VGG16, ResNet50, and InceptionV3 classification models were employed to classify potato leaves. In the third stage, UNet, PSPNet, and DeepLabV3+ semantic segmentation models were applied to divide potato leaves. Finally, the three-stage models were combined to segment and detect the potato leaf diseases. According to the experimental results, the average precision (AP) obtained by the Mask R-CNN network in the first stage was 81.87%, and the precision was 97.13%. At the same time, the accuracy of the classification model in the second stage was 95.33%. The mean intersection over union (MIoU) of the semantic segmentation model in the third stage was 89.91%, and the mean pixel accuracy (MPA) was 94.24%. In short, it not only provides a new model framework for the identification and detection of potato foliage diseases in natural environment, but also lays a theoretical basis for potato disease assessment and classification.

Research on Polygon Pest-Infected Leaf Region Detection Based on YOLOv8

“…They trained it using super-resolution, enhancing performance in instance segmentation for pest detection. In addition, Li et al [33] proposed an integrated framework that combines instance segmentation, classification, and semantic segmentation models. This framework enabled the accurate segmentation and detection of potato leaf diseases.…”

Application of deep learning in medical imaging segmentation

“…By using semantic segmentation, this technique may give each pixel of a digital image a class name, such as "tree," "sign," "pedestrian," "road," "structure," etc [4]. It is also considered to be a pixel-level image classification problem since it requires the ability to distinguish between various items in an image [4]. Before employing features to create various categories in an image, semantic segmentation seeks to extract features from the picture.…”

A Two-Stage Approach to the Study of Potato Disease Severity Classification

“…While this method is fast, it can only achieve the segmentation of a single case, and the evaluation accuracy is not high. Xudong Li et al [30] combined an image classification model and a semantic segmentation model to effectively segment and detect potato leaf diseases amid complex backgrounds. They initiated the process by utilizing the Mask R-CNN instance segmentation technique to segment potato leaves within the image.…”