Deep Learning-Based Segmentation of Peach Diseases Using Convolutional Neural Network

Abstract

Peach diseases seriously affect peach yield and people’s health. The precise identification of peach diseases and the segmentation of the diseased areas can provide the basis for disease control and treatment. However, the complex background and imbalanced samples bring certain challenges to the segmentation and recognition of lesion area, and the hard samples and imbalance samples can lead to a decline in classification of foreground class and background class. In this paper we applied deep network models (Mask R-CNN and Mask Scoring R-CNN) for segmentation and recognition of peach diseases. Mask R-CNN and Mask Scoring R-CNN are classic instance segmentation models. Using instance segmentation model can obtain the disease names, disease location and disease segmentation, and the foreground area is the basic feature for next segmentation. Focal Loss can solve the problems caused by difficult samples and imbalance samples, and was used for this dataset to improve segmentation accuracy. Experimental results show that Mask Scoring R-CNN with Focal Loss function can improve recognition rate and segmentation accuracy comparing to Mask Scoring R-CNN with CE loss or comparing to Mask R-CNN. When ResNet50 is used as the backbone network based on Mask R-CNN, the segmentation accuracy of segm_mAP_50 increased from 0.236 to 0.254. When ResNetx101 is used as the backbone network, the segmentation accuracy of segm_mAP_50 increased from 0.452 to 0.463. In summary, this paper used Focal Loss on Mask R-CNN and Mask Scoring R-CNN to generate better mAP of segmentation and output more detailed information about peach diseases.

High-Precision Peach Fruit Segmentation under Adverse Conditions Using Swin Transformer

“…The primary advantage of the presented dataset is the focus on detailed and complex segmentation scenarios that reflect real field environments because almost all existing datasets for segmentation provide simpler images with large and distinct fruits [3,5,11,31]. This level of detail is unprecedented and offers an invaluable resource for training more sophisticated fruit segmentation algorithms.…”

Deep learning implementation of image segmentation in agricultural applications: a comprehensive review

“…Nagaraju et al (2022) proposed two learning algorithms, the image preprocessing and transformation algorithm and the image masking and REC-based hybrid segmentation algorithm (IMHSA), to solve the problem of limited data sets and overfitting of convolutional neural network models in the classification process. Yao et al (2022) implemented Mask R-CNN and Mask Scoring R-CNN for the segmentation and identification of peach diseases. Utilizing instance segmentation models enables the extraction of disease names, locations, and segmentations, with the foreground area serving as the fundamental feature for subsequent segmentation.…”

“…Disease stage identification and labeling inconsistency are the two main challenges of image segmentation applied to plant diseases. Early, mid, and late stage diseases may appear similar in images, which makes it difficult to utilize image data for disease stage identification (Yao et al 2022). Simultaneously, variable criteria for determining disease type and severity may result in inconsistent labeling of training datasets.…”

Semantic segmentation of microbial alterations based on SegFormer

“…Notably, Convolutional Neural Networks (CNNs) have been extensively utilized in tasks related to the segmentation of agricultural diseases. They have proven instrumental in enhancing the precision of disease spot identification and significantly expanding the range of potential applications ( Jiang et al., 2020 ; Craze et al., 2022 ; Yao et al., 2022 ; Yong et al., 2023 ).…”