Segmentation of Leaves and Fruits of Tomato Plants by Color Dominance

Optimization processes or methods play an essential role in the continuous improvement of various human activities, particularly in agriculture, given its vital role in food production. In precision agriculture, which utilizes technology to optimize food production, a primary goal is to minimize the consumption of resources like water, fertilizers, and the detection of pests and diseases. In the fertilization process, it is essential to identify any deficiencies or excesses of chemical elements. Nutrient deficiencies, which are essential for plant development, are typically detected in the leaves of crops. This paper proposes a methodology for optimizing the color threshold dominance factors employed in the segmentation process for tomato crop leaves and fruits. The optimization is performed using an interpolation method to find the values that maximize the segmentation of leaves and fruits used by the color dominance segmentation method. A comparison of the interpolation method results with those obtained using a greedy algorithm, which iteratively finds the optimal segmentation values, shows nearly identical outcomes. Similarly, a UNetmodel is used for semantic segmentation, the results of which are inferior to those obtained by the proposed interpolation optimization method. The most significant contribution of the interpolation method is that it requires only a single iteration to generate the initial data, in contrast to the iterative search required by the greedy algorithm and the lengthy training process and video card dependency of the UNet model. This results in an 80% reduction in computation time.

show abstract

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network

Qian,

Liu,

et al. 2024

Agronomy

View full text Add to dashboard Cite

When monitoring crop growth using top-down images of the plant canopies, leaves in agricultural fields appear very dense and significantly overlap each other. Moreover, the image can be affected by external conditions such as background environment and light intensity, impacting the effectiveness of image segmentation. To address the challenge of segmenting dense and overlapping plant leaves under natural lighting conditions, this study employed a Bilayer Convolutional Network (BCNet) method for accurate leaf segmentation across various lighting environments. The major contributions of this study are as follows: (1) Utilized Fully Convolutional Object Detection (FCOS) for plant leaf detection, incorporating ResNet-50 with the Convolutional Block Attention Module (CBAM) and Feature Pyramid Network (FPN) to enhance Region of Interest (RoI) feature extraction from canopy top-view images. (2) Extracted the sub-region of the RoI based on the position of the detection box, using this region as input for the BCNet, ensuring precise segmentation. (3) Utilized instance segmentation of canopy top-view images using BCNet, improving segmentation accuracy. (4) Applied the Varifocal Loss Function to improve the classification loss function in FCOS, leading to better performance metrics. The experimental results on cucumber canopy top-view images captured in glass greenhouse and plastic greenhouse environments show that our method is highly effective. For cucumber leaves at different growth stages and under various lighting conditions, the Precision, Recall and Average Precision (AP) metrics for object recognition are 97%, 94% and 96.57%, respectively. For instance segmentation, the Precision, Recall and Average Precision (AP) metrics are 87%, 83% and 84.71%, respectively. Our algorithm outperforms commonly used deep learning algorithms such as Faster R-CNN, Mask R-CNN, YOLOv4 and PANet, showcasing its superior capability in complex agricultural settings. The results of this study demonstrate the potential of our method for accurate recognition and segmentation of highly overlapping leaves in diverse agricultural environments, significantly contributing to the application of deep learning algorithms in smart agriculture.

show abstract

Segmentation of Leaves and Fruits of Tomato Plants by Color Dominance

Cited by 3 publications

References 45 publications

Optimization of Color Dominance Factor by Greedy Algorithm for Leaves and Fruit Segmentation of Tomato Plants

Optimization of Color Dominance Factor by Greedy Algorithm for Leaves and Fruit Segmentation of Tomato Plants

Color Dominance-Based Polynomial Optimization Segmentation for Identifying Tomato Leaves and Fruits

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network

Contact Info

Product

Resources

About