Grape Berry Detection and Size Measurement Based on Edge Image Processing and Geometric Morphology

Abstract

Counting grape berries and measuring their size can provide accurate data for robot picking behavior decision-making, yield estimation, and quality evaluation. When grapes are picked, there is a strong uncertainty in the external environment and the shape of the grapes. Counting grape berries and measuring berry size are challenging tasks. Computer vision has made a huge breakthrough in this field. Although the detection method of grape berries based on 3D point cloud information relies on scanning equipment to estimate the number and yield of grape berries, the detection method is difficult to generalize. Grape berry detection based on 2D images is an effective method to solve this problem. However, it is difficult for traditional algorithms to accurately measure the berry size and other parameters, and there is still the problem of the low robustness of berry counting. In response to the above problems, we propose a grape berry detection method based on edge image processing and geometric morphology. The edge contour search and the corner detection algorithm are introduced to detect the concave point position of the berry edge contour extracted by the Canny algorithm to obtain the best contour segment. To correctly obtain the edge contour information of each berry and reduce the error grouping of contour segments, this paper proposes an algorithm for combining contour segments based on clustering search strategy and rotation direction determination, which realizes the correct reorganization of the segmented contour segments, to achieve an accurate calculation of the number of berries and an accurate measurement of their size. The experimental results prove that our proposed method has an average accuracy of 87.76% for the detection of the concave points of the edge contours of different types of grapes, which can achieve a good edge contour segmentation. The average accuracy of the detection of the number of grapes berries in this paper is 91.42%, which is 4.75% higher than that of the Hough transform. The average error between the measured berry size and the actual berry size is 2.30 mm, and the maximum error is 5.62 mm, which is within a reasonable range. The results prove that the method proposed in this paper is robust enough to detect different types of grape berries.

Plant Disease Recognition Model Based on Improved YOLOv5

“…In recent years, the rapid development of machine vision and artificial intelligence has accelerated the process of engineering intelligence in various fields, and machine vision technology has also been rapidly improved in industrial, agricultural and other complex scene applications [4][5][6][7][8][9]. In response to the plant disease detection problem, disease detection methods based on visible light and near-infrared spectroscopic digital images have been widely used.…”

Design and Analysis of a Flexible Adaptive Supporting Device for Banana Harvest

“…The flexible supporting device designed in this paper works on the whole banana bunch during harvest, as shown in Figure 2a. Therefore, the parameters of the banana bunch were studied [24,25]. Banana bunches have the following characteristics.…”

Combinations of novel hybrid optimization algorithms‐based trajectory planning analysis for an industrial robotic manipulators

“…Besides, it is applied as a surgical aid in the medical domain (Misra & Singh, 2019). Further, in the agriculture field (Wu et al, 2021), it is used for picking fruits (Luo et al, 2021) and vegetables (Cao et al, 2021; Pambudi et al, 2019). Also, it can find its application even in space exploration.…”