Design and Test of a Sorting Device Based on Machine Vision

Abstract

At present, the sorting of agricultural products in China mainly relies on manual labour, which results in low efficiency, and the development of corresponding automatic equipment lags behind. The grasping method based on machine vision has been widely used in industry, and can provide a reference for the automatic sorting of agricultural products. In this paper, an automatic sorting device for agricultural products was designed. The grasping mechanism adopted a 4-degree-of-freedom (4-DOF) manipulator, and the machine vision control system adopted a monocular camera, which can realize the positioning and classification of the grasp-target. First, the geometric model of the manipulator was established, and the kinematics model of the manipulator was established via the Denavit-Hartenberg (D-H) parameter method. Next, the kinematics analysis and verification were carried out. Then, Zhang Zhengyou calibration method was used to calibrate the camera. An image processing method based on histogram correction was proposed. Based on this, a target positioning algorithm based on the pinhole imaging principle and a target classification algorithm based on the area threshold were established. Finally, an automatic sorting test platform for agricultural products using a visual servo was built. Target classification, positioning and sorting tests were conducted using tomatoes and oranges as the test objects. The test results show that the success rate of the target positioning is close to 98%, that of the target classification is close to 98% and that of the grasping is close to 95%. Furthermore, the sorting time of a single target object can be as fast as 1 second, which can meet the requirements of automatic sorting for common agricultural products. The automatic sorting device for agricultural products has a simple structure, reliable performance and low costs. The structure and algorithms proposed in this paper are simple, reliable, and highly efficient and thus can easily realize technology transplantation. These relevant methods provide a theoretical reference for the development of an automatic sorting device for agricultural products.

Development of Multi-Robotic Arm System for Sorting System Using Computer Vision

“…They can improve production efficiency and ensure product accuracy [25][26][27][28][29]. For example, industrial robots have been commonly used in industrial production for sorting [30][31][32][33][34]. Wu et al [31] rational degree and type of workpieces at a high rate of speed.…”

“…Based on a 'rule-scene' matching and interaction algorithm, robot can sort the object automatically using the automatic programming and execution algorithm. Zhou et al [34] develop an automatic sorting system for agricultural products using a 4-DOF robot arm and a monocular camera. An image processing method based on histogram correction was proposed for target classification.…”

An automatic alignment method for discharge arm of mobile crushing station based on binocular vision and fuzzy control

“…Binocular stereo vision technology can realize automatic and real-time data interaction, and it has relatively low requirements on equipment and personnel, so it is widely used in non-contact detection and positioning, navigation systems and various aspects of smart cities. The visual positioning system is popular in the automatic packing equipment of agricultural and sideline products (Mehta and Burks, 2014; Posada-Gomez et al, 2015; Zhou et al, 2020). The binocular vision positioning system is welcome in the robot’s positioning and object recognition (Cheng et al, 2017; Tong, 2020; Xie et al, 2011; Zhai et al, 2020).…”

Design of an Automated Control System of a Delta Manipulator With Microcontroller Based Machine Vision

“…These systems are widely and assiduously implemented in many industries. Machine vision in such systems is mostly based on personal computers or single board computers [1][2][3][4][5][6]. The new RISC-V core-based microcontrollers (MCU) show better performance in machine vision tasks than most single board computers [7].…”

“…al. designed and implemented a machine vision based tomato sorting manipulator [1], driven by 4-DOF servo motors. Machine vision is performed on a laptop and a monocular camera.…”