Fast reconstruction method of three-dimension model based on dual RGB-D cameras for peanut plant

Abstract

Background Plant shape and structure are important factors in peanut breeding research. Constructing a three-dimension (3D) model can provide an effective digital tool for comprehensive and quantitative analysis of peanut plant structure. Fast and accurate are always the goals of the plant 3D model reconstruction research. Results We proposed a 3D reconstruction method based on dual RGB-D cameras for the peanut plant 3D model quickly and accurately. The two Kinect v2 were mirror symmetry placed on both sides of the peanut plant, and the point cloud data obtained were filtered twice to remove noise interference. After rotation and translation based on the corresponding geometric relationship, the point cloud acquired by the two Kinect v2 was converted to the same coordinate system and spliced into the 3D structure of the peanut plant. The experiment was conducted at various growth stages based on twenty potted peanuts. The plant traits’ height, width, length, and volume were calculated through the reconstructed 3D models, and manual measurement was also carried out during the experiment processing. The accuracy of the 3D model was evaluated through a synthetic coefficient, which was generated by calculating the average accuracy of the four traits. The test result showed that the average accuracy of the reconstructed peanut plant 3D model by this method is 93.42%. A comparative experiment with the iterative closest point (ICP) algorithm, a widely used 3D modeling algorithm, was additionally implemented to test the rapidity of this method. The test result shows that the proposed method is 2.54 times faster with approximated accuracy compared to the ICP method. Conclusions The reconstruction method for the 3D model of the peanut plant described in this paper is capable of rapidly and accurately establishing a 3D model of the peanut plant while also meeting the modeling requirements for other species' breeding processes. This study offers a potential tool to further explore the 3D model for improving traits and agronomic qualities of plants.

Robust colored point cloud alignment based on L*a*b* guided and Cauchy kernel

“…Additionally, this method exhibits high adaptability and can be applied to the reconstruction of other vegetation or urban landscapes. Liu et al 53 introduced a three‐dimensional model reconstruction method for documenting the height, width, length, and volume of potted peanuts at different growth stages. This method utilizes Kinect cameras to capture depth and color images of peanut plants.…”

A Visual Method of Hydroponic Lettuces Height and Leaves Expansion Size Measurement for Intelligent Harvesting

“…Machine vision technology mainly focuses on 3D point cloud and 2D planar imaging [10,11]. A 3D point cloud obtains the coordinates of targets through high-precision equipment, such as depth cameras and lidar, which have the advantage of being free from perspective distortions [12][13][14]. Currently, studies on the measurement of the phenotypic parameters of lettuces mainly focus on the volume [15], height, diameter, and leaf area [16] of a single lettuce, and there are few studies on those of multiple lettuces.…”

An Efficient and Automated Image Preprocessing Using Semantic Segmentation for Improving the 3D Reconstruction of Soybean Plants at the Vegetative Stage

“…Yadong Liu et al [15] proposed a fast and accurate 3D reconstruction method for peanut plants based on dual RGB-D cameras. Two Kinect V2 cameras were symmetrically placed on both sides of a peanut plant, and the point cloud data obtained were filtered twice to remove noise interference.…”