A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

Abstract

Background Tracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS). Results We calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set. Conclusions PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap.

Open source 3D phenotyping of chickpea plant architecture across plant development

“…This underestimation would also explain the greater overall MAPE for area estimates in our study versus other previously studied crops. A similar discrepancy was reported by Bernotas et al (2019) for Arabidopsis thaliana,…”

An optimality‐based model explains seasonal variation in C3 plant photosynthetic capacity

“…(e.g., μmol/mol) to pressure unit (Pa). All of them refer to growing season or monthly mean values in existing optimality-based models (Bernotas et al, 2019;Bloomfield et al, 2018;.…”

Gene Regulatory Network Inference: Connecting Plant Biology and Mathematical Modeling

“…At the phenotypic level, ML systems have been used to analyze images for rapid phenotyping (Gonzalez-Sanchez et al, 2014;Sommer et al, 2017). Computer vision systems using ML have been used to track Arabidopsis growth and movement through day-night cycles, extracting patterns of movement and growth, automating extraction of phenotypic information (Bernotas et al, 2019). In another example, linear regression, support vector machines (SVMs), artificial neural networks (ANNs), random forest regression, and stochastic gradient boosting were tested for accuracy and robustness in yield prediction in almonds using orchard images, orchard-specific attributes, and weather data.…”