Explainable deep learning in plant phenotyping

Abstract

The increasing human population and variable weather conditions, due to climate change, pose a threat to the world's food security. To improve global food security, we need to provide breeders with tools to develop crop cultivars that are more resilient to extreme weather conditions and provide growers with tools to more effectively manage biotic and abiotic stresses in their crops. Plant phenotyping, the measurement of a plant's structural and functional characteristics, has the potential to inform, improve and accelerate both breeders' selections and growers' management decisions. To improve the speed, reliability and scale of plant phenotyping procedures, many researchers have adopted deep learning methods to estimate phenotypic information from images of plants and crops. Despite the successful results of these image-based phenotyping studies, the representations learned by deep learning models remain difficult to interpret, understand, and explain. For this reason, deep learning models are still considered to be black boxes. Explainable AI (XAI) is a promising approach for opening the deep learning model's black box and providing plant scientists with image-based phenotypic information that is interpretable and trustworthy. Although various fields of study have adopted XAI to advance their understanding of deep learning models, it has yet to be well-studied in the context of plant phenotyping research. In this review article, we reviewed existing XAI studies in plant shoot phenotyping, as well as related domains, to help plant researchers understand the benefits of XAI and make it easier for them to integrate XAI into their future studies. An elucidation of the representations within a deep learning model can help researchers explain the model's decisions, relate the features detected by the model to the underlying plant physiology, and enhance the trustworthiness of image-based phenotypic information used in food production systems.

Analysing the Performance and Interpretability of CNN-Based Architectures for Plant Nutrient Deficiency Identification

“…Notably, VGG-16 exhibited the most reliable localisation of affected regions based on its heatmap quality. Similar to the finding in [51], these visual explanations enhanced our understanding of how models identify nutrient deficiencies by pinpointing the highlighted areas.…”

Fast and Efficient Root Phenotyping via Pose Estimation

“…The adoption of deep learning has drastically improved the accuracy of root segmentation [ 16 , 21 – 25 ]. Despite these advances, two issues remain: (a) annotation for segmentation is intrinsically laborious as pixels must be carefully annotated and (b) downstream skeletonization and instance segmentation have a very low tolerance to errors.…”