Classification of Maize Lodging Extents Using Deep Learning Algorithms by UAV-Based RGB and Multispectral Images

Abstract

Lodging depresses the grain yield and quality of maize crop. Previous machine learning methods are used to classify crop lodging extents through visual interpretation and sensitive features extraction manually, which are cost-intensive, subjective and inefficient. The analysis on the accuracy of subdivision categories is insufficient for multi-grade crop lodging. In this study, a classification method of maize lodging extents was proposed based on deep learning algorithms and unmanned aerial vehicle (UAV) RGB and multispectral images. The characteristic variation of three lodging extents in RGB and multispectral images were analyzed. The VGG-16, Inception-V3 and ResNet-50 algorithms were trained and compared depending on classification accuracy and Kappa coefficient. The results showed that the more severe the lodging, the higher the intensity value and spectral reflectance of RGB and multispectral image. The reflectance variation in red edge band were more evident than that in visible band with different lodging extents. The classification performance using multispectral images was better than that of RGB images in various lodging extents. The test accuracies of three deep learning algorithms in non-lodging based on RGB images were high, i.e., over 90%, but the classification performance between moderate lodging and severe lodging needed to be improved. The test accuracy of ResNet-50 was 96.32% with Kappa coefficients of 0.9551 by using multispectral images, which was superior to VGG-16 and Inception-V3, and the accuracies of ResNet-50 on each lodging subdivision category all reached 96%. The ResNet-50 algorithm of deep learning combined with multispectral images can realize accurate lodging classification to promote post-stress field management and production assessment.

Recognition and localization of maize leaves in RGB images based on Point-Line Net

“…(2) introduced a new and lightweight architecture called DLMC-Net, which demonstrated the capability of real-time agricultural applications in detecting plant leaf diseases across multiple crops. (3) developed a deep-learning-based classification method to evaluate the extent of maize lodging using RGB and multi-spectral images captured by unmanned aerial vehicles (UAVs). They analyzed the characteristic variations exhibited in RGB and multi-spectral images, corresponding to three different lodging extents.…”

Research on a Multi-Lens Multispectral Camera for Identifying Haploid Maize Seeds

“…However, the data acquisition of HIS is slow and its cost is high. MSI is similar to HSI, and the key difference is that MSI only obtains spectral images under characteristic wavelengths [35][36][37][38]. The acquisition is fast, and the cost is greatly reduced.…”

Evaluation of the ability to measure morphological structures of plants obtained from tissue culture applying image processing techniques

“…Over the last few years, the studies on the classi cation of RGB images obtained from drones have been discussed more in agriculture and natural resource management (Arif et al, 2017;Meng et al, 2021, Kim et al, 2020 to separate weeds from trees, different varieties of plants (Malamiri et al, 2021;Yang et al, 2022;Tan et al 2021). However, remote sensing and image processing science have been used measly in laboratory and micro-scale environments (Ibaraki & Kenji, 2001).…”