Chimera: A Multi-Task Recurrent Convolutional Neural Network for Forest Classification and Structural Estimation

Abstract

More consistent and current estimates of forest land cover type and forest structural metrics are needed to guide national policies on forest management, carbon sequestration, and ecosystem health. In recent years, the increased availability of high-resolution (<30 m) imagery and advancements in machine learning algorithms have opened up a new opportunity to fuse multiple datasets of varying spatial, spectral, and temporal resolutions. Here, we present a new model, based on a deep learning architecture, that performs both classification and regression concurrently, thereby consolidating what was previously several independent tasks and models into one stream. The model, a multi-task recurrent convolutional neural network that we call the Chimera, integrates varying resolution, freely available aerial and satellite imagery, as well as relevant environmental factors (e.g., climate, terrain) to simultaneously classify five forest cover types (`conifer’, `deciduous’, `mixed’, `dead’, `none’ (non-forest)) and to estimate four continuous forest structure metrics (above ground biomass, quadratic mean diameter, basal area, canopy cover). We demonstrate the performance of our approach by training an ensemble of Chimera models on 9967 georeferenced (true locations) Forest Inventory and Analysis field plots from the USDA Forest Service within California and Nevada. Classification diagnostics for the Chimera ensemble on an independent test set produces an overall average precision, recall, and F1-score of 0.92, 0.92, and 0.92. Class-wise F1-scores were high for `none’ (0.99) and `conifer’ (0.85) cover classes, and moderate for the `mixed’ (0.74) class samples. This demonstrates a strong ability to discriminate locations with and without trees. Regression diagnostics on the test set indicate very high accuracy for ensembled estimates of above ground biomass ( R 2 = 0 . 84 , RMSE = 37 . 28 Mg/ha), quadratic mean diameter ( R 2 = 0 . 81 , RMSE = 3 . 74 inches), basal area ( R 2 = 0 . 87 , RMSE = 25 . 88 ft 2 /ac), and canopy cover ( R 2 = 0 . 89 , RMSE = 8 . 01 percent). Comparative analysis of the Chimera ensemble versus support vector machine and random forest approaches demonstrates increased performance over both methods. Future implementations of the Chimera ensemble on a distributed computing platform could provide continuous, annual estimates of forest structure for other forested landscapes at regional or national scales.

Weed Identification in Maize, Sunflower, and Potatoes with the Aid of Convolutional Neural Networks

“…For distinguishing between many classes, a large and robust dataset is required, which is a time-consuming task [25,30,31,48]. In cases where authors have tried to achieve multi-class weed and plant classification, their classification accuracy dropped under 90% [6,49].…”

Use of Remote Sensing Data to Improve the Efficiency of National Forest Inventories: A Case Study from the United States National Forest Inventory

“…Hogland et al [192] used NAIP and its derivatives with FIA data to tree density and basal area for portions of Georgia, Alabama and Florida, and cited the need to download NAIP imagery for local processing as being one time-consuming element of the project. To circumvent this challenge, Chang et al [193] streamlined pre-processing and acquisition of NAIP imagery by using the cloud-based GEE platform in a project that relied on machine learning to map several FIA attributes in California and Nevada.…”

Context-Aware Human Activity and Smartphone Position-Mining with Motion Sensors

“…Multi-Task Learning (MTL) is a learning paradigm in machine learning and its purpose is to take advantage of useful information contributed by multiple related tasks to improve the generalization performance of all the tasks [11]. MTL has shown significant advantage to single-task learning because of its ability to facilitate knowledge sharing between tasks [31], e.g., bioinformatics and health informatics [32,33], web applications [34,35] and remote sensing [36][37][38].…”