Evaluation of Optimized Preprocessing and Modeling Algorithms for Prediction of Soil Properties Using VIS-NIR Spectroscopy

Self Cite

In contrast with classic bench-top hyperspectral (multispectral)-sensor-based instruments (spectrophotometers), the portable ones are rugged, relatively inexpensive, and simple to use; therefore, they are suitable for field implementation to more closely examine various soil properties on the spot. The purpose of this study was to evaluate two portable spectrophotometers to predict key soil properties such as texture and soil organic carbon (SOC) in 282 soil samples collected from proportional fields in four Canadian provinces. Of the two instruments, one was the first of its kind (prototype) and was a mid-infrared (mid-IR) spectrophotometer operating between ~5500 and ~11,000 nm. The other instrument was a readily available dual-type spectrophotometer having a spectral range in both visible (vis) and near-infrared (NIR) regions with wavelengths ranging between ~400 and ~2220 nm. A large number of soil samples (n = 282) were used to represent a wide variety of soil textures, from clay loam to sandy soils, with a considerable range of SOC. These samples were subjected to routine laboratory soil analysis before both spectrophotometers were used to collect diffuse reflectance spectroscopy (DRS) measurements. After data collection, the mid-IR and vis-NIR spectra were randomly divided into calibration (70%) and validation (30%) sets. Partial least squares regression (PLSR) was used with leave one out cross-validation techniques to derive the spectral calibrations to predict SOC, sand, and clay content. The performances of the calibration models were reevaluated on the validation set. It was found that sand content can be predicted more accurately using the portable mid-IR spectrophotometer and clay content is better predicted using the readily available dual-type vis-NIR spectrophotometer. The coefficients of determination (R2) and root mean squared error (RMSE) were determined to be most favorable for clay (0.82 and 78 g kg−1) and sand (0.82 and 103 g kg−1), respectively. The ability to predict SOC content precisely was not particularly good for the dataset of soils used in this study with an R2 and RMSE of 0.54 and 4.1 g kg−1. The tested method demonstrated that both portable mid-IR and vis-NIR spectrophotometers were comparable in predicting soil texture on a large soil dataset collected from agricultural fields in four Canadian provinces.

Section: Resultssupporting

confidence: 67%

Section: Introductionmentioning

confidence: 99%

Evaluation of Two Portable Hyperspectral-Sensor-Based Instruments to Predict Key Soil Properties in Canadian Soils

Dhawale

Adamchuk

Prasher

et al. 2022

Self Cite

“…In many previous studies, predictive models of SOM, carbon, and nitrogen were developed using the PLSR model, which extracted complex absorption patterns and demonstrated high levels of efficiency when investigating a correlation between patterns and soil [ 17 , 19 , 20 , 21 , 22 ]. Owing to the relationship between spectral data and soil characteristics rarely being linear, studies applying neural networks and machine learning-based ANN, SVR, and random forest have been conducted [ 5 , 23 , 24 ]. Although Vis-NIR spectroscopy is considered a well-established method for estimating soil properties, no accepted universal model currently exists that is widely applied [ 18 ].…”

Section: Introductionmentioning

confidence: 99%

Development of a Soil Organic Matter Content Prediction Model Based on Supervised Learning Using Vis-NIR/SWIR Spectroscopy

Kim

Lee

Choi

et al. 2022

In the current scenario of anthropogenic climate change, carbon credit security is becoming increasingly important worldwide. Topsoil is the terrestrial ecosystem component with the largest carbon sequestration capacity. Since soil organic matter (SOM), which is mostly composed of organic carbon, and can be affected by rainfall, cultivation, and pollutant inflow, predicting SOM content through regular monitoring is necessary to secure a stable carbon sink. In addition, topsoil in the Republic of Korea is vulnerable to erosion due to climate, topography, and natural and anthropogenic causes, which is also a serious issue worldwide. To mitigate topsoil erosion, establish an efficient topsoil management system, and maximize topsoil utilization, it is necessary to construct a database or gather data for the construction of a database of topsoil environmental factors and topsoil composition. Spectroscopic techniques have been used in recent studies to rapidly measure topsoil composition. In this study, we investigated the spectral characteristics of the topsoil from four major rivers in the Republic of Korea and developed a machine learning-based SOM content prediction model using spectroscopic techniques. A total of 138 topsoil samples were collected from the waterfront area and drinking water protection zone of each river. The reflection spectrum was measured under the condition of an exposure time of 136 ms using a spectroradiometer (Fieldspec4, ASD Inc., Alpharetta, GA, USA). The reflection spectrum was measured three times in wavelengths ranging from 350 to 2500 nm. To predict the SOM content, partial least squares regression and support vector regression were used. The performance of each model was evaluated through the coefficient of determination (R2) and root mean square error. The result of the SOM content prediction model for the total topsoil was R2 = 0.706. Our findings identified the important wavelength of SOM in topsoil using spectroscopic technology and confirmed the predictability of the SOM content. These results could be used for the construction of a national topsoil database.

“…Visible and near infrared reflectance (Vis-NIR) spectroscopy has been widely used to rapidly analyze many properties in various types of soils or sediments [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 ]. As the primary chemical attribute, organic carbon in soils or sediments (SOC) is directly related with Vis-NIR reflectance and has been mainly investigated for 20 years [ 13 ].…”

Section: Introductionmentioning

confidence: 99%

“…Studies also showed that ASD spectrometers are the most commonly used in the Vis-NIR spectral analysis due to their good performance and reputation [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 17 , 18 , 19 ]. However, ASD spectrometers are expensive, being a barrier to studies on Vis-NIR spectroscopy [ 13 , 18 ].…”

Section: Introductionmentioning

confidence: 99%

A Method to Evaluate Spectral Analysis by Spectroscopy

Liu

Fan

Qiu

et al. 2022

Visible and near infrared spectroscopy has been widely used to develop a method for rapidly determining organic carbon in soils or sediments (SOC). Most of these studies concentrated on how to establish a good spectral model but ignored how to evaluate the method, such as the use of detection range (max and min), resolution and error for SOC spectral analysis. Here, we proposed a method to evaluate the spectral analysis of SOC. Using 96 sediments sampled in the Yellow Sea and Bohai Sea, China, we established three spectral models of SOC after collecting their spectral reflectance by Agilent Cary 5000, ASD FieldSpec 4 and Ocean Optics QEPro, respectively. For both the calibration set and validation set in each spectrometer, the predicted SOC concentrations followed a distribution curve (function), in which the x-axis was the SOC concentrations. Using these curves, we developed these four technical parameters. The detection ranges were the SOC concentrations where the curve was near to or crossing with the lateral axis, while the detection resolution was the average difference between the two neighboring SOC concentrations. The detection errors were the differences between the predicted SOC and the measured SOC. The results show that these technical parameters were better in the bench-top spectrometer (Cary 5000) than those in the portable spectrometers when analyzing the same samples. For the portable spectrometers, QEPro had a broader detection range and more consistent detection error than FieldSpec 4, suggesting that the low-cost QEPro performed as well as the high-cost FieldSpec 4. This study provides a good example for evaluating spectral analysis by spectroscopy, which can support the development of the spectral method.