Research on the Detection Method of Organic Matter in Tea Garden Soil Based on Image Information and Hyperspectral Data Fusion

Zhang, Haowen; He, Qinghai; Yang, Chongshan; Lu, Min; Liu, Zhongyuan; Zhang, Xiaojia; Li, Xiaoli; Dong, Chunwang

doi:10.3390/s23249684

Cited by 3 publications

(1 citation statement)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After multiple training iterations, the model's performance is gradually improved. Before modeling, the spectral data were preprocessed using the Savitzky-Golay (SG) [34][35][36] and standard normalized variate (SNV) [37][38][39] algorithm to remove noise and background effects from the spectral data. Through leave-one-out cross-validation and sk cross-validation with 2-fold, 5-fold, and 10-fold configurations, we identified the optimal cross-validation approach for the current dataset.…”

Section: Convolutional Autoencodermentioning

confidence: 99%

QPWS Feature Selection and CAE Fusion of Visible/Near-Infrared Spectroscopy Data for the Identification of Salix psammophila Origin

Ma,

Li,

Peng

et al. 2023

Forests

View full text Add to dashboard Cite

Salix psammophila, classified under the Salicaceae family, is a deciduous, densely branched, and erect shrub. As a leading pioneer tree species in windbreak and sand stabilization, it has played a crucial role in combating desertification in northwestern China. However, different genetic sources of Salix psammophila exhibit significant variations in their effectiveness for windbreak and sand stabilization. Therefore, it is essential to establish a rapid and reliable method for identifying different Salix psammophila varieties. Visible and near-infrared (Vis-NIR) spectroscopy is currently a reliable non-destructive solution for origin traceability. This study introduced a novel feature selection strategy, called qualitative percentile weighted sampling (QPWS), based on the principle of the long tail effect for Vis-NIR spectroscopy. The core idea of QPWS combines weighted sampling and percentage wavelength selection to identify key wavelengths. By employing a multi-threaded parallel execution of multiple QPWS instances, we aimed to search for the optimal feature bands to address the instability issues that can arise during the feature selection process. To address the problem of reduced prediction performance in one-dimensional convolutional neural network (1D-CNN) models after feature selection, we have introduced convolutional autoencoders (CAEs) to reduce the dimensions of wavelengths that are discarded during feature selection. Subsequently, these reduced dimensions are fused with the selected wavelengths, thereby enhancing the model’s performance. With our completed model, we selected outstanding models for model fusion and established a decision system for Salix psammophila. It is worth noting that all 1D-CNN models in this study were developed using Bayesian optimization methods. In comparison with principal component analysis (PCA) and full spectrum methods, QPWS exhibits superior predictive performance in the field of machine learning. In the realm of deep learning, the fusion of data combining QPWS with CAE demonstrated even greater potential with an improvement of average accuracy of approximately 2.13% when compared to QPWS alone and a 228% increase in operational speed compared to a model with full spectra. These results indicated that the combination of CAE with QPWS can be an effective tool for identifying the origin of Salix psammophila.

show abstract