Prediction of Soil Available Boron Content in Visible-Near-Infrared Hyperspectral Based on Different Preprocessing Transformations and Characteristic Wavelengths Modeling

Zhu, Juanjuan; Jin, Xiu; Li, Shaowen; Han, Yalu; Zheng, Wenrui

doi:https://doi.org/10.1155/2022/9748257

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Materials and Methods Results and Discussion Discussion Conclusions Data Availability Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Exploration of Human Cognition using Artificial Intelligence in Healthcare

View this Special Issue

Research Article | Open Access

Volume 2022 | Article ID 9748257 | https://doi.org/10.1155/2022/9748257

Prediction of Soil Available Boron Content in Visible-Near-Infrared Hyperspectral Based on Different Preprocessing Transformations and Characteristic Wavelengths Modeling

Juanjuan Zhu,¹Xiu Jin,^1,2Shaowen Li ,^1,2Yalu Han,¹and Wenrui Zheng¹

Academic Editor: Arpit Bhardwaj

Received16 May 2022

Accepted20 Jun 2022

Published11 Aug 2022

Abstract

The trace element boron (Boron, B) is an important factor in crops’ development, pollination, and fertilization. Available boron (AB) in soil is the main source of boron nutrient absorption for crops. Rapid detection of AB is of great significance for crop nutrition diagnosis, soil testing and fertilization, precision agriculture development, scientific production management, and guarantee of stable yield and high quality. In this study, we propose a new method to predict soil available boron content using handheld nonimaging hyperspectroscopy in the visible-near-infrared range (350–1655 nm). As boron content is one of the fewest soil chemical elements, a rapid and accurate method has yet to be developed to detect and quantify the soil available boron. Visible-near-infrared ray (VIS-NIR) spectroscopy is widely utilized in the detection and quantification of soil available nutrients. There is, however, scant research on the detection of soil boron based on NIR data, and the performance of current regression model is still far from satisfactory. Our soil samples were collected from southern Anhui, China, with their NIR spectroscopy examined and the NIR data pretreated by 29 transformations and modeled with 10 regression algorithms. Of all the tested methods, SVM_RBF, BPNN, and PLS_RBF algorithms demonstrated the best performance and gave 0.80∼0.82 coefficient of determination value. At the same time, Random Forest algorithm (RFA), Successive Projection Algorithm (SPA), and Variable Importance in Projection (VIP) were used to extract the spectral characteristic wavelength data of soil available boron, and then the characteristic wavelength data were modeled with three regression algorithms: SVM_RBF, PLS_RBF, and BPNN. A comparative analysis of the prediction performance (, RPD, RMSE, and RPIQ) of the models established at the full band showed that the RFA-MSC/BPNN model achieved the best performance. Compared with the best full-wavelength model DT/SVM_RBF, the test set achieved a 3.06% increase in , a 7.12% drop in RMSE, a 7.71% gain in RPD, and a 7.78% increase in RPIQ. Our work sheds lights on how to achieve rapid quantification of the soil available boron concentration.

1. Introduction

As an essential trace element, boron plays a pivotal role in flowering, fertilization, yield boosting, and quality of crop produce [1]. In coarse-textured sandy calcareous soils, boron can serve as one of the key limiting micronutrients. Boron deficiency can be a major constraint on crop production [2] and is reported in >80 countries for at least 132 crops over the past 70 years [3]. Boron deficiency is a global phenomenon and is recognized as the second most essential micronutrient constraint on crops [4]. Researches demonstrated that 21% of the studied soils across 14 countries were boron deficient [5]. As boron content is usually the least among all the chemical elements in soil, a rapid and accurate detection of the soil available boron carries special weight. However, currently soil available boron detection methods (such as curcumin method and azomethine-H method) mainly depend on chemical analysis and thus are prone to low detection efficiency, high cost, sample damage, and potential environmental pollution.

Hyperspectroscopy mainly uses the characteristics of electromagnetic energy to analyze soil properties. Visible-near-infrared light is a kind of electromagnetic wave, and near-infrared spectroscopy is generated by vibrational and rotational energy level transitions in the internal movement of molecules. Present in boric acid molecules and boric acid ions, the soil available boron is mainly water-soluble and adsorbable by organic matters, which have unique spectral characteristics. Visible-near-infrared ray (VIS-NIR) spectroscopy can provide a nondestructive, real-time, rapid method to detect the physical and chemical properties in crops and soil [6]. VIS-NIR, therefore, is widely utilized in agriculture in monitoring the organic compounds and mineral nutrients.

VIS-NIR spectroscopy of soil nutrient elements mainly focuses on organic matter (OM), nitrogen (N), carbon (C), and water, and only a few studies have focused on the quantitative prediction of soil available boron. Mouazen et al. performed partial least square linear regression (PLSR), principal component regression (PCR), and back-propagation neural network (BPNN) comparative analysis on the accuracy of VNIR spectroscopy (350–2500 nm) in measuring soil properties, using 168 soil samples collected in Belgium and France for organic carbon (OC), phosphorus (P), potassium (K), sodium (Na), and magnesium (Mg). It was found that the prediction models of various attributes established by using the latent variables of PLS combined with BPNN were better than the PLSR and PCR models, and the PCR effect was the worst. Among them, the model accuracy of OC and Mg was higher, and the R² values of the prediction results were 0.84 and 0.82, respectively; the RPD value was both 2.54 while the K, Na, and P models have R² = 0.68–0.74 and RPD = 1.77–1.94; and the prediction effect is average [7]. Tarin et al. compared partial least squares discriminant analysis (PLS-DA), random forest (RFA), SG Simple Smoothing (SGS), SG Smoothed First Derivative (SG1D), SG Smoothed Second Derivative (SG2D), Mean Centering (MC), Standard Normal Transformation (SNV), Multiple Scatter Correction (MSC), Generalized Least Squares Weighting (GLSW), SG1D + SNV, and MSC + SG2D + MC. The soil spectral modeling performance of SGS + AS + GLSW with 10 different pretreatment transformations was evaluated for SOM, pH, , , and other soil properties in the Negev Desert of Israel. Results show that the GLSW-based model has relatively good classification accuracy, and both PLS-DA and RF are suitable for spectral modeling analysis [8]. Tahmasbian et al. utilized laboratory-based hyperspectral image (400–1000 nm) analysis to predict soil C, N, and their isotopic compositions; the PLSR models gave coefficient of determination () > 0.8 for all tested compositions [9]. Tamburini group examined the eﬀects of moisture and particle size on quantitative determination of total organic carbon (TOC) in soils by near-infrared spectroscopy and discovered that standard normal variate (SNV) and second derivatives combined with the PLSR regression algorithm gave the best prediction [10]. Padarian et al. used a deep convolutional neural network (CNN) to establish NIR calibration models for OC, TN, cation exchange capacity (CEC), pH, clay, and sand content in soil and found that CNN had higher model accuracy compared with traditional models [11]. Qi et al. used VNIR spectra (350–2500 nm) data based on regularized linear multitask learning (LMTL) algorithm to model and predict available N, P and K, pH, water content (WC), OM, and electrical conductivity (EC). The performance of LMTL model was compared with the commonly used single-task algorithm model index based on PLSR, which shows that LMTL can further improve the generalization ability of regression model to predict soil properties [12]. Jin et al. utilized VIS-NIR spectroscopy for prediction of soil available K content and uncovered that the boosting algorithms (GBRT and AdaBoost) demonstrated the best [13].

Though NIR has attracted enormous attention and has been studied intensively in soil disciplines over the past decades [14], the accuracy and universality of the VIS-NIR model to predict soil available minerals is still not satisfactory, especially for trace element content. Currently, Malmir et al. reported the utilization of hyperspectral imaging (400–1000 nm) technique to analyze the boron content in sieved and ground air-dried soils, modeled by the PLSR algorithm, and reached of 0.62 and 0.53 in sieved and ground soils, respectively [15]. Airborne HSI and laboratory mid-infrared spectroscopy (2500–25,000 nm) generated of 0.17∼0.30 for soil boron prediction [16, 17]. In contrast, the best model for As prediction can be achieved with 5 latent variables in PLS models and yielded Pearson’s coefficient, RMSE, RPD, and SEP of 0.94, 69.65, 2.9, and 66.99, respectively [18].

In this study, a total of 188 yellow loam samples were collected from Anhui province, China. The nonimaging VIS-NIR spectrum was examined by indoor analysis, and the boron content was determined by chemical analysis. The spectrum data were transformed by 29 preprocessing methods, including detrend correction and Savitzky–Golay (SG) convolution smoothing and further modeled by 10 regression algorithms, such as elastic net, ridge, and support vector machine (SVM). The original spectra were preprocessed by DT, MSC, and SG + SNV + DT, respectively. Then, three different variable selection algorithms (RFA, SPA, and VIP) [19–21] were used to select a small number of characteristic wavelengths, and SVM_RBF, BPNN, and PLS_RBF were combined to establish nine models for comparative analysis. The established models were evaluated for the prediction of soil available boron by , ratio of performance of deviation, ratio of performance to IQ, etc. for the model’s accuracy, reliability, and stability. Our work is one of the first studies to predict soil available boron in the 200–1700 nm range based on nonimaging hyperspectroscopy. Our results provide a reference for remote sensing monitoring of soil and fertilizer micronutrient element information.

2. Materials and Methods

2.1. Soil Sample Collection

The experimental soil samples in this study were collected from rapeseed fields in southern Anhui. As a boron-preferred crop, rapeseed has high demand for boron. Because of its strong boron absorption capacity, rapeseed is highly sensitive to boron nutrition. A total of 188 yellow loam soil samples were collected from the typical mountainous region in southern Anhui, China (Figure 1). The geographical coordinates for sampling are 117°29′7″∼118°11′1″ E, 30°8′23″∼30°22′25″ N. Diagonal sampling method was utilized for sampling with its depth between 0 and 20 cm. After the removal of plant roots and grave debris, 1.5 kg pure soil samples were collected, numbered, air-dried, and ground. Samples > 2 mm in diameter were filtered. Each sample was passed through hyperspectral analysis and boron examination by VIS-NIR and azomethine-H acid colorimetric analysis.

The VIS-NIR measurements were performed using a portable nonimaging spectrometer (Ocean Optics OFS-1700) with a spectral range 200–1700 nm (Figure 2). The spectral resolution is 2 nm for 200–950 nm and 5 nm for 950–1700 nm. The resampling interval is 1 nm. Measurements between 200 and 349 nm were filtered as noise.

Processed 2 mm soil powder particles were placed in a sample container which was covered with a black cloth to insulate it from stray light. For each soil sample, 3 sets were randomly selected for spectrum measurement, and the average spectra were utilized as the soil spectrum.

2.2. Pretreatment Transformation

A total of 29 methods were utilized for pretreatment transformation, including the sole application or combinations of detrend correction (DT), first derivative transformation (FD), second derivative transformation (SD), logarithmic transformation (LG), mean centering (MC), multivariate scattering correction (MSC), standard normal variable transformation (SNV), and Savitzky–Golay convolution smoothing (SG) (Table 1) [22, 23]. Among them, the SG treatment is generally utilized to remove the edge band from the spectral curve, which significantly eliminates the influence of high-frequency noise, enhances the signal-to-noise ratio, and maximally retains the peak characteristics of the original spectral signal. Even though FD and SD are effective in eliminating the linear baseline effect, the noise will be amplified after treatment. SNV is applied to calibrate the influence of soil particle size and surface scattering [24], while MC and DT reduce the spectral offset. Therefore, various treatments, when combined together, may integrate their strengths and eliminate their weaknesses.

2.3. Regression Algorithms

Totally, 10 algorithms were utilized for regression. As a common multiple linear regression algorithm [25], partial least squares (PLS) has been widely used in data analysis to predict soil properties using spectra. Support vector regression (SVR) is a popular algorithm in the machine learning field [26]. Different kernel functions, including linear, polynomial, sigmoid, and radial basis functions (RBF), are employed to map the inputs to a high-dimensional feature space.

BPNN is a one-way multilayer perceptual feed-forward neural network [27], and its powerful learning ability has been widely used in soil spectral regression modeling analysis [28, 29]. In this study, a four-layer BPNN model is selected, including the input layer, the middle two hidden layers, and the output layer. The modeling structure of sample i is shown in Figure 3.

A BP neural network regression model of soil available boron based on the whole band was constructed by using 1306 wavelengths extracted from hyperspectral data in the effective band range of 350–1655 nm as the input of the model. The number of nodes in the input layer and the output layer was set to 16 and 1, respectively. The two hidden layers in the middle were set to 8 and 4 nodes, respectively. At the same time, tan-sigmoid is selected as the transfer function of the hidden layer, and pure-linear is selected as the transfer function of the output layer. In order to minimize the overfitting phenomenon, the Bayesian-regularized back-propagation algorithm (trainbr) was used for model calibration and training. The tuning parameters set the loss function to be Mean Squared Error, the initial learning rate to be 0.01, the learning rate to be 0.1, the momentum to be 0.9, and the maximum number of iterations to be 150; the optimizer is SGD, and SGD is random descent. Table 2 shows the setting of network structure parameters.

Ridge regression estimates the coefficients of multiple-regression models when linear regression models have highly correlated independent variables by creating a ridge regression estimator, which provides a more accurate ridge parameter approximation.

Lasso regression performs both variable selection and regularization to enhance the model’s prediction accuracy and interpretability. The lasso procedure encourages simple, sparse models with fewer parameters, and it is well-suited for models with high multicollinearity levels.

The elastic net is a regularized regression method that linearly integrates the penalties of the lasso and ridge methods to effectively shrink coefficients (such as in ridge regression) and set some coefficients to zero (such as in lasso).

2.4. Evaluation Metrics

The coefficient of determination (), the root mean square error (RMSE), and the ratio of performance of deviation (RPD) were adapted as prediction evaluation metrics in this study.

In the formula, is the number of predicted samples, is the actual chemical measurement value of the th sample, is the predicted value of the th sample, and is the average value of .

S.D is the standard deviation. The models were categorized into different levels based on different RPD values as shown in Table 3.

Since the soil’s physical properties and chemical contents usually demonstrate a biased normal distribution, the ratio of its performance to IQ (RPIQ) serves as a better indicator than RPD. RPIQ is the ratio of IQ to RMSE, where IQ is the difference between the third quartile Q3 (75% of samples) and the first quartile Q1 (25% of samples). The larger the value of RPIQ is, the better the performance of the model demonstrates. Nawar and Mouazen accessed the model quality based on RPIQ values [30]: excellent model (RPIQ ≥ 2.5), very good model (2.5 > RPIQ ≥ 2.0), better model (2.0 > RPIQ ≥ 1.7), a reasonable model (1.7 > RPIQ ≥ 1.4) and a very poor model (RPIQ < 1.4).

In summary, this manuscript compares the , RMSE, RPD, and RPIQ for regression model comparison.

3. Results and Discussion

3.1. Soil Sample Statistics

By means of the Kennard-Stone method, these 188 soil samples were split into a training set and a testing set with a ratio of 7 : 3, namely a training set of 131 samples and a testing set of 57 samples. As the statistical metrics demonstrated in Table 4, both sets exhibited different distribution patterns in soil available boron content.

Pretreatment is an essential step in accurate VIS-NIR spectrum analysis. Various pretreatment methods were employed to filter noise and reduce complexity. Reflection spectra with diverse pretreatments are revealed in Figure 4. SG method can reduce spectrum noise and smooth the curve, and therefore, it is always used in combination with other pretreatment methods (Figure 4(b)). Except for the scattering correction methods, SNV and MSC, the rest of the methods all significantly modified the pattern of the spectral curve. FD, SD, and LG almost reshaped the curve thoroughly.

(a)

(b)

3.2. Performance Evaluation for Different Regression Models

The combination of pretreatment transformation and regression algorithms generated a total of 300 models for the VIS-NIR spectrum. Figure 5 exhibits the values of each model for the test sets. The SVM method utilizing the RBF kernel and the PLS model with the RBF kernel demonstrated the highest values in the prediction of test data no matter which pretreatment transformation was applied. Whatever regression model was employed, the pretreatments by SD, MSC + SD, or SNV + SD always generated the worst , especially for SNV + SD. The RPD levels and RPIQ of models are exhibited in Table 5 and Figure 6. Consistent with the result, SVM with RBF kernel and PLS with RBF generated the most A-level results. The elastic net and lasso models did not compare favorably with other models in performance. Since the soil available boron content showed a biased normal distribution, the RPIQ is employed for evaluations in Figure 6. The SVM with RBF kernel dominated the best performance in almost every pretreatment group. The highest RPIQ value (2.16) appeared in the DT group with SVM_RBF model.

Table 5 demonstrates the Level A RPD level of each model to determine the influence of pretreatments. Level A indicated the highest stability for a model while Level C suggested the lowest stability. Without any pretreatment, some RS data sets can also reach A level (Supplementary Table). The elastic net, lasso, and SVM_Sigmoid models for RS data rendered Level C while ridge, SVM_Linear, and SVM_RBF models increased its level to B. After being pretreated by DT, LG, SNV, MSC, SNV + DT, SG + DT, or SG + SNV + DT, and further regressed by SVM_RBF, the VIS-NIR data could generate Level A model (Supplementary Table). This indicated that DT or SNV was more preferable to other pretreatment transformations.

Figure 7(a) demonstrates the statistics of RPD levels based on the pretreatment types. Even though pretreatment transformations were expected to reduce the noise and increase the accuracy, several transformations generated worse results than the original RS spectrum, especially for FD and SD. Most transformations containing FD and SD led to all Cs, which strongly indicated that these two transformations cannot be used to predict boron based on VIS-NIR data. DT and LG methods improved the overall performance to better levels compared to the original RS data. The performance of MSC and SNV improved in some models but declined in others. No observable improvement was detected for the SG treatment, even though it was the typical pretreatment utilized in NIR data analysis.

(a)

(b)

Figure 7(b) shows the statistical result of RPD levels for different based on regression methods. PLS models generated the most A-level results, which suggested its stability in prediction.

3.3. The Favorable Models for VIS-NIR Prediction of Boron

Different regression algorithms were combined with different pretreatments to generate the best model for each regression algorithm. Elastic net and SVM_RBF were required to combine with DT pretreatment to render the best model while ridge, SVM_Linear, and SVM_Sigmoid were the best partners for LG. SG-transformed methods were preferential for PLS. SG was the best choice for lasso regression (Table 6). All of these combinations resulted in a ≥ 0.72, and SVM_RBF generated both the highest (0.82) and the best RPD level (Level A). Therefore, dissimilar regression algorithms corresponded to diverse pretreatments to achieve the optimal performance, and DT + SVM_RBF rendered the best performance among all the tested models in this study (Table 6). Consistent with the and RPD-level result, the RPIQ values of SVM_RBF were the highest among these models (Table 6). In summary, the SVM_RBF algorithm was determined to exhibit the best performance in predicting the soil available boron content by VIS-NIR.

3.4. Spectral Feature Extraction of Soil Available Boron

RFA is an ensemble machine learning approach, which uses its variable importance measure as a feature selection tool for high-dimensional data sets to sort the feature data, search one by one in a sequential backward way, and eliminate the least influential features from the feature set in turn by recursive iteration. As the number of variables in the characteristic wavelength data set increases, the classification accuracy keeps growing accordingly until the optimal characteristic variables are selected. RFA has a very flexible, powerful, efficient, and practical classification feature ability, and it is also robust to identify some data with missing outliers and noise data, and its learning and iterative optimization speed is fast. In recent years, RFA has been mainly used to solve various problems such as classification, prediction, feature selection, outlier detection, and recognition [19, 31].

As a forward selection variable method that minimizes vector space collinearity, SPA selects wavelengths to reduce information redundancy and solve the linear problem. According to the method, variable groups with redundant information can be sufficiently and thoroughly eliminated from a large amount of spectral information, and original spectral data are replaced by residual spectral information so as to reduce data dimensionality and the number of data variables. The above method has been widely used in spectral analysis. Using the Monte Carlo sampling method, a certain proportion of the wavelength data was extracted for PLS modeling, and the absolute values of the regression coefficients were compared. The spectral wavelength variables with small absolute values were eliminated for their small weights, while the spectral wavelength variables with large absolute values were retained because of their large weights. After the ith Monte Carlo sampling, the minimum was cross-validated with the root mean square error to determine the optimal modeling wavelength [32]. In this study, the Monte Carlo sampling was run 100 times, and the number of characteristic wavelengths was determined by 10-fold cross-validation.

VIP technology [21] is a variable screening method based on partial least squares regression, and its value can be used to identify some important wavelengths in the model. Its specific calculation and formula are as follows:where is the score of the projection importance of the -th independent variable under the condition of using latent variables for modeling, is the number of independent variables, is the corresponding weight coefficient, is the explanatory power of using latent variables to the dependent variable , and is the explanatory power of using all latent variables to .

The VIP value represents the importance of the independent variable to the model fitting. It is generally believed that when all VIP values are equal to 1, the prediction effect of each variable on is the same. When the VIP value is greater than 1, the independent variable has a very important indication effect on the prediction of , that is, the characteristic wavelength; when the VIP value is less than 1, it means that the contribution of the independent variable to the prediction of is small. The researcher Word [33] believes that the contribution of the independent variable to can be ignored when the VIP value is less than 0.8. VIP analysis is widely used in independent variable screening in various fields, and scholars such as Paz-Kagan et al. [34] and Rossel et al. [35] also use VIP values to analyze the corresponding relationship between different spectral bands and the detected objects. The larger the VIP value is, the stronger the importance of the wavelength in the prediction model is, and the smaller the number of characteristic wavelengths is.

In order to compare with the three better methods in the results in Section 3.3, on the basis of DT, MSC, and SG + SNV + DT preprocessing of the original spectrum, three different variable selection algorithms (RFA, SPA, VIP) were selected to screen out a small number of characteristic wavelengths. The prediction results are shown in Tables 7–9 by combining the nine models established by the three algorithms of SVM_RBF, BPNN, and PLS_RBF.

In MSC/BPNN modeling, the characteristic wavelengths selected by the VIP threshold between 1.0 and 1.6 have strong collinearity; when the threshold exceeds 1.6 (corresponding to 108 wavelengths), the learning ability of the model begins to deteriorate significantly. Therefore, the threshold value of 1.6 was selected as the VIP value, and 108 characteristic wavelengths were used as the input data of BPNN to establish the regression model of soil AB. Figure 8 shows the results of the impact of different variable projection importance score thresholds on the accuracy of the VIP-MSC/BPNN model.

Based on the RFA-MSC/BPNN model, the predicted soil AB content in the test set was compared with the actual detection value, and the results are shown in Figure 9(a). Figure 9(b) shows the results of the comparison between the predicted value of the VIP-MSC/BPNN model and the actual detection value. It can be seen that there is a good correlation between them. The AB content was mostly concentrated in the lower value area, which is consistent with the distribution patterns of micronutrient content.

(a)

(b)

4. Discussion

Based on the VIS-NIR spectroscopy of soil samples collected from China’s Anhui province, this study combined 29 pretreatment transformations, the original RS data, with 10 regression algorithms to generate 300 models for the prediction of soil available boron contents. Among all the generated models, the SVM_RBF model with DT pretreatment, PLS_RBF model with SG_SNV_DT transformation, and the BPNN model with MSC pretreatment significantly outperformed other models and gave value of 0.80 to 0.82 and RPD Level A (Table 6). SVM is widely used for the calibration of VIS-NIR spectra [24, 36], and the nonlinear RBF kernel is a Gaussian kernel. Since the number of samples in our study is much smaller than that of features, the number of frequencies, the Gaussian kernel here played the role of dimensionality reduction. The performance of the PLS_RBF model is literally similar to that of SVM_RBF when , RMSE, RPD, and RPIQ metrics are utilized for performance evaluation (Table 6). The two best models utilize the RBF model, which suggests that the Gaussian kernel is effective in predicting soil available mineral and also solidifies the necessity of dimensionality reduction for soil content prediction. The DT pretreatment method filters the tendency and reflects the true fluctuation and thus can eliminate the deceptive correlation. In addition, DT transformation usually follows SNV, and our results also demonstrate that SNV alone and SNV + DT pretreatments in the SVM_RBF models show Level A results (Table 5). Generally, the DT pretreatment seems to be able to improve the model performance when superimposed with other transformations, whatever the regression algorithm is employed. This result also suggests that SNV, when well-tuned with the regression algorithms, may generate an acceptable model for soil boron prediction.

Meanwhile, the PLS_Linear model generated the fewest Level C results (Figure7(b)), which was consistent with our previous results for soil K prediction [13]. Even though the RBF kernel (SVM or PLS) generated the most Level A models, they also generated a comparable number of Level C counterparts (Figure 7(b)). This indicated that the RBF kernel may be especially suitable for some, but not all, pretreatments. In contrast, the PLS_Linear model may be more applicable for all pretreatment transformations. PLS_Linear model, therefore, has stronger robustness.

Even though the pretreatment transformations were expected to smooth the curve, reduce noise, and improve model performance, not all pretreatments were effective in our study of soil available boron prediction. As a standard preparation of the soil spectral curves, SG is utilized in almost every NIR analysis. However, our results demonstrated that SG contributed little to model performance improvement. In some models, it even resulted in worse performance, such as DT + SG vs. DT alone in the elastic net models (Table 5). Additionally, the SD transformation caused severe performance reduction in almost every model, which strongly indicated that this method was inappropriate for the analysis of soil available chemical content prediction based on VIS-NIR.

Based on the above results, it was found that 328 characteristic wavelengths extracted by the RFA algorithm can be used as the best characteristic wavelengths of soil AB content. The specific characteristic wavelengths and distribution points selected by RFA and VIP during MSC/BPNN modeling are arranged in order of importance of VIP values from large to small as shown in Table 10 and Figure 10. It is found that the AB characteristic wavelengths of soil are mainly distributed in 400–600 nm, 700–1000 nm, 1300–1400 nm, and 1500–1700 nm, including 455 nm, 538 nm, 858 nm, 905 nm, 1645 nm, and other important wavelengths. The distribution of characteristic wavelengths selected by VIP is relatively more concentrated and obvious, and the main characteristic wavelengths are distributed around 450 nm, 850 nm, 1300 nm, 1400 nm, 1600 nm, and 1650 nm. Some literature shows that the dissociation of boric acid at low concentration will be adsorbed by clay minerals, iron and aluminum oxides, and organic matters in combination with the OH group [37, 38]. However, the AB characteristic wavelength of the soil in this study is highly consistent with the absorption band of iron oxide and hydroxyl OH, with similar spectral peaks, which is consistent with the research results of Beyrouty et al. [39], indicating that the AB spectral characteristic response may be related to boron adsorption. In addition, Tahmasbian et al. [9, 40] have shown that the spectral regions of 400–410 nm, 515–575 nm, 660–665 nm, 875 nm, and 910–1000 nm are important wavelengths for predicting soil TN. The 940–1000 nm region is one of the most important regions for soil TC prediction. Shi et al. [41] found that the TN content showed a high correlation with the derivative spectra and that the important absorption wavelengths were near the visible 540 nm and near-infrared 1400, 1900, 2200, and 2300 nm regions. Yang and Li and Cozzolino and Morón [42, 43] found that 700–1000 nm is also an important band range for TC prediction. There is also an overlap between the important wavelengths of soil AB in the current study and those of TC and TN in previous studies, indicating that there is a high correlation between soil AB spectral analysis and soil TC and TN. The overlap of important spectral regions and the strong correlation between the successfully predicted elements indicate that the successful prediction of AB may also result from its high degree of correlation with the spectrally active compounds C and N in soil.

Currently, there is limited research on NIR-based boron content detection in soil. Relevant research is found in only a few groups’ work. However, the accuracy was not high enough [15]. With C = 200000 and gamma = 1 as parameters, we improved the value in our model to 0.82. By modeling with the selected characteristic wavelength, we further improved the value to 0.84 in the model, which is much higher than that was used in the Malmir model. Since boron is one of the fewest elements in soil, predicting its available content and total content is quite a challenging task. Our research generates two models with high and low RMSE, which lay the groundwork for rapid detection of soil boron.

5. Conclusions

Based on the VIS-NIR data of 188 soil samples collected from southern Anhui, China, 300 regression models were generated for soil available boron prediction by the assembly of 29 pretreatment methods, plus the original spectrum reflectance data set, and 10 regression algorithms. The most favorable models for soil boron content prediction were generated from the DT-pretreated spectrum data followed by the SVM algorithm with RBF kernel function, the MSC transformations followed by the BPNN, or the SG_SNV_DT transformations followed by PLS with RBF kernel. With the parameters of C 200000 and gamma 1 for the SVM_RBF model, [1, 4, 8, 16] for BPNN and n_component 14, gamma 0.05 for PLS_RBF, a high value of 0.80–0.82, and RPD Level A were reached. SVM_RBF, BPNN, and PLS_RBF algorithms were considerably superior to other algorithms in our study, and SD pretreatment caused inferior performance in most cases. Even though SG transformation is generally employed in the NIR data analysis, no recognizable improvement was observed in the soil boron prediction models. Lasso and elastic net models are not suitable for the spectral prediction of soil AB.

In the study of hyperspectral prediction of soil available boron based on characteristic wavelength modeling, the original spectra were preprocessed by DT, MSC, and SG + SNV + DT. Three different variable selection algorithms (RFA, SPA, and VIP) were used to select a small number of characteristic wavelengths, and then, nine models were established by SVM_RBF, BPNN, and PLS_RBF. Results show that, RFA-MSC/BPNN (N = 328, = 0.841, RMSE = 0.352, RPD = 2.530, and RPIQ = 1.136) and VIP-MSC/BPNN (N = 108, = 0.832, RMSE = 0.361, RPD = 2.463, and RPIQ = 1.106), the prediction accuracy of the two models was further improved on the basis of the model accuracy constructed by the whole band, and the prediction accuracy grade reached A level, which could be used to predict the AB content of the soil. RFA-MSC/BPNN model generates the best effect, and compared with other modeling algorithms, the BPNN algorithm is better in the use of soil AB spectral feature extraction modeling method.

The study also shows that the successful prediction of AB may also be related to boron adsorption such as iron oxide and hydroxyl and has a high correlation with the spectral active compounds C and N in soil.

Data Availability

The [DATA TYPE] data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was financially supported by the “948” project of the Ministry of Agriculture of China (2015-Z44 and 2016-X34), Project of Anhui Provincial Key Laboratory of Smart Agricultural Technology and Equipment (APKLSATE2019 × 001 and APKLSATE2019 × 005), and the research project of Anhui Education Department (KJ2019A0212).

Supplementary Materials

Supplementary Table 1: RPD levels of regression models with various pretreatment transformations. (Supplementary Materials)

References

J. S. Kanwar and N. S. Randhawa, Micro-nutrient Research in Soil and Plants in India [M], Indian Council of Agricultural Research (ICAR), New Delhi, India, 1967.
M. Sillanpaeae and AGL, Micronutrients and the Nutrient Status of Soils: A Global Study, Food and Agriculture Organization of the United Nations, Rome, Italy, 1982.
V. M. Shorrocks, “The occurrence and correction of boron deficiency,” Boron in Soils and Plants: Review, vol. 193, no. 2, pp. 121–148, 1997.
View at: Publisher Site | Google Scholar
R. Padbhushan and D. Kumar, “Fractions of soil boron: a review,” The Journal of Agricultural Science, vol. 155, no. 7, pp. 1023–1032, 2017.
View at: Publisher Site | Google Scholar
M. Sillanp Aeae, L. W. D. V. D. Fao, and AGL, “Micronutrient Assessment at the Country Level: An International Study,” Fao Soils Bulletin, Food and Agriculture Organization of the United Nations (FAO), Quebec, Canada, 1990.
View at: Google Scholar
J. A. Prananto, B. Minasny, and T. Weaver, “Near infrared (NIR) spectroscopy as a rapid and cost-effective method for nutrient analysis of plant leaf tissues,” Advances in Agronomy, vol. 164, pp. 1–49, 2020.
View at: Publisher Site | Google Scholar
A. M. Mouazen, B. Kuang, J. De Baerdemaeker, and H. Ramon, “Comparison among principal component, partial least squares and back propagation neural network analyses for accuracy of measurement of selected soil properties with visible and near infrared spectroscopy,” Geoderma, vol. 158, no. 1-2, pp. 23–31, 2010.
View at: Publisher Site | Google Scholar
O. Rozenstein, T. Paz-Kagan, C. Salbach, and A. Karnieli, “Comparing the effect of preprocessing transformations on methods of land-use classification derived from spectral soil measurements,” Ieee Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 8, no. 6, pp. 2393–2404, 2015.
View at: Publisher Site | Google Scholar
I. Tahmasbian, Z. Xu, S. Boyd, and S. ZhouEsmaeilaniCheHosseini Bai, “Laboratory-based hyperspectral image analysis for predicting soil carbon, nitrogen and their isotopic compositions,” Geoderma, vol. 330, no. 15, pp. 254–263, 2018.
View at: Publisher Site | Google Scholar
E. Tamburini, F. Vincenzi, S. Costa, and G. MantoviPedriniCastaldelli, “Effects of moisture and particle size on quantitative determination of total organic carbon (TOC) in soils using near-infrared spectroscopy,” Sensors, vol. 17, no. 10, p. 2366, 2017.
View at: Publisher Site | Google Scholar
J. Padarian, B. Minasny, and A. B. McBratney, “Using deep learning to predict soil properties from regional spectral data,” Geoderma Regional, vol. 16, Article ID e00198, 2019.
View at: Publisher Site | Google Scholar
H. Qi, T. Paz-Kagan, A. Karnieli, and S. Li, “Linear multi-task learning for predicting soil properties using field spectroscopy,” Remote Sensing, vol. 9, no. 11, p. 1099, 2017.
View at: Publisher Site | Google Scholar
X. Jin, S. Li, W. Zhang, and J. ZhuSun, “Prediction of soil-available potassium content with visible near-infrared ray spectroscopy of different pretreatment transformations by the boosting algorithms,” Applied Sciences, vol. 10, no. 4, p. 1520, 2020.
View at: Publisher Site | Google Scholar
T. A. Goudge, J. M. Russell, J. F. Mustard, and S. HeadBijaksana, “A 40,000 yr record of clay mineralogy at Lake Towuti, Indonesia: p,” The Geological Society of America Bulletin, vol. 129, no. 7-8, pp. 806–819, 2017.
View at: Publisher Site | Google Scholar
M. Malmir, I. Tahmasbian, Z. Xu, and S. H. FarrarBai, “Prediction of soil macro- and micro-elements in sieved and ground air-dried soils using laboratory-based hyperspectral imaging technique,” Geoderma, vol. 340, pp. 70–80, 2019.
View at: Publisher Site | Google Scholar
W. D. Hively, G. W. McCarty, J. B. Reeves, and S. R. LangOesterlingDelwiche, “Use of airborne hyperspectral imagery to map soil properties in tilled agricultural fields,” Applied and Environmental Soil Science, vol. 2011, Article ID 358193, 13 pages, 2011.
View at: Publisher Site | Google Scholar
L. J. Janik, R. H. Merry, and J. O. Skjemstad, “Can mid infrared diffuse reflectance analysis replace soil extractions?” Australian Journal of Experimental Agriculture, vol. 38, no. 7, p. 681, 1998.
View at: Publisher Site | Google Scholar
F. Pallottino, S. R. Stazi, A. D’Annibale et al., “Rapid assessment of as and other elements in naturally-contaminated calcareous soil through hyperspectral VIS-NIR analysis,” Talanta, vol. 190, pp. 167–173, 2018.
View at: Publisher Site | Google Scholar
A. Cutler, D. R. Cutler, and J. R. Stevens, “Random Forests[M],” Machine Learning, vol. 45, 2004.
View at: Google Scholar
M. C. U. Araújo, T. C. B. Saldanha, R. K. H. Galvão, and V. YoneyamaChameVisani, “The successive projections algorithm for variable selection in spectroscopic multicomponent analysis,” Chemometrics and Intelligent Laboratory Systems, vol. 57, no. 2, pp. 65–73, 2001.
View at: Publisher Site | Google Scholar
S. Wold, M. Sjöström, and L. Eriksson, “PLS-regression: a basic tool of chemometrics,” Chemometrics and Intelligent Laboratory Systems, vol. 58, no. 2, pp. 109–130, 2001.
View at: Publisher Site | Google Scholar
X. Peng, T. Shi, A. Song, and W. ChenGao, “Estimating soil organic carbon using VIS/NIR spectroscopy with SVMR and SPA methods,” Remote Sensing, vol. 6, no. 4, pp. 2699–2717, 2014.
View at: Publisher Site | Google Scholar
Y. Bao, F. Liu, W. Kong, and Z. SunHeQiu, “Measurement of soluble solid contents and pH of white vinegars using VIS/NIR spectroscopy and least squares support vector machine,” Food and Bioprocess Technology, vol. 7, no. 1, pp. 54–61, 2013.
View at: Publisher Site | Google Scholar
Y. Zhai, L. Cui, X. Zhou, Y. Gao, T. Fei, and W. Gao, “Estimation of nitrogen, phosphorus, and potassium contents in the leaves of different plants using laboratory-based visible and near-infrared reflectance spectroscopy: comparison of partial least-square regression and support vector machine regression methods,” International Journal of Remote Sensing, vol. 34, no. 7, pp. 2502–2518, 2012.
View at: Publisher Site | Google Scholar
W. S, H. M, and H. W, “The Multivariate Calibration Problem in Chemistry Solved by the PLS Method,” Matrix Pencils, Springer, Berlin, Germany, pp. 286–293, 1983.
View at: Google Scholar
C Cortes and V Vapnik, “Support-vector networks,” Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.
View at: Publisher Site | Google Scholar
M. R. Widyanto, H Nobuhara, K. Kawamoto, and B. HirotaKusumoputro, “Improving recognition and generalization capability of back-propagation NN using a self-organized network inspired by immune algorithm (SONIA),” Applied Soft Computing, vol. 6, no. 1, pp. 72–84, 2005.
View at: Publisher Site | Google Scholar
L. Lin, Y. Wang, J. Teng, and X. Xi, “Hyperspectral analysis of soil total nitrogen in subsided land using the local correlation maximization-complementary superiority (LCMCS) method,” Sensors, vol. 15, no. 8, pp. 17990–18011, 2015.
View at: Publisher Site | Google Scholar
P. Liu, Z. Liu, Y. Hu, and G. ShiPanWangWang, “Integrating a hybrid back propagation neural network and particle swarm optimization for estimating soil heavy metal contents using hyperspectral data,” Sustainability, vol. 11, no. 2, p. 419, 2019.
View at: Publisher Site | Google Scholar
S. Nawar and A. M. Mouazen, “Predictive performance of mobile vis-near infrared spectroscopy for key soil properties at different geographical scales by using spiking and data mining techniques,” Catena, vol. 151, pp. 118–129, 2017.
View at: Publisher Site | Google Scholar
A. Verikas, A. Gelzinis, and M. Bacauskiene, “Mining data with random forests: a survey and results of new tests,” Pattern Recognition, vol. 44, no. 2, pp. 330–349, 2011.
View at: Publisher Site | Google Scholar
H. Li, Y. Liang, Q. Xu, and D. Cao, “Key wavelengths screening using competitive adaptive reweighted sampling method for multivariate calibration,” Analytica Chimica Acta, vol. 648, no. 1, pp. 77–84, 2009.
View at: Publisher Site | Google Scholar
S. Wold, “PLS for Multivariate Linear Modeling,” Chemometric Methods in Molecular Design, Wiley, Hoboken, NJ, USA, pp. 195–218, 1995.
View at: Google Scholar
T. Paz-Kagan, M. Shachak, E. Zaady, and A. Karnieli, “A spectral soil quality index (SSQI) for characterizing soil function in areas of changed land use,” Geoderma, vol. 230-231, pp. 171–184, 2014.
View at: Publisher Site | Google Scholar
R. A. V. Rossel, Y. S. Jeon, I. O. A. Odeh, and A. B. McBratney, “Using a legacy soil sample to develop a mid-IR spectral library,” Soil Research, vol. 46, no. 1, p. 1, 2008.
View at: Publisher Site | Google Scholar
F. Liu and Y. He, “Use of visible and near infrared spectroscopy and least squares-support vector machine to determine soluble solids content and pH of cola beverage,” Journal of Agricultural and Food Chemistry, vol. 55, no. 22, pp. 8883–8888, 2007.
View at: Publisher Site | Google Scholar
D Zhu, D. Cheng, M. Geng, and W. Liu, “Analysis to structural regimes of boron containing adsorption on the Surface of aluminum hydroxide,” Journal of Huazhong Agricultural, vol. 17, no. 1, pp. 44–48, 1998.
View at: Google Scholar
D ZZhu, “Research progress on chemical behavior of boron in soil,” Progress in Soil Science, vol. 22, no. 1, pp. 11–17, 1994.
View at: Google Scholar
C. A. Beyrouty, G. E. Van Scoyoc, and J. R. Feldkamp, “Evidence supporting specific adsorption of boron on synthetic aluminum hydroxides,” Soil Science Society of America Journal, vol. 48, no. 2, pp. 284–287, 1984.
View at: Publisher Site | Google Scholar
M. Vohland, M. Ludwig, S. Thiele-Bruhn, and B. Ludwig, “Determination of soil properties with visible to near- and mid-infrared spectroscopy: Effects of spectral variable selection,” Geoderma, vol. 223-225, pp. 88–96, 2014.
View at: Publisher Site | Google Scholar
T. Shi, L. Cui, J. Wang, and G. FeiChenWu, “Comparison of multivariate methods for estimating soil total nitrogen with visible/near-infrared spectroscopy,” Plant and Soil, vol. 366, no. 1-2, pp. 363–375, 2013.
View at: Publisher Site | Google Scholar
H. YangYang and J. Li, “Predictions of soil organic carbon using laboratory-based hyperspectral data in the northern Tianshan mountains, China,” Environmental Monitoring and Assessment, vol. 185, no. 5, pp. 3897–3908, 2013.
View at: Publisher Site | Google Scholar
D. Cozzolino and A. Morón, “Potential of near-infrared reflectance spectroscopy and chemometrics to predict soil organic carbon fractions,” Soil and Tillage Research, vol. 85, no. 1-2, pp. 78–85, 2006.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Juanjuan Zhu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

474

Downloads

369

Citations