Biotechnology in Environmental Monitoring and Pollution AbatementView this Special Issue
Back Propagation Neural Network Model for Predicting the Performance of Immobilized Cell Biofilters Handling Gas-Phase Hydrogen Sulphide and Ammonia
Lab scale studies were conducted to evaluate the performance of two simultaneously operated immobilized cell biofilters (ICBs) for removing hydrogen sulphide (H2S) and ammonia (NH3) from gas phase. The removal efficiencies (REs) of the biofilter treating H2S varied from 50 to 100% at inlet loading rates (ILRs) varying up to 13 g H2S/m3·h, while the NH3 biofilter showed REs ranging from 60 to 100% at ILRs varying between 0.5 and 5.5 g NH3/m3·h. An application of the back propagation neural network (BPNN) to predict the performance parameter, namely, RE (%) using this experimental data is presented in this paper. The input parameters to the network were unit flow (per min) and inlet concentrations (ppmv), respectively. The accuracy of BPNN-based model predictions were evaluated by providing the trained network topology with a test dataset and also by calculating the regression coefficient (R2) values. The results from this predictive modeling work showed that BPNNs were able to predict the RE of both the ICBs efficiently.
A typical landfill gas consists of methane (45–60% v/v), carbon dioxide (40–60% v/v), and other compounds that include nitrogen, oxygen, sulphides, ammonia, carbon monoxides, and trace constituents. The amount of landfill gas generated is proportional to the amount of organic waste present and is produced by the bacteria during decomposition. These gases can easily move through the landfill surface to the ambient air and then to the community with the wind. The sulphur compounds (mercaptans and hydrogen sulphide) are the main contributors to the persisting odor problem from landfills, which are also considered toxic . On the other hand, ammonia is both a potentially toxic product of refuse degradation and an essential nutrient for the bacteria responsible for this. The presence of these pollutants in the atmosphere has shown to cause significant damage to both human health and natural environment [2, 3]. In South Korea, there are a large number of landfills that do not incorporate suitable strategies to prevent these emissions from reaching the nearby community. Hence, there arises potential necessity to adapt worthy control techniques for effectively removing these emissions from landfills.
Biological treatment systems such as biofilters, and biotrickling filters have been demonstrated for several decades to be a cost effective technology for the treatment of waste gases containing low concentrations of contaminants at large flow rates [4–6]. The high removal efficiencies (REs) achieved along with its uncomplicated and flexible design, low operational, and maintenance costs edges biofilters over other biological treatment techniques such as biotrickling filters and bioscrubbers [7–11]. Biofilters can effectively remove H2S and NH3 emissions from waste-gas streams using a bed of biologically active material such as compost, peat, and wood bark. Belatedly, immobilization of microbes in suitable support matrix such as alginate beads or suitable polymeric materials has gained popularity in the research domain of biofiltration. The principal advantages of adopting immobilization techniques in biofiltration is to provide high cell concentrations, improve genetic stability, protecting the microbes from shear damage, and to enhance favorable microenvironment for microbes (nutrient gradients and pH). Pseudomonas putida CH11 was tested for the removal of H2S in both batch and continuous systems (pH: 6.0–8.0), yielding maximum removal rate and saturation constant values of g S/day·kg dry bead and ppm, respectively . A biofilter inoculated with Nitrosomonas europaea was used to remove gaseous ammonia, in the concentration range of 10 or 20 ppm showed 99% RE after 4 days of operation . The effects of operational factors such as retention time, temperature, and inlet concentration on the performance of a biofilter packed with Thiobacillus thioparus immobilized with Ca-alginate pellets were evaluated and found to have an optimal S-loading of 25 g/m3h, in order to achieve high removal of that compound . For the treatment of landfill gas containing H2S and NH3, they can be easily treated by two immobilized cell biofilters (ICB) with different microorganisms in series or single ICB column with mixed microorganisms, as shown in our previous studies [2, 3].
Traditionally, the performance of biofilters has been modeled/predicted using process-based models that are based on mass balance principles, simple reaction kinetics, and a plug flow of air stream [15–18]. The main advantages of these process models are that, they are anchored on the underlying physical process and the results obtained from these process models generally provide a good understanding and interpretation of the system. However, this depends on numerous model parameters and obligates selective information on specific growth rate of microbes, biofilm thickness and density, values of diffusivity, partition, yield and distribution coefficients, intrinsic adsorption, and so forth [19–21]. The accurate estimation of some of these parameters requires elaborated technical facilities and expertise, the absence of which hinders the preciseness of the model and limits the application and reliability of the model.
An alternate modeling procedure consists of a data driven approach wherein the principles of artificial intelligence (AI) is applied with the help of neural networks . The concept of neural network modeling has widespread applications in the field of applied science and engineering. An ANN-based model was developed to simulate different types of biomass for a gasification process and it was demonstrated that the model predicted profiles matched closely to the experimental values . ANN model based on wavelet packet decomposition, entropy, and neural networks was formulated to predict the long-term performance of a wastewater treatment plant . A 3-layered neural network with the standard back propagation algorithm was used in their study and the authors reported that the model was able to predict plant performance better. Recently, an ANN-based software was developed to predict thermal power plant effluent temperature that could help in optimizing load generation among different power generation units and this software demonstrated its ability to predict the canal temperature over the normal operating range with high accuracy . With respect to the application of ANN for optimization purposes, ANN and genetic algorithm-based techniques were combined together to optimize media constituents, in order to enhance lipase production by soil microbes . The results from their study showed that ANN-based model was able to predict the system behavior clearly showing lipolytic activity of 7.69 U/mL. It has been shown quite recently that the performance of biofilters and/-or biotrickling filters can be predicted from prior estimation of easily measurable operational parameters using ANNs [27–30]. In our previous studies, ANN-based predictive approach was proposed to model the performance of individually operated ICBs for H2S and NH3 removal, respectively [31, 32]. The outputs of the model were RE and EC, respectively, while the input parameters to the model were inlet concentration, loading rate, flow rate, and filter-bed pressure drop, respectively. The results for the H2S operated ICB showed that a multilayer network (4-4-2) with back propagation algorithm was able to predict the ICB performance effectively with a values of 0.9157 and 0.9965 for removal efficiency and elimination capacity, respectively . Similarly, for the ICB treating NH3, multilayer network (4-4-2) with error back propagation predicted the RE and EC with values of 0.9825 and 0.9982, respectively .
The objectives of this research work were to experimentally evaluate the collective performance of two biofilters treating H2S and NH3 and to predict the ICBs performance parameter, namely RE, using one back propagation neural network (BPNN). Experiment data collected from our previous studies [2, 3] were thus integrated for predicting the RE profiles of H2S and NH3 using the BPNN. The input parameters to the model were unit flow (gas-flow rate/volume) and inlet concentrations, while the output parameter was the RE of the ICBs. After model development, the input parameters were subjected to sensitivity analysis in order to understand their effects on the RE profiles.
2. The Simple Back Propagation Neural Network Approach
Multilayer perceptron (MLP) using the back propagation algorithm [26, 33] is the most widely used neural network for forecasting/prediction purposes [34–36]. Neural networks acquire their name from the simple processing units in the brain called neurons which are interconnected by a network that transmits signals between them. These can be thought of as a black box device that accepts inputs and produces a desired output. MLP generally consists of three layers; an input layer, a hidden layer, and an output layer . Each layer consists of neurons which are connected to the neurons in the previous and flowing layers by connection weights . These weights are adjusted according to the mapping capability of the trained network. An additional bias term () is provided to introduce a threshold for the activation of neurons. The input data is presented to the network through the input layer, which is then passed to the hidden layer along with the weights. The weighted output is then summed and added to a threshold to produce the neuron input in the output layer that can be represented by
This neuron input passes through an activation function to produce the desired output . The most commonly used activation function is the logistic sigmoid function which takes the form;
3. Modeling Methodology
3.1. Model Input-Outputs and Data Division
A combined neural network-based predictive model was developed for the two biofilters using unit flow () and inlet concentration () as the model inputs and removal efficiency () as the output. The experimental data was divided into training (, 75%) and test data (, 25%). The test data was set aside during network training and was only used for evaluating the predictive potentiality of the trained network. The basic statistics of the variables for the training and test matrix is shown in Tables 1 and 2, respectively.
3.2. Error Evaluation
The closeness of prediction between the experimental and model predicted outputs were evaluated by computing the determination coefficient values as shown below ; where —predictions made by the model, —observed true values from experiments, —number of cases analyzed, —average value, and —standard deviations.
3.3. Data Preprocessing and Randomization
Experimental data collected from the biofilters during the 67 × 2 days (2 denotes the two biofilters) of continuous operation was randomized to obtain a spatial distribution of the data, which accounts for both steady state and transient (or) quasi-steady-state operations. The data was also normalized and scaled to the range of 0 to 1 using (4), so as to suit the transfer function in the hidden (sigmoid) and output layer (linear) where is the normalized value and and are the minimum and maximum values of respectively.
3.4. Network Parameters
The internal parameters of the back propagation network, namely, epoch size, error function, learning rate (), momentum term (), training cycle (), and transfer function are to be appropriately selected to obtain the best network architecture that gives high predictions for the performance variables. In this study, the number of neurons in the input layer () and output layer () were chosen based on the number of input and output variables to the network. A detailed study on the effect of internal network parameters on the performance of back propagation networks  and the procedure involved in selecting the best network topology has been described elsewhere [34, 35]. However, in most instances, literature suggests the use of a trial and error approach where the performance goal is set by the user. In this study, the best values of the network parameters were chosen by carrying out simulations using a trial and error approach. The best network was chosen based on the maximum predictability of the network for the test data by analyzing the determination coefficient values.
3.5. Software Used
BPNN-based predictive modeling was carried out using the shareware version of the neural network and multivariable statistical modeling software, NNMODEL (Version 1.4, Neural Fusion, NY, USA).
3.6. Experimental Materials and Methods
The details of the experimental strategy adopted, inoculum, media composition, preparation of immobilized packing media, experimental setup, ICB operation, and analytical techniques for data collection have been detailed in our previously published work [2, 3].
4. Results and Discussions
The initial inlet loading rates (ILRs) to both the biofilters were sufficiently low (<1 gH2S (or) NH3/m3h), that allowed the immobilized microbes to acclimatize themselves to the vapor phase pollutant. Once acclimatized (high removal, RE > 95%), the ICBs were subjected to a step-wise increase in ILRs by gradually varying the inlet concentration of either H2S or NH3 to the ICBs. During every step increase in the ILR, it was observed that the biofilter took about 2 to 4 d to adapt to the new concentration and reached a new steady state value shortly. Initially, when the loading rates were <1 g/m3h, the RE increased gradually from 45 to ~100%, which indicated good activity of the immobilized cells to treat these pollutants. The removal profiles and EC achieved for both the biofilters during the entire operational steps are shown in Figures 1 and 2, as a function of the ILRs. For the ICB treating H2S vapors, the input was changed in 7 steps up to a ILR of 8 gH2S/m3h, during which the RE remained constant at 82%. It has been shown that H2S metabolism by heterotrophic sulphur oxidizing bacteria is a detoxification process and high inlet concentrations have often been reported to decrease the H2S removal efficiency . The EC profiles were almost linear till an ILR of 8 gH2S/m3h, which indicates that the biofilter performed with 100% efficiency till this critical load . For the ICB treating NH3, it is evident that the RE was nearly >95% up to a ILR of 4.5 gNH3/m3h. However, when the ILR was increased significantly by varying both the concentration and flow rate to values as high as 7.5 gNH3/m3h, a noticeable decrease in the RE values from 100% to ~60% was observed. The critical NH3 loading rate to the biofilter was considered as 4.5 gNH3/m3h. Pressure drop values were sufficiently low during the operational time for both of the ICBs (0.1–1.7 cm of H2O) and did not cause any significant operational problem. These values of pressure drop are within the safe operational range suggested for full-scale biofilter operation [2, 4, 9].
4.2. BPNN Modeling
4.2.1. Network Architecture
Artificial neural network-based models requires the best combinations of network parameters such as training cycle (), neurons in the input (), hidden () and output layer (), learning rate (η), momentum term (α), and a good algorithm for the predictions to be accurate [2, 3, 36]. In this study, the models for predicting the RE of ICBs were trained and tested adequately with the experimental data and evaluated by the determination coefficient values between the measured and predicted outputs from the network. Table 3 shows the different network parameters used for training the network. The algorithm used for training in this study was the standard back error propagation (BEP) algorithm, which has potentially shown to exhibit high capability in predicting process variables [38, 39]. The model was trained using different combinations of these parameters so as to achieve maximum determination coefficient values (target value = 1, i.e., 100% correlation between measured and predicted variables). This was achieved by a vigorous trial and error approach by keeping some training parameters constant and by slowly moving the other parameters over a wide range of values, as suggested in some previous works [26, 34, 35]. A trial and error approach was followed in this study to determine the best network topology and the effect of internal network parameters due to the following reasons: (i) there were several parameters whose values had to be varied from low to high values (example: learning rate from 0.1–1; momentum term from 0.1–1), by keeping other parameters constant, and (ii) although several literatures have suggested different heuristic rules for selecting the (best) parameters, adequate training of the network always remains a key issue during ANN modeling, as this largely depends on the complexity of the process, the quality of data obtained, and the nature of interpretation done by the user. In this study, the following observations were made during training: (i) increasing the number of neurons in the hidden layer from 2 to 8 did not significantly increase the R2 values, and the value of 2 was finally chosen, (ii) the training cycle appears to have a tremendous influence in increasing the R2 values and it was observed that the model predictions were high and significant when the training cycle was set to 40,000, (iii) similarly, high learning rates seem to invariably increase the prediction efficiency, and (iv) low values of momentum term showed R2 values greater than 0.84 in the test data during the predictions of RE. The R2 values during training and testing were 0.8716 and 0.8484, respectively. Thus, only about 13–16% of the total deviations could not be explained by the model for predicting the combined removal efficiency profiles in the ICBs. The best network architecture for this combined model is 2-2-1. The results from this study indicate high learning rate (η-0.9), low momentum term (α-0.3), and a training cycle of 40,000 with 2 neurons in the hidden layer are favorable values of the internal network parameters.
4.2.2. Predictive Potentiality of the Model
The performance parameter of the ICB treating H2S and NH3, namely RE, for the training and test data is shown in Figures 3 and 4, respectively. It can be observed that some of the data points for both H2S and NH3 were not predicted properly by the BPNN model, thus leading to large errors, ~13%. This could be due to the quasi-steady-state attained in the two ICBs, when the loading rate was step increased from one level to another. During this stage, the biofilter took some time (3 to 4 d) to adjust itself to the new concentration, thereby achieving steady state removals [2, 3]. Moreover, corroborating these deviations is the less critical load in the NH3 biofilter (4.5 g/m3h) in comparison to the H2S biofilter (8 g/m3h). This decrease in critical loads and corresponding removal profiles would have caused an impact in the networks generalization pattern while predicting the performance parameters, a pattern that has been often reported in biofilter and biotrickling filter operations [7, 9, 12]. However, the BPNN-based model showed good predictive ability for performance variables as seen from the closeness of the fit between the experimental and predicted observations.
Anew, the predictive capacity of the network was also evaluated in terms of its relative deviation, that is, (− REpred)/. These deviations for removal efficiency predicted by model during network training and testing are shown in Figures 5 and 6, respectively. The relative deviations are more significant, that is, >15% in some cases, which can be attributed to the change in load to the ICBs. This could be further explained by the EC profiles showed in Figures 1 and 2, respectively. For higher initial concentration and higher flow rate (high loading rates), the EC of the filter bed increased at a slower rate, becoming nearly constant at inlet loads beyond 8 g H2S/m3·h and 4.5 g NH3/m3·h, respectively. This phenomenon could be possibly due to the reaction and diffusion limitation steps as explained by Ottengraf , or by any one of the following mechanism; (i) smaller pore sizes in the media could restrict the accessibility of nutrients on the pore surface by the microorganisms, while at large pore size the specific surface area may be the limiting factor, (ii) at high cell densities, intra particle pore diffusion limitations have shown to play a significant role in reducing the elimination capacities, and (iii) microenvironmental conditions inside the encapsulated media could also vary with position and affect the physiology of the cells. The decline in RE at high loading rates could also be attributed to some complex mechanisms associated with the removal profiles in the immobilized media, where the waste air is first scrubbed and/-or absorbed in the liquid biofilm and then oxidized by the microorganisms.
The weights and bias terms between the hidden layer connections  obtained after network training is given in Table 4. In order to evaluate the significant effect of the input parameters on the developed model, a sensitivity analysis was carried out by estimating the Absolute Average Sensitivity (AAS). The sensitivity is calculated by summing the changes in the output variables caused by moving the input variables by a small amount over the entire training set. The AAS is the absolute values of the change in the input . The computed AAS value on different input parameters for model is shown in Table 5. Unit flow (0.5628) appears to have a more significant effect in predicting RE profiles in the ICBs than the concentration term. The results from this analysis reveal the degree of relevance of the input parameters to the outputs. Figure 7 shows the contour plot of RE, as a function of the concentration and unit flow for the ICB. This contour plot can be interpreted as follows: RE > 93.7% can be consistently maintained in the ICB, if the following condition is met: inlet H2S or NH3 concentration is constantly maintained at less than 120 ppmv, at a unit flow of 2 per min.
The predictive ability of the proposed model using the concepts of artificial intelligence and the back propagation algorithm was high and significant, as ascertained from the R2 value between the measured and predicted outputs in the training and test data for predicting RE of the ICB. This work could enable researches to extend and intensify research in BPNNs for evaluating pilot scale ICBs, besides helping in optimizing their state variables. For practical applications, ANNs can be used for real-time identification of state variables from the biofilter by continuously monitoring several important (easily measurable) parameters such as, inlet pollutant concentrations (using a gas chromatograph), gas flow rate (using a mass flow controller), humidity (using relative humidity sensors), filter bed pH, and temperature (using appropriate sensors). Real-time prediction of pollutant RE is then possible, wherein the acquired data (after proper noise filtering) is continuously integrated to an existing database of information (model inputs and outputs) and the ANN model can then be trained in either online or offline mode. Although, ANNs have found widespread application in real-time control of different industrial (chemical) processes and wastewater treatment systems, this research area still remains unexplored for the monitoring and real-time control of waste-gas treatment systems.
The RE of two individually operated immobilized cell biofilters (ICBs) was modeled using unit flow and inlet concentration as the input parameters. The best network architecture (2-2-1), determined by a trial and error approach showed that, high learning rates (η-0.9), low momentum term (α-0.3), with a training cycle of 40,000, are favorable conditions for high performance predictions. The developed BPNN model was able to identify all the peaks and plains of the data under different operating conditions with much less error (<15%). High REs (>93.7%) can be consistently maintained in the ICB, if the inlet H2S or NH3 concentration is maintained at <120 ppmv, at a unit flow of 2 per min, irrespective of the ICB operating volume. Furthermore, the results from this study evoke that neural networks can capture and extract complex relations among the easily measurable parameters, like unit flow and concentration, in an ICB process and forebode the performance in a meaningful manner.
Abbreviations, Symbols, and Nomenclature
|AAS:||Absolute average sensitivity|
|ANN:||Artificial neural network|
|BPNN:||Back propagation neural network|
|BEP:||Back error propagation|
|ICBs:||Immobilized cell biofilters|
|MLP:||Multi layered perceptron|
|RE:||Removal efficiency, %|
|C/N:||Carbon to nitrogen ratio|
|:||Connection weights between layers|
|:||Inputs to the neural network model|
|:||Output from the neural network model|
|:||Number of data points in the training data set|
|:||Number of data points in the test data set|
|:||Number of cases analyzed|
|:||Number of neurons in the input layer|
|:||Number of neurons in the output layer|
|:||Number of neurons in the hidden layer|
|:||Experimental removal efficiency, %|
|REpred:||Predicted removal efficiency, %.|
There are no disclosures for this paper.
Conflict of Interests
The authores declare there is no conflict of interests.
All authors of this paper contributed to a similar extent, and all authors have seen and agreed to the submission of this paper. M. Estefanía López contributed in analyzing the data and elucidating the effect of network parameters.
The authors would like to acknowledge the Ulsan Regional Environmental Technology Research Centre in Ulsan, South Korea, for their continual financial support in this field of experimental and modeling research.
E. R. Rene, M. Montes, M. C. Veiga, and C. Kennes, “Styrene removal from polluted air in one and two-liquid phase biotrickling filter: steady and transient-state performance and pressure drop control,” Bioresource Technology, vol. 102, no. 13, pp. 6791–6800, 2011.View at: Publisher Site | Google Scholar
C. Kennes and M. C. Veiga, “Conventional Biofilters,” in Bioreactors for Waste Gas Treatment, C. Kennes and M. C. Veiga, Eds., pp. 47–98, Kluwer Academic, Dodrecht, The Netherlands, 2001.View at: Google Scholar
Y.-C. Chung and C. Huang, “Biotreatment of ammonia in air by an immobilized Nitrosomonas europaea biofilter,” Environmental Progress, vol. 17, no. 2, pp. 70–76, 1998.View at: Google Scholar
M. A. Deshusses, G. Hamer, and I. J. Dunn, “Behavior of biofilters for waste air biotreatment. 1. Dynamic model development,” Environmental Science and Technology, vol. 29, no. 4, pp. 1048–1058, 1995.View at: Google Scholar
S. P. P. Ottengraf and A. H. C. Van Den Oever, “Kinetics of organic compound removal from waste gases with a biological filter,” Biotechnology and Bioengineering, vol. 25, no. 12, pp. 3089–3102, 1983.View at: Google Scholar
E. R. Rene and M. B. Saidutta, “Prediction of water quality indices by regression analysis and artificial neural networks,” International Journal of Environmental Research, vol. 2, no. 2, pp. 183–188, 2008.View at: Google Scholar
M. A. Haider, K. Pakshirajan, A. Singh, and S. Chaudhry, “Artificial neural network-genetic algorithm approach to optimize media constituents for enhancing lipase production by a soil microorganism,” Applied Biochemistry and Biotechnology, vol. 144, no. 3, pp. 225–235, 2008.View at: Publisher Site | Google Scholar
E. R. Rene, J. H. Kim, and H. S. Park, “An intelligent neural network model for evaluating performance of immobilized cell biofilter treating hydrogen sulphide vapors,” International Journal of Environmental Science and Technology, vol. 5, no. 3, pp. 287–296, 2008.View at: Google Scholar
S. C. Chukwu and A. N. Nwachukwu, “Analysis of some meteorological parameters using artificial neural network method for Makurdi, Nigeria,” African Journal of Environmental Science and Technology, vol. 6, pp. 182–188, 2012.View at: Google Scholar
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning representations by back-propagating errors,” Nature, vol. 323, no. 6088, pp. 533–536, 1986.View at: Google Scholar
K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, no. 5, pp. 359–366, 1989.View at: Google Scholar
S. P. P. Ottengraf, “Exhaust gas purification,” in Biotechnology: A Comprehensive Treatise, H. J. Rhem and G. Reed, Eds., vol. 8, pp. 425–452, VCH, Weinheim, Germany, 1986.View at: Google Scholar
J. M. Zurada, A. Malinowski, and I. Cloete, “Sensitivity analysis for minimization of input data dimension for feedforward neural network,” in Proceedings of the IEEE International Symposium on Circuits and Systems, pp. 447–450, June 1994.View at: Google Scholar