Research Article | Open Access
Jun-He Yang, Ching-Hsue Cheng, Chia-Pan Chan, "A Time-Series Water Level Forecasting Model Based on Imputation and Variable Selection Method", Computational Intelligence and Neuroscience, vol. 2017, Article ID 8734214, 11 pages, 2017. https://doi.org/10.1155/2017/8734214
A Time-Series Water Level Forecasting Model Based on Imputation and Variable Selection Method
Reservoirs are important for households and impact the national economy. This paper proposed a time-series forecasting model based on estimating a missing value followed by variable selection to forecast the reservoir’s water level. This study collected data from the Taiwan Shimen Reservoir as well as daily atmospheric data from 2008 to 2015. The two datasets are concatenated into an integrated dataset based on ordering of the data as a research dataset. The proposed time-series forecasting model summarily has three foci. First, this study uses five imputation methods to directly delete the missing value. Second, we identified the key variable via factor analysis and then deleted the unimportant variables sequentially via the variable selection method. Finally, the proposed model uses a Random Forest to build the forecasting model of the reservoir’s water level. This was done to compare with the listing method under the forecasting error. These experimental results indicate that the Random Forest forecasting model when applied to variable selection with full variables has better forecasting performance than the listing model. In addition, this experiment shows that the proposed variable selection can help determine five forecast methods used here to improve the forecasting capability.
Shimen Reservoir is located between Taoyuan City and Hsinchu County in Taiwan. The Shimen Reservoir offers irrigation, hydroelectricity, water supply, flood control, tourism, and so on. This reservoir is very important to the area and offers livelihood, agriculture, flood control, and economic development. Thus, the authorities should plan and manage water resources comprehensively via accurate forecasting.
Previous studies of reservoir water levels have identified three important problems:(1)There are few studies of reservoir water levels: related studies [1–4] in the hydrological field use machine learning methods to forecast water levels. They focused on water level forecasting of the flood stages in pumping stations, reservoirs, lakes, basins, and so on. Most of the water level forecasting of these flood stages collected the data about typhoons, specific climate, seasonal rainfall, or water levels.(2)Only a few variables have been used in reservoir water level forecasting. The literature shows only a few related studies of forecasting [5, 6]. These used water level as the dependent variable, and the independent variable only has rainfall, water level, and the time lag of the combined two variables. Thus, a few independent variables were selected. It is difficult to determine the key variable set in the reservoir water level.(3)No imputation method used in datasets of reservoir water level: previous studies of water level forecasting in hydrological fields have shown that the collected data are noninterruptible and long-term, but most of them did not explain how to deal with the missing values from human error or mechanical failure.
To improve these problems, this study collected data on Taiwan Shimen Reservoir and the corresponding information on daily atmospheric datasets. The two datasets were concatenated into single dataset based on the date. Next, this study imputed missing values and selected a better imputation method to further build forecast models. We then evaluated the variables based on different models.
This paper includes five sections: Section 2 is related work; Section 3 proposes research methodology and introduces the concepts, imputation methods, variable selection, and forecasting model; Section 4 verifies the proposed model and compares with the listing models. Section 5 concludes.
2. Related Work
This section introduces a forecast method of machine learning, imputation techniques, and variable selection.
2.1. Machine Learning Forecast (Regression)
2.1.1. RBF Network
Radial Basis Function Networks were proposed by Broomhead and Lowe in 1988 . RBF is a simple supervised learning feed forward network that avoids iterative training processes and trains the data at one stage . The RBF Network is a type of ANN for applications to solve problems of supervised learning, for example, regression, classification, and time-series prediction . The RBF Network consists of three layers: input layer, hidden layer, and output layer. The input layer is the set of source nodes, the second layer is a hidden layer high dimension, and the output layer gives the response of the network to the activation patterns applied to the input layer . The advantages of the RBF approach are the (partial) linearity in the parameters and the availability of fast and efficient training methods . The use of radial basis functions results from a number of different concepts including function approximation, noisy interpolation, density estimation, and optimal classification theory .
The Kstar is an instance-based classifier that differs from other instance-based learners in that it uses an entropy-based distance function . The Lazy Family Data Mining Classifiers supports incremental learning. It contains some classifiers such as Kstar, and it takes less time for training and more time for predicting . It provides a consistent approach to handling symbolic attributes, real valued attributes, and missing values . Kstar uses an entropy-based distance function for instance-based regression. The predicted class value of a test instance comes from values of training instances that are similar to the Kstar .
The -Nearest-Neighbor classifier offers a good classification accuracy rate for activity classification . The kNN algorithm is based on the notion that similar instances have similar behavior and thus the new input instances are predicted according to the stored most similar neighboring instances .
2.2. Random Forest
A Random Forest can be applied for classification, regression, and unsupervised learning . It is similar to the bagging method. Random Forest is an ensemble learning method. A decision tree represents the classifier. Random Forest gets outputs through decision trees. These are forecast by voting for all of the predicted results. It can solve the classification and regression problems. Random Forest is simple and easily parallelized .
2.3. Random Tree
Random Tree is an ensemble learning algorithm that generates many individual learners and employs a bagging idea to produce a random set of data in the construction of a decision tree . Random Tree classifiers can deal with regression and classification problems. Random trees can be generated efficiently and can be combined into large sets of random trees. This generally leads to accurate models . The Random Tree classifier takes the input feature vector and classifies it with every tree in the forest. It then outputs the class label that received the majority of the votes .
The daily atmospheric data may have missing values due to human error or machine failure. Many previous studies have shown that the statistical bias occurred when the missing values were directly deleted. Thus, imputing data can significantly improve the quality of the dataset. Otherwise, biased results may cause poor performance in the ensuing constructs . Single imputation methods have several advantages such as a wider scope than multiple imputation methods. Sometimes it is more important to find the missing values than to estimate the parameters . The median of nearby point imputation methods uses nearby values for ordering and then selects the median to replace the missing value. The advantage of the median imputation method is that its replaced value is actually a real value in the data . Series mean imputation methods replace the average of the variables directly. Regression imputation method uses simple linear regression to estimate missing values and replace them. The mean of the nearby point imputation methods is the mean of nearby values. The number of nearby values can be found by using a “span of nearby points” option . The linear imputation is most readily applicable to continuous explanatory variables .
2.5. Variable Selection
The variable selection method mainly identifies the key variable that actually influences the forecasting target from several variables. It then deletes the unimportant variables to improve the model’s efficiency. It can solve high dimensional and complex problems. Previous studies in several field have shown that variable selection can improve the forecasting efficiency of machine learning methods [29–32].
Variable selection is an important technique in data preprocessing. It removes irrelevant data and improves the accuracy and comprehensibility of the results . Variable selection methods can be categorized into three classes: filter, wrapper, and embedded. Filter uses statistic methods to select variables. It has better generalization ability and lower computational demands. Wrapper methods use classifiers to identify the best subset components. The embedded method has a deeper interaction between variable selection and construction of the classifier .
Filter models utilize statistical techniques such as principal component analysis (PCA), factor analysis (FA), independent component analysis, and discriminate analysis in the investigation of other indirect performance measures. These are mostly based on distance and information measures .
PCA transforms a set of feature columns in the dataset into a projection of the feature space with lower dimensionality. FA is a generalization of PCA; the main difference between PCA and FA is that FA allows noise to have nonspherical shape while transforming the data. The main goal of both PCA and FA is to transform the coordinate system such that correlation between system variables is minimized .
There are several methods to decide how many factors have to be extracted. The most widely used method for determining the number of factors is using eigenvalues greater than one .
3. Proposed Model
Reservoirs are important domestically as well as in the national defense and for economic development. Thus, the reservoir water levels should be forecast over a long period of time, and water resources should be planned and managed comprehensively to reach great cost-effectiveness. This paper proposes a time-series forecasting model based on the imputation of missing values and variable selection. First, the proposed model used five imputation methods (i.e., median of nearby points, series mean, mean of nearby points, linear, and regression imputation). It then compares these findings with a delete strategy to estimate the missing values. Second, by identifying the key variable that influences the daily water levels, the proposed method ranked the importance of the atmospheric variables via factor analysis. It then sequentially removes the unimportant variables. Finally, the proposed model uses a Random Forest machine learning method to build a forecasting model of the reservoir water level to compare it to other methods. The proposed model could be partitioned into four parts: data preprocessing, imputation and feature selection, model building, and accuracy evaluation. The procedure is shown in Figure 1.
3.1. Computational Step
To understand the proposed model more easily, this section partitioned the proposed model into four steps.
Step 1 (data preprocessing). The related water level and atmospheric data were collected from the reservoir administration website and the Taoyuan weather station. The two collected datasets are concatenated into an integrated dataset based on the date. There are nine independent variables and one dependent variable in the integrated dataset. The variables are defined in the integrated dataset and are listed in Table 1.
Step 2 (imputation). After Step 1, we found some variables and records with missing values in the integrated dataset due to mechanical measurement failure or human operation error. Previous studies showed that deleting missing values directly will impact the results. To identify that one that better fits with the imputation method, this paper utilized five imputation methods to estimate the missing values and then compared it with no imputation method to directly delete the missing value. The five imputation methods were the median of the nearby points, series mean, mean of nearby points, linear imputation, and regression imputation. This study had six processed datasets after processing the missing values problem. The problem is then how to identify the imputation method that is a better fit to the integrated dataset. To determine this, the following steps were followed: (i)In order to rescale all numeric values in the range , this step normalized each variable value by dividing the maximal value for the five imputed datasets and then deleted the missing value dataset. All independent and dependent variables are positive values.(ii)The six normalized datasets are partitioned into 66% training datasets and 34% testing datasets. We also employed a 10-fold cross-validation approach to identify the imputation dataset that has best prediction performance.(iii)We utilized five forecast methods including Random Forest, RBF Network, Kstar, IBK (KNN), and Random Tree via five evaluation indices. These include correlation coefficient (CC), root mean squared error (RMSE), mean absolute error (MAE), relative absolute error (RAE), and root relative squared error (RRSE). We identified the normalized dataset with the smaller index value over five evaluation indices as well as the more fit imputation. Section 4 shows that the better imputation method is the mean of nearby points.
Step 3 (variable selection and model building). Based on Step 2, this study will now determine the better imputation method (i.e., mean of nearby points). Then, the important problem is to determine the key variables that influence the reservoir water level. Therefore, this step utilized factor analysis to rank the importance of the variables for building the best forecast model. Based on the ordering of variable, we first deleted the least variable of importance. We then built the forecast model via a Random Forest, RBF Network, Kstar, KNN, and Random Tree. Next, we repeatedly delete the lower variable of importance to build the forecast model until the RMSE can no longer improve. After many iterative experiments, this study used five evaluation indices to determine the best forecast method. This step could be introduced step-by-step as follows:(i)The imputed integrated datasets are partitioned into 66% training datasets and 34% testing datasets.(ii)Factor analysis ranked the importance of the variables.(iii)The variable ranking of factor analysis was used to iteratively delete the least important variable. The remaining variables were studied with Random Forest, RBF Network, Kstar, KNN, and Random Tree until the RMSE can no longer improve.(iv)Based on the previous Step 3, the key variables are found when the lowest RMSE is achieved.(v)Concurrently, we used five evaluation indices (CC, RMSE, RRSE, MAE, and RAE) to determine which forecast method is a good forecasting model.
Step 4 (evaluation and comparison). To verify the performance of the reservoir water level forecasting model, this step uses the superior imputed datasets with different variables selected to evaluate the proposed method. It then compares the results with the listing methods. This study used CC, RMSE, MAE, RAE, and RRSE to evaluate the forecast mode. The five criteria indices are listed as equations (1)–(5).where is the actual observation value of the data, is the forecast value of the model, and is the sample number.
Correlation Coefficient (CC)where and are the observed and predicted values, respectively; and are the mean of the observed and predicted values.
Root Relative Squared Error (RRSE)where is the predicted value, is the actual value, and is the mean of the actual value.
Mean Absolute Error (MAE)Here, is the number of observation datasets, is the forecast value at time , and is the actual value at time .
Relative Absolute Error (RAE)where is the actual observation value of the data, is the mean value of the is the forecast value of the model, and is the sample number.
4. Experimental Results
This section verifies the performance of the proposed forecast model and compares the results with the listing methods. To determine which imputation method has the best performance for the collected dataset, this study collected daily atmospheric data from the monitoring station and the website of Water Resources Agency in Taiwan Shimen Reservoir. This work also compares the proposed model with the listing models with/without variable selection.
4.1. Experimental Data
The research dataset consisted of two historical datasets: one was collected form the website of Taiwan Water Resources Agency and the other was from Dasi monitoring station nearest to the Shimen Reservoir. The two datasets were collected from January 1, 2008, to October 31, 2015. The two collected data are concatenated into an integrated dataset based on the date. There are nine independent variables and one dependent variable in the integrated dataset that has 2,854 daily records. The study mainly forecasts the water level of the reservoir. The water level is the dependent variable. The independent variables are Reservoir_OUT, Reservoir_IN, Temperature, Rainfall, Pressure, Relative Humidity, Wind Speed, Direction, and Rainfall_Dasi, respectively. The detailed data types are shown as Table 2.
4.2. Forecast and Comparison
Based on the computational step in Section 3, this section will employ the practically collected dataset to illustrate the proposed model and compare it with the listing method. A detailed description is introduced in the following section.(1)To achieve better processing of the missing values dataset, this study applies series mean, regression, mean of nearby points, linear, or the median of nearby points’ imputation methods to estimate missing values. It then directly deletes missing values to determine which method has the best performance. After normalizing the six processed missing values datasets, we used two approaches to estimate the datasets: percentage spilt (dataset partition into 66% training data and 34% testing data) and 10-fold cross-validation. The two approaches employ Random Forest, RBF Network, Kstar, KNN, and Random Tree to forecast water levels for evaluating the six processed missing values methods under five evaluation indices: CC, RMSE, MAE, RAE, and RRSE. The results are shown in Tables 3 and 4, and we can see that the mean of the nearby points’ method wins versus other methods in CC, MAE, RAE, RRSE, and RMSE. Therefore, the mean of the nearby points’ imputation method better estimates the Shimen Reservoir water level.(2)Variable selection and model building uses the results from above. The best imputation method is the mean of nearby points. Therefore, this study will use the imputed dataset of the mean of nearby points to select the variable and build the model. For variable selection, this study utilizes factor analysis to rank the importance of independent variables for an improved imputed dataset. Table 5 indicates that the ordering of important variables is Reservoir_IN, Temperature, Reservoir_OUT, Pressure, Rainfall, Rainfall_Dasi, Relative Humidity, Wind Speed, and Direction. Next, we determine the key variables and build a forecast model. This study utilizes the ordering of important variables and iteratively deletes the least important variable to iteratively implement the proposed forecasting model when the minimal RMSE is reached. First, all independent variables are used to build the water level forecasting model. Second, the least important variables are removed one-by-one. The remaining variables serve as a forecast model until the minimal RMSE is reached. After these iterative experiments, the optimal forecast model is achieved when the Wind Speed and Direction are deleted. The key remaining variables are Reservoir_IN, Temperature, Reservoir_OUT, Pressure, Rainfall, Rainfall_Dasi, and Relative Humidity. As a rule of thumb, we recommend interpreting only factor loadings with an absolute value greater than 0.5, which explains around 25% of the variance . We can see that the loadings of the two deleted variables are smaller than 0.5 as seen in Table 5. Finally, this study employs the Random Forest forecast method based on variable selection and full variables to build a forecast model for water level forecasting in Shimen Reservoir, respectively.(3)Model comparison: this study compares the proposed forecast model (using Random Forest) with the Random Forest, RBF Network, Kstar, IBK (KNN), and Random Tree forecast models (Tables 6 and 7). Tables 6 and 7 show that before variable selection (full variables), the Random Forest forecast model has the best forecast performance in CC, RMSE, MAE, RAE, and RRSE indices. After variable selection, all five forecast models have improved forecast performance under CC, RMSE, MAE, RAE, and RRSE. Therefore, the results show that variable selection could improve the forecasting performance. The Random Forest model as applied to variable selection with full variables is better than the listing model.
| denotes the best performance among 5 imputation methods.|
| denotes the best performance among 5 imputation methods.|
|Note. Each factor’s highest factor loading appears in bold.|
| denotes after variable selection with enhancing performance; denotes the best performance among 5 models after variable selection.|
| denotes after variable selection with enhancing performance; denotes the best performance among 5 models after variable selection.|
After variable selection and model building, some key findings can be highlighted:(1)Imputation: after the two collected datasets were concatenated into an integrated dataset, there are missing values in the integrated dataset due to human error or mechanical failure. Tables 3 and 4 show the integrated dataset that uses the median of nearby points, series mean, mean of nearby points, linear, regression imputation, and the delete strategy to evaluate their accuracy via five machine learning forecast models. The results show that the integrated dataset that uses the mean of the nearby points’ imputation method has better forecasting performance.(2)Variable selection: this study uses factor analysis to rank the ordering of variables and then sequentially deletes the least important variables until the forecasting performance no longer improves. Tables 6 and 7 show that the variable selection could significantly improve the performance of all five forecasting models. After iterative experiments and variable selection, the key remaining variables are Reservoir_IN, Temperature, Reservoir_OUT, Pressure, Rainfall, Rainfall_Dasi, and Relative Humidity.(3)Forecasting model: this study proposed a time-series forecasting model based on estimating missing values and variable selection to forecast the water level in the reservoir. These experimental results indicate that the Random Forest forecasting model when applied to variable selection with full variables has better forecasting performance than the listing models in the five evaluation indices. The proposed time-series forecasting model is feasible for forecasting water levels in Shimen Reservoir.
This study proposed a time-series forecasting model for water level forecasting in Taiwan’s Shimen Reservoir. The experiments showed that the mean of nearby points’ imputation method has the best performance. These experimental results indicate that the Random Forest forecasting model when applied to variable selection with full variables has better forecasting performance than the listing model. The key variables are Reservoir_IN, Temperature, Reservoir_OUT, Pressure, Rainfall, Rainfall_Dasi, and Relative Humidity. The proposed time-series forecasting model with/without variable selection has better forecasting performance than the listing models using the five evaluation indices. This shows that the proposed time-series forecasting model is feasible for forecasting water levels in Shimen Reservoir. Future work will address the following issues:(1)The reservoir’s utility includes irrigation, domestic water supply, and electricity generation. The key variables identified here could improve forecasting in these fields.(2)We might apply the proposed time-series forecasting model based on imputation and variable selection to forecast the water level of lakes, salt water bodies, reservoirs, and so on.
In addition, this experiment shows that the proposed variable selection can help determine five forecast methods used here to improve the forecasting capability.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
- F.-J. Chang and Y.-T. Chang, “Adaptive neuro-fuzzy inference system for prediction of water level in reservoir,” Advances in Water Resources, vol. 29, no. 1, pp. 1–10, 2006.
- M. K. Tiwari and C. Chatterjee, “Development of an accurate and reliable hourly flood forecasting model using wavelet-bootstrap-ANN (WBANN) hybrid approach,” Journal of Hydrology, vol. 394, no. 3-4, pp. 458–470, 2010.
- C.-S. Chen, Y.-D. Jhong, T.-Y. Wu, and S.-T. Chen, “Typhoon event-based evolutionary fuzzy inference model for flood stage forecasting,” Journal of Hydrology, vol. 490, pp. 134–143, 2013.
- F.-J. Chang, P.-A. Chen, Y.-R. Lu, E. Huang, and K.-Y. Chang, “Real-time multi-step-ahead water level forecasting by recurrent neural networks for urban flood control,” Journal of Hydrology, vol. 517, pp. 836–846, 2014.
- A. Hipni, A. El-shafie, A. Najah, O. A. Karim, A. Hussain, and M. Mukhlisin, “Daily Forecasting of Dam Water Levels: Comparing a Support Vector Machine (SVM) Model With Adaptive Neuro Fuzzy Inference System (ANFIS),” Water Resources Management, vol. 27, no. 10, pp. 3803–3823, 2013.
- Y. Seo, S. Kim, O. Kisi, and V. P. Singh, “Daily water level forecasting using wavelet decomposition and artificial intelligence techniques,” Journal of Hydrology, vol. 520, pp. 224–243, 2015.
- D. S. Broomhead and D. Lowe, “Multivariable functional interpolation and adaptive networks,” Complex Systems, vol. 2, no. 3, pp. 321–355, 1988.
- K. Ganapathy, V. Vaidehi, and J. B. Chandrasekar, “Optimum steepest descent higher level learning radial basis function network,” Expert Systems with Applications, vol. 42, no. 21, pp. 8064–8077, 2015.
- P. Brandstetter and M. Kuchar, “Sensorless control of variable speed induction motor drive using RBF neural network,” Journal of Applied Logic, vol. 24, no. part A, pp. 97–108, 2017.
- C. M. Anish and B. Majhi, “Hybrid nonlinear adaptive scheme for stock market prediction using feedback FLANN and factor analysis,” Journal of the Korean Statistical Society, vol. 45, no. 1, pp. 64–76, 2016.
- M. Pottmann and H. P. Jörgl, “Radial basis function networks for internal model control,” Applied Mathematics and Computation, vol. 70, no. 2-3, pp. 283–298, 1995.
- I. Morlini, “Radial basis function networks with partially classified data,” Ecological Modelling, vol. 120, no. 2-3, pp. 109–118, 1999.
- A. Nawahda, “An assessment of adding value of traffic information and other attributes as part of its classifiers in a data mining tool set for predicting surface ozone levels,” Process Safety and Environmental Protection, vol. 99, pp. 149–158, 2016.
- N. R. Kasat and S. D. Thepade, “Novel Content Based Image Classification Method Using LBG Vector Quantization Method with Bayes and Lazy Family Data Mining Classifiers,” in Proceedings of the 7th International Conference on Communication, Computing and Virtualization, ICCCV 2016, pp. 483–489, February 2016.
- E. Mężyk and O. Unold, “Machine learning approach to model sport training,” Computers in Human Behavior, vol. 27, no. 5, pp. 1499–1506, 2011.
- J. Abawajy, A. Kelarev, M. Chowdhury, A. Stranieri, and H. F. Jelinek, “Predicting cardiac autonomic neuropathy category for diabetic data with missing values,” Computers in Biology and Medicine, vol. 43, no. 10, pp. 1328–1333, 2013.
- M. A. Ayu, S. A. Ismail, A. F. A. Matin, and T. Mantoro, “A comparison study of classifier algorithms for mobile-phone's accelerometer based activity recognition,” Procedia Engineering, vol. 41, pp. 224–229, 2012.
- A. Tamvakis, V. Trygonis, J. Miritzis, G. Tsirtsis, and S. Spatharis, “Optimizing biodiversity prediction from abiotic parameters,” Environmental Modeling and Software, vol. 53, pp. 112–120, 2014.
- C. Brokamp, R. Jandarov, M. B. Rao, G. LeMasters, and P. Ryan, “Exposure assessment models for elemental components of particulate matter in an urban environment: a comparison of regression and random forest approaches,” Atmospheric Environment, vol. 151, pp. 1–11, 2017.
- L. Breiman, “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, 2001.
- P. Yıldırım, “Pattern Classification with Imbalanced and Multiclass Data for the Prediction of Albendazole Adverse Event Outcomes,” in Proceedings of the 7th International Conference on Ambient Systems, Networks and Technologies, ANT 2016 and the 6th International Conference on Sustainable Energy Information Technology, SEIT 2016, pp. 1013–1018, May 2016.
- Y. Zhao and Y. Zhang, “Comparison of decision tree methods for finding active objects,” Advances in Space Research, vol. 41, no. 12, pp. 1955–1959, 2008.
- K. M. A. Kumar, N. Rajasimha, M. Reddy, A. Rajanarayana, and K. Nadgir, “Analysis of users' Sentiments from Kannada Web Documents,” in Proceedings of the 11th International Conference on Communication Networks, ICCN 2015, pp. 247–256, August 2015.
- C. Zhong, W. Pedrycz, D. Wang, L. Li, and Z. Li, “Granular data imputation: A framework of Granular Computing,” Applied Soft Computing, vol. 46, pp. 307–316, 2016.
- C. Genolini, A. Lacombe, R. Écochard, and F. Subtil, “CopyMean: A new method to predict monotone missing values in longitudinal studies,” Computer Methods and Programs in Biomedicine, vol. 132, pp. 29–44, 2016.
- M. Majidpour, C. Qiu, P. Chu, H. R. Pota, and R. Gadh, “Forecasting the EV charging load based on customer profile or station measurement?” Applied Energy, vol. 163, pp. 134–141, 2016.
- O. Cokluk and M. Kayri, “The effects of methods of imputation for missing values on the validity and reliability of scales,” in Educational Sciences: Theory and Practice, vol. 11, pp. 303–309, 2011.
- S. A. Bashir and S. W. Duffy, “The correction of risk estimates for measurement error,” Annals of Epidemiology, vol. 7, no. 2, pp. 154–164, 1997.
- A. Öztürk, S. Kayalıgil, and N. E. Özdemirel, “Manufacturing lead time estimation using data mining,” European Journal of Operational Research, vol. 173, no. 2, pp. 683–700, 2006.
- H. Vathsala and S. G. Koolagudi, “Closed Item-Set Mining for Prediction of Indian Summer Monsoon Rainfall A Data Mining Model with Land and Ocean Variables as Predictors,” in Proceedings of the 11th International Conference on Communication Networks, ICCN 2015, pp. 271–280, August 2015.
- S. Banerjee, A. Anura, J. Chakrabarty, S. Sengupta, and J. Chatterjee, “Identification and functional assessment of novel gene sets towards better understanding of dysplasia associated oral carcinogenesis,” Gene Reports, vol. 4, pp. 131–138, 2016.
- H. Yahyaoui and A. Al-Mutairi, “A feature-based trust sequence classification algorithm,” Information Sciences, vol. 328, pp. 455–484, 2016.
- H. B. Borges and J. C. Nievola, “Comparing the dimensionality reduction methods in gene expression databases,” Expert Systems with Applications, vol. 39, no. 12, pp. 10780–10795, 2012.
- A. Wang, N. An, G. Chen, L. Li, and G. Alterovitz, “Accelerating wrapper-based feature selection with K-nearest-neighbor,” Knowledge-Based Systems, vol. 83, no. 1, pp. 81–91, 2015.
- S.-W. Lin, Z.-J. Lee, S.-C. Chen, and T.-Y. Tseng, “Parameter determination of support vector machine and feature selection using simulated annealing approach,” Applied Soft Computing, vol. 8, no. 4, pp. 1505–1512, 2008.
- Ö. Uncu and I. B. Türkşen, “A novel feature selection approach: combining feature wrappers and filters,” Information Sciences, vol. 177, no. 2, pp. 449–466, 2007.
- R. E. Anderson, R. L. Tatham, and W. C. Black, Multivariate Data Analysis, 1998.
Copyright © 2017 Jun-He Yang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.