A New Hybrid Approach for Wind Speed Prediction Using Fast Block Least Mean Square Algorithm and Artificial Neural Network
A new hybrid wind speed prediction approach, which uses fast block least mean square (FBLMS) algorithm and artificial neural network (ANN) method, is proposed. FBLMS is an adaptive algorithm which has reduced complexity with a very fast convergence rate. A hybrid approach is proposed which uses two powerful methods: FBLMS and ANN method. In order to show the efficiency and accuracy of the proposed approach, seven-year real hourly collected wind speed data sets belonging to Turkish State Meteorological Service of Bozcaada and Eskisehir regions are used. Two different ANN structures are used to compare with this approach. The first six-year data is handled as a train set; the remaining one-year hourly data is handled as test data. Mean absolute error (MAE) and root mean square error (RMSE) are used for performance evaluations. It is shown for various cases that the performance of the new hybrid approach gives better results than the different conventional ANN structure.
Recently the alternative renewable and clean energy sources have gained great importance in the world. Principally the wind and solar energy sources have received much attention because of their minimal environmental effect and sustainability [1–3]. Wind energy is one of the most economical methods for electrical energy generation. On the other hand, wind power plants require continuous and appropriate intensity winds. In terms of the reliability and power quality of the power systems, the variability of wind power has led to problems. To minimize these problems, highly accurate wind speed prediction method should be used [1, 4] for optimum grid operations.
Wind speed prediction can be considered as three categories based on the prediction horizon :(i)Immediate short term prediction is usually applied to intervals ranging from 10 secs to 8 hours ahead and used generally in electricity market-wind prediction control.(ii)Short term prediction is usually for 8 hours to 168 hours ahead; it has attracted the attention of most researchers because of strategy planning and commitment decisions of systems.(iii)Long term prediction is for ranges that are one week longer used generally in maintenance planning and wind farm study.
Immediate and short term wind speed prediction are critical and challenging problems for optimum grid operations. Various methods have been implemented in the last decades, such as regression-based methods [5–9], ANN models [10–15], Markov chains [16–21], support vector regression [22, 23], and spatiotemporal models , and recently, applications of hybrid ANNs-hybrid models with statistical or other intelligent [25–38] approaches have received attentions.
In this study, a new hybrid approach which is based on FBLMS and ANN is proposed for short term wind speed prediction. Since adaptive FBLMS algorithm operates on an instantaneous basis, the weighting vector is updated for every new iteration. The adaptation of filter parameters is performed in the frequency domain using fast and efficient Fast Fourier Transform (FFT) algorithm . FBLMS algorithm has also improved convergence rate which can also easily follow seasonal or other variations in data set . This powerful adaptive prediction filter is applied together with ANN to get a superior performance.
To compare the performances of the proposed FBLMS and ANN based hybrid approach with conventional and known ANN based methods, real hourly wind speed values are used. The hourly averaged wind data are collected from two different regions stations of Turkish State Meteorological Service of Eskisehir and Bozcaada.
The remaining parts of the paper are organized as follows. In Section 2, the FBLMS method with ANN and its algorithm steps for wind speed prediction are clarified briefly. In Section 3, description and representation of data used for this study Eskisehir and Bozcaada region are given. Applications of the model and prediction correctness results are presented and the results of this method are compared in the sense of MAE and RMSE in Section 4. Finally, in Section 5, the main contributions of this paper are emphasized and possible research directions are discussed.
2. Hybrid FBLMS and ANN Method for Wind Speed Prediction
Adaptive filters are one of the most efficient solutions when the input signal’s characteristics are not available, especially for filtering and prediction problems. The most popular and very well analyzed adaptive filter algorithms implementation is the least mean squares (LMS) widely used and there are many variations of this algorithm, reducing the complexity and increasing the convergence gracious rate . This algorithm instantly updates the prediction for each new sample. An important method to find the coefficients of the solution is fast block. This method is gracious, but raw computations requirement of these algorithms can be a problem for systems that need many filter taps. For performing fast convolution, FFT algorithm provides a powerful tool and fast correlation .
The weight vector is updated for every new sample since the algorithm operates on an instantaneous basis. But a steady-state analysis of convergence for the LMS algorithm with deterministic reference inputs showed that the steady-state weight vector is biased, and thus the adaptive estimate does not approach the Wiener solution. To solve this problem, another strategy to estimate the coefficients is the block LMS algorithm. The coefficient vector is updated only once every occurrence based on block gradient estimation in this algorithm .
FBLMS technique is a quick numerically efficient version of the block LMS. It will have the same characteristics with regard to adaptive performance but potentially can need much fewer operations to implement. Using the FFT algorithm with an overlap-save method, the adaptation of filter parameters is performed in the frequency domain . Including overlapping output sections rather than input sections, the overlap-add method results in more computation. A schematic diagram of the FBLMS with overlap-save method is given in Figure 1. The details of the FBLMS algorithm are presented in .
The implementation of FBLMS algorithm can be summarized as follows.
Step 1 (filtering). Considerwhere is the zero padded and extended input vector.
are the last elements of inverse FFT (IFFT) ofwhere is tap weight vector and denotes element-by-element multiplication of vectors.
Step 2 (error estimation). Considerwhere is a desired wind speed value and is an output wind speed value.
Step 3 (adaptation of tap weight). Considerwhere is tap weight vector update, where is defined as step size.
Step 4 (constraint of tap weight). Consider
Step 5. The outputs of ANN model are utilized for wind speed data.
The output of FBLMS is selected as one of the inputs of the ANN structure. Hybrid FBLMS and ANN structure for wind speed prediction structure is presented in Figure 2. In the simulations, is chosen as six which is the number of neurons.
In this figure, is the output of the FBLMS method , where are the previous available wind speed values. The proposed ANN structure uses both the available previous wind speed hourly values and FBLMS output. A detailed diagram for the second structure is shown in Figure 3.
3. Description and Representation of the Data Set
In this study, six-year hourly wind speed data of Bozcaada and Eskisehir regions between 2007 and 2012 are used for training. Year 2013 is used to test the accuracy of the proposed hybrid FBLMS and ANN approach. To figure out the underlying dynamics of wind speed data, a proper analysis is needed. To model the wind speed data, two regions with different spectral behaviors are handled. The data referring to Bozcaada (39.8°, 26.06°) and Eskisehir (39.7°, 30.5°) are used testing the proposed approach.
Bozcaada is located in the west of Turkey and is surrounded on all sides and has a vast coastal area. Bozcaada has one of the highest wind energy potentials in Turkey. On the other hand, Eskisehir has very low wind potential due to its terrestrial climate and terrain structure. Wind speed hourly averaged data are collected from measured from Turkish State Meteorological Service for Eskisehir region in the year 2013: (a) weekly pattern, (b) monthly pattern, and (c) yearly pattern are given in Figure 4. In Figure 5, (a) weekly pattern, (b) monthly pattern, and (c) yearly pattern of wind speed hourly averaged data are shown for Bozcaada region in the year 2013.
As seen from Figures 4 and 5, the characteristics of wind data can be modelled as nonstationary random time series and predicting the future value is challenging problem. Magnitude of the wind speed data of two regions tell us that the wind energy potential of Bozcaada region is quite higher than Eskisehir. These two regions are especially chosen to compare the effectiveness of the method for different cases.
The important statistics of Eskisehir and Bozcaada are given in Table 1.
4. Application and Results
In this section, the accuracy of the proposed method is tested using wind speed data values between 2007 and 2012 for training and the remaining one-year hourly data as testing. This section of the study has been divided into three parts. In the first part, two different conventional ANN structures are applied to Eskisehir and Bozcaada wind speed data for prediction models. In the second part, hybrid FBLMS and ANN is implemented for chosen regions. In the last part, comparison of the results is discussed. The RMSE is defined as where and are the exact and predicted wind speed values, respectively.
The MAE can be defined as where is the number of periods of time.
4.1. Conventional ANN Structures for Wind Speed Prediction
The different conventional ANN structures have been commonly used to predict wind speed values [1, 5, 8, 9]. To make fair comparison, the ANN structures are created where the previous available past values are used as in Figure 2. The hourly parameters of wind speed data are got as the input; the hourly prediction values are got as the output values. Two different ANN structures are applied. The first ANN structure has two layers as shown in Figure 2. Feed forward backpropagation is handled as a network type. The second ANN structure consists of five layers and three of them are hidden layers. Each hidden layer has ten neurons. The number of neurons of input layer is six and output layer has one for the first and second structure. Transfer function is taken in log-sigmoid. Levenberg–Marquardt backpropagation algorithm which has fast convergence is handled by learning process for all ANN structures. The trained data network structure is used for one-hour ahead prediction. Actual wind speed values and output of the first conventional ANN structure for Eskisehir results in 2013 and a zoomed portion are given in Figures 6(a) and 6(b), respectively.
Same conventional ANN structures are also applied to Bozcaada region data. Two different structures are used as in Eskisehir. Transfer function is taken in log-sigmoid.
4.2. Hybrid FBLMS and ANN Based Wind Speed Prediction
FBLMS structure in Figure 1 and ANN structures are used together to make highly accurate wind speed prediction as shown in Figure 2. To our knowledge, this hybrid adaptive and ANN structure is firstly applied to wind speed prediction in this study. The real data which are collected from two different regions between 2007 and 2012 are used to train and determine the parameters of the FBLMS and ANN structures. Then the wind speed data of Eskisehir and Bozcaada region for the year 2013 are used to test the performance of the proposed structures.
4.3. Comparison of the Results of Conventional ANN and Hybrid FBLMS and ANN Method
MAE and RMSE results for conventional ANN and hybrid FBLMS and ANN method is presented in Table 2.
MAE and RMSE values in Table 2 are calculated using (6) and (7), respectively. Since the mean values are smaller in Eskisehir region, the error values of Eskisehir are lower than Bozcaada region. On the other hand, hybrid FBLMS and ANN method finds best results of selected two regions. The error values are approximately decreased between 2.1% and 3.3% when the proposed approach is applied.
Prediction of the wind speed values is quite significant for optimum electricity market operations, strategy planning, commitment decision, and wind farms studies for all horizon. Although wind speed data has some diurnal and seasonal periodicities, it is highly stochastic data and it is hard to predict future values. In this study, hybrid FBLMS and ANN method is firstly used to predict wind speed values to get more accurate results. Since, the proposed approach is based on adaptive filtering, the seasonal and other variations on data can be successfully tracked which reduces the overall error. To make fair comparison, ANN structure with two and five layers and the proposed hybrid FBLMS and ANN method are applied to real wind data. Consequently, the proposed hybrid FBLMS+ANN method’s performance is better than the conventional ANN approximately between 2.1% and 3.3%. Additionally, this approach is fast and can adaptively track the variations on data.
|:||Tap weight vector update|
|():||Extended input vector|
|:||Desired output vector|
|:||Tap weight vector|
|:||The last elements of IFFT of|
|:||One sample delay.|
The author declares that there are no competing interests.
This work was supported by Anadolu University Scientific Research Projects Fund with Project no. 1505F512. The received fund covers the costs to publish in open access. And the author is grateful to the Turkish State Meteorological Service for providing the data.
M. A. Duran and Ü. Başaran Filik, “Short-term wind speed prediction using several artificial neural network approaches in Eskisehir,” in Proceedings of the International Symposium on Innovations in Intelligent Systems and Applications (INISTA '15), pp. 1–4, Madrid, Spain, September 2015.View at: Publisher Site | Google Scholar
Ü. Başaran Filik and M. Kurban, “Potential analysis of some renewable energy sources for Eskisehir, Turkey,” in Proceedings of the World Renewable Energy Congress X (WREC X '08), Glasgow, UK, July 2008.View at: Google Scholar
Ü. Basaran Filik, T. Filik, and O. N. Gerek, “New electric transmission systems: experiences from Turkey,” in Handbook of Clean Energy Systems, J. Yan, Ed., John Wiley & Sons, New York, NY, USA, 2015.View at: Google Scholar
Ü. Başaran Filik, “Wind speed prediction based on different artificial neural network approach for Eskisehir region,” in Proceedings of the 5th International 100% Renewable Energy Conference (IRENEC '15), Istanbul, Turkey, 2015.View at: Google Scholar
S. Haykin, Adaptive Filter Theory, chapter 10, 3rd edition, 1996.