Short-Term Power Load Point Prediction Based on the Sharp Degree and Chaotic RBF Neural Network

Niu, Dongxiao; Lu, Yan; Xu, Xiaomin; Li, Bingjie

doi:https://doi.org/10.1155/2015/231765

Mathematical Problems in Engineering

On this page

Abstract Introduction Conclusion References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 231765 | https://doi.org/10.1155/2015/231765

Short-Term Power Load Point Prediction Based on the Sharp Degree and Chaotic RBF Neural Network

Dongxiao Niu,¹Yan Lu,¹Xiaomin Xu,¹and Bingjie Li¹

Academic Editor: Dan Simon

Received21 Oct 2014

Revised09 Dec 2014

Accepted16 Dec 2014

Published08 Jan 2015

Abstract

In order to realize the predicting and positioning of short-term load inflection point, this paper made reference to related research in the field of computer image recognition. It got a load sharp degree sequence by the transformation of the original load sequence based on the algorithm of sharp degree. Then this paper designed a forecasting model based on the chaos theory and RBF neural network. It predicted the load sharp degree sequence based on the forecasting model to realize the positioning of short-term load inflection point. Finally, in the empirical example analysis, this paper predicted the daily load point of a region using the actual load data of the certain region to verify the effectiveness and applicability of this method. Prediction results showed that most of the test sample load points could be accurately predicted.

1. Introduction

Short-term load forecasting (STLF) plays a key role in power dispatching work. It is the foundation of power grid planning, grid control, system safety analysis, and the economic operation. The forecasting accuracy is closely related to the grid running safety and economy [1, 2]. At present, many scholars and experts have already done a lot of theoretical researches and practical simulations on short-term load forecasting [3–20]. More common short-term load forecasting models include regression prediction model [3], time series prediction model [4], artificial neural network prediction model [5], fuzzy logic and expert system [6, 7], the wavelet analysis model [8], chaos theory [9], and combination prediction model [10–12]. Literature [13] analyzed the power factors and predicted the short-term load based on rough set method. Literature [14, 15] introduced data mining techniques for short-term load forecasting. Literature [16] proposed a novel combination prediction model for short-term load forecasting which mainly studied the weight of combination prediction model with different scenarios. Literature [17] established a combination of modified firefly algorithm and support vector regression model which was used for the STLF. Literature [18] studied the short-term forecasting of categorical changes in wind power based on Markov chain models. Literature [19] studied the short-term load forecasting based on the wavelet transform and grey model improved by PSO. Literature [20] proposed a relevance vector machine short-term load forecasting model based on nonnegative matrix decomposition.

On the whole, research on short-term load forecasting has been relatively mature. The models are more complicated and intelligent. Combination forecasting model is a research trend [21]. Inflection point is usually the most concern of the dispatch staff in short-term load forecasting. How to identify and predict inflection point of short-term load is a challenge problem. At present, there is no mature solution to the short-term load forecasting of inflection point. This paper gets a load sharp degree sequence by the transformation of the original load sequence based on the algorithm of sharp degree. Then, it forecasts the load sharp degree sequence by designing and training the forecasting model of chaotic RBF neural network to realize the short-term load forecasting of inflection point.

2. Inflection Point Identification Algorithm Based on Sharp Degree

Inflection point is the most important features of load curve. The inflection point in this paper is the point that changes the direction of load curve upward or downward in a certain time interval. This paper identifies the inflection point according to the sharp degree of each point on the load curve. Set the function of load curve as , in which the independent variable means time and the dependent variable represents the load time series.

Randomly select a point on the curve as the center. is the point in front of a distance of . And is the point behind a distance of .

Define the vector : Define , the angle of and , as the angle consisting of , , and on the load curve. Figure 1 shows the part outline figure of the load curve. The peripheral solid line is composed of load time series. The dotted line is the circular arc fitted by , , and . And is the center of circular arc. Usually, the value of is set in the range of 3–5. For the endpoint of load curve, we will take 3 to 5 sample values forward and backward on the sample load data. On the actual curve, the points , , and can be approximately regarded as three points on the circular arc as the interval of the three points is very small [22].

Assuming that , then In this function, .

When , , and are in a straight line, , then When the value of decreases tending to zero, Therefore, in a very small load curve, the variable sharp can be defined as sharp degree of The larger the value of sharp, the smaller the value of , and the curve would be more sharp. On the contrary, the curve would be more smooth. Because of the continuity of load, the identification of inflection point is closely related to the interval of load curve sequence and the set threshold value. Therefore, the threshold value can be set according to the load curve characteristics and actual situation. If sharp , the can be regarded as inflection point.

3. Prediction Model Based on Chaotic RBF Neural Network

Artificial neural network is a common type of load forecasting methods. This method is highly intelligent which has strong ability to look for patterns [23]. Radical basis function (RBF) neural network is a kind of highly efficient feed-forward neural network. It has the best approximation performance and global optimal property. And the structure is simple; the training speed is fast [24]. Chaos prediction algorithm applied to power load is a very hot research field which is caused by the intrinsic characteristics of systems. It can be predicted in the short term [25]. It predicts directly according to the laws of the objective extracting data sequence itself and does not need to establish the mapping relation model of influence factors. In theory, it not only can decrease the cost of prediction, but can improve the prediction accuracy as well [26]. The method combining chaos and RBF neural network can make full use of the randomicity and initial value sensitivity of chaos. In addition, it can make full use of the function of RBF, such as massively parallel processing, self-organizing, and self-adapting [27].

Although sharp degree sequence is turbulent, it can be used to identify the inflection point. Chaotic time series are similar to random noise which is chaotic and unpredictable. But its inherent nonlinear dynamics structure makes it meet the short-term predictability [28]. Use phase space reconstruction to find the internal of regularity conversion sequences that can be described by a nonlinear mapping, and then approximate the nonlinear mapping by applying radial basis to forecast the inflection point. The process of the model established in this paper is shown in Figure 2.

First of all, we can get the sharp degree sequence which can identify the inflection point on the basis of Section 2. Then, reconstruct phase space and identify chaos based on chaos theory. This paper selects mutual information method to calculate delay time, Cao method to determine embedding dimension, and the computing of largest Lyapunov exponent to identify the chaos. Thirdly, the input layer of RBF neural network can be determined based on the delay time and embedding dimension. Then, train the RBF neural network and predict the sharp degree sequence making use of the trained network. Finally, determine the threshold and position the inflection point.

3.1. Phase Space Reconstruction and Chaos Identification

Extend the time series to three-dimension or higher dimension space by using delay-coordinate method to reconstruct state space which can find information and rules contained in the original time series. And by “Takens” theorem, the dynamic characteristic of attractor of the system can be restored in the sense of topological equivalence [29, 30]. Assume that the time sequence is ; properly select embedding dimension and time delay ; the reconstructed phase space is as follows: of which is the length of the vector sequence.

3.1.1. Delay Time Calculated by Mutual Information Method

Mutual information method is a kind of commonly used methods to calculate delay time [31]. It is suitable for large data sets and nonlinear problem. Set offline random variables , . The mutual information is as follows: In the functions, is the probability of happening , is the total number of possible things or states, and the logarithmic function often takes 2 for base number.

For the time series and delay time with an interval of , set as the probability of the in , and , the probability of in , can be calculated through the frequency in the corresponding time sequence, and , the joint probability of common presence of and in these two sequences, can be found in the corresponding grid on plane . Therefore, the mutual information can be regarded as the function of delay time , . When the meets the minimum for the first time, the lag time is the time delay of phase space reconstruction.

3.1.2. Embedding Dimension Determined by Cao Method

There are some methods to determine embedding dimension, such as the pseudo adjacent point method. G-P algorithm, and C-C method. Cao algorithm is a mature method which was put forward by Cao Liangyue [32]. When using Cao method, firstly set a delay time, and the embedding dimension and delay time are relatively independent [33]. Define In the function, is a vector that is in a space of dimensions, is the integer that makes be the nearest neighbor domain of in the -dimensional reconstruction space. depends on and ; and means the Euclidean distance.

Define the average of all as Define the change of dimensional to dimensional as If the time series are generated by the chaotic attractor, when saturated with the increases of , the value of is the minimum embedding dimension. Define to distinguish deterministic chaotic signal and random signal: For the random sequence, to all of the values of , the values of always equal about 1, while for the chaotic sequence, the values of are related to values of . Namely, values of are not constant to all of in chaotic sequence [34].

3.1.3. Identify the Chaos by Computing the Largest Lyapunov Exponent

The fundamental characteristics of chaos are the extreme sensitivity to initial values. The sensitivity can be measured by the exponent of Lyapunov. It reflects the divergence speed close to the initial orbit. The exponent of Lyapunov exponent reflects the contracting and tensile properties of the system in all directions. This paper calculates Lyapunov exponent based on the Wolf method to judge whether the original sequence is with chaos characteristics [35]. Wolf method is based on phase trajectory, phase plane, and phase volume. The process is as follows.(1)Determine the embedding dimension and delay time to reconstruct phase space.(2)Track the evolution of the distance from initial point and its closest point. Limit the short separation.(3)Continue to the front steps until the end of the time series.(4)Get the maximum Lyapunov exponent.

3.2. Chaotic Time Series Predicted by RBF Neural Network

3.2.1. The Basic Principle of RBF Neural Network

RBF neural network is a feed-forward neural network consisting of input layer, hidden layer, and output layer [36, 37], as shown in Figure 3.

Input layer to hidden layer is linear connection. And hidden layer to output layer is nonlinear connection.

3.2.2. Chaotic RBF Neural Network Prediction Steps

The specific steps of chaotic RBF neural network prediction are as follows.

(1) Establish the Network. Determine the input and output according to the calculated embedding dimension and delay time . The input is a vector . The output is a data . RBF neural network is a mapping from -dimension to 1-dimension. In this paper, the number of input layer nodes is . The number of output layer nodes is 1. The input matrix and output matrix are as follows:

(2) Training Stage. Select a certain length of time series; set matrix as input and vector as output to train the network.

(3) Forecasting Stage. Set as the input of the neural network, and the output is the actual predictive value of the sequence. Then iterate the network with the predictive value as a new network input.

4. The Empirical Example Analysis

To do empirical analysis, this paper selects the load on May 2, 2011, May 9, May 16, and May 23, and May 30 (Monday) of a region and collects 96 points per day, a total of 480 load data to calculate. Among them, set the data of first four days, a total of 384 data as the training sample, the data of last day, and a total of 96 as test samples, to verify and analyze the load prediction model of inflection points.

Firstly, compose the load data of May 2, 9, 16, and 23 to a load sequence. Then, calculate the sharp degree of every point of the load data according to the identification algorithm of inflection point based on sharp degree that was mentioned above. The load sequence and sharp degree sequence are, respectively, shown in Figures 4 and 5.

As can be seen from Figure 5, the polarization phenomenon of sharp degree sequence is obvious. The point of sharp degree sequence is corresponding to the point of original sequence. Most of the values in Figure 5 are less than 0.1, which are corresponding to the flat load curve in Figure 4. Only a few values in Figure 5 are between 0.1 and 1, which are corresponding to the inflection points in Figure 4. Therefore set the threshold as 0.1. The load point with a sharp degree value greater than 0.1 is the inflection point defined in this paper. Thus, inflection point can be effectively identified by the sharp degree sequence.

According to the mutual information method, the delay time . And calculate the minimum embedding dimension with Cao method. It can be seen in Figure 6 that tends to be saturate along with the increase of . When , remains the same. So the minimum embedding dimension is 6 (). At the same time, it also can be seen in the diagram that, with different values of , is not always equal to 1. The value of Lyapunov exponent is 0.3017 after being calculated by Wolf method, which is greater than zero. So the conversion sequences of input can be judged as chaotic sequence.

Reconstruct the phase space according to the minimum embedding dimension and delay time. Then we can predict the sharp degree of load sequence based on RBF neural network. The most critical part of determining RBF network is the choice of nonlinear excitation function. In some typical excitation functions, this paper uses the Gaussian function as the excitation function for its radial symmetry, smoothness, and simple expression formula. Set the error of training system to 0.001. Select the self-organizing selection center method to determine the network center, width, and weight. Then train the training sample with RBF neural network. The convergence curve in training process is shown in Figure 7. We can see that the blue trace is the convergence curve of training. The red horizontal line which parallels the -axis and equals 10⁻³ is the goal of training. The green vertical line which parallels the -axis and equals 285 epochs at the far right side of the plot means that best training performance is 0.00099767 at epoch 285. The forecasting result of test samples of the load sharp degree sequence is shown in Figure 8.

This paper uses the average absolute percentage error MAPE and the root mean square error RMSE to evaluate the forecasting effect, and the formula is The calculation shows that the MAPE is 5.293% and the RMSE is 6.391%. The predicting is with a high accuracy.

The forecasting error curve of load sharp degree sequence test samples based on chaotic RBF is shown in Figure 9. It can be seen that there is one point whose error value is bigger than others. The point is the ninth point of prediction sequence. The actual value of this point is less than 0.001. However, the predicted value is 0.576. The reason of this situation is that the ninth point of 96 points in the historical everyday data is inflection point. The ninth point of forecasting sequence is an abnormal point.

This paper selects BP neural network model in order to verify the effectiveness and superiority of the proposed algorithm. BP neural network is one of the most commonly used kinds of artificial neural network. The forecasting result of test samples based on chaotic RBF and BP is shown in Figure 10. The MAPE of the results based on BP neural network is 9.149%, which is much higher than the MAPE of chaotic RBF. Thus, the superiority of chaotic RBF algorithm is evident particularly.

Set the inflection point threshold , extract the points with a predictive value greater than 0.1 in sharp degree sequence, and then locate and highlight the points in the known load curve on May 30, as shown in Figure 11.

It can be seen from Figure 11 that most of the inflection points of test samples can be accurately predicted by either using inflection point identification algorithm based on contour sharp degree or forecasting model based on chaotic RBF neural network and that verified that inflection point prediction model proposed in this paper is of high accuracy.

In order to further validate the applicability and effectiveness of model, this paper selected representative load curves of different seasons to carry out the empirical researches. The prediction training sample contains 96 points per day of the same week type 4 weeks before the prediction, and the training data totally contains 384 points. The prediction error results are shown in Table 1.

The forecasting of 16 groups data shows that the average MAPE of the model proposed in this paper is 4.25%. The average RMSE is 3.897%. It suggests that the forecast effect is fine and the model is with strong practicability and applicability.

5. Conclusion

This paper puts forward a feasible load inflection point prediction method by proposing an inflection point forecasting model that can realize effective prediction of inflection point based on the algorithm of sharp degree and chaotic RBF neural network on the basis of research on short-term power load.

In the calculation example, the paper proposed an empirical analysis method of 96 points per day, and the algorithm can be also applied to the inflection point prediction of a shorter or a longer time interval. However, the time interval and different threshold selection will directly affect the inflection point identification based on the forecasted sharp degree sequence. According to actual needs, the original load time interval and the value of threshold can be adjusted.

Although forecasting of the load curve contains the information of inflection point, during the ordinary load forecasting, the prediction error of inflection points is slightly larger than other points. This paper transformed the original load sequence based on the sharp degree. And after transformation, the polarization phenomenon of the sequence is obvious that highlights the regularity of the change of the inflection point. In the later research work, the inflection point forecast correction, the improvement of original load curve forecasting results, and mining of the influence factors of inflection point to increase the input dimension of inflection point prediction can be considered to further improve the prediction accuracy.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

This paper is supported by the National Science Foundation of China (Grant nos. 71071052 and 71471059).

References

D. X. Niu, S. H. Cao, and J. C. H. Lu, Power Load Forecasting Technique and Its Application, China Electric Power Press, 2009.
C. H. Q. Kang, Q. Xia, and M. Liu, Power System Load Forecasting, China Electric Power Press, 2007.
T. Hong and P. Wang, “Fuzzy interaction regression for short term load forecasting,” Fuzzy Optimization and Decision Making, vol. 13, no. 1, pp. 91–103, 2014.
View at: Publisher Site | Google Scholar
N. Amjady, “Short-term hourly load forecasting using time-series modeling with peak load estimation capability,” IEEE Transactions on Power Systems, vol. 16, no. 3, pp. 498–505, 2001.
View at: Publisher Site | Google Scholar
L. Hernández, C. Baladrón, J. M. Aguiar et al., “Artificial neural networks for short-term load forecasting in microgrids environment,” Energy, vol. 75, pp. 252–264, 2014.
View at: Publisher Site | Google Scholar
M. Y. Chow and H. Tram, “Application of fuzzy logic technology for spatial load forecasting,” IEEE Transactions on Power Systems, vol. 12, no. 3, pp. 1360–1366, 1997.
View at: Publisher Site | Google Scholar
D. Srinivasan and S. S. Tan, “Parallel neural network-fuzzy expert system strategy for short-term load forecasting: system implementation and performance evaluation,” IEEE Transactions on Power Systems, vol. 14, no. 3, pp. 1100–1106, 1999.
View at: Publisher Site | Google Scholar
W. J. Staszewski and K. Worden, “Wavelet analysis of time-series: coherent structures, chaos and noise,” International Journal of Bifurcation and Chaos, vol. 9, no. 3, pp. 455–471, 1999.
View at: Google Scholar
H. Mori and S. Vrano, “Short-term load forecasting with chaos time series analysis,” in Proceedings of the International Conference on Intelligent Systems Applications to Power Systems, pp. 283–287, 2007.
View at: Google Scholar
J. X. Che and J. Z. Wang, “Short-term load forecasting using a kernel-based support vector regression combination model,” Applied Energy, vol. 132, pp. 602–609, 2014.
View at: Publisher Site | Google Scholar
A. Deihimi, O. Orang, and H. Showkati, “Short-term electric load and temperature forecasting using wavelet echo state networks with neural reconstruction,” Energy, vol. 57, pp. 382–401, 2013.
View at: Publisher Site | Google Scholar
H. J. Sadaei, R. Enayatifar, A. H. Abdullah, and A. Gani, “Short-term load forecasting using a hybrid model with a refined exponentially weighted fuzzy time series and an improved harmony search,” International Journal of Electrical Power and Energy Systems, vol. 62, pp. 118–129, 2014.
View at: Publisher Site | Google Scholar
Z. H. Xiao and S. J. Ye, “Rough set method for short-term load forecasting,” Journal of Systems Engineering, vol. 24, no. 2, pp. 143–149, 2009.
View at: Google Scholar
C. H. Kim, B. G. Koo, and J. H. Park, “Short-term electric load forecasting using data mining technique,” Journal of Electrical Engineering and Technology, vol. 7, no. 6, pp. 807–813, 2012.
View at: Publisher Site | Google Scholar
L. Z. H. Zhu, “Short-term electric load forecasting with combined data mining algorithm,” Automation of Electric Power Systems, vol. 30, no. 14, pp. 82–86, 2006.
View at: Google Scholar
D. X. Niu and Y. N. Wei, “Short-term power load combinatorial forecast adaptively weighted by FHNN similar-day clustering,” Automation of Electric Power Systems, vol. 37, no. 3, pp. 54–57, 2013.
View at: Publisher Site | Google Scholar
A. Kavousi-Fard, H. Samet, and F. Marzbani, “A new hybrid Modified Firefly Algorithm and Support Vector Regression model for accurate Short Term Load Forecasting,” Expert Systems with Applications, vol. 41, no. 13, pp. 6047–6056, 2014.
View at: Publisher Site | Google Scholar
M. Yoder, A. S. Hering, W. C. Navidi, and K. Larson, “Short-term forecasting of categorical changes in wind power with Markov chain models,” Wind Energy, vol. 17, no. 9, pp. 1425–1439, 2014.
View at: Publisher Site | Google Scholar
S. Bahrami, R.-A. Hooshmand, and M. Parastegari, “Short term electric load forecasting by wavelet transform and grey model improved by PSO (particle swarm optimization) algorithm,” Energy, vol. 72, pp. 434–442, 2014.
View at: Publisher Site | Google Scholar
S. H. D. Pan, Z. H. N. Wei, Z. H. Gao et al., “A short-term load forecasting model based on relevance vector machine with nonnegative matrix factorization,” Automation of Electric Power Systems, vol. 36, no. 11, pp. 62–66, 2012.
View at: Google Scholar
Q.-H. Zhang, “A model for short-term load forecasting in power system based on multi-AI methods,” System Engineering Theory and Practice, vol. 33, no. 2, pp. 354–362, 2013.
View at: Google Scholar
Z. G. Qian and X. Z. Lin, “Detection algorithm of image corner based on contour sharp degree,” Computer Engineering, vol. 34, no. 6, pp. 202–204, 2008.
View at: Google Scholar
B. Amrouche and X. Le Pivert, “Artificial neural network based daily local forecasting for global solar radiation,” Applied Energy, vol. 130, pp. 333–341, 2014.
View at: Publisher Site | Google Scholar
R. Mohammadi, S. M. T. F. Ghomi, and F. Zeinali, “A new hybrid evolutionary based RBF networks method for forecasting time series: a case study of forecasting emergency supply demand time series,” Engineering Applications of Artificial Intelligence, vol. 36, pp. 204–214, 2014.
View at: Publisher Site | Google Scholar
H. Y. Luo, T. Q. Liu, and X. Y. Li, “Chaotic forecasting method of short-term wind speed in wind farm,” Power System Technology, vol. 33, no. 9, pp. 67–71, 2009.
View at: Google Scholar
M. D. Alfaro, J. M. Sepúlveda, and J. A. Ulloa, “Forecasting chaotic series in manufacturing systems by vector support machine regression and neural networks,” International Journal of Computers Communications & Control, vol. 8, no. 1, pp. 8–17, 2013.
View at: Publisher Site | Google Scholar
Z. Y. Zhang, T. Wang, and X. G. Liu, “Melt index prediction by aggregated RBF neural networks trained with chaotic theory,” Neurocomputing, vol. 131, pp. 368–376, 2014.
View at: Publisher Site | Google Scholar
H. B. Bi and Y. B. Zhang, “Application of the chaotic RBF neural network on electrical loads prediction,” Science, Technology and Engineering, vol. 9, no. 24, pp. 7480–7492, 2009.
View at: Google Scholar
W. Y. Zhang, W. C. Hong, Y. Dong, G. Tsai, J. T. Sung, and G. F. Fan, “Application of SVR with chaotic GASA algorithm in cyclic electric load forecasting,” Energy, vol. 45, no. 1, pp. 850–858, 2012.
View at: Publisher Site | Google Scholar
S. Kouhi, F. Keynia, and S. N. Ravadanegh, “A new short-term load forecast method based on neuro-evolutionary algorithm and chaotic feature selection,” International Journal of Electrical Power & Energy Systems, vol. 62, pp. 862–867, 2014.
View at: Publisher Site | Google Scholar
X.-Q. Lu, B. Cao, M. Zeng, S.-S. Huang, and X.-G. Liu, “Algorithm of selecting delay time in the mutual information method,” Chinese Journal of Computational Physics, vol. 23, no. 2, pp. 184–188, 2006.
View at: Google Scholar
K. Aihara, T. Takabe, and M. Toyoda, “Chaotic neural networks,” Physics Letters A, vol. 144, no. 6-7, pp. 333–340, 1990.
View at: Publisher Site | Google Scholar | MathSciNet
Y. R. Cheng and S. B. Guo, “Stock price prediction based on analysis of chaotic time series,” Journal of UEST of China, vol. 32, no. 4, pp. 469–472, 2003.
View at: Google Scholar
S.-Q. Zhang, J. Jia, M. Gao, and X. Han, “Study on the parameters determination for reconstructing phase-space in chaos time series,” Acta Physica Sinica, vol. 59, no. 3, pp. 1576–1582, 2010.
View at: Google Scholar
D. Kressner, M. Ple{\vS}inger, and C. Tobler, “A preconditioned low-rank CG method for parameter-dependent Lyapunov matrix equations,” Numerical Linear Algebra with Applications, vol. 21, no. 5, pp. 666–684, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J. Z. Zhou, Y. C. Zhang, Q. Q. Li, and J. Guo, “Probabilistic short-term load forecasting based on dynamic self-adaptive radial basis function network,” Power System Technology, vol. 34, no. 3, pp. 37–41, 2010.
View at: Google Scholar
H. L. Deng and X. Q. Li, “Stock price inflection point prediction method Based on chaotic time series analysis,” Statistics and Decision, no. 5, pp. 19–20, 2007.
View at: Google Scholar

Copyright

Copyright © 2015 Dongxiao Niu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1376

Downloads

1106

Citations