Research Article | Open Access
Application of Empirical Mode Decomposition with Local Linear Quantile Regression in Financial Time Series Forecasting
This paper mainly forecasts the daily closing price of stock markets. We propose a two-stage technique that combines the empirical mode decomposition (EMD) with nonparametric methods of local linear quantile (LLQ). We use the proposed technique, EMD-LLQ, to forecast two stock index time series. Detailed experiments are implemented for the proposed method, in which EMD-LPQ, EMD, and Holt-Winter methods are compared. The proposed EMD-LPQ model is determined to be superior to the EMD and Holt-Winter methods in predicting the stock closing prices.
Recent studies have indicated that financial markets typically follow nonlinear and nonstationary behavior. Therefore, forecasting finance using classical techniques is quite difficult. The empirical mode decomposition (EMD) explored by Huang et al.  is a very powerful tool in modern quantitative finance and has emerged as a powerful statistical modeling technique [2, 3]. The capacity of the EMD to handle nonlinear and nonstationary behaviors has provided both researchers and practitioners with an attractive alternative tool. The EMD can explain the generation of time series data from an alternative perspective by breaking up time series signals into smaller numbers of independent and concretely implicational intrinsic modes based on scale separation. This distinguishing feature makes the EMD a valuable and desirable tool for forecasting financial time series signals . The current study aims to extract and forecast the trend of two stock markets, namely, the Kuala Lumpur Bursa (KLSE) index and the New Zealand stock market index (NZX50), using the advantages of local linear quantile (LLQ) regression. The proposed method consists of two stages. In the first stage, LLQ is applied to corrupt and noisy data. The remaining series is subsequently expected to be hidden in the residuals. In the second stage, EMD is applied to the residuals. The final estimate is the summation of the fitting estimates from the LLQ and EMD. To extract and forecast the trend using EMD-LLQ and EMD, we summarize the steps as follows. (1) A signal is decomposed by the EMD-LLQ and EMD. (2) Meaningful intrinsic mode functions (IMFs) (components) are selected using the fast Fourier transform (FFT) (see ). (3) Selected components are added to the residue to obtain the trend. (4) The Holt-Winter method is based on the selected components and provides the forecasting results.
The remainder of this paper is organized as follows. Section 2 presents a brief background of the EMD and LLQ. Section 3 introduces the proposed method. Section 4 compares the results of the original EMD algorithm and the new proposed method by forecasting the daily closing prices of two stock markets, namely, the KLSE and the NZX50. Section 5 concludes.
2. Why EMD-LPQ (Empirical Mode Decomposition Combined with Local Linear Quantile Regression)?
Due to the edged effects, nonparametric techniques such as empirical mode decomposition show a sharp increase in variance and bias at points near the boundary. The presence of such problem has dramatic effects on results. Varieties of works have been reported in literature in order to reduce the effects of boundary problem in traditional EMD. Two-stage methods or coupling methods nowadays have been used extensively for solving such problem; for instance , applied neural network to each IMF to restrain the end effect  provided an algorithm based on the sigma-pi neural network which is used to extend signals before applying EMD. Reference  proposed a new two-stage algorithm. The algorithm includes two steps: the extrapolation of the signal through support vector (SV) regression at both endpoints to form the primary expansion signal, and then the primary signal is further expanded through extrema mirror expansion and EMD is performed on the resulting signal to obtain reduced end limitations. All previous methods have been shown to have good solutions to the end point and achieved a higher precision in an application part as well. In this paper we have followed . The proposed method EMD-LPQ (empirical mode decomposition combined with local linear quantile regression) is designed to be a robust version of classical empirical mode decomposition especially in presence of edge effect problems.
3. Empirical Mode Decomposition
The EMD  has proven to be a natural extension of and an alternative technique to traditional methods for analyzing nonlinear and nonstationary signals, such as wavelet methods, Fourier methods, and empirical orthogonal functions . In this section, we briefly describe the EMD algorithm. The EMD mainly decomposes the data into smaller signals called IMFs. An IMF is a function in which the upper and the lower envelopes are symmetric. Moreover, the number of zero-crossings and the numbers of extremes are equal or differ by one, at the most . The algorithm for extracting IMFs for a given time series is called shifting, and it consists of the following steps.(i)The initial estimates for the residue are set at , , and , and the IMF index is set at .(ii)The lower minima and the upper envelopes of the signal are constructedusing the cubic spline method.(iii)The mean values are computed by averaging the upper and lower envelopes as .(iv)The mean is subtracted from the original signal; that is, and . Steps (i) to (iv) are repeated until becomes an IMF. Hence, the th IMF is given by .(v)The residue is updated via . This residual component is treatedas new data and subjected to the previously described process to calculate the next .(vi)The previous steps are repeated until the final residual component becomes amonotonic function. The final estimation of residue is subsequently considered.
Several methods have been presented to extract trends from a time series. Freehand and least squares methods are the commonly used techniques; the former depends on the experience of users, whereas the latter is difficult to use when the original series is very irregular . The EMD is another effective method for extracting trends .
4. Local Linear Quantile (LLQ) Regression
The seminal study of Koenker and Bassett  introduced parametric quantile regression, which is considered an alternative to the classical regression in both parametric and nonparametric fields. Numerous models for the nonparametric approach have been introduced in statistical literature, such as the locally polynomial quantile regression by Chaudhuri  and the kernel methods by Koenker et al. . In this paper, we adopt the LLQ regression employed by Yu and Jones .
Let be bivariate observations. To estimate the th conditional quantile function of response , the equation below is defined given :
Let be a positive symmetric unimodal kernel function, and consider the following weighted quantile regression problem: where . Once the covariate observations are centered at point, the estimate of is simply , which is the first component of the minimizer of (1), and determines the estimate of the slope of the function at point .
5. Bandwidth Selection
The practical performance of strongly depends on the selected bandwidth parameter. We adopt the strategy of Yu and Jones . In sum, we employ the automatic bandwidth selection strategy for smoothing conditional quantiles as follows.(1)We use ready-made and sophisticated methods in selecting ; we employ  which explored a “direct plugin” bandwidth selection procedure which relies on asymptotically optimal bandwidth: where and for later use we have introduced the array
Again for later use we write down the following estimator with a bandwidth for : This is simply a normalized residual sum of squares and normalizing quantity , sometimes known as the degrees of freedom, which is given by .
Its presented guarantees , where is either constant or linear .(2)We use to obtain all of the other from . and are standard normal density and distribution functions, and is a bandwidth parameter for regression mean estimation with various existing methods. This procedure obtains identical bandwidths for the and quantiles.
6. Proposed Method
The proposed method consists of two stages that automatically decrease the boundary effects of EMD . At the first stage, LLQ which is considered as an excellent boundary treatment  is applied to the corrupted and noisy data. The remaining series is then expected to be hidden in the residuals. At the second stage, EMD is applied to the residuals. The final estimate is the summation of the fitting estimates from LLQ and EMD. Compared with EMD, this combination obtains more accurate estimates.
This section elaborates the proposed method, EMD-LLQ. The basic idea behind the proposed method is to estimate the underlying function with the sum of a set of EMD functions, , and an LLQ function, . That is,
We estimate the two components and to obtain our proposed estimate, , through the following steps.(1)The LLQ is applied to the corrupt and noisy data , and the trend estimate is subsequently obtained.(2)The residuals of from LLQ, that is, , are determined.(3)The EMD is applied to , given that the remaining series is expected to be hidden in the residuals. This step is accomplished by performing the following substeps: this substep is accomplished by performing algorithms (i) to (vi).(4)The final estimate is the summation of the fitting estimates from LLQ and EMD and is as follows:
7. Experiment Analysis and Results
In this section, we consider the daily closing prices of two stock markets, namely, KLSE and NZX50, from December 3, 2007, to December 6, 2013, see Figure 1. The last 10, 30, and 50 days of the KLSE and NZX50 stock indices are forecasted, respectively, based on the past sequences. The selection of these two indices aims to qualitatively and culturally compare the time series of two different markets. The data used in this study are collected from the website: http://in.finance.yahoo.com/. We analyze the two indices based on the EMD-LLQ and EMD, in combination with the FFT and the Holt-Winter methods. The approach consists of several steps. First, we decompose the daily closing prices of the stock markets into a finite number of components called IMFs and one residue. Second, we select significant components by applying the FFT to each IMF. Third, we add the significant component obtained from step two to the residue to acquire the trend. Finally, we employ the Holt-Winter method for forecasting the trend.
8. Comparison of Forecasted Data
Two criteria are used to evaluate the forecasting performance of the different models in empirical studies. The forecasting accuracy measures employed in this study are root mean square error (RMSE), mean error (MAE), and mean absolute square error (MASE). The RMS, MA, and MASE values obtained through the EMD-LLQ, EMD, and Holt-Winter methods in each test set for the two index series are summarized in Tables 1 and 2. The results demonstrate that the proposed EMD-LLQ method is more successful in all cases in forecasting the stock closing prices than the EMD and the Holt-Winter methods.
9. Conclusion and Future Research
We propose an EMD-LLQ model for forecasting future prices by considering the past sequences of daily stock prices. The EMD-LLQ method is a new two-stage forecasting method that combines the EMD and LLQ algorithm. The effectiveness of the new model is analyzed by performing experiments on KLSE and NZX50 data. The capability of the EMD-LLQ for forecasting the future daily stock closing prices is better than that of LLQ, EMD, and the Holt-Winter methods. The results demonstrate that EMD-LLQ is an effective method for forecasting financial time series. Future research should improve the performance of the proposed method. We can consider several forecasting strategies by analyzing the composition of daily stock closing prices. Another possible strategy is to apply the Hilbert-Huang transform for selecting meaningful IMFs (components) instead of using the FFT.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
The authors would like to thank Universiti Sains Malaysia (USM Short Term Grant 304/PMATHS/6313045) for financial support.
- N. E. Huang, Z. Shen, S. R. Long et al., “The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis,” Proceedings of the Royal Society of London A: Mathematical, vol. 454, pp. 903–995, 1971.
- K. Drakakis, “Empirical mode decomposition of financial data,” International Mathematical Forum, vol. 3, no. 25, pp. 1191–1202, 2008.
- N. E. Huang, M. Wu, W. Qu, S. R. Long, and S. S. P. Shen, “Applications of Hilbert-Huang transform to non-stationary financial time series analysis,” Applied Stochastic Models in Business and Industry, vol. 19, no. 3, pp. 245–268, 2003.
- A. Lin, P. Shang, G. Feng, and B. Zhong, “Application of empirical mode decomposition combined with K-nearest neighbors approach in financial time series forecasting,” Fluctuation and Noise Letters, vol. 11, no. 2, Article ID 1250018, 2012.
- S. Rezaei, Physiological Synchrony as Manifested in Dyadic Interactions, University of Toronto, 2013.
- Y. Deng, W. Wang, C. Qian, Z. Wang, and D. Dai, “Boundary-processing-technique in EMD method and Hilbert transform,” Chinese Science Bulletin, vol. 46, no. 11, pp. 954–960, 2001.
- Z. Liu, “A novel boundary extension approach for empirical mode decomposition,” in Intelligent Computing, pp. 299–304, Springer, 2006.
- A. M. Jaber, M. T. Ismail, and A. M. Altaher, “Empirical mode decomposition combined with local linear quantile regression for automatic boundary correction,” Abstract and Applied Analysis, vol. 2014, Article ID 731827, 8 pages, 2014.
- C. D. Blakely, A Fast Empirical Mode Decomposition Technique for Nonstationary Nonlinear Time Series, Elsevier Science, Amsterdam, The Netherlands, 2005.
- A. Amar and Z. E. A. Guennoun, “Contribution of wavelet transformation and empirical mode decomposition to measurement of U.S core inflation,” Applied Mathematical Sciences, vol. 6, no. 135, pp. 6739–6752, 2012.
- J. Fan and R. Li, “Statistical challenges with high dimensionality: feature selection in knowledge discovery,” http://arxiv.org/abs/math/0602133.
- R. Koenker and G. Bassett Jr., “Regression quantiles,” Econometrica, vol. 46, no. 1, pp. 33–50, 1978.
- P. Chaudhuri, “Nonparametric estimates of regression quantiles and their local Bahadur representation,” The Annals of Statistics, vol. 19, no. 2, pp. 760–777, 1991.
- R. Koenker, P. Ng, and S. Portnoy, “Quantile smoothing splines,” Biometrika, vol. 81, no. 4, pp. 673–680, 1994.
- K. Yu and M. C. Jones, “Local linear quantile regression,” Journal of the American Statistical Association, vol. 93, no. 441, pp. 228–237, 1998.
- D. Ruppert, S. J. Sheather, and M. P. Wand, “An effective bandwidth selector for local least squares regression,” Journal of the American Statistical Association, vol. 90, no. 432, pp. 1257–1270, 1995.
- T. C. M. Lee and V. Solo, “Bandwidth selection for local linear regression: a simulation study,” Computational Statistics, vol. 14, no. 4, pp. 515–532, 1999.
- Z. Cai and X. Xu, “Nonparametric quantile estimations for dynamic smooth coefficient models,” Journal of the American Statistical Association, vol. 103, no. 484, pp. 1595–1608, 2008.
Copyright © 2014 Abobaker M. Jaber et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.