- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents

Abstract and Applied Analysis

Volume 2013 (2013), Article ID 796384, 14 pages

http://dx.doi.org/10.1155/2013/796384

## A Comparison of Bullwhip Effect under Various Forecasting Techniques in Supply Chains with Two Retailers

College of Management and Economics, Tianjin University, Tianjin 300072, China

Received 7 October 2013; Accepted 23 October 2013

Academic Editor: Massimiliano Ferrara

Copyright © 2013 Junhai Ma and Xiaogang Ma. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We examine the impact of three forecasting methods on the bullwhip effect in a two-stage supply chain with one supplier and two retailers. A first order mixed autoregressive-moving average model (ARMA(1, 1)) performs the demand forecast and an order-up-to inventory policy characterizes the inventory decision. The bullwhip effect is measured, respectively, under the minimum mean-squared error (MMSE), moving average (MA), and exponential smoothing (ES) forecasting techniques. The effect of parameters on the bullwhip effect under three forecasting methods is analyzed and the bullwhip effect under three forecasting methods is compared. Conclusions indicate that different forecasting methods lead to different bullwhip effects caused by lead time, underlying parameters of the demand process, market competition, and the consistency of demand volatility between two retailers. Moreover, some suggestions are present to help managers to select the forecasting method that yields the lowest bullwhip effect.

#### 1. Introduction

In a supply chain, as moving backward from a downstream member to an upstream member, the variance of order quantities of orders placed by the downstream member to its (immediate) upstream member tends to be amplified. The discovery of the phenomenon can be dated back to Forrester [1, 2] who discussed its causes and possible remediation in the context of industrial dynamics. After that, more and more researchers recognized the existence of this phenomenon in supply chains. At MIT, the well known “beer game” which was widely used in teaching inventory management was developed by Sterman [3]. The above phenomenon was first called as “bullwhip effect” by Lee et al. [4, 5]. In works of Lee et al. [4, 5], demand signal processing, nonzero lead-time, order batching, supply shortages, and price fluctuation were recognized as five important sources which might lead to the emergence of the bullwhip effect in supply chains. In order to avoid the bullwhip effect, many managerial approaches have been done, that is, lead-time reduction, information sharing, or applying different replenishment rules for the inventory system.

Among the most important issues that need to be addressed in dealing with the bullwhip effect, quantifying the bullwhip effect is a challenge. In the following papers, the supply chain might employ different demand processes and different forecasting methods. Using a first-order autoregressive (AR) demand process, Chen et al. [6, 7] investigated the impact of the MA and ES forecasting methods on the bullwhip effect for a simple, two-stage supply chain with one supplier and one retailer. Likewise, Xu et al. [8] conducted a similar research for the lead-time demand that is forecasted with the ES method. Luong [9] measured the bullwhip effect for a simple two-stage supply chain that includes only one retailer and one supplier in the environment where the retailer employs the order-up-to inventory policy for their inventory and demand forecast is performed through the AR model, and the effect of autoregressive coefficient and lead time on this measure was investigated. For the same two-stage supply chain, Duc et al. [10] investigated effects of the autoregressive coefficient, the moving average parameter, and the lead time on the bullwhip effect when the retailer performed through the ARMA(1, 1) model. Duc et al. [11] examined the impact of a third-party warehouse on the bullwhip effect in a three-stage supply chain with one supplier, one third-party warehouse and two retailers. Then, they found that the existence of the third-party warehouse has no influence on the bullwhip effect when the lead times of the third-party warehouse, and the two retailers are equal. Zhang [12] measured the bullwhip effect for the simple supply chain with AR demand process under various forecasting methods, and considered the impact of forecasting methods on the bullwhip effect. Feng and Ma [13] compared the MMSE, MA, and ES forecasting methods for the simple supply chain with ARMA(1, 1) demand process by using the dynamic simulation.

Ferrara et al. [14] examined how performances and characteristics of innovation poles and science park affect various aspects of Italian regional economies at NUTS 2 level. In particular, they found that impacts are different by geographic location but the effects are still evident even in the aggregate model. The number of IP/SP per region seems to display a positive role in sustaining the economic growth of corresponding regions. In addition, the patenting activity and the creation of research centers foster the growth of affiliated firms, which in turn affects regional economy’s parameters. To the contrary, the distance between the IP/SP and affiliated firms reduces the growing potential of the latter. Moreover, firms within an IP/SP turn out to outperforms (largely) the regional average. Finally, they found that more recent structures tend to be more prone to both patenting activity and high-level growth.

The supply chain model usually has only one retailer in the previous researches which study on the bullwhip effect, but the new supply chain we will build has two retailers. This supply chain is more in line with the structure of market. Pindyck and Rubinfeld [15] thought that the ARMA model often fits the time series of the demand process better than the AR model because the demand process usually has characteristics of both moving average and autoregressive process. The two retailers both employ the ARMA(1, 1) demand process, and both use the MMSE, MA, and ES method to forecast the lead-time demand, respectively. Our research not only determines an exact measure of the bullwhip effect but also analyzes the impact of parameters on the bullwhip effect under various forecasting methods and compare the impact of three forecasting method on the bullwhip effect.

The rest of this paper is organized as follow. Section 2 presents a new supply chain model containing two retailers which both follow the ARMA(1, 1) demand process and employ the order-up-to stock policy. In Section 3, the bullwhip effect measure for MMSE, MA, and ES forecasting method is derived. In Section 4, we analyze the effects of parameters on the bullwhip effect under different forecasting methods and compare the impact of three forecasting methods on the bullwhip effect. At last, some concluding remarks are discussed in Section 5.

#### 2. Supply Chain Model

##### 2.1. Demand Process

In this research, a two-stage supply chain with one supplier and two retailers is developed. Two retailers face customer demands and place orders to the supplier, respectively. We consider that retailer 1 faces an ARMA demand model as follows:

Here, and are the autoregressive and moving average coefficients of this demand model, where , . is independent and identically distributed from a symmetric distribution with mean and variance . And, we have

Similarly, retailer 2 also faces an ARMA(1, 1) demand model as follows: here, and have same properties with and accordingly. So, we also have

##### 2.2. Inventory Policy

Assumption of the order-up-to inventory policy is used in this supply chain system for its inventory management. Two retailers both employ the order-up-to inventory policy. Retailer 1 places an order of quantity to the supplier at the beginning of period . And the order quantity can be given as where is the order-up-to lever of retailer 1 at period , and it can be determined by the lead-time demand as where is the forecast for the lead-time demand of retailer 1 which is depend on the forecasting method and , is the standard deviation of lead-time demand forecast error, and is the normal -score that can be determined based on a given service level. Duc et al. [10] has proofed that does not depend on and has no influence on the bullwhip effect.

For retailer 2, the order quantity also can be given as

The order-up-to level of retailer 2 at period is Equations (7)-(8) have the same meaning with (5)-(6).

##### 2.3. Forecasting Technique

In this paper, we assume that two retailers both use the same forecasting technique to forecast the lead-time demand. In Section 3, the bullwhip effect will be measured, respectively, under the MMES, MA, and ES forecasting methods. Those three forecasting methods will be introduced in this section firstly.

###### 2.3.1. The MMSE Forecasting Method

In the MMSE forecasting method, the forecast for the lead-time demand can be given as where is the forecast for the demand at period , and can be determined as

###### 2.3.2. The MA Forecasting Method

Using the MA forecasting method, the forecast for the lead-time demand can be given as where is the span (number of date points) for the MA forecasting method.

###### 2.3.3. The ES Forecasting Method

The ES forecasting method is an adaptive algorithm in which one-period-ahead forecast is adjusted with a fraction of the forecasting error, and can be written as where denotes the fraction used in the method, also called the smoothing exponent.

#### 3. The Measure of the Bullwhip Effect under Various Forecasting Techniques

In this section, the measure of the bullwhip effect under the MMSE, MA, and ES forecasting methods will be derived, respectively.

Total demand which two retailers face is

The variance of is determined as

Two retailers face the same perfectly competitive market, and their demands present a negative correlation. We assume that the correlation coefficient is (), we can get

Using (15) in (14), we can get

##### 3.1. The Measure of the Bullwhip Effect under the MMSE Forecasting Method

According to Duc et al. [10], for the MMSE forecasting method, the order quantity of retailer 1 can be determined as where .

In the same, we also have where .

Total order quantity of period is

Proposition 1. *The variance of the total order quantity of period under the MMSE forecasting method can be given as
*

*Proof. *See the Appendix

For simplicity, (20) can be written as where is the coefficient of , is the coefficient of , and is the coefficient of in (20).

From (16) and (21), the measure of the bullwhip effect under the MMSE forecasting method, denoted as here, can be determined as where , which means the consistency of demand volatility between two retailers.

##### 3.2. The Measure of the Bullwhip Effect under the MA Forecasting Method

According to (5)-(6) and (11), we can get the order of retailer 1

We know that does not depend on , so (23) equals where is the span of the MA forecasting method for retailer 1. Retailer 2 has the same span , so the order quantity of retailer 2 is

The total order quantity of retailers in period is

Proposition 2. *The variance of the total order quantity at period under the MA forecasting method can be given as
*

*Proof. *See the Appendix.

For simplicity, (27) can be written as

where is the coefficient of , is the coefficient of , and is the coefficient of in (27).

From (16) and (28), the measure of the bullwhip under the MA forecasting method, denoted as here, can be determined as

the same, where .

##### 3.3. The Measure of the Bullwhip Effect under the ES Forecasting Method

According to Zhang [12], we know that the order quantity of retailer 1 at period under the ES forecasting method is where is the smoothing exponent of retailer 1 and is the forecast of the demand at period for retailer 1.

The same, the order quantity of retailer 2 at period under the ES forecasting method is where is the smoothing exponent of retailer 2 and is the forecast of the demand at period for retailer 2.

Hence, total order quantity of two retailers at period is

Proposition 3. *The variance of the total order quantity at period under the ES forecasting method can be given as
*

*Proof. *
See the Appendix.

For simplicity, (33) can be written as

where is the coefficient of , is the coefficient of , and is the coefficient of in (33).

From (16) and (34), the measure of the bullwhip under the ES forecasting method, denoted as here, can be determined as

the same, where .

#### 4. Analysis and Comparison for Various Forecasting Methods

In this section, impacts of demand process, inventory policy, forecasting methods, and other parameters on the bullwhip effect will be analyzed and illustrated by using numerical experiments. Results of these numerical experiments highlight the economic and managerial application of our model and findings.

##### 4.1. The Effect of Parameters on the Bullwhip Effect under the MMSE

Figures 1–3 simulate the expression of the bullwhip effect under the MMSE forecasting method to illustrate the impact of parameters on the bullwhip effect. Luong [9] has indicated that the bullwhip effect occurs only when the autoregressive coefficient is positive in the demand process under MMSE forecasting method. So, we vary the autoregressive coefficient of retailer 1 from 0 to 1 and set , , , , , and in Figure 1 to reveal the impact of on the bullwhip effect. We observe that the bullwhip effect increases slowly with the increase of , and the bullwhip effect begins to decrease rapidly when it reaches the maximum value. The bullwhip effect does not occur only when increases to a certain value, and those values are different for the different . For , when is smaller than a certain value, the smaller it is the larger the bullwhip effect is; when is larger than that certain value and smaller than another certain value, then the larger it is the larger the bullwhip effect is; and when is larger than another certain value, the smaller it is the larger the bullwhip effect is.

Figure 2 shows the impact of on the bullwhip effect when we set , , , , , and . The bullwhip effect increases slowly firstly, and then decreases slowly with the increase of .

Figure 3 investigates how parameters and affect the bullwhip effect when we set , , , , , and . The bullwhip effect decreases firstly, and it reaches the minimum value when , then increases with the increase of . The phenomenon illustrates that the bullwhip effect is smaller when the volatility of demand between two retailers is more consistent. Specially, the bullwhip effect attains a minimum when two retailers have the same volatility of demand. For the correlative coefficient of demand between two retailers, the larger it is the larger the bullwhip effect is. This phenomenon indicates that the intense competition between two retailers can reduce the bullwhip effect.

##### 4.2. The Effect of Parameters on the Bullwhip Effect under the MA

Figures 4–7 simulate the expression of the bullwhip effect under the MA forecasting method to illustrate the impact of parameters on the bullwhip effect. We vary from −1 to 1, shift , and fix values for all other parameters in Figure 4. It shows that the bullwhip effect decreases slowly firstly when , then increases slowly and decreases rapidly when . We also observe that the greater the lead-time of retailer 1 is the greater the bullwhip effect when is less than a certain number, and the greater the lead-time of retailer 1 is the less the bullwhip effect when is greater than that certain number.

Figure 5 shows the impact of on the bullwhip effect when we set , , , , , . The bullwhip effect increases slowly all the time with the increase of . And, in this situation, we shift the lead-time of retailer 1, and then the bullwhip effect becomes greater with the increase of .

We shift the span for the MA forecasting method to examine how the parameter affects the bullwhip effect in Figure 6. We can observe that is an important factor to affect the bullwhip effect, the greater can lead to the less bullwhip effect.

Figure 7 investigates how parameters and affect the bullwhip effect when we set , , , , , , and . The bullwhip effect increases firstly, and it reaches the maximum number when , then decreases with the increase of . The phenomenon illustrates that the bullwhip effect is stronger when the volatility of demand between two retailers is more consistent. Specially, the bullwhip effect attains a maximum when two retailers have the same volatility of demand. For the correlative coefficient of demand between two retailers, the larger it is the stronger the bullwhip effect is. The conclusion is different from the conclusion under the MMSE forecasting method. In proportion, this phenomenon indicates that the intense competition between two retailers can increase the bullwhip effect.

##### 4.3. The Effect of Parameters on the Bullwhip Effect under the ES

Figures 8–11 simulate the expression of the bullwhip effect under ES forecasting method to illustrate the impact of parameters on the bullwhip effect. For the ES forecasting method, we add the analysis for smoothing exponents. In Figure 8, we set , , , , , , and vary from to for different . The bullwhip effect increases firstly to the maximum value, and then decreases with the increase of . We observe that the greater is, the less the bullwhip effect when we fix other parameters, this result is different from cases under MMSE or MA forecasting method.

Figure 9 shows the impact of on the bullwhip effect when we set , , , , , and . The bullwhip effect increases slowly all the time with the increase of . And in this situation, we shift the lead-time of retailer 1, and then the bullwhip effect becomes great with the increase of . This result is the same as the situation under the MA forecasting method.

We shift the smoothing exponent of retailer 1 to indicate its impact on the bullwhip effect in Figure 10, and we observe the bullwhip effect as it grows to be greater with the increase of .

Figure 11 investigates how parameters and affect the bullwhip affect under the ES forecasting method when we set , , , . The bullwhip effect increases firstly, and it reaches the maximum number when , then decreases with the increase of . The phenomenon illustrates that the bullwhip effect is stronger when the volatility of demand between two retailers is more consistent. Specially, the bullwhip effect attains a maximum when two retailers have the same volatility of demand. For the correlative coefficient of demand between two retailers, the larger it is, the stronger the bullwhip effect is. The conclusion is the same as the conclusion under the MMSE forecasting method.

##### 4.4. The Comparison of Three Forecasting Methods

To compare bullwhip effects under three forecasting methods, we have to select appropriate , and . According to Zhang [12], the MA and ES forecasting methods have the same average date age (), when we set Figures 12–17 depict the comparison of the bullwhip effect among the MMSE, MA, and ES forecasting methods with different date ages, respectively. Then those figures illustrate which one is the best forecasting method for decreasing the bullwhip effect in different conditions.

From Figures 12–14, we observe that will always be higher than whatever is as long as . and get lower gradually with the increase of or with the decrease of and . We set , and and fix other parameters in Figure 12, and is lower than and whatever is. It means that the MMSE forecasting method is the best to forecast lead-time demand in this situation. In Figure 13, let , , is lower than when is smaller than a certain value, is higher than when is larger than that certain value, and is lower than whatever is. The conclusion means that the MMES method is the best when the market has fierce competition, and the MA method is the best when the market competition is not hot. In Figure 14, let , , is lower than when is smaller than a certain value, is higher than when is larger than that certain value. And is higher than when is larger than another certain value. It reveals that the MMES method is the best when the market has fierce competition, and the MA method is the best when the market competition is not so hot, and the MMSE method is the worst when the market has little competition.

From Figures 15–17, we observe that is always higher than whatever is as long as . and get lower gradually with the increase of or with the decrease of and . We set , and fix other parameters in Figure 15, and is lower than and whatever is. It means that the MMSE forecasting method is the best to forecast lead-time demand whatever the consistency of demand volatility between two retailers is.

In Figure 16, let , is lower than when is smaller than a certain value, is higher than when is larger than that certain value, and is lower than whatever is. The conclusion means that the MMES method is the best when the volatility of demand between two retailers is more consistent, and the MA, method is the best when the consistency of demand volatility between two retailers is weaker. In Figure 17, let , , is lower than when is smaller than a certain value, is higher than when is larger than that certain value, and is higher than whatever is. This phenomenon reveals that the MA method is the best whatever the consistency of demand volatility between two retailers is, and the MMSE method is the worst when the consistency of demand volatility between two retailers is weaker.

#### 5. Conclusions

In this research, a new supply chain model containing two retailers which both followed the ARMA(1, 1) demand process and employed the order-up-to stock policy was established. The bullwhip effect was measured under the MMSE, MA, and ES forecasting methods respectively. For three bullwhip effect expressions, we investigated the effect of lead-times, autoregressive coefficients, moving average parameters, and the correlation coefficients between two retailers on the bullwhip effect.

Besides those important sources which are pointed out by Lee et al. [4, 5], market competition and the consistency of demand volatility between two retailers are also two important factors leading to the bullwhip effect. The results show that the forecasting methods play an important role in determining the impact of those factors on the bullwhip effect. If the MMSE or MA forecasting method is used, shortening lead-time does not always reduce the bullwhip effect when the demand autocorrelation is varying. But, shortening lead-time has the most significant impact on reducing the bullwhip effect when the ES method is used to forecast demand. Under the MA or ES method, average date age has the significant impact on the bullwhip effect, the greater it is the weaker the bullwhip is. Market competition is proportional to the bullwhip effect when the MA or ES method is used, and it is inversely proportional to the bullwhip effect when the MMSE method is used. The consistency of demand volatility between two retailers is inversely proportional to the bullwhip effect when the MA or ES method is used, and it is proportional to the bullwhip effect when the MMSE method is used.

From a managerial perspective, the findings suggest that managers cannot reduce the bullwhip effect by shortening the lead-time blindly. So, managers should learn more knowledge of the basic demand models and different forecasting methods. The MMSE method is always the best among three methods if only the MA and ES method have the shorter average date age. The MA method is always better than the ES method whatever the average date age is. But, the bullwhip effect under the MA and ES methods will be receded with the increase of average date age. Also, we know that the MA or ES method may perform better than the MMSE method because they are more flexible and adapt better to the changing structures of the demand when the demand structure is not well specified or shifts over time. Then, the MA or ES method may be better than the MMSE method.

Quantifying the bullwhip effect and investigating its behavior are helpful in the allocation of efforts for mitigating the influence of the bullwhip effect in supply chains. This paper can be continuous in several directions that are likely to enhance our understanding of how demand signals are transmitted along the supply chain system. First, more general inventory policies can be studied. The simple order-up-to inventory policy can be misleading when an obvious fixed ordering cost exists. So, the study on the bullwhip effect for the general policy would have more practical significance. Second, more factors can be used for evaluating three forecasting methods. In this paper, the bullwhip effect as the only factor is the standard to estimate various forecasting methods. Managers may pay more attention to the inventory cost in practice, so researches on the impact of parameters for the inventory cost should be interesting.

#### Appendix

#### Proofs

According to Feng and Ma [13], we have

After iteration computation, we have so, we can get and we also have

According to Duc et al. [10], we have so, we also have

*Proof of Proposition 1. *Total order quantity of period under the MMSE forecasting method is

Taking the variance for (A.12), we get

Bring (A.1)–(A.12) into (A.14) and take the simplification, then we can get

This completes the Proof for Proposition 1.

*Proof of Proposition 2. *Total order quantity of period under the MA forecasting method is

Taking the variance for (A.16), we get

Bring (A.1)-(A.2) and (A.5)–(A.9) into (A.17), then take the simplification, and we can get

This completes the Proof for Proposition 2.

*Proof of Proposition 3. *
Total order quantity of period under the MA forecasting method is

Taking the variance for (A.19), we get

From Zhang [12], we have

According to (A.21), we can get
and according to (A.5), (A.24) equals to

The same, we also have

According to (A.21), we can get
and according to (A.9), (A.27) equals to

The same, we also have

From (A.21), we also get

So, we can get

Bing (A.1)-(A.2), (A.22)-(A.23), (A.28)-(A.29), and (A.31) into (A.20), then take the simplification, and we can get

This completes the Proof for Proposition 3.

#### Acknowledgments

This work was supported by the National Nature Science Foundation of China (no. 61273231) and the Doctoral Scientific Fund Project of the Ministry of Education of China (no. 20090032110031).

#### References

- J. W. Forrester, “Industrial dynamics—a major breakthrough for decision making,”
*Harvard Business Review*, vol. 36, no. 4, pp. 37–66, 1958. View at Google Scholar - J. W. Forrester,
*Industrial Dynamics*, MIT Press, Cambridge, Mass, USA, 1961. - J. Sterman, “Optimal policy for a multi-product, dynamic, nonstationary inventory problem,”
*Management Science*, vol. 12, pp. 206–222, 1989. View at Google Scholar - H. L. Lee, V. Padmanabhan, and S. Whang, “Information distortion in a supply chain: the bullwhip effect,”
*Management Science*, vol. 43, no. 4, pp. 546–558, 1997. View at Google Scholar · View at Scopus - H. L. Lee, P. Padmanabhan, and S. Whang, “Bullwhip effect in a supply chain,”
*Sloan Management Review*, vol. 38, pp. 93–102, 1997. View at Google Scholar - F. Chen, Z. Drezner, J. K. Ryan, and D. Simchi-Levi, “Quantifying the bullwhip effect in a simple supply chain: the impact of forecasting, lead times, and information,”
*Management Science*, vol. 46, no. 3, pp. 436–443, 2000. View at Google Scholar · View at Scopus - F. Chen, J. K. Ryan, and D. Simchi-Levi, “The impact of exponential smoothing forecasts on the bullwhip effect,”
*Naval Research Logistics*, vol. 47, no. 4, pp. 269–286, 2000. View at Google Scholar · View at Scopus - K. Xu, Y. Dong, and P. T. Evers, “Towards better coordination of the supply chain,”
*Transportation Research E*, vol. 37, no. 1, pp. 35–54, 2001. View at Publisher · View at Google Scholar · View at Scopus - H. T. Luong, “Measure of bullwhip effect in supply chains with autoregressive demand process,”
*The European Journal of Operational Research*, vol. 180, no. 3, pp. 1086–1097, 2007. View at Publisher · View at Google Scholar · View at Scopus - T. T. H. Duc, H. T. Luong, and Y.-D. Kim, “A measure of bullwhip effect in supply chains with a mixed autoregressive-moving average demand process,”
*The European Journal of Operational Research*, vol. 187, no. 1, pp. 243–256, 2008. View at Publisher · View at Google Scholar · View at Scopus - T. T. H. Duc, H. T. Luong, and Y.-D. Kim, “Effect of the third-party warehouse on bullwhip effect and inventory cost in supply chains,”
*International Journal of Production Economics*, vol. 124, no. 2, pp. 395–407, 2010. View at Publisher · View at Google Scholar · View at Scopus - X. Zhang, “The impact of forecasting methods on the bullwhip effect,”
*International Journal of Production Economics*, vol. 88, no. 1, pp. 15–27, 2004. View at Publisher · View at Google Scholar · View at Scopus - Y. Feng and J. H. Ma, “Demand and forecasting in supply chains based on ARMA(1,1) demand process,”
*Industrial Engineering Journal*, vol. 11, no. 5, pp. 50–55, 2008. View at Google Scholar - M. Ferrara, R. Mavilia, and F. Lamperti, “The effects of innovation poles and science parks on regional economies in Italy,” in
*Proceedings of the 3rd International Conference on Communication and Management in Technological Innovation and Academy*, Recent Advances in Communications, Circuits and Technological Innovation, pp. 196–202, WSEAS Press, Paris, France, 2012. - R. S. Pindyck and D. L. Rubinfeld,
*Econometric Models and Economic Forecasts*, McGraw-Hill, Irwin, Ba, USA, 4th edition, 1998.