Journal of Renewable Energy

Volume 2013 (2013), Article ID 368940, 6 pages

http://dx.doi.org/10.1155/2013/368940

## Reliability Measures of Second-Order Semi-Markov Chain Applied to Wind Energy Production

^{1}Dipartimento di Farmacia, Università “G. D'Annunzio” di Chieti-Pescara, 66013 Chieti, Italy^{2}Dipartimento di Scienze Economiche ed Aziendali, Università degli Studi di Cagliari, 09123 Cagliari, Italy^{3}Dipartimento di Ingegneria Industriale e dell'Informazione e di Economia, Università degli Studi dell'Aquila, 67100 L'Aquila, Italy

Received 12 September 2012; Revised 26 November 2012; Accepted 7 December 2012

Academic Editor: Shuhui Li

Copyright © 2013 Guglielmo D'Amico et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We consider the problem of wind energy production by using a second-order semi-Markov chain in state and duration as a model of wind speed. The model used in this paper is based on our previous work where we have shown the ability of second-order semi-Markov process in reproducing statistical features of wind speed. Here we briefly present the mathematical model and describe the data and technical characteristics of a commercial wind turbine (Aircon HAWT-10 kW). We show how, by using our model, it is possible to compute some of the main dependability measures such as reliability, availability, and maintainability functions. We compare, by means of Monte Carlo simulations, the results of the model with real energy production obtained from data available in the Lastem station (Italy) and sampled every 10 minutes. The computation of the dependability measures is a crucial point in the planning and development of a wind farm. Through our model, we show how the values of this quantity can be obtained both analytically and computationally.

#### 1. Introduction

Wind is one of the most important renewable energy sources. Wind energy is produced by converting the kinetic energy of wind into electrical energy by means of a generator. For this reason, it is important to dispose of an efficient stochastic model for wind speed changes.

First- and second-order Markov chain models have been extensively used in wind speed modelling and synthetic time series generation; see, for example, Shamshad et al. [1], Nfaoui et al. [2], Youcef Ettoumi et al. [3], Sahin and Sen [4], and Torre et al. [5].

The Markovian assumption has, especially in the modeling of wind speed, several flaws. In discrete time Markov chain models, waiting times in a state before making a transition to another state are geometrically distributed. Therefore Markov chains impose artificial assumptions on the structure of the data that, very often, are inappropriate. This leads to a great simplification of the model which is unable to reproduce correctly the statistical properties of the real wind speed process.

Semi-Markov chains do not have this constraint because the waiting time distribution functions in the states can be of any type, and this allows the data to speak for themselves without any restriction. For this reason, semi-Markov chains have been extensively applied to different fields [6–13].

D'Amico et al. [14] was the first paper where semi-Markov chains were applied in the modelling of wind speed. In that paper were proposed first- and second-order semi-Markov models with the aim of generate synthetic wind speed data. It was shown that the semi-Markov models perform better than the Markov chain model in reproducing the statistical properties of wind speed data. In particular, the model recognized as being more suitable is the second-order semi-Markov model in state and duration.

In this paper we show how to compute dependability measures as availability, reliability, and maintainability functions for the second-order semi-Markov chain in state and duration. These indicators give important information on the feasibility of the investment in a wind farm by giving the possibility to quantify the uncertainty in the wind energy production.

Another important aspect is related to the location of the wind farm. In fact, today, many wind farms are built offshore for different reasons: the wind speed is more powerful and constant due to the absence of obstacles, and visual, environmental, and acoustic impact is cut down. The maintenance cost, instead, is higher than the onshore wind farm. A good stochastic model can help the planning of preventive maintenance suggesting when is suitable to execute the maintenance operation. This is possible by analyzing what happens after a particular transition between two different states which is lasted for a certain time period.

The results presented here are new and generalize some of the results obtained for semi-Markov chain of order one (see [15, 16]). The model generalizes also Markov chains and renewal models.

We apply our model to a real case of energy production. For this reason, we choose a commercial wind turbine, a 10 kW Aricon HAWT assumed to be installed at the station of L.S.I-Lastem which is situated in Italy.

The paper is organized as follows. Section 2 presents some definitions and notation on the second-order semi-Markov chain in state and duration. Section 3 describes the database and the technical characteristics of the commercial wind turbine. Section 4 shows the way in which it is possible to compute the dependability measures via kernel transformations, and the values computed on the real data and on the synthetic data are compared. In the last section some concluding remarks and possible extensions are presented.

#### 2. The Second-Order Semi-Markov Chains in State and Duration

Higher-order semi-Markov processes were introduced by Limnios and Oprişan [17]. The dependence on the past was given only through past states. These models were recently generalized by D'Amico et al. [14] that proposed second-order semi-Markov chain in state and duration.

Let us consider a finite set of states in which the system can be into and a complete probability space on which we define the following random variables:

They denote the state occupied at the th transition and the time of the th transition, respectively. To be more concrete, by we denote the wind speed at the th transition and by the time of the th transition of the wind speed process.

We assume that

Relation (2) asserts that the knowledge of the values suffices to give the conditional distribution of the couple whatever the values of the past variables might be.

The conditional probabilities are stored in a matrix of functions called the second-order kernel (in state and duration). The element represents the probability that next wind speed will be at time given that the current wind speed is , the previous wind speed state was , and the duration in wind speed before reaching wind speed was equal to units of time.

We can define the cumulated second-order kernel probabilities:

The process is a second-order Markov chain with state space and transition probability matrix . We will refer to it as the embedded Markov chain.

The conditional cumulative distribution functions of the waiting time in each state, given the state previously occupied and the duration of occupancy, are defined as

Denote by for all the number of transitions up to time . The second-order semi-Markov chain in state and duration can be defined as

If we define, for all , and , the semi-Markov transition probabilities by it is possible to prove that they verify the following system of equations:

For this model more general duration-dependent transition probabilities than (7) have been obtained in D'Amico et al. [14].

#### 3. Database and Commercial Wind Turbine

As in our previous work [14] we used a free database of wind speed sampled in a weather station situated in Italy. The station processes the speed every 10 minutes in a time interval ranging from 25/10/2006 to 28/06/2011. During the 10 minutes are performed 31 sampling which are then averaged in the time interval. In this work, we use the sampled data that represents the average of the modulus of the wind speed (m/s) without considering a specific direction. This database is composed of about 230000 wind speed measures ranging from 0 to 16 m/s.

In order to apply our semi-Markov model, we discretize wind speed into 8 states (see Table 1) chosen to cover all the wind speed distribution. This choice is done by considering a tradeoff between accuracy of the description of the wind speed distribution and the number of parameters to be estimated. An increase in the number of states better describes the process but requires a larger dataset to get reliable estimates, and it could also be not necessary for the accuracy needed in forecasting future wind speeds. On the third column of Table 1 we report the number of times the recorded wind speed was in state . As it is possible to see, the number of occupancies of state 7 is small compared to all other states and wind speed exceeds 8 m/s in very few cases. We stress that the discretization should be chosen according to the database to be used.

We apply our model to a real case of energy production. For this reason we choose a commercial wind turbine, a 10 kW Aricon HAWT with a power curve given in Figure 1. The power curve of a wind turbine represents how much energy it produces as a function of the wind speed. In this case, see Figure 1, there is a cut in speed at 2 m/s, instead the wind turbine produces energy almost linearly from 3 to 10 m/s, and then, with increasing wind speed, the energy production remains constant until the cut out speed, in which the wind turbine is stopped for structural reason. Then the power curve acts as a filter for the wind speed. In the database used for our analysis the wind speed does never exceed 16 m/s, and it is seldom over 8 m/s, this is why the discretization is performed according to Table 1 and the wind never reached the cut out speed.

Through this power curve we can know how much energy is produced as a function of the wind speed at a given time.

#### 4. Reliability Theory for the Second-Order Semi-Markov Chain in State and Duration

In this section, following the research line in Barbu et al. [15] and in Blasi et al. [16], we define and compute reliability measures for the second-order semi-Markov chain in state and duration.

Let be partitioned into sets and , so that The subset contains all “Up” states in which the system is working and subset all Down' states in which the system is not working well or has failed. In the wind speed model the Up states are those for which the wind speed is sufficiently high to allow the production of energy or not excessive high such that the turbine should be turned off.

In the following we present both the typical indicators used in reliability theory and also their application. In order to verify the validity of our model, we compare the behaviour of these indicators for real and synthetic data. The indicators of the synthetic data are computed averaging over 500 different trajectories generated through Monte Carlo simulations based on the second-order semi-Markov model in state and duration. The number of trajectories is chosen to have stable results.

The three indicators that we evaluate are the following.

(i)* The pointwise availability function * giving the probability that the system is working on at time whatever happens on .

In our model we denote this function by where , see relation (5). The availability gives the probability that at time the wind turbine produces energy given that at time zero the wind speed entered state coming from state with a duration equal to .

(ii)* The reliability function * giving the probability that the system was always working from time 0 to time :
The reliability gives the probability that the wind turbine will always produce energy from time zero up to time given that at time zero the wind speed entered state coming from state with a duration equal to .

(iii)* The maintainability function * giving the probability that the system will leave the set within the time being in at time 0:
The maintainability gives the probability that the turbine will produce energy at least once from time zero up to time given that at time zero the wind speed entered state coming from state with a duration equal to .

These three probabilities can be computed in the following way if the process is a second-order semi-Markov chain in state and duration of cumulated kernel .

The three indicators, computed and shown in the following figures, are plotted by varying the initial state , the current state , and the sojourn time . The numeric choice of each parameter is given only for graphical reasons, in order to show the maximum number of curves without overlaps. As numeric indicator to compare the gap between the curves we compute the mean square error (MSE) between the indicator applied to the real data and the 500 simulated trajectories. The mean square error is defined as follows: where stands for the indicators or estimated form real data and the indicators or estimated from each synthetic trajectory.

(i) *The point wise availability function *: to compute these probabilities it is sufficient to use the following formula:

In Figure 2 the availability functions of the real and synthetic data are compared. The comparison is made by varying the sojourn time and the starting state. Particularly, in Figure 2 the availability function for two different initial states is plotted maintaining constant the current state for two different sojourn times . In Table 2 we show the MSE for each of the curves of Figure 2.

(ii) *The reliability function *: to compute these probabilities, we will now work with another cumulated kernel for which all the states of the subset are changed into absorbing states by considering for all the following transformation:
where is given by solving the evolution equation of a second-order semi-Markov chain in state and duration but now with the cumulated kernel .

The related formula will be where are the transition probabilities of the process with all the states in that are absorbing, that is, with cumulated kernel .

Figure 3 shows the reliability functions for real data compared with the simulated ones. The plotting procedure is the same as for the previous figure: we maintain constant the current state , and we vary the initial state and the sojourn time . The theoretical trend of the reliability function is confirmed, and the probability decreases at the increasing of the time interval. A numerical comparison is given in Table 3 in which the MSE of the four curves of Figure 3 is computed.

(iii) *The maintainability function *: to compute these probabilities we will now work with another cumulated kernel for which all the states of the subset are changed into absorbing states by considering the following transformation:
where is given by solving the evolution equation of a second-order semi-Markov chain in state and duration but now with the cumulated kernel .

The related formula for the maintainability function will be where is the transition probability of the process with all the states in that are absorbing, that is, with cumulated kernel .

The maintainability function is plotted in Figure 4. As the previous figures, this one shows the comparison of the maintainability for the real and simulated data varying the initial state and sojourn time and maintaining constant the current state. In Table 4 the MSE of the maintainability function for the curves of Figure 4 is computed.

It is possible to note that all the indicators plotted above (availability, reliability, and maintainability) depend strongly on the initial and current states and that there is also a great dependence on the sojourn time . In fact, all the probabilities have different values also if only the sojourn time is changed keeping constant initial states and final state . For example, from Figure 3 it is possible to see that, in general, and in particular and . This reveals that it is important to dispose of a model that is able to distinguish between these different situations which are determined only from a different duration of permanence in the initial state before making a transition to the current state . Models based on Markov chains or classical semi-Markov chain are unable to capture this important effect that our second-order semi-Markov chain in state and duration reproduces according to the real data.

For each of the indicator we have computed the mean square error between real and synthetic data at different time distance from time zeros. In all cases, the difference between real and simulated data increases with time. The data we are using are 10 minutes sampled, this implies that our model works well for very short time scales, and its performance becomes worse for longer time scale. To get better results on a longer time horizon (from more than 1 hour to days) one should use data sampled less frequently but for a longer period. Then, given that the transition probabilities in our model are estimated for high-frequency date it is intended for forecasting the probabilities of reliability measures at very short time scale (from 10 minutes to 1 hour).

#### 5. Conclusion

In our previous work, we presented new stochastic models for the generation of synthetic wind speed data. In this work, instead, we compute, for the first time, typical indicators in reliability theory for wind speed phenomenon by using a second-order semi-Markov model in state and duration. In order to check the validity of the presented model, we have compared the behaviour of these indicators for real data and data simulated by means of Monte Carlo simulations. To do this, we applied our model to a real case of energy production, filtering real, and simulated data by the power curve of a commercial wind turbine. To compare results from real and simulated date we have computed the mean square error between real and synthetic data for each of the indicator. The results show that the proposed model is able to reproduce the behaviour of real data by exhibiting the dependence of the reliability indicators on past visited states and on the length of the sojourn times. This shows that semi-Markov approach is more suitable than simpler Markov chain models. From our results we can also say that our model applied to 10 minutes sampled data works well if one considers short time scale (from 10 minutes to 1 hour), and its performance decreases with time.

The indications provided by the model are of importance for assessing the suitability of a location for the wind farm installation as well as for the planning of a preventive maintenance policy.

#### References

- A. Shamshad, M. A. Bawadi, W. M. A. Wan Hussin, T. A. Majid, and S. A. M. Sanusi, “First and second order Markov chain models for synthetic generation of wind speed time series,”
*Energy*, vol. 30, no. 5, pp. 693–708, 2005. View at Publisher · View at Google Scholar · View at Scopus - H. Nfaoui, H. Essiarab, and A. A. M. Sayigh, “A stochastic Markov chain model for simulating wind speed time series at Tangiers, Morocco,”
*Renewable Energy*, vol. 29, no. 8, pp. 1407–1418, 2004. View at Publisher · View at Google Scholar · View at Scopus - F. Youcef Ettoumi, H. Sauvageot, and A. E. H. Adane, “Statistical bivariate modelling of wind using first-order Markov chain and Weibull distribution,”
*Renewable Energy*, vol. 28, no. 11, pp. 1787–1802, 2003. View at Publisher · View at Google Scholar · View at Scopus - A. D. Sahin and Z. Sen, “First-order Markov chain approach to wind speed modelling,”
*Journal of Wind Engineering and Industrial Aerodynamics*, vol. 89, no. 3-4, pp. 263–269, 2001. View at Publisher · View at Google Scholar · View at Scopus - M. C. Torre, P. Poggi, and A. Louche, “Markovian model for studying wind speed time series in Corsica,”
*International Journal of Renewable Energy Engineering*, vol. 3, no. 2, p. 3119, 2001. View at Google Scholar - G. D'Amico, J. Janssen, and R. Manca, “Semi-Markov reliability models with recurrence times and credit rating applications,”
*Journal of Applied Mathematics and Decision Sciences*, vol. 2009, Article ID 625712, 17 pages, 2009. View at Publisher · View at Google Scholar - G. D'Amico, J. Janssen, and R. Manca, “European and American options: the semi-Markov case,”
*Physica A*, vol. 388, no. 15-16, pp. 3181–3194, 2009. View at Publisher · View at Google Scholar · View at Scopus - G. D'Amico, M. Guillen, and R. Manca, “Full backward non-homogeneous semi-Markov processes for disability insurance models: a Catalunya real data application,”
*Insurance*, vol. 45, no. 2, pp. 173–179, 2009. View at Publisher · View at Google Scholar · View at Scopus - J. Janssen and R. Manca,
*Semi-Markov Risk Models for Finance, Insurance and Reliability*, Springer, 2007. - N. Limnios and G. Oprişan,
*Semi-Markov Processes and Reliability*, Statistics for Industry and Technology, Birkhäuser, Boston, Mass, USA, 2001. View at Publisher · View at Google Scholar - G. D'Amico and F. Petroni, “A semi-Markov model with memory for price changes,”
*Journal of Statistical Mechanics*, no. P12009, 2011. View at Google Scholar - G. D'Amico and F. Petroni, “A semi-Markov model for price returns,”
*Physica A*, vol. 391, no. 20, pp. 4867–4876, 2012. View at Publisher · View at Google Scholar - G. D'Amico and F. Petroni, “Weighted-indexed semi-Markov models for modeling financial returns,”
*Journal of Statistical Mechanics*, no. P07015, 2012. View at Google Scholar - G. D'Amico, F. Petroni, and F. Prattico, “First and second order semi-Markov chains for wind speed modeling,”
*Physica A*. In press. View at Publisher · View at Google Scholar - V. Barbu, M. Boussemart, and N. Limnios, “Discrete-time semi-Markov model for reliability and survival analysis,”
*Communications in Statistics*, vol. 33, no. 11, pp. 2833–2868, 2004. View at Publisher · View at Google Scholar · View at Scopus - A. Blasi, J. Janssen, and R. Manca, “Numerical treatment of homogeneous and non-homogeneous semi-Markov reliability models,”
*Communications in Statistics*, vol. 33, no. 3, pp. 697–714, 2004. View at Google Scholar · View at Scopus - N. Limnios and G. Oprişan, “An introduction to semi-Markov processes with application to reliability,” in
*Handbook of Statistics*, D. N. Shanbhag and C. R. Rao, Eds., vol. 21, pp. 515–556, North-Holland, Amsterdam, The Netherland, 2003. View at Publisher · View at Google Scholar