On the Relation between Phase-Type Distributions and Positive Systems

Kim, Kyungsup

doi:https://doi.org/10.1155/2015/731261

Abstract and Applied Analysis

On this page

Abstract Introduction Preliminaries Conclusions References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 731261 | https://doi.org/10.1155/2015/731261

On the Relation between Phase-Type Distributions and Positive Systems

Kyungsup Kim¹

Academic Editor: Shawn X. Wang

Received21 Jan 2015

Revised25 Mar 2015

Accepted04 Apr 2015

Published14 Apr 2015

Abstract

The relation between phase-type representation and positive system realization in both the discrete and continuous time is discussed. Using the Perron-Frobenius theorem of nonnegative matrix theory, a transformation from positive realization to phase-type realization is derived under the excitability condition. In order to explain the connection, some useful properties and characteristics such as irreducibility, excitability, transparency, and order reduction for positive realization and phase-type representation are discussed. In addition, the connection between the phase-type renewal process and the feedback positive system is discussed in the stabilization concept.

1. Introduction

Positive system problems have been developed in applications areas such as biological models, production systems, and economic applications. The realization problem for positive system has extensively been considered in many research papers as [1–5]. Many research activities and applications have been devoted to the field of phase-type distributions [6–8]. The positive representation problem finding a Markov chain associated with phase-type distribution has considerable connections with the positive realization problem in the control theory [9].

We will discuss the relationship between phase-type representation and positive realization by using the Perron-Frobenius theorem introduced in [10–13]. The Perron-Frobenius theorem is an important concept for the study of positive systems. For example, the Perron-Frobenius theorem can be used to derive a transformation from positive realization to phase-type representation. We use tools and results within the broad research area of nonnegative matrix theory, which enable us to explore the characteristics and properties of a Metzler matrix and nonnegative matrix. Metzler matrices are replaced by -matrices, in particular, by the -matrices introduced in [10–13].

The connection between phase-type and positive realization has restrictively been proved in irreducible representation cases by remarking that it can be easily simplified to an irreducible case by discarding some states [9]. Under the irreducible assumption, it is proven that the positive realization can be transformed into a phase-type representation [9]. We will show that a positive realization normalized by a positive number can be transformed into a phase-type representation. We modify the correspondence between positive realizations and phase-type representations under more general assumptions. We use excitable systems as a subclass of the positive systems introduced in [2, 14]. However, the phase-type representation has a benefit that the number of free parameters in the representation can be reduced, compared with the general positive realization.

We will discuss the properties and characteristics, such as irreducibility, excitability, transparency, and stabilization introduced in [3, 8, 15–18]. Excitability and transparency are similar to the reachability and observability of positive linear systems [17, 18]. There exist unreachable and unobservable positive states that are excitable and transparent [2, 14]. The properties of excitability and transparency are discussed furthermore. We will demonstrate how to discard some unnecessary states when a representation is not irreducible. The common connection between the phase-type renewal process introduced in [7, 8] and the state feedback control introduced in [15, 16] will be handled. In addition, the relation and the common characteristics between discrete phase-type distributions and discrete-time positive systems are discussed in a similar manner to that applied to the continuous case.

An outline of the paper is as follows. In Section 2, some relevant background materials, including definitions and preliminary results are provided. Section 3 addresses the relationship between phase-type distributions and positive realizations in the continuous-time domain and discusses the common properties and characteristics, such as irreducibility, excitability, transparency, and stabilization. Section 4 discusses the relationship and the common characteristics between discrete phase-type and discrete-time positive systems in a similar manner to the continuous case. Finally, the conclusions follow.

2. Preliminaries

Before proceeding, we introduce some basic notations. An nonnegative matrix is denoted by if its entries are nonnegative and at least one entry is positive. is defined by a strict positive matrix (i.e., ) if all entries . The associated directed graph, , consists of vertices , where denotes an edge from to . A nonnegative matrix is said to be reducible if there exists a permutation matrix such that where and are square matrices and is defined by the transpose of . Otherwise, is called irreducible. It is called a Frobenius normal form of if there exists a suitable permutation such that is in block triangular of the formwhere is square and either irreducible or a null matrix. The spectral radius of , denoted by , is defined by the largest absolute eigenvalue of . The spectrum of , denoted by , is defined by the set of eigenvalues of . The dominant eigenvalue of is called by the maximal real among the real eigenvalues of , denoted by .

A matrix is said to be a Metzler matrix if all of its off-diagonal elements are nonnegative. If is a Metzler matrix, then there exist a nonnegative matrix and some such that . The real dominant eigenvalue of is defined by if for all . There is a long stream of research dealing with -matrices and -matrices instead of Metzler matrices [10]. Metzler matrices are replaced by -matrices; that is, is a -matrix if is a Metzler matrix. In particular, a matrix is called an -matrix if any matrix is expressed in the form where and .

Basic definitions and results of cone theory may be needed within this paper. A set is said to be a cone if for all . A cone is convex if for any two points in it contains the line segment between them. A convex cone is solid if the interior of is nonempty. It is pointed if . A closed pointed solid convex cone is called a proper cone. A cone is said to be polyhedral if it can be expressed as the set of nonnegative combinations of a finite set of generating vectors. We adopt the notation if coincides with the set of nonnegative combinations of the matrix .

We discuss the phase-type distribution for a random variable in the terms of a continuous-time Markov process. A continuous-time Markov process is defined on finite state space. The row vector gives the initial probabilities with state probability . A phase-type distribution is defined as the distribution of the time to absorption in a continuous-time Markov chain (CTMC) with one absorbing state [8]. If the state is an absorbing state and all other states are transient, we define a phase-type infinitesimal generator matrix of the Markov chain, denoted by , such that where refers to the column vector, row vector, or matrix with all entries equal to zero in the case without ambiguity, is the corresponding row vector whose th entry is one and the others are zero, and is the column vector with all entries being one. We can see that if , and otherwise. Phase-type distributions are commonly represented by a vector-matrix tuple that describes the transient part of the CTMC. The vector-matrix tuple is a phase-type (Markovian) representation of a phase-type distribution if and only if and , is a Metzler matrix with and , and is nonsingular.

The probability density function (PDF), cumulative distribution function (CDF), and Laplace-Stieltjes transform (LST) of the PDF, respectively, are defined by where is an expectation. The ME (matrix exponential) distribution is a generalization of the phase-type distribution. A distribution function is called an ME distribution if there exists the triple such that , and there is no restriction on the elements of .

We note that these representations of phase-type distributions are equivalent to the state space realizations of linear systems in control. Let us consider single-input, single output linear time-invariant systems of the form The linear system in (5) is said to be a positive linear system provided that, for any nonnegative input and nonnegative initial state, the state trajectory and the output are always nonnegative. Let a transfer function be defined by the Laplace transform of the impulse response function for and, otherwise, . A triple is said to be a positive realization of in a continuous-time linear positive system if and only if is a Metzler matrix, , and . A triple is denoted by a minimal realization if is jointly completely controllable and completely observable.

An integral function of is defined by and . We can see that an augmented realization of is defined by

The augmented realization presents a state space realization of the integral function, such as . The augmented realization is closely related to representation (3). We note that the positive realization of the integration of a positive system is closely related to the representation of the phase-type distribution.

3. Phase-Type Representation and the Positive Realization

3.1. Some Connections

Using a generalized version of the Perron-Frobenius theorem of nonnegative matrix theory, we derived a transformation from positive realization into phase-type realization under a constraint. The Perron-Frobenius theorem asserts that a real square matrix with positive entries has a unique largest real eigenvalue and that the corresponding eigenvector has strictly positive components [10, 19]. The Perron-Frobenius results of reducible matrices are characterized by being weaker than those of irreducible matrices. The general Perron-Frobenius theorem for reducible matrices is introduced from the result in Chapter 8 in [19] as follows.

Theorem 1 (Perron-Frobenius [19]). Let be an matrix. Then, A has a nonnegative real eigenvalue equal to its spectral radius and there is an eigenvector corresponding to .

The solvability problem of the matrix equation with constraint was originally solved by Carlson [11]. Several generalized versions have been discussed by researchers [12, 13, 20]. We note that the excitability is closely related to the existence of the strict positive solution of (i.e., ) as a more general case. For a discrete-time positive system with realization , is defined to be excitable if there is an such that , and is defined to be transparent if there is an such that [2, 14]. We consider some properties of excitability.

Lemma 2. Assume that with . Let . Then the following statements are equivalent: (1)There is a such that and .(2) is excitable.

Proof. : we define . Assume that is strictly positive and . Therefore, there is an such that for all and where is defined by -norm of . Because for sufficiently large , it follows that is excitable.
: because is stable (i.e., ), the sum converges uniformly to as . We have . Because each entry of is monotonically increasing with respect to and excitable, we can see that is strictly positive.

Consider a continuous-time system with a positive realization . Since is a Metzler matrix, we can choose an such that and . We can define the excitability and the transparency of continuous-time positive linear systems in a similar form to discrete-time ones. The pair is excitable if there is an integer such that for some . The pair is transparent if there exists an such that for some .

Lemma 3. For the continuous time with a positive realization , assume that is excitable, is an asymptotically stable Metzler matrix i.e., , and an augmented realization is given as (6). Then there is a positive eigenvector of the spectral radius i.e., such that is strictly positive i.e., .

Proof. We can choose a sufficiently large such that a positive matrix satisfies , and for all . By using the Perron-Frobenius Theorem 1 for the augmented nonnegative matrix with the order , there exists an eigenvector corresponding to such that . If the last entry of is zero, , then it induces that a vector is an eigenvector of corresponding to an eigenvalue . It contradicts the fact that all the eigenvalues of are less than . Therefore, we have .
Set . We have since . Thus, is stable and positive. By using Lemma 2, the excitable condition (7) implies a strict positive solution . Therefore, it is shown that is strictly positive; that is, .

We will show that a positive realization of continuous-time positive system can be transformed into a phase-type representation normalized by a positive number. Under the irreducible assumption, it was proven that the positive realization can be transformed into phase-type representation [9]. We modify the proof as a generalized version of the correspondence between positive realizations and phase-type representation. We can see that a phase-type representation is a special positive realization with excitable constraint.

Theorem 4. Consider the continuous-time positive system with the positive realization such that is excitable, and is an asymptotically stable and Metzler matrix. Then it is transformed into a phase-type infinitesimal generator matrix such that where and .

Proof. First, let us define an augmented realization in the form of (6). Using Lemma 3, the Perron eigenvector of corresponding to the Perron root is strictly positive. Set . Thus, we can derive that with , , and . Therefore, we can verify that where , , , and .

An important consequence of the above theorem is that an excitable positive realization can be transformed into the form of phase-type representation. Therefore, it is remarked that he concept of positive realizations is a superset of phase-type representations.

3.2. Common Properties and Characteristics

We discuss the properties and characteristics, such as stability, irreducibility, excitability, and transparency, in positive systems and phase-type distributions. A positive system with a positive realization is said to be irreducible if is excitable and is transparent in the terminology introduced in [2, 14]. We note that the properties and characteristics of excitability and transparency are closely related to those of the reachability and observability of positive linear systems [17, 18]. A phase-type representation in whose graph all the state vertices are connected to the initial vertex and to the absorbing vertex is called irreducible [8]. We note that the irreducible representation is closely related to the irreducibility of the phase-type renewal process in the Markovian point process introduced in [7, 8]. Renewal processes provide simple models of point processes, which may describe an ordered set of points. We consider a renewal process with a phase-type distribution for the interrenewal intervals. In [8], the phase-type representation for the distribution function is called irreducible if is irreducible where an infinitesimal generator is defined by We may associate a Markov process with a phase-type renewal process. A renewal function denoted by for a phase-type distribution is defined by the expected number of renewals in the interval ; that is, , where denotes the number of renewals. A renewal density is defined by . The Laplace transform of the renewal density is denoted by , which is rewritten by In view of control theory, the equation in (11) is equivalent to the positive feedback control. Because the state space realization of the inverse system is given by , we can see that its renewal density is given by , which is equal to the results in [7]. For an irreducible representation , the vectors and are strictly positive [8]. We note that these results are related to the excitability and transparency of the positive linear system.

The irreducibility of a positive system can be defined in a similar manner. A positive system is irreducible if each state variable influences and is influenced by another variable [2]. It is defined by an irreducible realization for the positive system with a positive realization if is irreducible, where is defined by For the open-loop system (5), the associated closed loop system (positive feedback system) is given by where the linear state-feedback law is and is the constant feedback gain row vector. The closed loop system (13) is positive if and only if is a Metzler matrix. The stabilization problem of positive systems has recently been discussed in [3, 15, 16]. It is known an unstable open positive system (5) cannot be stabilized by linear state-feedback if the restriction on nonnegative control in the closed loop is imposed [15, 16].

The properties and characteristics of excitability and transparency are closely related to the reachability and observability of positive linear systems [5, 17, 18]. A reachable set is the set of all points which the states approach from the origin by nonnegative inputs within finite time. It was shown that , where is a closure set of [17]. An observable set is the set of initial states in which the output is nonnegative for all . The observable set can be defined by .

Theorem 5 (see [17]). Let a transfer function be a strictly proper rational function with degree n, whose realization is given by . Then, has a positive realization with a Metzler matrix if and only if there exists a generator matrix and such that a polyhedral cone satisfies (1);(2),where , , is a reachable set, and is an observable set.

A positive system is said to be reducible otherwise. When a representation is not irreducible, it can be simplified by discarding some states. Our next question is how to discard some unnecessary states when a representation is not irreducible. We discuss an order reduction algorithm of the asymptotical stable and unexcitable positive realization. Let a set . For a column vector with entries, we define a support set

Theorem 6. Assume that a positive realization is unexcitable and is asymptotically stable. Then there is a permutation matrix such that where is an matrix. Furthermore, we have a reduced positive realization such that

Proof. Because is a Metzler matrix and asymptotical stable, there is an such that is a positive matrix. Define with . There is an integer such that for all . A support set for is defined by . Let be the element number of . We can find a permutation matrix such that . Set where the size of is . If is a nonzero matrix, then we have , but this contradicts the definition of . We can see that there is a permutation matrix such that and . We have . Because is a Metzler matrix and , we can see by the definition of . By using Theorem 5, we can derive (16).

We discussed the method to remove unnecessary states in the unexcitable case. When the transposed realization is given by , the concept of the transparency can be interpreted by that of the excitability. A removing method of the unnecessary state in the nontransparent case is similar to that in the unexcitable case. We illustrate the previous theorems by means of an example.

Example 7. A positive state-space realization is given by We can see that is reducible. Set . We have . The support set is . We obtain By using Theorem 6 and removing the unexcitable part, we obtain an excitable positive realization such that , , and . By using Theorem 4, the phase-type representation can be obtained as follows:

4. Discrete Phase-Type Distributions and Discrete-Time Positive Systems

A discrete phase-type (DPT) distribution is the distribution of the time until one absorbing state in a discrete-state discrete-time Markov chain (DTMC) with transients states and one absorbing state [8, 21]. DPT distributions have received little attention in applied stochastic modeling. The main research activity has addressed continuous phase-type distributions. Let be the time till absorption into state in the DTMC. We say that is a random variable of order and representation [8]. The DPT representation has the following properties. A positive matrix is an matrix grouping the transition probabilities among the transient states. A column vector is a positive -dimensional column vector grouping the probabilities from any state to the absorbing state. Thus, we have . It means that . An vector is defined by the initial probability vector. The augmented matrix tuple is denoted by the augmented phase-type representation where the one-step transition probability matrix of the corresponding DTMC can be partitioned by the augmented initial vector is defined by , and . Its probability generating function is defined by [8].

We can also discuss the realization between the DPH distributions and discrete-time positive systems in a similar manner. The discrete-time linear system is represented by where , , and . The matrix tuple denotes the positive realization (21). In the next theorem, we show that the positive realization can be transformed into a DPH representation multiplied by a positive scalar (i.e., is not necessarily a probability vector).

Theorem 8. Assume that a realization is denoted by a positive realization satisfying (21) and is excitable (essential reachable) and stable. Then there is a nonsingular matrix such that the realization , which is defined by , , and , has the properties of the DPH representation such as and .

Proof. Because is positive, stable, and excitable, the absolute values of its eigenvalues are less than 1 and we can use Lemma 2. Thus, we obtain the fact that the entries of are positive. A similarity transform matrix is defined by a diagonal matrix, . Compute a new realization . We obtain the facts that , , and . Therefore, we can verify that the new realization satisfies the discrete phase-type distribution properties.

We can easily deploy the properties and characteristics, such as irreducibility, excitability, transparency, and order reduction, in the discrete domain in a similar manner as in the continuous case. We omit the detailed exploration for the discrete case in this paper.

5. Conclusions

We considered the relation between the positive realization and the phase-type representation in continuous time and discrete time, respectively. Using the Perron-Frobenius theorem, it was shown that a phase-type representation is a special case with excitable constraint of the positive realization. We discussed their common properties and characteristics, such as irreducibility, excitability, transparency, stabilization, and order reduction. The connection between the phase-type renewal process and the feedback control of positive system was discussed. A lot of open problems related to positive system still remain and should be addressed in future research. The communities of control and probability theory can work together on solving the remaining same open problems.

Conflict of Interests

The author declares that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

This work was supported by research fund of Chungnam National University.

References

L. Benvenuti, L. Farina, and B. D. O. Anderson, “Filtering through combination of positive filters,” IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, vol. 46, no. 12, pp. 1431–1440, 1999.
View at: Publisher Site | Google Scholar
L. Farina and S. Rinaldi, Positive Linear Systems: Theory and Applications, Wiley, 2000.
View at: Publisher Site | MathSciNet
T. Kaczorek and L. Sajewski, The Realization Problem for Positive and Fractional Systems, vol. 1, Springer, 2014.
View at: Publisher Site | MathSciNet
K. Kim, “A construction method for positive realizations with an order bound,” Systems & Control Letters, vol. 61, no. 7, pp. 759–765, 2012.
View at: Publisher Site | Google Scholar
K. Kim, “A constructive positive realization with sparse matrices for a continuous-time positive linear system,” Mathematical Problems in Engineering, vol. 2013, Article ID 878146, 9 pages, 2013.
View at: Publisher Site | Google Scholar
A. Cumani, “On the canonical representation of homogeneous markov processes modelling failure-time distributions,” Microelectronics Reliability, vol. 22, no. 3, pp. 583–602, 1982.
View at: Publisher Site | Google Scholar
G. Latouche and V. Ramaswami, Introduction to Matrix Analytic Methods in Stochastic Modeling, vol. 43, SIAM, 1999.
M. F. Neuts, Matrix-geometric Solutions in Stochastic Models: An Algorithmic Approach, Dover Publications, New York, NY, USA, 1994.
View at: MathSciNet
C. Commault and S. Mocanu, “Phase-type distributions and representations: some results and open problems for system theory,” International Journal of Control, vol. 76, no. 6, pp. 566–580, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
A. Berman and R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, Society for Industrial and Applied Mathematics, 1994.
View at: Publisher Site | MathSciNet
D. Carlson, “A note on M-matrix equations,” Journal of the Society for Industrial & Applied Mathematics, vol. 11, no. 4, pp. 1027–1033, 1963.
View at: Google Scholar
D. Hershkowitz and H. Schneider, “Solutions of Z-matrix equations,” Linear Algebra and Its Applications, vol. 106, pp. 25–38, 1988.
View at: Publisher Site | Google Scholar | MathSciNet
H. Schneider, “The influence of the marked reduced graph of a nonnegative matrix on the Jordan form and on related properties: a survey,” Linear Algebra and Its Applications, vol. 84, pp. 161–189, 1986.
View at: Publisher Site | Google Scholar
S. Muratori and S. Rinaldi, “Excitability, stability, and sign of equilibria in positive linear systems,” Systems & Control Letters, vol. 16, no. 1, pp. 59–63, 1991.
View at: Publisher Site | Google Scholar
P. De Leenheer and D. Aeyels, “Stabilization of positive linear systems,” Systems & Control Letters, vol. 44, no. 4, pp. 259–271, 2001.
View at: Publisher Site | Google Scholar
G. James and V. Rumchev, “Stability of positive linear discrete-time systems,” Bulletin of the Polish Academy of Sciences Technical Sciences, vol. 53, no. 1, pp. 1–8, 2005.
View at: Google Scholar
Y. Ohta, H. Maeda, and S. Kodama, “Reachability, observability, and realizability of continuous-time positive systems,” SIAM Journal on Control and Optimization, vol. 22, no. 2, pp. 171–180, 1984.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
M. E. Valcher, “Reachability properties of continuous-time positive systems,” IEEE Transactions on Automatic Control, vol. 54, no. 7, pp. 1586–1590, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
C. Meyer, Matrix Analysis and Applied Linear Algebra, Society for Industrial and Applied Mathematics, 2000.
View at: Publisher Site | MathSciNet
J. Victory, “On nonnegative solutions of matrix equations,” Journal on Algebraic and Discrete Methods, vol. 6, no. 3, pp. 406–412, 1985.
View at: Publisher Site | Google Scholar | MathSciNet
A. Bobbio, A. Horvath, M. Scarpa, and M. Telek, “Acyclic discrete phase type distributions: properties and a parameter estimation algorithm,” Performance Evaluation, vol. 54, no. 1, pp. 1–32, 2003.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Kyungsup Kim. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1235

Downloads

1085

Citations