Research Article | Open Access

Yung-Chung Wang, Dong-Liang Cai, Li-Hsin Chiang, Cheng-Wei Hu, "Elucidating the Short Term Loss Behavior of Markovian-Modulated Batch-Service Queueing Model with Discrete-Time Batch Markovian Arrival Process", *Mathematical Problems in Engineering*, vol. 2014, Article ID 814810, 10 pages, 2014. https://doi.org/10.1155/2014/814810

# Elucidating the Short Term Loss Behavior of Markovian-Modulated Batch-Service Queueing Model with Discrete-Time Batch Markovian Arrival Process

**Academic Editor:**Cristian Toma

#### Abstract

This paper applies a matrix-analytical approach to analyze the temporal behavior of Markovian-modulated batch-service queue with discrete-time batch Markovian arrival process (DBMAP). The service process is correlated and its structure is presented through discrete-time batch Markovian service process (DBMSP). We examine the temporal behavior of packet loss by means of conditional statistics with respect to congested and noncongested periods that occur in an alternating manner. The congested period corresponds to having more than a certain number of packets in the buffer; noncongested period corresponds to the opposite. All of the four related performance measures are derived, including probability distributions of a congested and noncongested periods, the probability that the system stays in a congested period, the packet loss probability during congested period, and the long term packet loss probability. Queueing systems of this type arise in the domain of wireless communications.

#### 1. Introduction

The queueing systems under various types of arrival and service processes have been investigated due to their applicability in wireless multimedia networks. The bursty nature of multimedia traffic incurs bursty packet losses, making it impossible for long term loss behavior to quantify precisely the QoS of multimedia services over the internet. However, the quality of real-time multimedia applications perceived by the end user is highly sensitive to the bursty loss behavior, necessitating the supplementing of traditional long term QoS metrics with short term based ones. Therefore, short term performance metrics such as distribution of the length of congested periods and noncongested periods, that is, the likelihood that the system remains in the congested period and loss probability during the congested period, will seriously degrade the quality of service perceived by the end users, which is especially relevant for systems supporting real-time multimedia services. Consequently, short term performance metrics profoundly impact the evaluation of wireless based multimedia applications. Exploring the short term loss behavior of multimedia traffic in wireless multimedia networks is thus of priority concern.

Because the traditional Markov model can not adequately capture the property of complex multimedia traffic, such as web browsing, VoIP, and teleconferencing, it is necessary to propose a suitable traffic model to describe multimedia applications over wireless networks. Traffic with certain bursty characteristics can be qualitatively modeled by a DBMAP, as confirmed in [1]. The literature on the application of the DBMAP to model network traffic is rich. The use of DBMAP is proposed in [2] to model video sources. In [3], Kang et al. provided evidence that DMAP yields a very good estimation of the cell loss ratio for usual superpositions of voice and VBR video sources. In [4], Heyman and Lucantoni provided evidence that a DMMPP is a good model for Internet traffic at the packet/byte level. In [5], Salvador et al. proposed a parameter fitting procedure using superposed two-state DMMPP that leads to accurate estimates of queueing behavior for network traffic exhibiting long-range-dependent behavior. Based on this observation, an arrival process for packet stream is modeled as a DBMAP [1, 2, 6] in this paper.

Like the DBMAP, discrete-time batch Markovian service process (DBMSP) is a versatile service process and can capture the correlation among the service times. Therefore, DBMSP is suitable to model wireless systems employing multiple transmission modes in the physical layer, each of which corresponds to a particular modulation and coding scheme. Based on this observation, service process for wireless multimedia networks is modeled as a DBMSP in this paper.

So far, much research has focused on the queue with Markovian service process (MSP). In [7], Bocharov et al. applied the method of embedded Markov chain to derive the main stationary characteristics of the G/MSP/1/r. In [8], Banik and Gupta derived the steady state distribution at prearrival and arbitrary epochs along with some important performance measures of /MSP/1/N. In [9], Gupta and Banik derived system length distribution at prearrival and arbitrary epochs for finite and infinite buffer single server queue with renewal input and Markovian service process. In [10], Wang et al. derived the loss pattern of DBMAP/DMSP/1/K. In [11], Samanta and Zhang analyzed the steady state behavior of a discrete-time single-server queueing system with MSP and server vacations. However, all of the above papers consider the queue with MSP. These models can not be applied to analyze the performance measures of wireless multimedia networks. So far, much research has focused on the batch-service queue. In [12], Chaudhry and Gupta analyzed a finite buffer discrete-time queue with general bulk-service rule, wherein the arrival process is DMAP and service times are arbitrarily and independently distributed. In [13], Banik obtained queue length distributions at various epochs of BMAP//1/N and BMAP//1/N systems. In [14], Claeys et al. derived moments and tail probabilities of the customer delay in a discrete-time queueing system with batch arrivals and a batch server adopting the full batch-service policy. In [15], Claeys et al. studied the the customer delay and buffer content of the discrete-time //1 system. In [16], Claeys et al. analyzed a discrete-time DBMAP//1 queue, whereby the service time of a batch is dependent on the number of customers within it. Most of the past works assume an infinite buffer and focus on obtaining the queue and the waiting time characteristics. This paper assumes a finite buffer and obtains various packet loss characteristics such as the congested period, noncongested period, and the packet loss probability during congested period. With buffer size , the sojourn-time on congestion of the DBMAP/DBMSP/1/ queueing system is characterized. Mathematical models undertaken here to examine the short term packet loss behavior of a queue are different from those in the literature in one or more respects. We apply a matrix-analytical approach to analyze the sojourn-time on congestion. We examine the bursty nature of packet loss by means of conditional statistics with respect to congested and noncongested periods that occur in an alternating manner. As stated before, the congested period corresponds to having more than a certain number of packets in the buffer; the noncongested period corresponds to the opposite. Hence, there is a threshold buffer level that splits the state space in two. By such state-space decomposition, two transient Markov chains are devised to describe the alternating renewal process. The distributions of various absorbing times in the two transient Markov chains are derived to compute the average durations of the congested periods and the conditional packet loss probability encountered during a congested period. These performance measures describe the quality of service provided by the communication devices with wireless link.

This paper is organized as follows. In Section 2, the DBMAP/DBMSP/1/ queueing system is briefly introduced. In Section 3, the short term loss behavior of the DBMAP/DBMSP/1/ queueing system is analyzed. In Section 4, Queueing systems of this type occur in the domain of wireless communications. Experimental numerical results are computed and discussed in Section 5 to reveal the computational tractability of our analysis and to develop a better understanding of the packet loss pattern over wireless networks. Concluding remarks are given in Section 6.

#### 2. DBMAP/DBMSP/ Queue

In this section, we introduce the arrival process, service process, and queueing model.

##### 2.1. Arrival Model

The arrival processes discussed in this paper are assumed to be DBMAPs since time is assumed to be slotted. A DBMAP can be described by a special type of discrete-time Markov chain. Let be a discrete-time Markov chain with two-dimensional state space and transition probability matrix where represents the total number of arrivals during consecutive slots, represents an auxiliary state or phase variable, and s are nonnegative matrices whose entries are between and , called parameter matrices. The transition probability from state to state , which corresponds to the arrival of a batch of size , is the th entry of the matrix . may depend on phases and . The sum of all parameter matrices is an stochastic matrix which is the transition probability matrix of the underlying Markovian structure with respect to the DBMAP. is assumed to be nonsingular such that the sojourn time at any state of the state space is finite with probability 1, thus guaranteeing that the process never terminates. The fundamental arrival rate of this DBMAP can then be defined as where is the stationary probability vector of in (2); that is, , , and is assumed in this paper to be the all-1 column vector with the designated dimension.

##### 2.2. Service Model

A DBMSP can be described by a special type of discrete-time Markov chain. Let be a discrete-time Markov chain with two-dimensional state space and transition probability matrix where represents the total number of served packets during consecutive slots, represents an auxiliary state or phase variable, and , , are nonnegative matrices whose entries are between and , called parameter matrices. is the maximum number of packets to be served at one slot time. The transition probability from state to state , which corresponds to the service departure of a batch of size , is the th entry of the matrix . may depend on phases and . The sum of all parameter matrices is an stochastic matrix which is the transition probability matrix of the underlying Markovian structure with respect to the DBMSP. is assumed to be nonsingular such that the sojourn time at any state of the state space is finite with probability 1, thus guaranteeing that the process never terminates. The fundamental service rate of this DBMSP can then be defined as where is the stationary probability vector of in (5); that is, , , and is assumed in this paper to be the all-1 column vector with the designated dimension.

##### 2.3. DBMAP/DBMSP/ Queue

The queueing model must be specified as the late arrival model, in which a packet arrives to the queue before a slot boundary. Consider the embedded Markov chain of the queueing system, which can be described as a particular type of semi-Markov process where the state jumps regularly at a constant slot time. This is considered in the state space , where , , and denote the buffer occupancy, the phase of the DBMAP, and the phase of the DBMSP, respectively, at the end of the th time slot. For convenience, the queueing system is said to be at a level if its buffer occupancy is equal to . The Markov chain now has an irreducible transition probability matrix of the following block form:

where and is the Kronecker product [17]. Each block is of dimension and corresponds to the transition from one buffer level to another buffer level.

#### 3. Performance Evaluation

To characterize the real packet loss behavior of wireless communication, it is not adequate to examine only the long term packet loss probabilities. For example, a packet stream may experience the loss of a string of consecutive packets followed by bursty arrivals, though the long term packet loss probability is small. This phenomenon makes the traffic source suffer from a significant QoS degradation in that time period. Therefore, in light of the high correlation among consecutive packet arrivals in the wireless multimedia networks, it is necessary to study the packet loss behavior during a short term interval, that is, the conditional packet loss behavior, as well as during long term intervals, in order to characterize the real packet loss behavior of a wireless communication queueing system.

##### 3.1. Transient Performance Measures

The level of buffer occupancy of a queueing system passes through alternating congested and noncongested periods. To study the short term loss behavior of a queue during a congested period, we decompose the state space into two subsets according to the congested buffer level . In order to simplify the description, we assume in this paper. With this partition of the state space, the transition probability matrix in (7) of the Markov chain of the queueing system can be partitioned as follows: where The matrices , , and are transition probability submatrices governing transitions from into itself, from into , from into , and from into itself, respectively.

Next, noncongested and congested periods are characterized by deriving the steady state probabilities for the initial state of each transient Markov chain, as denoted by vector for noncongested and vector for congested periods. Then, Let and be the lengths of noncongested and congested periods in the queuing system, respectively. Obviously, and represent the life-span of the transient Markov chain, with respect to and for transitions on and . According to the transient Markov chain theory, the respective probability generating functions of and are The average lengths of noncongested and congested periods are

To investigate the packet loss behavior during a congested period, the submatrix in (9) is decomposed as where The matrix consists of the probabilities of events which make state transitions within without any packet loss; however, the matrix , , consists of the probabilities of events which make state transitions within with the loss of packets. Similarly, the submatrix in (9) can also be considered as where The matrix consists of the probabilities of events which make a transition from a state in to a state in without any packet loss; and the matrix , , consists of the probabilities of events which make such transition with the loss of packets.

Note that the behavior of the queueing system during a congested period can be described by the transient Markov chain. For a state in , let be the probability that the state of the transient Markov chain enters with a total of packets lost after transitions. Let be an -vector whose th entry is . The initial vector can be determined by the behavior of the queueing system during a previous noncongested period as In addition, the vectors , , and can be obtained recursively by Let be the probability that there is a total of packets lost during a congested period of length . Then, The generating function of , that is, = , is where and . Now, the average total number of packets lost during a congested period, denoted as , can be calculated as by (22). Consequently, the packet loss probability during a congested period can be obtained by where is the average length of a congested period in (14) and is the fundamental arrival rate of the arrival traffic.

##### 3.2. Steady State Performance Measure

Let , with , be the steady state probability vector of the queueing system; that is, It follows from (25) that Notice that the system of linear equations (26) and (27) has finite dimension; thus, some algorithms given in the literature can be used to solve the system of linear equations, such as Gauss elimination method and Gauss-Seidel method. The Gauss-Seidel method is usually more efficient and more effective than the Gauss elimination method when the size of the transition probability matrix is large. The number of iterations required to achieve the desired convergence is not usually known in advance and the resulting distributions have round-off errors associated with them. For more details on above algorithms, see Alfa [18].

Let denote the number of packets lost during a time slot, with only long term packet loss probability considered as significant. Now, the expected value of can be evaluated as Consequently, the long term packet loss probability, denoted by , is where is the fundamental arrival rate of the packet stream as in (3).

#### 4. Application

We consider an end-to-end wireless transmission system with adaptive modulation and coding (AMC) scheme in the physical layer to provide streaming media service. We experiment an arrival process described by a DBMAP which can capture time correlations commonly observed in VBR traffic such as MPEG coded streaming video. On the transmitter side, streaming media packets are buffered in a queue with finite length , which operates in a first-in-first-out (FIFO) manner. On the receiver side, a selector determines the modulation mode and coding rate and sends them back to the transmitter through an error-free feedback channel. Due to different modulation modes, each packet may contain one or more streaming media packets.

In AMC scheme, the modulation mode and coding rate are chosen depending on the time-varying channel conditions. AMC is employed at the physical layer with transmission modes corresponding to different channel state. We assume that when the channel is in state , the transmitter transmits packets. We further assume that . For convenience, let .

For flat channels, we adopt the general Nakagami- model to describe the received signal-to-noise ratio (SNR) statistically, which is a random variable with Gamma probability density function where is the expected value of , , and is the Nakagami- fading parameter. We partition the entire SNR range into nonoverlapping consecutive intervals with boundaries denoted as . The algorithm for determining the boundaries with the prescribed packet error rate is described in detail in [19]. Specifically, mode is chosen when the received SNR is in the interval . To capture the variations of the multistate Nakagami fading channel, we employ the finite state Markov channel model used in [19]. For a packet transmission system, we assume that a one-step transition in the Markov channel model corresponds to channel state transition after one packet time period . Then, the Nakagami- fading is said to be in state , , if the received SNR is in the interval . We allow transitions from a given state to its two adjacent states only. Let , , be the expected number of times per second the received SNR passes downward across the threshold . We have where is the mobility-induced Doppler spread. Based on the slow fading assumption of the Rayleigh fading channel, the level crossing rate should be much smaller than the value of the packet transmission rate . Thus, we can get the approximated value of transition probabilities as follows: The transition matrix of FSMC is

Finally, consider a Nakagami- fading channel which can be modeled by a DBMSP which is defined by matrices , , whose elements are the conditional probabilities of transferring from channel state to channel state and producing packets successfully transmitted. Then, it can be found as follows: where is the vector which has all zero entries except in the th entry with .

#### 5. Numerical Results

In this section, we present some numerical results obtained on the basis of an FSMC of packet transmission mode induced by the Rayleigh fading [19, 20]. We remark that this is just an example to illustrate the application of our analysis. Discussion about appropriate ways to model fading channels is not the focus here. We refer to the vast literature on the topic for more detail. Consider the case dB and let be the value of the Doppler frequency normalized to the packet transmission rate, which determines the process memory span. The fading process is approximated by the FSMC with the following matrix probability: The service rate per state of wireless link with AMC is We can find , , by (34).

The time is slotted such that the unit time is equal to the packet transmission time, which is equal to . The numerical results are computed by the algorithm developed in Section 3.

In [21], Skelly et al. proposed an eight-state MMPP to model a compressed version of the Star Wars movie. In [4], Heyman and Lucantoni provided evidence that a DMMPP is a good model for internet traffic at the packet/byte level. In [5], Salvador et al. proposed a parameter fitting procedure using superposed two-state MMPP that leads to accurate estimates of queueing behavior for network traffic exhibiting long-range-dependent behavior. Based on the above observation, we experiment an arrival process described by a DMMPP which can capture time correlations commonly observed in VBR traffic such as MPEG coded streaming video. In DMMPP, packets arrive according to a Poisson process whose instantaneous rate is a function of the state of a discrete-time finite Markov chain. Thus, an DMMPP can be represented by a pair of matrices , with the first matrix being the transition matrix of the Markov chain and the second being a diagonal matrix specifying the arrival intensity associated with each state of the Markov chain. Let the rate matrix . This definition of a DMMPP coincides with a DBMAP with representation , where The irreducible stochastic matrix . In our experimental studies, the numerical values for the parameters used are We also multiply the arrival rates by a factor , so that the queue will have different load conditions. The buffer capacity is taken to be 30.

Figure 1 illustrates the packet loss probability during a congested period as a function of the traffic arrival rate and threshold setting. When the traffic arrival rate increases, it leads to a small increase in the short term loss probability of the arriving traffic. With the threshold setting , increases from to with a traffic arrival rate from to . With a traffic arrival rate , increases from to with a threshold setting from to . Due to the buffer limitations, is high under any load conditions. This finding confirms our postulation that the short term packet loss probability during a congested period is a significant performance measure of a queue.

Figure 2 summarizes the numerical results of the average lengths of a congested period and a noncongested period with respect to the traffic arrival rate and threshold setting. As it is anticipated, slightly varies with the load condition. Additionally, is significantly longer than that of a congested period under a light-to-moderate load condition; in addition, decreases with an increasing traffic arrival rate. According to Figure 2, increases with an increasing traffic arrival rate. A cycle consists of a congested period and a noncongested period; decreasing the average length of the noncongested period by a larger factor would reduce the length of the cycle. This effect causes the system to frequently alternate congested periods and noncongested periods. Because the system alternates between noncongested periods and congested periods, increasing the traffic arrival rate increases the probability that the system remains in the congested period. Increasing the system bandwidth reduces the average length of the congested period and increases the average length of the noncongested period.

According to Figure 3, increases with an increasing traffic arrival rate. However, , and profoundly impact wireless communication based multimedia services. For instance, with traffic arrival rate and threshold setting , and time slots, indicating that the packet loss probability during a congested period and the average length of a congested period are too high to provide multimedia services. According to Figure 4, increases with an increasing traffic arrival rate. Sensitivity of to the traffic load is largely owing to .

#### 6. Conclusions

This paper applies matrix-analytic approach to investigate the loss behavior of Markovian-modulated batch-service queueing model with DBMAP. We have examined the congestion nature of packet loss by means of conditional statistics with respect to alternating congestion and non-congestion periods and evaluated the long term packet loss probabilities. By the conditional statistics, all of the four related performance measures are derived, including a long term loss probability and the three short term measures, such as the average lengths and of a congestion period and a non-congestion period, as well as conditional packet loss probability during a congestion period. We use this queuing model to quantify the effects of multimedia services over a Rayleigh fading channel.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgment

This work was supported by the National Science Council, Taiwan, under Grant NSC92-2213-E-027-047.

#### References

- M. F. Neuts, “Models based on the Markovian arrival process,”
*IEICE Transactions on Communications*, vol. 75, no. 12, pp. 1255–1265, 1992. View at: Google Scholar - C. Blondia and O. Casals, “Statistical multiplexing of VBR sources—a matrix-analytic approach,”
*Performance Evaluation*, vol. 16, no. 1-3, pp. 5–20, 1992. View at: Google Scholar - S. H. Kang, Y. H. Kim, D. K. Sung, and B. D. Choi, “An application of Markovian arrival process (MAP) to modeling superposed ATM cell streams,”
*IEEE Transactions on Communications*, vol. 50, no. 4, pp. 633–642, 2002. View at: Publisher Site | Google Scholar - D. P. Heyman and D. Lucantoni, “Modeling multiple IP traffic streams with rate limits,”
*IEEE/ACM Transactions on Networking*, vol. 11, no. 6, pp. 948–958, 2003. View at: Publisher Site | Google Scholar - P. Salvador, R. Valadas, and A. Pacheco, “Multiscale fitting procedure using Markov modulated Poisson processes,”
*Telecommunication Systems*, vol. 23, no. 1-2, pp. 123–148, 2003. View at: Publisher Site | Google Scholar - Y.-C. Wang, C.-W. Liu, and C.-C. Lu, “Loss behavior in space priority queue with batch Markovian arrival process—discrete-time case,”
*Performance Evaluation*, vol. 41, no. 4, pp. 269–293, 2000. View at: Publisher Site | Google Scholar - P. P. Bocharov, Ch. D'Apiche, A. V. Pechinkin, and S. Salerno, “Stationary characteristics of the queueing system $G/MSP/1/r$,”
*Autom Remote Control*, no. 2, pp. 127–142, 2003. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A. D. Banik and U. C. Gupta, “Analyzing the finite buffer batch arrival queue under Markovian service process: ${GI}^{X}/MSP/1/N$,”
*TOP*, vol. 15, no. 1, pp. 146–160, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - U. C. Gupta and A. D. Banik, “Complete analysis of finite and infinite buffer $GI/MSP/1$ queue—a computational approach,”
*Operations Research Letters*, vol. 35, no. 2, pp. 273–280, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-C. Wang, J.-H. Chou, and S.-Y. Wang, “Loss pattern of $\mathrm{DBMAP}/\mathrm{DMSP}/1/K$ queue and its application in wireless local communications,”
*Applied Mathematical Modelling*, vol. 35, no. 4, pp. 1782–1797, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - S. K. Samanta and Z. G. Zhang, “Stationary analysis of a discrete-time $GI/D$-$MSP/1$ queue with multiple vacations,”
*Applied Mathematical Modelling*, vol. 36, no. 12, pp. 5964–5975, 2012. View at: Publisher Site | Google Scholar | MathSciNet - M. L. Chaudhry and U. C. Gupta, “Analysis of a finite-buffer bulk-service queue with discrete-Markovian arrival process: $D$-$MAP/{G}^{a,b}/1/N$,”
*Naval Research Logistics*, vol. 50, no. 4, pp. 345–363, 2003. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A. D. Banik, “Queueing analysis and optimal control of $BMAP/{G}^{(a,b)}/1/N$ and $BMAP/MS{P}^{\left(a,b\right)}/1/N$ systems,”
*Computers and Industrial Engineering*, vol. 57, no. 3, pp. 748–761, 2009. View at: Publisher Site | Google Scholar - D. Claeys, K. Laevens, J. Walraevens, and H. Bruneel, “Complete characterisation of the customer delay in a queueing system with batch arrivals and batch service,”
*Mathematical Methods of Operations Research*, vol. 72, no. 1, pp. 1–23, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - D. Claeys, J. Walraevens, K. Laevens, and H. Bruneel, “Analysis of threshold-based batch-service queueing systems with batch arrivals and general service times,”
*Performance Evaluation*, vol. 68, no. 6, pp. 528–549, 2011. View at: Publisher Site | Google Scholar - D. Claeys, B. Steyaert, J. Walraevens, K. Laevens, and H. Bruneel, “Analysis of a versatile batch-service queueing model with correlation in the arrival process,”
*Performance Evaluation*, vol. 70, no. 4, pp. 300–316, 2013. View at: Publisher Site | Google Scholar - A. Graham,
*Kronecker Products and Matrix Calculus: With Applications*, Ellis Horwood Series in Mathematics and its Applications, Ellis Horwood, Chichester, UK, 1981. View at: MathSciNet - A. S. Alfa,
*Queueing Theory for Telecommunicaions*, Springer, New York, NY, USA, 2010. - Q. Liu, S. Zhou, and G. B. Giannakis, “Queuing with adaptive modulation and coding over wireless links: cross-layer analysis and design,”
*IEEE Transactions on Wireless Communications*, vol. 4, no. 3, pp. 1142–1153, 2005. View at: Publisher Site | Google Scholar - S. Vassilaras, “A cross-layer optimized adaptive modulation and coding scheme for transmission of streaming media over wireless links,”
*Wireless Networks*, vol. 16, no. 4, pp. 903–914, 2010. View at: Publisher Site | Google Scholar - P. Skelly, M. Schwartz, and S. Dixit, “Histogram-based model for video traffic behavior in an ATM multiplexer,”
*IEEE/ACM Transactions on Networking*, vol. 1, no. 4, pp. 446–458, 1993. View at: Publisher Site | Google Scholar

#### Copyright

Copyright © 2014 Yung-Chung Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.