Abstract

A multiserver queueing model that does not have a buffer but has batch arrival of customers is considered. In contrast to the standard batch arrival, in which the entire batch arrives at the system during a single epoch, we assume that the customers of a batch (flow) arrive individually in exponentially distributed times. The service time is exponentially distributed. Flows arrive according to a stationary Poisson arrival process. The flow size distribution is geometric. The number of flows that can be simultaneously admitted to the system is under control. The loss of any customer from an admitted flow, with a fixed probability, implies termination of the flow arrival. Analysis of the sojourn time and loss probability of an arbitrary flow is performed.

1. Introduction

Queueing systems effectively describe the operations of channels and servers of many communication networks, and they have received a great deal of attention in the probabilistic literature, beginning with the pioneering works by the Danish mathematician and engineer A. K. Erlang. A celebration of the 100 year jubilee of the origin of queueing theory will be held in 2009. Erlang's famous loss formula for the customer loss probability for the system  0 served as the basis for capacity planning and performance evaluation of telecommunication networks for an entire century. Sevastjanov proved in [1] that this loss formula is valid for the more general queueing system as well. In [24], analysis of Erlang's model was extended to the system with (batch Markovian arrival process) BMAP.

It was assumed in [24] that customers can arrive in batches of random size, with the standard assumption that, during a batch arrival epoch, all batch customers arrive at the system simultaneously. However, nowadays, it is a typical feature of many communication networks, IP networks in particular, that customers arrive in batches, but the arrival of customers of a batch is not instantaneous. To distinguish the standard batches from the batches considered in this paper the latter ones are named flows. The first customer of a flow arrives during the flow arrival epoch, while the rest of the customers arrive individually during random intervals. The flow size is random, and it may not be known a priori during the flow arrival epoch. Such a situation is typical, for example, in modeling transmission of video and multimedia information. This situation is also discussed in [5] with respect to the modeling scheme of alternative packet overflow routing in networks. In this scheme, the flow represents a set of packets that must be sequentially routed in the same channel. When a packet arrives, it is determined (e.g., by means of IP address) if the packet is a part of a flow previously tracked. If the packet belongs to an existing flow, the packet is marked for transmission. If the flow has not yet been tracked and the buffer and channel capacity is still available, the packet is admitted to the system and the flow count is increased. Otherwise, the flow is routed on an overflow link (or is dropped) and the packet is rejected in the considered channel. Tracked flows are cleared after they are finished. Clearing of an inactive flow is performed if no more packets belonging to this flow are received within a certain time interval. Tracking and clearing of flows is performed by a token mechanism. Physically, the token can be interpreted as a particular timer that is activated during a flow admission epoch and is restarted during epochs of other customers from this flow arrival, and is terminated if a particular fixed timeout expires and a new customer from this flow does not arrive. The number of tokens (timers), which defines the maximum number of flows that can be admitted to the system simultaneously, is a very important control parameter. If this number is too small, the channel may be underutilized. If this number is too large, the channel may become congested. Many packets from admitted flows may be lost, and grade of service is poor. In addition, the delay and jitter of flows may inherently increase. So, the problem of defining the optimal number of tokens is practically important and nontrivial. In [5], performance measures of the SAPOR scheme of routing in IP networks are evaluated by means of computer simulation. In [6], a description of such a scheme is given in terms of the queueing model.

Also, there is an analogous model for information retrieval in relational databases, where, besides the CPU and disc memory, some additional threads or connections must be provided, to start the user's application processing. In this interpretation, a flow means an application, while customers are queries that will be processed within this application.

In [6], a multiserver Markovian queueing model with a finite buffer that suits the performance evaluation of the scheme of alternative packet overflow routing in IP networks, as well as that of other real-world systems with a time distributed arrival of customers in a flow, is constructed and investigated analytically. In particular, the joint distribution of the number of customers and flows in the system is computed. A very important performance measure of this queueing model is the flow sojourn time computed since the instant of a flow arrival until the instant when all customers from this flow finish their arrival and processing in the system.

In [6], the Laplace-Stieltjes transform for a flow sojourn time distribution is calculated only for the case of a single server queue. In this paper, we calculate this distribution for a multiserver queue with losses (without a buffer). The considered model is more general than the model considered in [6], and in the following respect: it was assumed in [6] that the loss of any customer from the admitted flow does not affect the further behavior of the system. In this paper, we assume that, with fixed probability, the entire flow terminates its arrival after the loss of a customer from this flow. This assumption is realistic in various situations, for example, termination of a connection can occur ahead of schedule if the percentage of lost voice or video packets (and quality of speech or movie) becomes unacceptable for the user.

The rest of the paper is organized as follows. In Section 2, the model is described. The steady-state joint distribution of the number of flows and customers in the system is given in Section 3. Sections 4 and 5 contain the main contributions of this paper: an analysis of a flow sojourn time distribution, and an expression for the loss probability of an accepted flow, due to the loss of a particular customer from this flow. Numerical illustrations are presented in Section 6.

2. Mathematical Model

We consider a queueing system with identical servers, where the service time in the server has an exponential distribution with the parameter The system does not have a buffer. Customers arrive at the system in flows. Flows arrive at the system according to a stationary Poisson arrival process with the intensity In accordance with [5], we assume that admission of flows is restricted by means of tokens. The total number of available tokens is assumed to be The number can be considered as a control parameter, and various optimization problems can be solved.

If there is no token available at a flow arrival epoch, or all the servers are busy, the flow is rejected. It leaves the system permanently. If the number of available tokens is positive and there is at least one free server, the flow is admitted to the system and the number of available tokens decreases by one. After admission of the flow, the next customer of this flow can arrive at the system in an exponentially distributed time, with the parameter .

If there is a free server at the instant of arrival of a customer from the admitted flow, the customer is admitted to the system. Otherwise, the customer is rejected. With probability this rejection does not affect the future behavior of the system. But, with the supplementary probability this rejection causes the termination of the flow arrival. However, the customers from this flow, which were previously admitted to the system, can only leave the system after being processed by the server.

The number of customers in a flow has a geometrical distribution, with the parameter that is, the probability that the flow consists of customers is equal to and the mean number of the customers in a flow is equal to .

If an exponentially distributed time (parameter ) since the arrival of the previous customer of a flow expires, and a new customer does not arrive, this means that the arrival of the flow is finished. The token, which was obtained by this flow upon arrival, is returned to the pool of available tokens. The customers of this flow, which stay in the system during the epoch when the token is returned, must be processed by the system. When the last customer is served, the sojourn time of the flow in the system is considered finished.

It is intuitively obvious that this mechanism of arrivals restriction by means of tokens is reasonable. At the expense of rejecting some flows, it enables a decrease of the probability of the loss of a customer from the admitted flows, flows sojourn time, and jitter. It is important in modeling real-world systems, because the quality of transmission of accepted information units must satisfy the imposed requirements of quality of service (QoS).

3. Stationary Distribution of the Number of Flows and Customers in the System

Let denote the total number of customers in the system during epoch and let denote the number of flows with a token for admission to the system during epoch Here, a notation such as means that assumes values from the set . It is obvious that the two-dimensional process is a finite irreducible regular continuous-time Markov chain.

Let be the generator of the Markov chain with blocks of dimension consisting of intensities of the Markov chain transitions from the state to the state The diagonal entries of the matrix are negative, and the modulus of the entry defines the total intensity of leaving the state of the Markov chain.

Here, we introduce the following notation:

(i);(ii) that is, the diagonal matrix with the diagonal entries ;(iii) is an identity matrix, is a zero matrix, is a column vector of dimension consisting of 1 s, is a row vector of dimension consisting of 0 s;(iv)(v)(vi)square matrices of the corresponding size have all zero entries, except the entries , which are equal to 1. If the size of a matrix is not indicated as a suffix explicitly, it is assumed to be equal to ;(vii) is the sign of the Kronecker product of matrices, is the Kronecker delta.

Lemma 3.1. The infinitesimal generator of the Markov chain has the following three-block-diagonal structure: where the nonzero blocks are computed by

The proof of the lemma consists of analysis of the Markov chain transitions during the infinitesimal interval of time, and combining the corresponding transition intensities with the matrix blocks.

Because the Markov chain is irreducible and regular, and has a finite state space, the stationary probabilities exist:

We can apply an effective and numerically stable algorithm for calculation of such probabilities for Markov chains with a generator of form (3.3), (elaborated in [4]).

Once the stationary probabilities have been computed, we can calculate various performance measures of the system. The most essential measures are as follows.

Corollary 3.2. The mean number of customers processed by the system during unit time (throughput) is computed by The probability of an arbitrary flow rejection upon arrival is computed by

4. Distribution of the Sojourn Time

Let denote the distribution function of the sojourn time of an arbitrary flow in the system under study, and let denote its Laplace-Stieltjes transform (LST): We derive an expression for the by means of the very powerful method of collective marks (method of additional event, method of catastrophes); see [7, 8]. To this end, we interpret the variable as the intensity of a particular virtual stationary Poisson process of catastrophes. So, the function denotes the probability that no catastrophe arrives during the sojourn time of an arbitrary (tagged) flow.

Let denote the probability that a catastrophe from the stationary Poisson process of catastrophes with intensity will not arrive during the rest of the tagged flow sojourn time in the system conditional that, at the given instant, the number of flows processed in the system is equal to the number of customers is equal to and the number of customers from the tagged flow equals The system of linear algebraic equations for functions is derived by means of the law of the total probability, expressed as follows: where

Proof of (4.2) can be clarified by considering that

(i) is the intensity of new flows gaining admission to the system;(ii) is the intensity of service completion of customers from the tagged flow;(iii) is the intensity of service completion of customers that are not from the tagged flow;(iv) is the intensity of arrival of new customers from a tagged flow, when the system is not full;(v) is the intensity of arrival of new customers from other flows, when the system is not full;(vi) is the intensity of arrival of new customers from all admitted flows to the full system, which will not cause the termination of the corresponding flow;(vii) is the intensity of the termination (due to an arriving customer loss) of nontagged flows;(viii) is the intensity of the termination (due to an arriving customer loss) of the tagged flow;(ix) is the intensity of finishing the arrival of customers from the tagged flow;(x) is the intensity of finishing the arrival of customers from the nontagged flows;(xi) is probability of no catastrophe arrival after finishing the arrival of customers from the tagged flow, when customers from this flow are served in the system at the arrival finishing epoch.

To solve system (4.2), the following vector notation is useful: Let the matrix function be defined by its entries: where the matrix is obtained from the identity matrix by means of supplementing it from the right (left) side with the column The matrix is obtained from the identity matrix by means of supplementing it from the top with the row .

Using this notation, system (6.1) can be easily expressed as

Considering this relation and using the law of the total probability, we can easily prove the following statement.

Theorem 4.1. The is calculated by where the vector consisting of the conditional Laplace-Stieltjes transforms is computed by

Remark 4.2. It can be shown that the diagonal entries of the matrix dominate in each row. Thus (see [9]) the matrix is nonsingular for any .

Corollary 4.3. The mean sojourn time of an arbitrary flow is computed by where the values are computed as the corresponding entries of the vector which is calculated by The mean sojourn time of an arbitrary accepted flow is computed by

5. Loss Probability of an Arbitrary Admitted Flow

In this section, we derive the expression for the loss probability of an arbitrary admitted flow. Recall that the admitted flow can be lost, with probability , due to the loss of any customer from this flow.

Let denote the probability that a catastrophe will not arrive during the rest of the tagged flow sojourn time in the system conditional that, at the given instant, the number of flows processed in the system is equal to the number of customers in the system is equal to the number of customers from the tagged flow is equal to and the flow will not be rejected (terminated) due to the loss of a particular customer from this flow.

Analogous to the previous section, we can prove the following statement.

Theorem 5.1. The loss probability of an arbitrary admitted flow is calculated by where the functions are the entries of the vector which is calculated by formula where is the vector defined by

Remark 5.2. It is worthy of mention that, in contrast to the classical Erlang loss model, where the loss probability can be calculated by a simple analytical expression, calculation of the loss probability of an arbitrary flow, and an arbitrary admitted flow in the model with flow arrivals, requires the development of an algorithmic tool. Such a tool is the main contribution of this paper.

6. Numerical Examples

To demonstrate the feasibility of the proposed means of the characteristics calculation and to provide insight into the dependence of the main system performance measures on its parameters and the number of token we present the results of various numerical experiments.

Experiment 6.1. In this experiment, we fix the following parameters of the system: Figure 1 shows the dependence of the mean sojourn time of an arbitrary admitted flow on the number of servers and the number of tokens .
Note that the mean sojourn time increases as the number of servers increases. This surprising effect is easily explained as follows. The sojourn time of an arbitrary admitted flow increases with increasing , because the probability of the flow termination due to the loss of a customer from this flow decreases with increasing .

Experiment 6.2. In this experiment, we fix the following parameters of the system and assume that the number of tokens Figure 2 illustrates the dependence of the loss probability of an arbitrary admitted flow on the number of servers and the probability of flow termination when a customer from this flow is rejected.
As is expected, the loss probability of an arbitrary admitted flow increases when the probability of flow termination due to its customer rejection increases. This effect declines as the number of servers increases.

Experiment 6.3. In this experiment, we show the effect of changing the parameter , which defines the number of customers in a flow. We fix the same parameters as in the previous experiment, and set Figure 3 illustrates the dependence of the loss probability of an arbitrary admitted flow on the number of servers and the parameter .
The loss probability of an arbitrary admitted flow increases as the parameter (and average number of customers in a flow) increases. This effect declines as the number of servers increases.

Experiment 6.4. It is evident that the decision maker controlling the operation of the model with the flow arrival aims to increase the number of tokens to provide the highest throughput of the system. However, an increase of evidently leads to greater competition between flows, and an increase of the loss probability of an arbitrary admitted flow. To protect the interests of users, some QoS requirements should be imposed. The natural requirement is to ensure that the loss probability of an arbitrary admitted flow is less than a particular preassigned level .
So the following optimization problem arises: subject to restriction
In this experiment, we consider this optimization problem, and illustrate the effect of the number of servers , probability of the flow termination when a customer from this flow is rejected, and parameter that characterizes the distribution of the number of customers in a flow.
Firstly, we fix the following parameters of the system: Figure 4 shows the dependence of the value which is the solution to problem (6.1), (6.2), on the number of servers for various admissible values of the loss probability.

It is clear from this figure that if the number of servers is less than or equal to four, even when the number of tokens the loss probability is greater than For the loss probability can be guaranteed. For and correspondingly, the loss probability and can be guaranteed. By increasing the number of servers the number can be rapidly increased.

Secondly, we fix the following parameters of the system: Figure 5 shows the dependence of which is the solution to problem (6.1), (6.2), on the probability of flow termination, when a customer from this flow is rejected, for various values of admissible loss probability.

As is expected, an increase of the probability implies a decrease of .

Finally, we fix the following parameters of the system: Figure 6 shows the dependence of on the parameter .

Because the mean number of customers in a flow is equal to this number rapidly increases when approaches 1. Correspondingly, which is the solution to problem (6.1), (6.2), rapidly decreases. For values of equal to 0.997, 0.9997, 0.99997, that correspond to the mean number of customers in a batch equal to 330, 3330, and 33330, respectively, the system cannot provide the required QoS, even when where the values of are respectively.

7. Conclusion

We analyzed the sojourn time distribution, loss probability of an arbitrary flow, and arbitrary admitted flow in a multiserver loss queueing system with a flow arrival of customers. The results can be exploited for performance evaluation and capacity planning of systems of IP telephony and other systems of information transmission that do not have buffers but have time distributed (flow) arrival of customers. Results can be easily extended to the cases of the MAP arrival process of flows and phase-type service time distribution. However, this particular account of the phase-type service time distribution results in an inherent increase of the state space of the Markov chain under study. Results can also be generalized to the case of an arbitrary distribution of the number of customers in a flow. However, in this case, the state space of the Markov chain also inherently increases, because it is necessary to record the number of customers that previously arrived in each flow. The alternative means of weakening the assumptions about the exponential distribution of interarrival times in a flow and the geometric batch size distribution is to assume a phase-type mechanism of customers arrival in a flow. Customer arrivals occur at the instants of transitions of the underlying Markov process of the phase-type distribution. Analysis of such a model is in progress.

Acknowledgment

This research was supported by Korea Research Foundation, Grant KRF-2007-521-D00330, and Small and Medium Business Administration in Korea.