Abstract and Applied Analysis

Volume 2013 (2013), Article ID 840925, 5 pages

http://dx.doi.org/10.1155/2013/840925

## Linear Discrete Pursuit Game Problem with Total Constraints

^{1}Institute of Mathematics of Uzbekistan, 29 Dorman yuli Street, 100125 Tashkent, Uzbekistan^{2}Institute for Mathematical Research and Department of Mathematics, Faculty of Science (FS), Universiti Putra Malaysia, 43400 Serdang, Selangor, Malaysia

Received 8 March 2013; Revised 28 May 2013; Accepted 28 May 2013

Academic Editor: Valery Y. Glizer

Copyright © 2013 Atamurat Kuchkarov et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We study a linear discrete pursuit game problem of one pursuer and one evader. Control vectors of the players are subjected to total constraints which are discrete analogs of the integral constraints. By definition pursuit can be completed in the game if there exists a strategy of the pursuer such that for any control of the evader the state of system reaches the origin at some time. We obtain sufficient conditions of completion of the game from any initial position of the state space. Strategy of the pursuer is defined as a function of the current state of system and value of control parameter of the evader.

#### 1. Introduction

Pursuit and evasion differential game problems with integral constraints for continuous time dynamical systems were investigated in many works, (see, for example, [1–14]). Such constraints represent the constraints on resource, energy, fuel, and so forth. Discrete analog of integral constraint is called total constraint.

There are many works on discrete controlled systems where controls are subjected to total or geometric constraints. Sirotin [15] studied some conditions of 0-controllability and asymptotical controllability of discrete time linear systems. In this work, the control is bounded in Holder norm. In particular, he obtained necessary and sufficient conditions of 0-controllability and asymptotical controllability of the system.

Sazanova [16] studied the problem of steering the state of a linear discrete system from the given point at a given time to another given point at a given time by a control which minimizes a given functional. She constructed an optimal program control.

However, discrete linear pursuit games with total constraints on control vectors of players were studied in a few works, for example, [17–20]. Satimov et al. [19] examined linear discrete pursuit games of many objects under total constraints on controls of players. Game is described by the following systems: It is assumed that the eigenvalues of matrices are real. Sufficient conditions of completion of pursuit were obtained.

The paper of Satimov and Ibragimov [20] was also devoted to discrete time pursuit games of several players described by the same linear systems. They obtained sufficient conditions of completion of the game for any matrices . It should be noted that in case of one pursuer these conditions are also necessary. In particular, they obtained necessary and sufficient conditions of 0-controllability when the coefficient matrix of control is an identity matrix.

Azamov and Kuchkarov [17] obtained necessary and sufficient conditions of solvability of both the 0-controllability problem and pursuit problem for a linear discrete system when the control parameter of pursuer is subjected to geometric constraint and that of evader is subjected to total constraint.

In the monograph of Azamov [21], the fundamentals of theory of discrete time pursuit and evasion dynamic games are given systematically. The main notions of the theory of discrete games were explained by interesting examples.

In the present paper, we study a linear discrete pursuit game problem described by the linear equation with constant coefficients of general form. Controls of both pursuer and evader are subjected to total constraints. We give sufficient conditions of completion of pursuit from any initial position.

#### 2. Statement of the Problem

We consider a discrete pursuit game described by the following equation: where is a step number which belongs to the set of nonnegative integers, , , , and are , , and constant matrices, respectively, is the control parameter of pursuer, and is that of evader.

*Definition 1. *Sequences and , subjected to the following total constraints:
are referred to as the controls of the pursuer and evader, respectively, where is the set of nonnegative integers, and are given numbers, and .

The conditions (3) and (4) are the discrete analogs of integral constraints, and they are called total constraints.

*Definition 2. *A function , , is called strategy of the pursuer. The triple consisting of a given initial point , the strategy , and a control of the evader generates the unique trajectory defined by the following formula:
The sequence , , is referred to as the realization of the strategy . The strategy of the pursuer is called admissible if all its realizations with fixed satisfy the condition (3).

*Definition 3. *Pursuit is said to be completed in the game (2)–(4) from the initial position if there exists a strategy of the pursuer such that for any control of the evader the trajectory generated by , , and satisfies the condition at some , .

The aim of the pursuer is to realize the equality as earlier as possible. Thus we deal with pursuit problem. The pursuer uses a strategy, and the evader uses any control . By Definition 2 at any time the value of the strategy is constructed based on the state and value of the control parameter of the evader .

*Problem 1. *Find the conditions under which pursuit can be completed in the game (2)–(4) from any initial position.

#### 3. Main Result

To prove the main result, we first prove two lemmas. Let be the eigenvalues of the matrix . Denote Let be the set of all sequences that satisfy the constraint (4).

Lemma 1. *If , then *(a) *for all the set
* *is contained in a ball ;*(b) *for any triple consisting of , , and there exists a number , , such that
*

* Proof. *Since , then as ; therefore there exists a positive integer , such that . Then according to the property of norm, we have

Clearly,
Using the Holder inequality, we obtain for any that
It follows from (9)–(11) that
for all . Let . It is easy to check that if , then . Therefore, the inequality (12) implies that
Since (12) holds for any positive integer , then the statement (a) of Lemma 1 follows.

We now turn to the statement (b) of the lemma. Assume the contrary: there exist a control and positive numbers , such that
It follows from (9) that
Since , then we can conclude that there exists a positive integer , , such that
Clearly, (14) implies that
Setting , we get
According to the part (a) of Lemma 1, this vector belongs to . Then by (16), . Hence, from (17), we obtain that . Therefore, using the Holder inequality yields
where . This gives
Substituting and then replacing by again, we obtain
We conclude from these inequalities that
According to (4) for any , the left hand side of this inequality is bounded by , while the right hand side as . Contradiction. The proof of Lemma 1 is complete.

Lemma 2. *If , then for any the solution of the system
**
satisfies the equality
*

*Proof. *Let and be an arbitrary positive number. Since , then the system is asymptotically stable. Therefore for any there exists a number such that

Next, by Lemma 1 there exists a number such that

Using (25) and (26), we have

As the number is arbitrary, then , and Lemma 2 follows.

Theorem 3. *If and , then pursuit can be completed in the game (2)–(4) from any initial position .*

* Proof. *Define the strategy of the pursuer as follows:

Since , the set contains a ball of radius of the space . It follows from Lemma 2 that for every control there exists a step such that . Consequently, for some
Then by (28) we have , and therefore
This proves the theorem.

We now give an illustrative example.

*Example 4. *Consider the following discrete system in :
where , , and . Eigenvalues of the matrix
are , and . Next, it is not difficult to verify that , where
Thus, all hypotheses of Theorem 3 are satisfied, and therefore pursuit can be completed from any initial position .

#### 4. Conclusion

In the present paper, we have studied a linear discrete pursuit game problem under total constraints. We have obtained conditions under which pursuit starting from any initial position can be completed in a finite number of steps. We have described a strategy for the pursuer which is constructed based on the information about the position and value of the control parameter of the evader at each step . It should be noted that the resource of the pursuer does not need to be greater than that of the evader .

#### Acknowledgment

The present research was partially supported by the National Fundamental Research Grant Scheme (FRGS) of Malaysia, 01-01-13-1228FR.

#### References

- A. Ya. Azimov, “Linear differential pursuit game with integral constraints on the control,”
*Differential Equations*, vol. 11, pp. 1283–1289, 1975. View at Google Scholar - A. A. Chikrii and A. A. Belousov, “On linear differential games with integral constraints,”
*Memoirs of Institute of Mathematics and Mechanics, Ural Division of RAS. Ekaterinburg*, vol. 15, no. 4, pp. 290–301, 2009 (Russian). View at Google Scholar - P. B. Gusiatnikov and E. Z. Mohon’ko, “On ${l}_{\infty}$-escape in a linear many-person differential game with integral constraints,”
*Journal of Applied Mathematics and Mechanics*, vol. 44, no. 4, pp. 436–440. View at MathSciNet - G. I. Ibragimov, A. A. Azamov, and M. Khakestari, “Solution of a linear pursuit-evasion game with integral constraints,”
*ANZIAM Journal. Electronic Supplement*, vol. 52, pp. E59–E75, 2010. View at Publisher · View at Google Scholar · View at MathSciNet - G. I. Ibragimov, M. Salimi, and M. Amini, “Evasion from many pursuers in simple motion differential game with integral constraints,”
*European Journal of Operational Research*, vol. 218, no. 2, pp. 505–511, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - G. I. Ibragimov and N. Yu. Satimov, “A multiplayer pursuit differential game on a closed convex set with integral constraints,”
*Abstract and Applied Analysis*, vol. 2012, Article ID 460171, 12 pages, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - R. Isaacs,
*Differential Games. A Mathematical Theory with Applications to Warfare and Pursuit, Control and Optimization*, New York, NY, USA, 1967. - N. N. Krasovskii,
*The Theory of Motion Control*, Nauka, Moscow, Russia, 1968. - A. V. Mesencev, “Sufficient conditions for evasion in linear games with integral constraints,”
*Doklady Akademii Nauk SSSR*, vol. 218, pp. 1021–1023, 1974. View at Google Scholar · View at MathSciNet - M. S. Nikolskii, “The direct method in linear differential games with integral constraints,”
*Controlled Systems, IM, IK, SO AN SSSR*, no. 2, pp. 49–59, 1969. View at Google Scholar - L. S. Pontryagin,
*Selected Scientific Papers*, vol. 2, Nauka, Moscow, Russia, 1988. - B. N. Pshenichnii and V. V. Ostapenko,
*Differential Games*, Naukova Dumka, Kiev, Russia, 1992. - N. Yu. Satimov,
*Methods for Solving a Pursuit Problem in the Theory of Differential Games*, NUUz Press, Tashkent, Uzbekistan, 2003, in Russian. - V. N. Ushakov, “Extremal strategies in differential games with integral constraints,”
*Prikladna Matematika I. Mehanika*, vol. 36, no. 1, pp. 15–23, 1972. View at Google Scholar - A. N. Sirotin, “On null-controllable and asymptotically null-controllable finitedimensional linear systems with controls bounded in the Holder norms of control,”
*Automation and Remote Control*, vol. 60, no. 11, part 1, pp. 1729–1738, 1999. View at Google Scholar · View at MathSciNet - L. A. Sazanova, “Optimal control of linear discrete systems,”
*Proceedings of the Steklov Institute of Mathematics*, supplement 2, pp. S141–S157, 2000. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - A. A. Azamov and A. Sh. Kuchkarov, “On controllability and pursuit problems in linear discrete systems,”
*Journal of Computer and Systems Sciences International*, vol. 49, no. 3, pp. 360–365, 2010. View at Google Scholar · View at MathSciNet - G. I. Ibragimov, “Problems of linear discrete games of pursuit,”
*Mathematical Notes*, vol. 77, no. 5, pp. 653–662, 2005. View at Google Scholar - N. Yu. Satimov, B. B. Rikhsiev, and A. A. Khamdamov, “On a pursuit problem for linear differential and discrete n-person games with integral constraints,”
*Matematicheskii Sbornik*, vol. 46, no. 4, pp. 459–469, 1982. View at Google Scholar - N. Yu. Satimov and G. I. Ibragimov, “On a pursuit problem for discrete games with several participants,”
*Izvestiya Vysshikh Uchebnykh Zavedeniĭ. Matematika. Kazanskiĭ Gosudarstvennyĭ Universitet*, no. 12, pp. 46–57, 2004. View at Google Scholar · View at MathSciNet - A. A. Azamov,
*Fundamentals of Theory of Discrete Games*, Niso Poligraf, Tashkent, Uzbekistan, 2011, in Russian.