Rational Probabilistic Deciders—Part I: Individual Behavior

Kabamba, P. T.; Lin, W.-C.; Meerkov, S. M.

doi:https://doi.org/10.1155/2007/35897

Mathematical Problems in Engineering

On this page

Abstract References Copyright Related Articles

Research Article | Open Access

Volume 2007 | Article ID 035897 | https://doi.org/10.1155/2007/35897

Rational Probabilistic Deciders—Part I: Individual Behavior

P. T. Kabamba,¹W.-C. Lin,¹and S. M. Meerkov¹

Academic Editor: Jingshan Li

Received07 Dec 2006

Accepted23 Feb 2007

Published30 Apr 2007

Abstract

This paper is intended to model a decision maker as a rational probabilistic decider (RPD) and to investigate its behavior in stationary and symmetric Markov switch environments. RPDs take their decisions based on penalty functions defined by the environment. The quality of decision making depends on a parameter referred to as level of rationality. The dynamic behavior of RPDs is described by an ergodic Markov chain. Two classes of RPDs are considered—local and global. The former take their decisions based on the penalty in the current state while the latter consider all states. It is shown that asymptotically (in time and in the level of rationality) both classes behave quite similarly. However, the second largest eigenvalue of Markov transition matrices for global RPDs is smaller than that for local ones, indicating faster convergence to the optimal state. As an illustration, the behavior of a chief executive officer, modeled as a global RPD, is considered, and it is shown that the company performance may or may not be optimized—depending on the pay structure employed. While the current paper investigates individual RPDs, a companion paper will address collective behavior.

References

M. L. Tsetlin, “Automaton Theory and Modeling of Biological Systems,” Academic Press, New York, NY, USA, 1973.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
V. I. Varshavskiĭ, Collective Behavior of Automata, “Nauka”, Moscow, 1973, (in Russian).
View at: Google Scholar
M. L. Tsetlin, “On the behavior of finite automata in random media,” Automation and Remote Control, vol. 22, no. 10, pp. 1210–1219, 1961.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
I. M. Gel'fand, I. I. Pjateckiĭ-Šapiro, and M. L. Tsetlin, “On certain classes of games and robot games,” Doklady Akademii Nauk SSSR, vol. 152, no. 4, pp. 845–848, 1963.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
S. M. Meerkov, “Mathematical theory of behavior—individual and collective behavior of retardable elements,” Mathematical Biosciences, vol. 43, no. 1-2, pp. 41–106, 1979.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
V. Y. Krylov, “On one stochastic automata which is asymptotically optimal in a random medium,” Automation and Remote Control, vol. 24, no. 9, pp. 1226–1228, 1963.
View at: Google Scholar | Zentralblatt MATH
V. A. Ponomarev, “A construction of an automaton which is asymptotically-optimal in a stationary random medium,” Biophysics, vol. 9, no. 1, pp. 104–110, 1964.
View at: Google Scholar
V. I. Krinskiy, “An asymptotically-optimal automata with an exponential rate of convergence,” Biophysics, vol. 9, no. 4, pp. 484–487, 1964.
View at: Google Scholar
A. A. Miljutin, “On automata with an optimal behavior in random media,” Automation and Remote Control, vol. 26, no. 1, pp. 117–131, 1965.
View at: Google Scholar | Zentralblatt MATH
V. I. Varshavskiĭ and I. P. Vorontsova, “On the behavior of stochastic automata with a variable structure,” Automation and Remote Control, vol. 24, no. 3, pp. 327–333, 1963.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
V. I. Bryzgalov, I. M. Gel'fand, I. I. Pjateckiĭ-Šapiro, and M. L. Tsetlin, “Homogeneous games of automata and their simulation on digital computers,” Automation and Remote Control, vol. 25, no. 11, pp. 1572–1580, 1964.
View at: Google Scholar | Zentralblatt MATH
S. L. Ginsburg and M. L. Tsetlin, “On modeling of collective behavior of automata,” Problems of Information Transmission, vol. 1, no. 2, pp. 54–62, 1965.
View at: Google Scholar
V. I. Varshavskiĭ, M. I. Meleshina, and M. L. Tsetlin, “The behavior of automata in periodic random media and the problem of synchronization in the presence of noise,” Problems of Information Transmission, vol. 1, no. 1, pp. 65–71, 1965.
View at: Google Scholar
V. Y. Krylov and M. L. Tsetlin, “On automaton games,” Automation and Remote Control, vol. 24, no. 7, pp. 975–987, 1963.
View at: Google Scholar | Zentralblatt MATH
V. I. Krinskiy, “Zero-sum games for two asymptotically optimal sequences of automata,” Problems of Information Transmission, vol. 2, no. 2, pp. 43–53, 1966.
View at: Google Scholar
E. T. Gurvich, “Method for asymptotic investigation of games between automata,” Automation and Remote Control, vol. 36, no. 2, part 1, pp. 257–270, 1975.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
V. A. Borovikov and V. I. Bryzgalov, “The simplest symmetric game of many automata,” Automation and Remote Control, vol. 26, no. 4, pp. 681–684, 1965.
View at: Google Scholar | MathSciNet
V. A. Volkonskiĭ, “Asymptotic properties of the behavior of simple automata in a game,” Problems of Information Transmission, vol. 1, no. 2, pp. 36–53, 1965.
View at: Google Scholar
B. G. Pittel, “The asymptotic properties of a version of the gur game,” Problems of Information Transmission, vol. 1, no. 3, pp. 99–112, 1965.
View at: Google Scholar
B. G. Pittel, “A simple probability model of collective behavior,” Problems of Information Transmission, vol. 3, no. 3, pp. 30–44, 1967.
View at: Google Scholar | MathSciNet
Yu. D. Tenisberg, “Some models of collective behavior in dynamic processes of market price formation,” Automation and Remote Control, vol. 30, no. 7, pp. 1140–1148, 1969.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
G. J. McMurtry and K.-S. Fu, “A variable structure automaton used as a multi-modal searching technique,” IEEE Transactions on Automatic Control, vol. 11, no. 3, pp. 379–387, 1966.
View at: Publisher Site | Google Scholar
K. S. Fu, “Stochastic automata as models of learning systems,” in A Prelude to Neural Networks: Adaptive and Learning Systems, pp. 393–431, Prentice-Hall Press, Englewood Cliffs, NJ, USA, 1994.
View at: Google Scholar
K.-S. Fu, “Learning control systems—review and outlook,” IEEE Transactions on Automatic Control, vol. 15, no. 2, pp. 210–221, 1970.
View at: Publisher Site | Google Scholar | MathSciNet
K. S. Narendra and R. Viswanathan, “A two-level system of stochastic automata for periodic random environments,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 2, no. 2, pp. 285–289, 1972.
View at: Google Scholar | Zentralblatt MATH
K. S. Narendra and M. A. L. Thathachar, “Learning automata—a survey,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 4, no. 4, pp. 323–334, 1974.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
K. S. Narendra, E. A. Wright, and L. G. Mason, “Application of learning automata to teletraffic routing and management,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 7, no. 11, pp. 785–792, 1977.
View at: Google Scholar
K. S. Narendra and M. A. L. Thathachar, “On the behavior of learning automata in a changing environment with application to telephone traffic routing,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 10, no. 5, pp. 262–269, 1980.
View at: Google Scholar | Zentralblatt MATH
K. S. Narendra and M. A. L. Thathachar, Learning Automata: An Introduction, Prentice-Hall, Englewood Cliffs, NJ, USA, 1989.
View at: Google Scholar
B. Tung and L. Kleinrock, “Distributed control methods,” in Proceedings of the 2nd International Symposium on High Performance Distributed Computing, pp. 206–215, Spokane, Wash, USA, July 1993.
View at: Publisher Site | Google Scholar
Y.-C. Tung, “Distributed control using finite state automata,” Ph.D. dissertation, Computer Science Department, UCLA, Los Angeles, Calif, USA, 1994.
View at: Google Scholar
Y. U. Cao, A. S. Fukunaga, and A. B. Kahng, “Cooperative mobile robotics: antecedents and directions,” Autonomous Robots, vol. 4, no. 1, pp. 7–27, 1997.
View at: Publisher Site | Google Scholar
R. Iyer and L. Kleinrock, “QoS control for sensor networks,” in Proceedings of IEEE International Conference on Communications (ICC '03), vol. 1, pp. 517–521, Seattle, Wash, USA, May 2003.
View at: Publisher Site | Google Scholar
S. Ho, H. Nassef, N. Pornsinsirirak, Y.-C. Tai, and C.-M. Ho, “Unsteady aerodynamics and flow control for flapping wing flyers,” Progress in Aerospace Sciences, vol. 39, no. 8, pp. 635–681, 2003.
View at: Publisher Site | Google Scholar
J. Flinn, P. T. Kabamba, W.-C. Lin, S. M. Meerkov, and C. Y. Tang, “Collaborative power management in WPANs using rational controllers: a case study,” Mathematical Problems in Engineering, vol. 2005, no. 5, pp. 491–501, 2005.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2007 P. T. Kabamba et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation Order printed copies

Views

296

Downloads

615

Citations