Abstract

This paper investigates a class of Markov chains which are frequently encountered in various applications (e.g. queueing systems, dams and inventories) with feedback. Generating functions of transient and steady state probabilities are found by solving a special Riemann boundary value problem on the unit circle. A criterion of ergodicity is established.