Dynamic Request Routing for Online Video-on-Demand Service: A Markov Decision Process Approach

Table 1

System dynamics.

Time	Event
𝑡	The dispatcher samples the system state (𝜆(𝑡),𝐍(𝑡)), and make the decision 𝑎(𝑡) forwarding the buffered requests to appropriate edge servers (or rejecting some requests).
(𝑡,𝑡+1)	Requests arrive and are buffered in the dispatcher's waiting queue.
(𝑡+1)^−	Some requests in the service queue leave the system, and the system transits to the next state.