Journal of Applied Mathematics

Volume 2012 (2012), Article ID 235706, 7 pages

http://dx.doi.org/10.1155/2012/235706

## An Optimization Model of the Single-Leg Air Cargo Space Control Based on Markov Decision Process

Service Management Institute of Business School, Sichuan University, Chengdu 610064, China

Received 18 September 2012; Accepted 27 October 2012

Academic Editor: Jian-Wen Peng

Copyright © 2012 Chun-rong Qin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Based on the single-leg air cargo issues, we establish a dynamic programming model to consider the overbooking and space inventory control problem. We analyze the structure of optimal booking policy for every kind of booking requests and show that the optimal booking decision is of threshold type (known as booking limit policy). Our research provides a theoretical support for the air cargo space control.

#### 1. Introduction

For the air cargo carrier, the main purpose of implementing seat inventory control in the actual operation is to avoid cargo space being occupied by too many low-value goods, causing the lack of timely transportation of high-value goods and resulting in the loss of some potential gains. In fact, some customers (FITs or agents) who order the space through telephone or network temporarily cancel the booking or directly do not appear while the aircraft is taking off. It brings a lot of losses to the air cargo carrier. In order to reduce the losses caused by the empty cabin, decision makers tend to overbook. However, overbooking too much may lead to greater economic losses. For this reason, during the air cargo overbooking, it is necessary to consider freight revenue, but at the same time decision makers have to consider the cost of overbooking as well. Above all, the decision makers’ aim is to obtain the maximum profit of freight. Usually, most of the goods are transported by single legs (single routes). For some relatively tight (the market demand is greater than supply) segments (routes), it is more suitable for scientific space control and proper overbooking. The problem can be described in detail as follows: in some tight legs, if there are some booking requests, decision makers will decide whether to accept or not. If it is accepted, decision makers will have to set aside proper space to its customers in accordance with the cargo information. Simply put, in the case of implementing overbooking, the goal is to maximize air cargo revenue by properly accepting customers' booking requests.

#### 2. Related Literature Review

Based on the analysis of the characteristics of the products, Kasilingam [1] establishes the air cargo overbooking decision-making model on the case of space capacity random, discusses the production capacity in discrete case and continuous case, and identifies the optimal overbooking for each situation. Kleywegt and Papastavrou [2] use dynamic random backpack model to discuss air cargo revenue management problem. The above-mentioned method can be used to describe the multidimensional problems, but the model is too difficult to solve easily. Luo et al. [3] establish a two-dimensional air cargo overbooking model and then determine the approximate optimal overbooking level. In this model, both the weight attributes and volume attributes are taken into account, and the objective is to minimize freight costs. Moussawi and Cakanyildrima [4] further study the two-dimensional air cargo overbooking model. The objective is to maximize freight revenue. What they do is different from Luo et al. [3]. Considering the benefits of passengers and cargo, Sandhu and Klabjan [5] establish space inventory control model with the static method. On the assumption of fixed volume, using the method of reducing dimension, they get the model’s approximate solution and gain the maximum revenue. Considering the freight forwarders and the delay of cargo transportation, Chew et al. [6] establish a stochastic dynamic programming model of short-term space inventory control, and the objective is to minimize transportation costs. Amaruchkul et al. [7] consider a single-leg air cargo space control problem. Under the random cargo volume and weight, they build a Markov decision process model and take a heuristic algorithm to analyze the model. Considering protocol sale customers and free sale customers, Levin and Nediak [8] build a space inventory control model by using dynamic programming methods, and the purpose is to make maximum total income rooted in the receipt of the goods. Under uncertain environment, Wang and Kao [9] establish an air cargo overbooking model and solve it by the fuzzy systems approach. Taking into account the two different demands of customers, Modarres and Sharifyazdi [10] build a random capacity space inventory control model and get the optimal decision. By analyzing the expected revenue function in dynamic programming model, combining the randomness of cargo volume and weight, Huang and Chang [11] establish a more efficient algorithm in air cargo revenue management problem. Supposing the cargo volume, weight and the yields of the air cargo are random and the cargo space booking process has no aftereffect, Han et al. [12] set up a single-leg air cargo revenue management space allocation model and take the bid control strategy to determine the goods receiving. Amaruchkul and Lorchirachoonkul [13] study the allocation of air transport capacity for the number of freight forwarders, get the probability distribution of the actual use of the transport capacity through discrete Markov chain, and solve the model by dynamic programming methods.

By contrast, our work is to consider a single-leg air cargo overbooking and space inventory control problem by dynamic programming. We analyze the structure of optimal booking policy for every kind of booking requests and show that the optimal booking decision is of booking limit policy.

#### 3. Model Description

Next we will study the single-leg air cargo space inventory control and overbooking under the conditions of shipping season (the demand is greater than supply). Because of the complexity of the actual situation, in order to abstract practical problems to theoretical issues, we need some basic assumptions.(i)Aircraft total capacity is fixed (cargo size is unchanged);(ii)customers’ booking requests are sufficient, namely, the supply is adequate;(iii)the booking requests are divided into multiple classes;(iv)each class’s arrival is independent;(v)there is at most one booking request at any time;(vi)on the condition that the aircraft is due to take off, whether or not to show up for each booking request is independent;(vii)each booking request’s weight (volume) is identically independently distributed;(viii)during whole booking period, accepted booking requests will not be free to cancel.

Based on the above assumptions, we will establish mathematical model and make decisions on air cargo. In our model, the main parameters and variables are as follows: : decision time, , where is a booking period; : class booking request, , where is the number of booking classes; : the arrival probability of class booking request in time ; : probability of no booking request in time ; : unit tariff of class booking request; : penalty cost because of overbooking resulting in denying a booking request; : cumulative number of the accepted class booking request in time ; : cumulative number of all accepted booking requests in time ; : the show-up rate of each accepted booking request near the takeoff; : the maximum available load of the aircraft; : the maximum available volume of the aircraft; : weight of each booking request in time ; : volume of each booking request in time ; : expected weight of each booking request in time , namely, ; : expected volume of each booking request in time , namely, ; : IATA required standard density, value of .

In order to meet up only one request in a period, we will divide booking lead time into a number of small discrete booking periods. means that air cargo carrier begins to accept the booking; marks the end of booking, then the air cargo carrier should consider the DB (denying booking) problem.

When , is the maximum total expected profit given state in time . Given and , the dynamic programming optimality equation can be written as where is the opportunity cost of accepting some class request in time . From (3.1)’, it is optimal to accept th class booking request in time if .

Obviously, is the maximum total expected profit from the beginning of booking to the end of booking. In , the penalty cost of overbooking is

The boundary condition (3.2) shows that because of overbooking and relatively fixed capacity, air cargo carrier needs to deny some accepted requests at the end of booking.

#### 4. Structural Properties

In (3.2), there exist continuous random variables and . The cumulative distribution function and probability density function are , and , , respectively.

Next, we will prove that satisfies the following first-order and second-order properties as follows.

*Property 1. *, namely, is decreasing in .

*Proof. *When ,
Then, is decreasing in .

Suppose that is decreasing in . Next, we will show that is decreasing in .

From (3.1), we can get the conclusion easily. This completes the proof.

*Property 2. * is concave in , that is, for each given , is increasing in .

*Proof. *When ,

Then is increasing in , namely, is concave in .

Suppose that is increasing in . Next, we will show that is increasing in .

By (3.1)’, we have
Let

For , by the above assumption, is increasing in , then is increasing in .

For , suppose that there are classes booking requests satisfying , classes booking requests meeting . We may assume that the first classes in total satisfy , and the last classes satisfy . Then,

By above hypothesis, we know that is increasing in , then is increasing in .

From above, we can get: is increasing in . This completes the proof.

*Property 3. * is decreasing in , that is, .

*Proof. *From (4.3), we have

By Property 2, we have , then . This completes the proof.

Define , combining Property 3, we have at any time , as long as , air cargo carrier will accept class booking request. And then, we have the following optimal control policy.

Theorem 4.1. *The optimal control policy of the classes booking requests is a booking limit policy: it is optimal to accept class booking request in time if , or reject it. Furthermore, the threshold has the following properties:*(1)*If , is decreasing in , that is, ; *(2)* is increasing in , that is, .*

*Proof. *From Properties 2 and 3, we can have the conclusions easily. This theorem is verified.

The theorem shows that the optimal booking limits are time-dependent and nested in classes. Furthermore, the unit tariff is higher, the optimal booking control policy is more relaxed; the optimal booking limit policy of each class is increasing in time.

#### 5. Conclusions

In this paper, we consider a single-leg air cargo overbooking and space inventory control problem. Based on actual problem, we discrete the booking time into small pieces and establish the dynamic space inventory control model of considering overbooking. After some powerful proofs, we get the optimal booking-limit policy for each class of goods.

#### Acknowledgments

The authors would like to express their thanks to the referees for their valuable suggestions and comments. This work is supported by the National Natural Science Foundation of China (Grants nos. 71131006, 71172197, and 70771068) and the Central University Fund of Sichuan University (no. skgt201202).

#### References

- R. G. Kasilingam, “An economic model for air cargo overbooking under stochastic capacity,”
*Computers and Industrial Engineering*, vol. 32, no. 1, pp. 221–226, 1997. View at Google Scholar · View at Scopus - A. J. Kleywegt and J. D. Papastavrou, “The dynamic and stochastic knapsack problem,”
*Operations Research*, vol. 46, no. 1, pp. 17–35, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Luo, M. Çakanyıldırım, and R. G. Kasilingam, “Two-dimensional cargo overbooking models,”
*European Journal of Operational Research*, vol. 197, no. 3, pp. 862–883, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - L. Moussawi and M. Cakanyildrima, “Profit maximization in air cargo overbooking,”
*Working Paper*, 2005. View at Google Scholar - R. Sandhu and D. Klabjan, “Fleeting with passenger and cargo origin-destination booking control,”
*Transportation Science*, vol. 40, no. 4, pp. 517–528, 2006. View at Publisher · View at Google Scholar · View at Scopus - E. P. Chew, H. C. Huang, E. L. Johnson, G. L. Nemhauser, J. S. Sokol, and C. H. Leong, “Short-term booking of air cargo space,”
*European Journal of Operational Research*, vol. 174, no. 3, pp. 1979–1990, 2006. View at Publisher · View at Google Scholar · View at Scopus - K. Amaruchkul, W. L. Cooper, and D. Gupta, “Single-leg air-cargo revenue management,”
*Transportation Science*, vol. 41, no. 4, pp. 457–469, 2007. View at Publisher · View at Google Scholar · View at Scopus - Y. Levin and M. Nediak, “Cargo capacity management with allotments and spot market demand,”
*Operations Research*, vol. 60, no. 2, pp. 351–365, 2012. View at Publisher · View at Google Scholar - Y. J. Wang and C. S. Kao, “An application of a fuzzy knowledge system for air cargo overbooking under uncertain capacity,”
*Computers and Mathematics with Applications*, vol. 56, no. 10, pp. 2666–2675, 2008. View at Publisher · View at Google Scholar · View at Scopus - M. Modarres and M. Sharifyazdi, “Revenue management approach to stochastic capacity allocation problem,”
*European Journal of Operational Research*, vol. 192, no. 2, pp. 442–459, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - K. Huang and K. C. Chang, “An approximate algorithm for the two-dimensional air cargo revenue management problem,”
*Transportation Research Part E*, vol. 46, no. 3, pp. 426–435, 2010. View at Publisher · View at Google Scholar · View at Scopus - D. L. Han, L. C. Tang, and H. C. Huang, “A Markov model for single-leg air cargo revenue management under a bid-price policy,”
*European Journal of Operational Research*, vol. 200, no. 3, pp. 800–811, 2010. View at Publisher · View at Google Scholar · View at Scopus - K. Amaruchkul and V. Lorchirachoonkul, “Air-cargo capacity allocation for multiple freight forwarders,”
*Transportation Research Part E*, vol. 47, no. 1, pp. 30–40, 2011. View at Publisher · View at Google Scholar · View at Scopus