Task Assignment for Multi-UAV under Severe Uncertainty by Using Stochastic Multicriteria Acceptability Analysis
This paper considers a task assignment problem for multiple unmanned aerial vehicles (UAVs). The UAVs are set to perform attack tasks on a collection of ground targets in a severe uncertain environment. The UAVs have different attack capabilities and are located at different positions. Each UAV should be assigned an attack task before the mission starts. Due to uncertain information, many criteria values essential to task assignment were random or fuzzy, and the weights of criteria were not precisely known. In this study, a novel task assignment approach based on stochastic Multicriteria acceptability analysis (SMAA) method was proposed to address this problem. The uncertainties in the criteria were analyzed, and a task assignment procedure was designed. The results of simulation experiments show that the proposed approach is useful for finding a satisfactory assignment under severe uncertain circumstances.
Unmanned aerial vehicles (UAVs) are playing increasingly important roles in military and civilian applications. Over the last decade, UAVs were employed as intelligent units in various missions in dangerous and complex environments. When executing multiple missions, UAVs form teams and are able to work cooperatively. In this context, the multi-UAV cooperative control and decision mechanisms, including task assignment, path planning, and tactical decision making, have received a great deal of attention.
The purpose of multi-UAV task assignment is to allocate necessary tasks to UAVs, so as to maximize the overall performance. Here, tasks involve reconnaissance, search, attack, and verification. In applications wherein a group of UAVs executed complex missions, the result of task assignment directly determined how well the missions were performed. This problem has generated many research interests and a variety of approaches have been developed for different scenarios. Methods like linear programming [1, 2], dynamic programming (DP) , and Markov decision processes (MDP)  were employed. For solving techniques, the genetic algorithm [5, 6] and tabu search algorithm  were used.
Researchers have also considered task assignment under uncertain circumstances. Choi et al.  addressed single and multiple assignment problems by presenting 2 decentralized algorithms: the consensus-based auction algorithm (CBAA) and the consensus-based bundle algorithm (CBBA). These 2 algorithms were independent of inconsistencies in situational awareness and could, respectively, produce conflict-free solutions to the assignment problem. Bertuccelli et al.  extended the CBBA to resolve the heterogeneous UAVs real-time task assignment problem in uncertain environments. The first extension accounts for obstacle regions in order to generate collision-free paths for UAVs. The second extension reduces sensitivity to sensor noise and minimizes the churning behavior in flight paths. Alighanbari and How  presented a robust filter-embedded task assignment (RFETA) algorithm to achieve the target assignment for UAVs in uncertain dynamic environments. The algorithm used two techniques; one is proactive in order to hedge against the uncertainty, while the other is reactive in order to limit churning behavior by the vehicles. Alighanbari et al.  formulated a modification of the classical task assignment under noisy conditions. They developed a noise rejection algorithm that reduced the effects of high frequency noise on the planner. This algorithm could be used to mitigate the effect of noise in situational awareness on the solution.
In this study, we considered a task assignment problem for multi-UAV that performed attack tasks on a collection of ground targets in a severe, uncertain environment. Each target had to be allocated to a UAV before the mission began. The severe and uncertain environment refers to battlefield conditions in which much information vital to an assignment is random, fuzzy, or unknown. For example, the location of a target is vague within the task area. Though the predetected location provides a reference, it may be not in accordance with the real target location because of a sensor error or target movement; the threat of a target’s defense system to the UAVs is unclear; the value of the target is fuzzy. These conditions are often encountered in real-world UAV applications. Under these conditions, the common methods for task assignment cannot be used and new methods that can deal with severe uncertainty are needed.
To address this problem, we propose a novel task assignment method based on the stochastic multicriteria acceptability analysis (SMAA). SMAA is a method used for stochastic multicriteria decision problems. It ranks alternatives based on multiple criteria values that are random variables and can also address problems without weight information. Lahdelma et al.  gave the first version of the SMAA method, and later studies presented a series of extended versions, including SMAA-2 , SMAA-3 , SMAA-O , SMAA-A , SMAA-TRI , and SMAA-P . Here we have employed SMAA-2 to handle battlefield uncertainty. The aim of this study is to offer a suitable and reliable method for task assignment under severe uncertain circumstances.
The rest of this paper is organized as follows. Section 2 defines the problem. Section 3 analyses the criteria essential to task assignment. Section 4 provides the task assignment procedure. In Section 5, the results of simulation experiments are given and analyzed. Finally, the conclusion is presented in Section 6.
2. Problem Description
The problem is to assign the attack tasks of geographically dispersed ground targets to UAVs. Each UAV is equipped with an air-to-ground missile and can attack one target during one flight. Each UAV is assigned only one target, and each target should only be allocated to a UAV (i.e., ). The task assignment problem needs to be solved before the mission starts. The objective of task assignment is to maximize the total reward; one example of an assignment is shown in Figure 1. In this example, 3 targets were assigned to 3 UAVs, one target for each UAV.
The major symbols used for the problem are listed in Symbols.
To make an assignment, we consider 3 criteria: , , and . Their values are computed through the following 6 subcriteria: the value of the target; the value of the UAV; the distance between the UAV and the target; the flying cost per unit distance of UAV; the probability of UAV loss; and the probability of killing target. The 3 criteria are given by the following expressions:The common model for task assignment is given as follows:
Objective function (2) aims to maximize the total task reward, which is the difference between the expected attack reward and the cost. are weights, given by military commanders or experts. Constraints (3) and (4) ensure that there is a one-to-one relationship between the UAV and the target. Constraint (5) ensures that the weights are normalized. Constraints (6) and (7) give the range of the variables.
The task assignment problem can be settled by solving the above model when all values of the parameters are given. However, in complex battlefield scenarios, much information is severely uncertain. Uncertainty increases many difficulties for task assignment. In these conditions, we need new methods to handle uncertainty.
3. Criteria Analysis
In this section, we will provide an analysis of the criteria and give methods to quantitatively describe the involved uncertainties.
3.1. The Value of the Target
The value of a target, evaluated by military commanders or experts, determines whether the target is worth attacking. For ease of calculation in this paper, the lower and upper bounds of the value of target have been set to be 0 and 100. A higher number indicates a higher value. However, it is difficult for the commanders or experts to provide a precise value. They typically prefer to use linguistic variables, such as “very high” and “fairly low.” These linguistic variables are fuzzy descriptors that cannot be used in task assignment models. To solve this problem, we have defined a fuzzy linguistic set based on the work in [19, 20]:
Each linguistic variable in matches a value interval: , , , , , , , , and . Using the fuzzy set, the commanders or experts can use a linguistic variable to describe the value of a target, and then the variable is transformed to a numerical interval.
3.2. The Value of the UAV
When a UAV attacks a target, the UAV may also be at risk of being attacked. Therefore, the UAV’s value is an important factor that we need to consider. By contrasting it with the value of target, the value of UAV can be accurately obtained and can be represented by a precise number.
3.3. The Distance between the UAV and the Target
The distance between the UAV and the target is an important criterion for task assignment. To minimize the flying costs, a UAV tends to select the nearest target when other variables are equal.
The distance between the UAV and target is calculated by using the Euclidean distance, as shown in
In battlefield circumstances, the coordinate of target is not a certain value. The information we have is the detected position of . However, there is usually a deviation between a target’s detected position and its real position.
Normally, the real position follows a two-dimensional Gaussian distribution whose expectation is , as shown in
Because and are independent, we let and we assume . Then (10) can be simplified as
In (11), the probability distribution of a target’s real position within the task area is shown in Figure 2. The probability is 0.159 that a target’s real position is in accordance with the detected position.
The position can be accurately detected only when the UAV approaches the target. However, at the time the task assignment is made, the UAV only has uncertain information.
3.4. The Flying Cost per Unit Distance of UAV
This criterion, as well as the distance between the UAV and the target, determines the flying cost of a mission. For a UAV, the value of this criterion is fixed.
3.5. The Probability of UAV Loss
A high value target is usually protected by a defense system that is equipped with surface-to-air missiles. When performing the attack task, the UAV also faces the possibility of being destroyed. Washburn and Kress  provided the probability of loss when attacking target aswhere denotes the real-time distance between and and and are parameters calculated using
Equation (12) indicates that the probability of loss is 0 when being out of the range of a surface-to-air missile; within the range of the missile, the probability approximates a Gaussian distribution.
To calculate , we reasonably assume the following: the defense system will attack a UAV at the same time the UAV attacks the target; a UAV always attacks a target at the UAV’s best striking distance, which depends on the UAV’s onboard weapon. Different weapons have their own best strike distances.
Based on the above assumptions, we substitute in (12) with . typically is an interval, such as . Consequently, is also an interval, like and so forth.
3.6. The Probability of Killing Target
As mentioned above, the UAV always attacks the target at the UAV’s best striking distance. Washburn and Kress  presented the probability of UAV killing target as where represents the circular error probability, the definition of which is the following. If the probability that the weapon’s two-dimensional shooting error falls within the circle is 0.5, the radius of circle will be called the circular error probability.
4. Assignment Model
The SMAA-2 method was employed to solve the task assignment problem. The SMAA-2 method can handle multiattribute decision making problems in which uncertain criteria values and uncertain weights exist simultaneously. The SMAA-2 method has been applied in many aspects of the real world. Kangas et al.  used the SMAA-2 method for strategic forest planning. Hokkanen et al.  used the SMAA-2 method in a technology competition for cleaning polluted soil in Helsinki. Menou et al.  gave a decision support for centralizing cargo at a Moroccan airport hub using the SMAA-2 method. Rahman et al.  used the SMAA-2 method to evaluate the choices for sustainable rural electrification in developing countries. Pesola et al.  applied the method on alternatives for remote monitoring systems of municipal buildings.
4.1. The SMAA-2 Method
Considering alternatives and evaluation criteria, is a weight vector for the decision maker (DM) to express his subjective preference. represents the weight of criterion , satisfying . A weight distribution with density function is used to represent the DM’s partially known or unknown preference. The weight distribution is in the set of feasible weights defined as . represents the uncertain or imprecise value of criterion for alternative . Similarly, a joint probability distribution with density function in the space is used to represent the uncertain or imprecise criteria values. The utility of alternative is defined as where is the utility function of criterion .
The SMAA-2 method defines a ranking function which is given by the following to represent the rank of alternative : where is a judgment function. If , then ; otherwise .
The SMAA-2 method is based on analyzing the sets of favorable rank weights . Alternative always obtains rank for arbitrary weight . is defined as
The SMAA-2 method presents 3 important analysis indices. All the indices are based on properties of these stochastic sets. The first index is the rank acceptability index , defined as the expected volume of :
It is computed as a multidimensional integral over the criteria distributions and the favorable rank weights, representing the acceptability or the probability of alternative rank .
The rank acceptability index is a real number in and is generally expressed as a percent. Normally, the more acceptable alternatives should have higher acceptabilities for the best ranks.
The second index is the central weight vector , the best single weight vector representation of a hypothetical DM supporting alternative to rank first. It is computed as a double integral over the criteria distributions and the favorable first rank weights :
The central weight vector is the expected center of gravity of the favorable first rank weights . It can help the DM understand what preferences support the different alternatives. Moreover, the central weight vectors are used to compute the confidence factor.
The third index is the confidence factor , representing the probability for the alternative ranking first if the central weight vector is chosen. It is computed as an integral over the criteria distributions:
The confidence factor can also be used to judge whether the criteria value is accurate enough to distinguish the alternatives when the central weight vector is used. Providing any weight vector can also calculate the corresponding confidence factor in a similar way.
Comparing the alternatives according to their rank acceptabilities can be seen as a “second-order” multicriteria decision problem . The SMAA-2 method additionally defines the holistic acceptability index to provide a measure of the overall acceptability of each alternative. It is represented as a weighted sum of the rank acceptabilities:where are referred to as metaweights (or rank weights). A complete priority order between the metaweights should be well defined. Lahdelma and Salminen  gave three possible choices: linear weights , inverse weights , and centroid weights . After comparison, they preferred using centroid weights.
In practice, accurately calculating these indices requires complex computation processes. In order to reduce the computational complexity, Tervonen and Lahdelma  gave an approximate computation method by using the Monte Carlo technique. Even when dealing with large-scale problems, this method can quickly solve them. Furthermore Tervonen  presented JSMAA: open source software for SMAA computations.
4.2. The Decision Model
To solve the problem of assigning the attack tasks on targets to UAVs, we decompose the problem into parts based on the number of targets. For target , let the UAVs be alternatives and use , , , and to, respectively, represent the rank acceptability index, holistic acceptability index, central weight vector, and confidence factor of alternative . These indices are calculated by using the SMAA-2 method. On the basis of the indices, the DMs make the assignment decisions.
In this study, the DMs have weight intervals of the criteria and the widths of the intervals are small. The main consideration of the DMs is the overall acceptability. So the holistic acceptability index is the most suitable index for making decisions. Then the task assignment model in Section 2 is modified as
In this model, objective function (22) aims to maximize the holistic acceptability of the assignment schemes. To calculate the holistic acceptability, the DMs select centroid weights .
The steps of task assignment for multiple UAVs under severe uncertainty are given in Figure 3.
In step 1, linear utility functions are used. Let , respectively, represent the values of criteria , , and for alternative . Their values can be calculated using (1). is an income-type criterion. and are cost-type criteria. Their utility functions can, respectively, be defined aswhere and . The effects of the utility functions are to normalize the criteria values.
5. Simulation Experiments
The proposed task assignment method was tested by simulation experiments. In the experiments, the task area was represented by grid, which was populated by 4 UAVs and 4 targets, as seen in Figure 4. The experiments were run on a computer with an Intel Core 2 Duo E7500 2.93 GHz processor and 2 GB RAM.
In these simulations, the DM’s preference has been divided into 2 categories as follows.
The primary purpose of the mission is to kill all the targets. The DM considers criterion to be the most important, to be the second most important, and to be the third most important. The weight intervals are given in Table 3.
The primary purpose of the mission was to kill all the targets in the case of ensuring that the UAVs underwent zero damage, as far as possible. The DM considers criterion to be the most important, to be the second most important, and to be the third most important. The weight intervals are given in Table 6. The results are shown in Table 7.
The final results of task assignment are listed in Table 8.
This paper presented a task assignment method for multiple UAVs under severe uncertainty conditions, in which the values of the criteria essential to task assignment were random, fuzzy, or unknown. Taking advantage of the SMAA-2 method, this paper established the solving model and the solution process.
In the simulations, we selected different weight information for 2 simulation experiments. In the experiments, there was little difference in the central weight vector for each assignment, so we only needed to select alternatives on the basis of the holistic acceptability index. However, if the central weight vectors vary widely, the selection should instead be based on the holistic acceptability index, the central weight vector, and the confidence factor.
Another advantage to the SMAA-2 method is that it allows using any preference models commonly accepted by DMs in practical problems. This paper uses the linear utility function, because it is reasonably easy to handle, both theoretically and computationally; also, DMs understood it easily.
The proposed method provides a new method to apply to task assignment. It can provide an acceptable task allocation scheme before a mission, when a great deal of information is uncertain.
|:||Expected attack rewards|
|:||Flying costs of UAVs|
|:||Expected losses of UAVs|
|:||Two-dimensional coordinate of|
|:||Two-dimensional coordinate of|
|:||Predetected two-dimensional coordinate of|
|:||Flying cost per unit distance of|
|:||Distance between UAV and target|
|:||Probability of killing|
|:||Probability of loss|
|:||Best strike distance of ’s onboard weapon|
|:||Damage radius of ’s onboard weapon|
|:||Circular error probability of ’s onboard weapon|
|:||Maximum range of ’s defence missile|
|:||Minimum range of ’s defence missile|
|:||Decision variables. if is assigned to and is otherwise.|
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was partly supported by the National Natural Science Foundation of China (nos. 71401048 and 71131002) and the Humanities and Social Science Projects of Ministry of Education of China (no. 13YJC630051).
M. Alighanbari and J. P. How, “Cooperative task assignment of unmanned aerial vehicles in adversarial environments,” in Proceedings of the American Control Conference (ACC '05), pp. 4661–4666, June 2005.View at: Google Scholar
L. F. Bertuccelli, H. L. Choi, P. Cho, and J. P. How, “Real-time multi-UAV task assignment in dynamic and uncertain environments,” in Proceedings of the AIAA Guidance, Navigation, and Control Conference, August 2009.View at: Google Scholar
M. Alighanbari, L. F. Bertuccelli, and J. P. How, “Filter-embedded UAV task assignment algorithms for dynamic environments,” in AIAA Guidance, Navigation, and Control Conference and Exhibit, pp. 1–15, 2004.View at: Google Scholar
A. Washburn and M. Kress, Combat Modeling, Springer, New York, NY, USA, 2009.
A. Menou, A. Benallou, R. Lahdelma, and P. Salminen, “Decision support for centralizing cargo at a Moroccan airport hub using stochastic multicriteria acceptability analysis,” European Journal of Operational Research, vol. 204, no. 3, pp. 621–629, 2010.View at: Publisher Site | Google Scholar | Zentralblatt MATH