Abstract

A multiobjective dynamic vehicle routing problem (M-DVRP) has been identified and a time seed based solution using particle swarm optimization (TS-PSO) for M-DVRP has been proposed. M-DVRP considers five objectives, namely, geographical ranking of the request, customer ranking, service time, expected reachability time, and satisfaction level of the customers. The multiobjective function of M-DVRP has four components, namely, number of vehicles, expected reachability time, and profit and satisfaction level. Three constraints of the objective function are vehicle, capacity, and reachability. In TS-PSO, first of all, the problem is partitioned into smaller size DVRPs. Secondly, the time horizon of each smaller size DVRP is divided into time seeds and the problem is solved in each time seed using particle swarm optimization. The proposed solution has been simulated in ns-2 considering real road network of New Delhi, India, and results are compared with those obtained from genetic algorithm (GA) simulations. The comparison confirms that TS-PSO optimizes the multiobjective function of the identified problem better than what is offered by GA solution.

1. Introduction

Recently, intelligent transport system (ITS) has diversified the application area of dynamic vehicle routing problem (DVRP) enormously. E-commerce, print media, medical, public transportation, and oil sector are only few examples [1]. DVRP is an extension of traditional vehicle routing problem (VRP) in terms of complexity. The traditional VRP can be symbolically stated on a connected network , where indicates the set of nodes; and represents the set of connections, and denotes communication cost matrix defined over . Traditionally, the node is the central depot from where all the vehicles start and end their services. The remaining nodes of denote the customers spread over geographically distinct locations. The VRP is nothing but finding a set of routes for a given set of vehicles such that each vehicle visits the customers exactly once and overall travel cost of the vehicles should be minimum [2]. An example of traditional VRP has been illustrated in Figure 1. The central depot has four delivery vehicles to serve the demands of four customers. According to the availability of routes, the journey for delivery vehicles has been planned by the central depot. Due to the rapid technological advancements in real time wireless communication, the shape of VRP has been transformed into DVRP (cf. Figure 2). In the past, a number of variants of traditional VRP as DVRP have been suggested by incorporating different set of constraints [3]. Some variants of VRP have been illustrated in Table 1.

An example of DVRP has been illustrated in Figure 2. Due to real time communication among central depot, new customers, and delivery vehicles, the VRP depicted in Figure 1 has been transformed into DVRP shown in Figure 2. The planned route of all the four delivery vehicles depicted in the VRP (cf. Figure 1) has been changed dynamically due to real time communication of dynamic request. The optimal solution of the above mentioned variants of VRP as DVRPs with large number of customers and their demand parameters could not be obtained within reasonable time due to NP-hard nature of the problems [4]. In the last ten years, various nature inspired metaheuristic techniques have been applied to solve the customized instances of various DVRPs. Genetic algorithm (GA), ant colony optimization (ACO), and particle swarm optimization (PCO) have been commonly used for solving the above listed DVRPs [57]. Nowadays, these techniques have also been gaining popularity in vehicular ad hoc networks (VANETs) [8] and high performance computing [9].

In this paper, a multiobjective dynamic vehicle routing problem (M-DVRP) has been identified. A time seed based solution using particle swarm optimization (TS-PSO) for M-DVRP has been proposed. The five objectives considered in the proposed problem are geographical ranking of requests, customer ranking, service time, expected reachability time, and satisfaction level of customers. Each of these objectives has been materialized in terms of both conceptual and mathematical formulation. A multiobjective function has been generated having four components, namely, vehicle count/number of vehicles, expected reachability time, profit, and satisfaction level. The mathematical formulations have been derived for each of the component objectives using the metric of the problem. Three constraints of the multiobjective function, namely vehicle, capacity, and reachability have been defined. The proposed solution TS-PSO broadly operates into two steps. In the first step, the identified problem is partitioned into smaller size DVRPs. In the second step, time horizon of each smaller size DVRP has been divided into time seeds and the problem has been solved in each time seed using particle swarm optimization. A complete algorithm has also been developed for the proposed solution technique. The network simulator ns-2.34 has been used for the simulation along with two other supporting software programs MOVE and ArcGIS. The fifteen data sets OPK-01 to OPK-15 used in the simulation have been generated considering real vehicular environment and highly dynamic customer requirements. The simulation results have been compared with the genetic algorithm (GA) solution technique.

The rest of the paper is organized as follows. Section 2 presents some early and recent developments in dynamic vehicle routing problem. In Section 3, details of the identified problem M-DVRP are described. In Section 4, the TS-PSO is proposed and described. The analytical and simulation results are presented in Section 5. Conclusion is derived in Section 6.

2. Early and Recent Developments in VRP and DVRP

The VRP was first proposed by Dantzig and Ramser in 1959. The authors optimized the routing of a fleet of gasoline delivery trucks between a bulk terminal and a large number of service stations supplied by the terminal. They have used linear programing formulation for obtaining near optimal solution [10]. After the induction, VRP has been one of the challenging areas of research that has witnessed consistent attention of the researchers from both industries and academia. The research contribution can be categorized into two dimensions: probabilistic optimization and static optimization. In probabilistic optimization, the components of the problem such as demand, number of customers, and service time have been considered as future events and probabilistic models have been used to predict the future behavior of these components [11, 12]. In static optimizations, available information about the components has been considered without including future behavior of the components. Some of the most recent works in DVRP have been described below. Multiobjective dynamic vehicle routing problem with fuzzy travel times and customers’ satisfaction in supply chain management has been suggested in [13]. The authors have investigated fuzzy time window and fuzzy travel time in depth for the VRP. The travel distance, number of vehicles, and waiting time of vehicles have been minimized and the satisfaction rate of customers has also been minimized. A set based discrete particle swarm optimization approach for optimizing vehicle routing problem (S-PSO-VRPTW) with time window has been suggested in [14]. The solution approach selects an optimal subset from the universal set and subsequently solves the selected subset problem. The authors have derived new mathematical formulations for velocity and position update to realize discrete PSO. A fitness function for candidate solution evaluation has also been formulated. The line haul feeder vehicle routing problem with virtual depots has been presented in [15]. Feeder vehicle and virtual depot concepts have been introduced by the authors. Travel distance and waiting time for vehicles have been minimized using heuristic cost sharing methods. A patrol routing algorithm has been constructed in [16] for police, ambulance, and taxi services. The algorithm has been explored in terms of expression, execution, evaluation, and engagement. A domain specific language (DSL) turn has been used to express the algorithm. PatrolSim a custom simulator has been used for the execution of the algorithm. Response time, network coverage, and hotspot coverage metrics have been used for the evaluation of the algorithm. For a web based geographic information system (GIS) portal, CAPS Map has been used for end user engagement of the algorithm. Multidepot capacitated arc routing problem (MCARP) has been introduced in [17]. An evolutionary approach has been constructed by integrating some classical heuristics into a canonical evolutionary framework. The near optimum MCARP solution has been used to learn two distinct kinds of heuristic information. The evolutionary process has been guided by this heuristic information. An arc guided evolutionary algorithm for solving vehicle routing problem with time window has been developed in [18]. In the population, individuals have been represented using arcs so that evolution strategy can be adapted to the VRP-TW. The ruin and recreate principle have been used for mutation process. A trajectory local search algorithm has been developed to minimize distance. A route elimination procedure has been also suggested. Moreover, VRP has always been in the full attention of researchers.

3. Multiple-Objective Dynamic Vehicle Routing Problem (M-DVRP)

In this section, a different aspect of DVRP is identified by incorporating five objectives, namely, geographical ranking of requests, customer ranking, service time, expected reachability time, and satisfaction level of customers. The M-DVRP can be symbolically stated on a connected network , where indicates the set of nodes; and represents the set of connections, denotes communication cost matrix defined over and matrix vector is group of five objectives attached with each request. The DVRP in this consideration is nothing but finding a set of routes for a given set of vehicles such that it optimizes both and . In some of the earlier DVRP, strict time window has been considered for service time of the customers. Consequently, the customers provide their satisfaction values in binary digit, that is, 0 or 1 for each request. In other words, the customer either is fully satisfied or rejects the requested order in its totality [19]. But the binary digit satisfaction value consideration does not comply with real scenario. Inspired by the importance and continuous research in fuzzy set theory [20], the consideration of fuzzy time window is gaining momentum in VRP for complying with real customer scenario [21]. For developing a mathematical model for M-DVRP, a flexible time window is considered in which customers are ready to accept the delivery in relaxed time window. The other two important considerations of the problem are request vector and order vector. As soon as a customer enters in the system, he/she sends request information to the central depot via VANETs communication [2229]. Each customer request is a vector of length six as illustrated in Figure 3. Once a request vector reaches the central depot system, an order vector is generated corresponding to the request vector. The order vector of length six considered in the problem is shown in Figure 4. The other considerations of M-DVRP are briefly described in following subsections.

3.1. Geographical Ranking

In M-DVRP, the geographical ranking of a request not only is dependent on distance of the customer from the central depot but also is an implicit complex function of four variables, namely, average density of request (ADR), distance (DIST), safety and reliability (SR), and road networks (RN). Thus, a vector of length four is associated with each request by central depot reflecting geographical ranking. The components of the geographical ranking vector and corresponding weighting parameters have been shown in Figure 5. Considering as weighting parameter and length of the vector , the constraint always holds. The geographical ranking of a request can be calculated as where denotes the ranks and thus a request has been geographically ranked between 0 and 1.

3.2. Customer Ranking

In M-DVRP, the customers are categorized into four categories, namely, very important customer (VIC), important customer (IC), regular customer (RC), and casual customer (CC). A minimum guaranteed satisfactory level in the range is defined for each of these categories of customers (cf. Figure 6). Based on the minimum guaranteed satisfaction level, service time window of the customers is also defined. The VIC has strict service time window due to highest satisfactory level that is 1. The minimum satisfactory level for IC is defined in the range . Although the IC also has smaller service time window but the system provides services in the maximum possible relaxable time window. Considering long run importance of RC, the minimum satisfactory level is defined in the range for RC. The best possible service is provided in the flexible service time window. The lowest satisfactory level range is defined for the CC considering their random entry and incredible request vector. Based on their doubtable credibility, the delivery of requests is processed on the way during servicing the other category of customers.

3.3. Service Time

In M-DVRP, once the order of items reaches customer’s place, the time spent on delivering the items to the customers is known as service time of a request. The service time is defined by considering the quantity and type of items of the request. It is determined by the central depot on receipt of a request from the customers in real time fashion. The service time can be calculated as where denotes number of items, is the quantity of item, is the type of item, and is the service rate of item.

3.4. Expected Reachability Time

In M-DVRP, the average time required to reach a delivery vehicle from the central depot to the assigned customers is defined as expected reachability time . It depends on current geographical position of vehicle , the geographical position of customer , average speed of vehicle , and weightage of geographical ranking GRwt. It can be calculated as

3.5. Satisfaction Level of Customers

The delivery of service up to the customer’s expectation is the notion of satisfaction level for a particular request. It is defined as a function with domain and range . It is expressed as After defining all the considered objective of the identified problem, the formulation of multiobjective function and corresponding constraints is briefly described below. There are four components in the multiobjective function, namely, number of vehicles or vehicle count , expected reachability time, profit , and satisfaction level. The three constraints of the multiobjective function are vehicle, capacity, and reachability. The vehicle constraint states that only one vehicle can be assigned to a customer for a request. The capacity constraint states that each vehicle has prespecified capacity and this capacity could not be exceeded to deliver the request of customers. The reachability constraint states that the difference of ERT between two successive customers must be greater than or equal to the sum of service time of the previous customer and the travel time between the customers. For the multiobjective function, its components and constraints are expressed below where where denotes the number of vehicles and represents the number of customers. The is the characteristic function and is the weight of preference of customer. For solving the above identified problem, time seed based solution using particle swarm optimization has been proposed and described in the next section.

4. TS-PSO for M-DVRP

The traditional particle swarm optimization (PSO) [30] has been generally used in solving optimization problem in continuous search space. But, a novel method set based particle swarm optimization (S-PSO) [31] has been suggested for solving combinatorial optimization problems in discrete search space. TS-PSO is inspired from the S-PSO. In TS-PSO, the identified problem M-DVRP is partitioned into number of smaller size DVRPs considering solution feasibility. Thereafter, the time horizon of each smaller size DVRP is divided into a number of smaller time seeds. The duration of time seeds in a particular DVRP depends on the degree of dynamism. Higher degree of dynamism in a DVRP requires smaller time seeds as compared to a DVRP with lower degree of dynamism. A solution for a smaller size DVRP is generated for each of the time seeds. The solutions of all the smaller size DVRPs are combined that represents the solution of the identified M-DVRP. The partitioning of the problem and division of time seeds is more specifically presented below In TS-PSO, the search space is considered as set of all known and dynamically appearing connections , in the given time seed of a particular partition of the problem. A particle in the search space also known as candidate solution is an ordered vector of connected connections from with vehicle information. Initially we generate particles of some predefined length whose size can increase/decrease in successive time seeds to incorporate dynamic request of customers in efficient manner. The pictorial representation of initial structured of the vector, which has been found very useful in the construction of particles, is described in Figure 7. Initially, the vector has been filled up with fixed number of −1’s randomly. The vector has been kept open towards the right-end to indicate that it can grow in size in the successive time seeds. The total number of −1 in the vector represents the number of vehicles used in the solution. The ordinal numbering of customers in a solution vector or particle is based on initial order vectors calculated by central depot for each customer request vector accepted for a particular times seed in a smaller size DVRP. In Figure 8, a particle with 14 customers and 4 vehicles has been depicted. A vehicle is visiting the customers 3, 14, and 6 in order and returning to the depot represented by −1. Another vehicle is visiting 4, 8, 9, and 2 in order and returning to the depot. Similarly, the routes for other vehicle tours are shown. In successive iterations, particles are enhanced by incorporating new information from customers, vehicles, and order vectors. Due to these enhancements, the ordinal numbering of customers, number of customers handled by a particular vehicle, and number of vehicles in a particle may change.

The mathematical formulation of the proposed solution in terms of particle swarm optimization is given below. The formulas used for updating position and velocity of particles in the traditional particle swarm optimization have been expressed as where denotes inertia weight, and are the acceleration coefficients that define the rate of impact of and , respectively, and and represent two random numbers in the range . In TS-PSO, the above two mathematical formulations have been used for updating position and velocity of the particles. But each component operation of the two operations defined in (8) and (9) has been redefined in the framework of TS-PSO in the next subsections.

4.1. Position Representation of a Particle

In TS-PSO, position of a particle is a vector of ordered connections along with vehicle information. Actually, an instance of a particle represents the position of the particle. (cf. Figure 8). The position vector of a particle is represented as where is the connection between the customers and and is the vehicle used by the group of following customers.

4.2. Velocity Representation of a Particle

In TS-PSO, the velocity of a particle is a vector of connections associated with three inclusion probabilities. Each connection of the vector is associated with three inclusion probabilities , , and . is the insertion probability of a connection into solution giving importance to the expected reachability time. Similarly, and are insertion probability considering profit and satisfaction level. The velocity vector of a particle is expressed as

4.3. Velocity Updating of a Particle

As mentioned above, in TS-PSO, the velocity of a particle is updated using the traditional velocity updating equation (8). But the component operation is redefined in the framework of TS-PSO. The component operation changes the three probabilities attached to the connections of . The component operation or represents connection set reduction operation and multiplication of coefficient into position; that is, or associates the three probabilities to each connection of the position. Each of these operations has been more clearly defined below

4.4. Position Updating of a Particle

The position of a particle is updated using the traditional position updating equation (9). But the addition operation of the equation has been redefined in the framework of TS-PSO. The addition operation reconfigures all connections of the position to generate a new position . The reconfigured connection of is defined as where denotes the constraint set and is the dynamic connection set for the time seed. A complete algorithm for the proposed solution approach TS-PSO is presented in Algorithm 1.

Notations:
: Connected network graph; : Number of vehicles; : Number of static request; ST: Service time
CRV: Customer Request Vector; OV: Order vector; GR: Geographical Ranking; CRK: Customer ranking vector;
: Number of customers in th partition of network; : Number of dynamic request in th partition of network;
: Global best position of th generation; : Local best position of th particle in th generation
: Time horizon for th sub-networks; : th time seed of the th sub-network; ERT: Expected reachability time
: Threshold solution used for stopping criteria. Input- , , , . Output-
Process-
(1) Initialize a connected network .
(2) for   to // Generating CRV
(4) generate CRV (, PLDT, PUDT, STIL, STIU, ECPUT) randomly
(5) endfor
(6) for   to // Generating OV
(7)  generate GR vector (ADR, Dist., RN, SR) randomly and calculate Gr using (1)
(8)  generate CRK vector (VIC, IC, RC, CC) randomly and assign weight according to ranks
(9)  calculate ST using (2)
(10) calculate ERT using (3)
(11) endfor
(12) Partition   into sub-networks as
(13) for   to
(14)  Divide  time horizon into time seeds as
(15)  for each time seed
(16)   
(17)   for   to // Generating Customer Request Vector for Dynamic Requests
(18)    generate CRV (, PLDT, PUDT, STIL, STIU, ECPUT) randomly
(19)   endfor
(20)   for   to // Generating Customer Order Vector for Dynamic Requests
(21)    generate GR vector (ADR, Dist., RN, SR) randomly and calculate Gr using (1)
(22)    generate CRK vector (VIC, IC, RC, CC) and assign weight according to ranks
(23)    calculate ST using (2)
(24)    calculate ERT using (3)
(25)   endfor
(26)  
(27)  Generate  position and velocity for particle in th generation from COV
(28)  while  do
(29)   
(30)   for each particle , of the search space
(31)    evaluate fitness using objective function (5) as
(32)    if  (, , )
(33)       
(34)   endfor
(35)   
(36)   for   to number of particles in the swarm
(37)    if  , ,
(38)      
(39)   endfor
(40)  endwhile
(41)  store   for th time seed
(42)  endfor
(43) store  the set of for th partition
(44) endfor

5. Simulation and Analysis of Results

In this section extensive simulations have been performed to analyze the optimization accuracy of the proposed solution TS-PSO in solving the identified problem M-DVRP. The four objectives considered for optimization accuracy assessment are vehicle count, expected reachability time, profit, and satisfaction level. The simulation results have been compared with that of genetic algorithm (GA) based solution.

5.1. Simulation Environment and Methodology

Network simulator ns-2.34 has been used in the simulation of TS-PSO algorithm. The realistic mobility model and realistic urban traffic environment have been generated using mobility model generator for vehicular networks (MOVE) [32]. An open-source micro-traffic simulator known as simulation of urban mobility (SUMO) has been used to develop MOVE [33]. Most of the necessary scenario of urban traffic environment such as roads, lanes in each road, number of flows in each lane, junctions, traffic lights in a particular junction, vehicle speed, left or right turning probability of a vehicle at a particular point, and static nodes as customers has been set up through two main modules of MOVE, namely, road map editor and vehicle movement editor. The mobility trace generated by MOVE with the help of SUMO has been directly used in ns-2. The performance of TS-PSO has been tested using the fifteen data sets, namely, generated by considering realistic vehicular traffic environment and highly dynamic customer requirements. These datasets have been generated using real traffic data of California Vehicle Activity Database (CalVAD) [34] and US Department of Transportation [35] which can be downloaded from the website “Wireless Communication Research Lab” [36]. The reason behind generating the data sets is that a lot of dynamic features such as geographical ranking, customer ranking, expected reachability time, satisfaction level, and dynamic traffic hazards have been considered in the proposed solution TS-PSO that could not be tested with the existing VRP or modified-VRP data sets. To realize the twenty-three hours’ time horizon between 6 AM and 5 AM in the next morning, in the simulation, twenty- three-minute time horizon has been considered in the closed interval seconds. The other important simulation parameter is summarized in Table 2. After setting the network and traffic flow with the above discussed parameters, the simulation has been performed using the different data sets. The complete simulation process has been summarized in Figure 9. The satellite image of New Delhi, India (cf. Figure 10), has been obtained via Google Earth and it is imported in ArcGIS 10.2.2 for the coordinate assignments. The data set containing customer, vehicle, route, and connection information has been given input to MOVE that generates New Delhi Map with network information. Thereafter, configuration and trace file have been generated and ultimately vehicular traffic flow in the New Delhi Map has been produced. TS-PSO has been implemented in ns-2 using the trace file generated through MOVE.

5.2. Result Analysis

In this analysis, we have considered whether the Pareto based solution generated by the proposed algorithm TS-PSO covers the solution achieved by GA considering only one objective function while keeping others as constant. The comparison results between TS-PSO and GA have been depicted in Table 3.

The results depicted in Table 2 show that the solution provided by the proposed algorithm is found to be competitive enough as compared to the solution provided by the genetic algorithm. It is also noteworthy that our algorithm considers all the objective functions of M-DVRP model concurrently whereas single objective has been considered in genetic algorithms. Additionally in GA solution, by increasing number of vehicles two times as compared to TS-PSO, the solutions provided by GA come close to the proposed solution in terms of SL but the profit earned by the TS-PSO is far better than what is offered by GA solution. To closely analyze the performance of TS-PSO in optimizing the functions , , and , the following results have been obtained.

The results in Figure 11(a) show the comparison of optimization of function , that is, ERT between TS-PSO and GA solutions. It can be clearly observed that the proposed solution optimizes the function far better than that of the compared GA solutions considering equal vehicle count. This can be attributed to the fact that the geographical ranking of requests in the proposed solution results in better ERT. The optimization accuracy of GA in terms of ERT improves with increasing vehicle count in the solution as , , , and due to easy availability of vehicles for individual customers. Thus, TS-PSO uses lesser number of vehicles while reducing ERT as compared to GA solutions. The results of comparison of optimization accuracy for function , that is, PF between TS-PSO and GA solutions, have been depicted in Figure 11(b). It clearly reveals that the TS-PSO more effectively maximizes the PF as compared to GA solutions. This is due to the effective customer ranking in the proposed solution. It is also noteworthy that increasing the vehicle count beyond a particular optimized point deteriorates the PF earned by the solution. The optimization accuracy of , that is, SL between the proposed solution and GA, has been compared in the results shown in Figure 11(c). The results confirm that the maximization of SL by the proposed solution is significantly higher than the compared GA solutions. This is due to the consideration of in the proposed solution. Moreover, the maximization of SL increases with increasing vehicle count for both the solution approaches. But the difference in maximization of SL between the proposed solution and GA is clearly visible in the results.

6. Conclusion

In this paper, a novel variation of DVRP has been identified by incorporating multiple objectives such as geographical ranking, customer ranking, service time, expected reachability time, and satisfaction level. The identified DVRP is called multiobjective dynamic vehicle routing problem (M-DVRP). A time seed based solution using particle swarm optimization (TS-PSO) for the identified problem has been proposed. The proposed solution could be useful in the framework of various dynamic vehicle routing problems of real environments such as logistics, courier, and E-commerce because the M-DVRP has more realistic assumptions about the real environment. It effectively optimizes the considered parameters of the problem, for example, vehicle count, expected reachability time, profit, and satisfaction level. The optimization of expected reachability time by TS-PSO is far better than what is obtained from GA solution. It should also be noted that TS-PSO uses less vehicles. The optimization of profit by TS-PSO is almost three times better than what is obtained in case of GA approach. The satisfaction level has been effectively optimized by TS-PSO. In future research, authors will explore evolutionary multiobjective optimization (EMO) for solving M-DVRP.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Authors’ Contribution

Omprakash Kaiwartya conceived, designed, and performed the experiments. Sushil Kumar, D. K. Lobiyal, Pawan Kumar Tiwari, and Abdul Hanan Abdullah analyzed the data. Finally, Omprakash Kaiwartya wrote the paper with the help of Ahmed Nazar Hassan.

Acknowledgments

The research is supported by Ministry of Education Malaysia (MOE) and conducted in collaboration with Research Management Center (RMC) at Universiti Teknologi Malaysia (UTM) under VOT no. Q.J130000.2528.03H19. Dr. Vikash Rai is thanked for helpful discussions.