Abstract

A colored traveling salesman problem (CTSP) is a path optimization problem in which colors are used to characterize diverse matching relationship between cities and salesmen. Namely, each salesman has a single color while every city has one to multiple salesmen’s colors, thus allowing salesmen to visit exactly once the cities of their colors. It is noteworthy that cities’ accessibilities to salesmen may change over time, which usually takes place in the multiwarehouse distribution of online retailers. This work presents a new CTSP with dynamically varying city colors for describing and modeling some scheduling problems with variable city accessibilities. The problem is more complicated than the previously proposed CTSP with varying edge weights. In particular, the solution feasibility changes as the cities change their colors, that is, a feasible original solution path may become no longer feasible after city colors change. A variable neighborhood search (VNS) algorithm is presented to solve the new problem. Specifically, a dynamic environment simulator with an adjustable frequency and amplitude is designed to mimic such color changes. Then, direct-route encoding, greedy initialization, and appropriate population immigrant are proposed to form an enhanced VNS, and then its performance is evaluated. The results of extensive experiments show that the proposed VNS can quickly track the environmental changes and effectively resolve the problem.

1. Introduction

A colored traveling salesman problem (CTSP) generalizes the well-known multiple traveling salesman problem [1]. Each salesman in it has a single color, and each city has one to multiple salesmen’s colors. A city allows only one salesman of the same color to visit exactly once. Colors are used to characterize the cities’ accessibility for salesmen and can be applied to some real-world scheduling problems in which the tasks to be performed own different accessibilities for movable processing devices [2]. Li and Meng apply the CTSP to schedule multibridge machining systems for avoiding collision [3, 4]. In addition, He and Hao [5] propose a two-phase local search for solving the CTSP. Recently, three CTSP variants have been proposed, that is, large-scale general CTSP [6], biobjective CTSP [7], and precedence-constrained CTSP [8]. They can be applied to many engineering systems, for example, multibridge machining systems [4], robot systems [9], and multitrip pickup and delivery systems [10].

However, these mentioned CTSPs are static in terms of connection weights and task accessibility. In practice, many optimization problems, such as job scheduling, assembly, transportation scheduling, and production planning, involve dynamically changing environments. Particularly, the complex networks where the optimization problems arise, for example, the communication networks [1114] and intelligent transportation networks [1518], have the changing connection weights among nodes and even the network topologies themselves over time.

The dynamics of a dynamic TSP (DTSP) [19] reflects the changes in the topology [20] and connection weights [21] of a network to be modeled. DTSP is widely used in practice. Tinós [22] analyzes the effects of the edge weight changes on the fitness landscapes of TSP. Recently, Mavrovouniotis et al. [23] investigate a memetic ant colony optimization algorithm with local search to address symmetric and asymmetric DTSPs, and the experimental results show the efficiency of their proposed algorithm. Chen et al. [16] investigate the value of choosing the next stop to visit in a multistop trip based on current traffic conditions to minimize the expected total travel time of the tour, and they model this problem as a Markov decision process. In dynamic scenarios, datasets (city coordinate information) are generally incomplete and variable. Baykasoğlu and Durmuşoğlu [24] address a DTSP in which cities may be added to/deleted from the city domain with a multiagent-based approach.

In logistics and distribution, traffic network topology and customer demands are changing over time. If some practical constraints in logistics distribution are introduced into DTSP, it becomes a dynamic vehicle routing problem (DVRP) [25]. DVRP requires solving not only a dynamic path planning problem with varying edge weights but also the problem with some uncertain constraints in real delivery. It is more complex than the DTSP.

DVRP can be divided into two categories according to the customer's location information. One is those with known customer locations, but a traffic network topology varies and customer demands are random. Kim et al. [26] propose a DVRP model with nonstationary stochastic travel time under traffic congestion, and a Markov decision process model is adopted to solve this problem. A vehicle routing problem with stochastic demands (VRPSDs) is the one in which customer locations are known, but the demands of customers are random. For example, a flexible solution method is adopted to transform VRPSD into a small set of capacitated VRP, where Monte Carlo simulation with statistical distributions is used to estimate customer demands [27]. Mavrovouniotis et al. [23] present a DVRP with stochastic demands where customers arrive dynamically and randomly, and thereby their requests are not completely known. To solve it, an ant algorithm with an immigrant scheme is developed. Customer service time may be uncertain in a DVRP. Vonolfen and Affenzeller [28] resolve a dynamic pickup and delivery problem with time windows by using a novel waiting for heuristic strategy based on historical request information. Juan et al. [27] propose a method to estimate truck arrival time at each customer location for truck route planning in nonstationary stochastic networks.

Another DVRP category is the real-time or online VRP, that is, new customer orders are randomly generated, and both customer locations and demands are unknown. In this situation, it is necessary to reschedule vehicles based on previous schedules, that is, redistribute these vehicles for all not-served customers. Many scholars have studied the rule of accepting or rejecting new service requirements in a DVRP [2931]. Bopardikar et al. [32] investigate a DVRP with the Poisson distribution orders and design routing policies for a service vehicle to maximize the number of demands at the steady state. Pavone et al. [33] propose a distributed and adaptive segmentation algorithm to solve a DVRP and validate its effectiveness.

The above studies focus on path optimization over traffic networks with varying edge weights and all the cities with the same accessibility. So far, there is no research on the optimization problem with dynamic city accessibilities, which can well describe a supply and distribution problem faced by online retailers. Therefore, this work focuses on delivery route optimization for online retail with multiwarehouse and dynamic task accessibility.

For example, aiming at delivering goods faster and better, online retailers tend to build their own logistics system consisting of widely located warehouses in different countries or regions containing goods of different types and stocks. Amazon owns a total of 90 warehouses in the world, JD Company has built 143 warehouses in 43 cities of China, and Suning Logistics Group has 12 large-scale warehouses in China.

Once random customer orders are generated, an online retailer has to provide the customers with their ordered goods. The stocks of the goods differ at distinct warehouses and are constantly changing with sales and supplies. Therefore, decision-making is needed to decide which warehouse should provide the goods to a specific customer, and optimize the delivery routes of the different goods to different customers to meet customer requirements and reduce the supply cost. So far, there is no satisfying decision-making mechanism for this kind of online retail.

Suppose that each warehouse has one unique color. It can be considered as a salesman with the color to deliver goods for customers by its own transport system. Those online ordering customers, located in different areas, can be provided with the ordered goods stocked at one of the different warehouses. In other words, such a customer carries the warehouses’ colors, and thereby the customers can be regarded as the cities with one to multiple warehouses’ colors. Thus, the warehouses’ supply problem can be described as a CTSP. With the customers’ online purchases, each warehouse’s stock changes over time. When a commodity ordered by a customer is out of stock in a warehouse, the customer loses his/her color. This means that a customer whose warehouses’ colors will change in the sales process.

Therefore, we propose a new CTSP with varying city colors (CTSP-VCC). It can be applied to supply decision and delivery route optimization for online retail with multiwarehouse and varying task accessibility.

Considering the outstanding performance of Variable Neighborhood Search (VNS) [2] in solving static CTSP, we adopt it to solve CTSP-VCC. To overcome its instability under a dynamic circumstance, greedy initialization and best population immigrant are incorporated into it to maintain its fast convergence and solution diversity.

This work intends to make the following contributions:(1)It formulates a CTSP-VCC in which city colors are changing over time. CTSP-VCC can be applied to supply decision and delivery route optimization for a online retail with multiwarehouse.(2)It constructs a rigorous mathematical optimization problem for CTSP-VCC and designs a dynamic environment simulator to mimic the change of city colors.(3)It develops an improved VNS to solve CTSP-VCC in which a greedy operation and a novel population immigrant scheme are adopted to achieve better convergence and solution quality.

The remainder of this paper is organized as follows: Section 2 introduces CTSP-VCC. Section 3 presents a greedy-initialization VNS with a best population immigrant scheme. Section 4 shows simulation results. Section 5 concludes the work.

2. Problem Formulation

CTSP uses the colors to characterize city accessibility to salesmen [1, 2]. It owns salesmen and cities, where , . It can be formulated over a digraph with vertex set representing cities; each edge and represents a visit cost between cities and , associated with weight . Salesman is allocated with color . A city color matrix (CCM) M is defined to indicate the accessibility of cities to salesmen.where a row vector represents the color set allocated to city i, , . Clearly,, namely, city allows at least one salesman and at most salesmen to visit. The j-th column vector in M expresses which cities in the city set can be visited by salesman . The accessible city set with respect to salesman j is denoted by , . In addition, we define the set of single-colored cities to collect the cities that carry the same color , .

Here, we define a dynamic CTSP whose city colors are changing over time. CCM in CTSP-VCC is not a constant matrix, that is,, , , becomes a function that varies over time. Let , if city i has color at time t; otherwise .

Next, a 0-1 integer programming model of CTSP-VCC is given as follows: the binary access variables ,, , if salesman passes through edge (i, j); otherwise, .

Subject to:

Each salesman k is required to start from and return to depot . The equation is as follows:

Salesman k cannot visit a city whose color set does not include:

Each city can be visited exactly once by one and only properly colored salesman:

A salesman may visit a multicolor city, and a pair of entry and exit is required if it is the case:

Any solution consisting of several disconnected subtours for a salesman must be forbidden:where is the number of nodes visited in the tour of salesman k from to the node i.

Lemma 1. CTSP is a special case of CTSP-VCC.

Proof. In CCM, denotes the variable color of city in CTSP-VCC. If is an invariant constant (i.e., ), it means that the model turns to be a stationary one, i.e., CTSP.

Lemma 2. The solution space size of CTSP-VCC is , where denotes the number of cities visited by salesman k, and .

Proof. Let denote the route of salesman k. represents the number of cities in route k, and it is a variable, . Therefore, the solution space of CTSP-VCC with salesman k is . Finally, the solution space of CTSP-VCC with all salesmen is , where .

Theorem 1. CTSP-VCC is NP-hard.

Proof. CTSP is NP-hard [1], and it has been proved to be a special case of CTSP-VCC by Lemma 1. The solution space size of CTSP-VCC is given by Lemma 2, and its optimal solution varies over time, that is, with the variable city color , the optimal solution varies in its solution space. Therefore, CTSP-VCC is also NP-hard.
For this type of dynamic optimization problem, it is challenging to develop algorithms to track the optimal solution changes. In particular, the solution feasibility changes represent changes in city colors, (i.e., a feasible original solution path may become no longer feasible because of changes in city colors).

3. Enhanced VNS for CTSP-VCC

VNS has been proved to be an efficient method to address CTSP [2], so we adopt it to resolve CTSP-VCC. Considering the optimal solution of CTSP-VCC is no longer a fixed solution and varies over time, we introduce a best-population immigrant scheme and greedy-initialization method into VNS to enhance global searching ability. Furthermore, given that the varying city colors can change the solution feasibility, we introduce a verification operation into VNS to judge the solution feasibility. Some solutions must be deleted if it is infeasible after changes in city colors.

3.1. Solution Encoding

The direct-route encoding is adopted to encode each salesman’s route directly for CTSP-VCC. A coding example of CTSP-VCC with n = 10 and m = 3 (see Figure 1), namely, Cities 2-8-7-1 and 10-4-3, 9-5-6 are visited by salesmen 1–3, respectively. Let Rk denote the route of salesman k, excluding his depot. The solution is denoted by R = (R1, R2, …, Rm). The permutation of cities in the search space size is for salesman k. For all the salesmen in CTSP-VCC, their total solution space’s size is , where .

3.2. Basic VNS

The core thought of VNS is to search a better solution in the neighborhood of a high-quality solution. First, to ensure the population diversity of VNS, a random initialization method is used in VNS to generate initial individuals, that is, all salesmen select randomly the cities carrying the same color to establish their routes.

Then, shaking and local search operations are performed in each generation of VNS, and the current best solution is updated if a better one is obtained. On one hand, Interchange and Relocation are adopted to perturb the current incumbent solution to generate its neighborhood solution set in the shaking operation (see Figures 24). The detailed operations of them are given in [2]. On the other hand, a local search explores the neighborhood of the solution selected by shaking to obtain a better one. Particularly, two operations, that is, city-removal and reinsertion operations, carry the deep neighborhood search. Once a better solution is obtained in the local search, it is saved for the next iteration.

In addition, if the environment changes, VNS needs to analyze the feasibility of the original solution. If the solution is feasible and better than the current solutions, it is used to update the best solution; otherwise, it is deleted. The flowchart of basic VNS is given in Figure S1 in the Supplementary Material.

3.3. Improved VNS

A greedy-initialization scheme and a best-population immigrant scheme are introduced to improve the performance of basic VNS. Greedy-initialization means that a two-stage greedy is adopted to generate a better initial solution, that is, the greedy search with the minimum insertion for single color cities first and the multicolor cities next. An immigrant strategy with the best population is used to prevent the premature convergence of VNS. First, the current best individual is selected to perform immigrants after VNS’s local search. After the immigrant operation, several new individuals are generated, and they are used to replace those original individuals which are of poor quality. The detailed operations of the best-population immigrant scheme are shown in Algorithm 1.

(1)Begin
(2)Input: , k = 0;
(3)  Rank the ps solutions from small to large, where is the smallest one and is the largest one. .
(4)  While () do
(5)   l = random (1, m);
(6)   Do 2-opt for Rl in ,.
(7)   .
(8)   k++;
(9)  End While
(10)Output:
(11)End

On one hand, the greedy operation can be used to generate an initial solution of high quality during the initialization of VNS, and a good initial solution can benefit the quick search for a satisfactory solution. On the other hand, the best-population immigrant scheme can prevent premature convergence in a single search direction, which can help VNS to jump out of a local optimum and search more space. The flowchart of greedy ability VNS with a best-population immigrant scheme is illustrated in Figure 5.

3.4. Time Complexity of Improved VNS

We name the improved VNSs as VNS, VNSB, GVNS, and GVNSB. They represent in turn the random-initialized VNS, VNS with the best population immigrant, greedy-initialization VNS, and greedy-initialization VNS with a best population immigrant scheme.

Let and p denote the generations and population size, respectively, and the time complexity of VNSs are investigated as follows: the greedy-initialization takes time in constructing the initial routs. In VNS, the shaking operation needs time. The least-cost insertion is adopted in the local search of VNS, and it requires time. In addition, in the stage of Best-Population Immigrant, the rank operation and 2-opt operation take and , respectively.

Therefore, we can obtain that GVNSB takes . Since , the time complexity of GVNSB is .

(1)Begin
(2)Input: gen;
(3)If gen = = 1
(4)
(5)Else
(6)  If
(7)   a = random(0,1)
(8)   If
(9)    
(10)   Else
(11)   
(12)   End If
(13)  End If
(14)End If
(15)Output:.
(16)End

4. Experimental Study

4.1. Dynamic Environmental Simulations

The dynamics of CTSP-VCC are reflected by its city colors’ change over time. First, let M change over time where. Then, to describe the change of city colors, each is changed every generations during the run of algorithms with the probability , where , , , , and is the initial value. The environmental dynamics can be easily tuned by two parameters, and . The former controls the change speed, while the latter manipulates the severity each time the environment changes. The dynamic environment of CTSP-VCC is generated by Algorithm 2.

4.2. Experiment Design

We have implemented all the algorithms in C++ with Microsoft Visual Studio 2012 and executed them on Dell Computer Optiplex 390 running Windows 7 with CPU Intel Core i 3 at 3.40 GHz and RAM 4 GB. The offline performance is adopted to evaluate the overall performance of an algorithm:

Let N = 50 denote the total number of runs, and represents the total number of generations for a run. FBOGij is the best-of-generation fitness of generation i at run j, and is the average fitness of 50 runs.

To test the performances of the algorithms, our experiments are designed as follows: first, test cases, Eil101, A280, and Rat575 are derived from the datasets in TSPLIB [34] while their CCMs are generated randomly according to the number of cities and salesmen.

Then, the two parameters for dynamic environment control is set to be 30 or 50, and is set at 4 different levels, i.e., 0.1, 0.2, 0.5 and 1.0. In addition, each VNS is executed independently 50 times for each test case. One-tailed t-test with 98 degrees of freedom at a 0.05 level of significance is adopted to compare the statistical results of VNSs in dynamic environments.

4.3. Comparison among the Proposed Algorithms

To compare the performances among the proposed algorithms, the statistical analysis of the experimental results is given as follows. Figures 6 and 7 show the offline performances, and Figures 8 and 9 illustrates the dynamic performances for each test. In the dynamic environments with different change speeds and intensities, the statistical results of compared algorithms by one-tailed t-test with 98 degrees of freedom at a 0.05 level of significance are given in Tables 1 and 2, where “s+“, “s-“, and “∼” denote that one algorithm is significantly better than, significantly worse than, and similar to another algorithm, respectively. The standard deviations of 50 results of the algorithms for each test are given in Tables 3 and 4.

4.3.1. Effectiveness of Greedy-Initialization

The offline performances illustrated in Figures 6 and 7 show that GVNS outperforms VNS.

For example, the result from GVNS in Eil101–6, at and , is 2515.8 and it is 15.1% less than that from VNS. In A280-15, the result from GVNS is 5836.6 and it is only 22.4% of that from VNS.

In Figure 9, the dynamic performances show that, the greedy-initialization can effectively improve the initial solution quality of VNS. For example, the results obtained by GVNS in the environment at and are 2357.6, 8029.4, and 22478.7, that is, 82%, 34%, and 28% of those by VNS in Eil101–5, A280-8, and Rat575-10, respectively.

Similarly, the t-test results illustrated in Tables 1 and 2 show that GVNSB outperforms VNS, VNSB, and GVNS significantly.

Therefore, we can draw a conclusion that the greedy-initialization is very effective for VNS to solve CTSP-VCC. The reason is that a better initial solution is critically important for population evolution, and it can guide individuals to perform their search in a more promising solution space of its neighborhood. Indeed, VNS can find a better solution quickly and effectively at the initial stage by means of greedy-initialization, and it also can obtain other diverse solutions by random initialization. The greedy initialization can guarantee VNS not only an initial solution quality but also the diversity of the population. It is why GVNS and GVNSB perform better than VNS and VNSB.

4.3.2. Effectiveness of a Best Population Immigrant Scheme

The results of algorithms in a dynamic environment with are illustrated in Figure 9. Specially, in Eil101-4 at , the results obtained by VNS and VNSB are 2670.2 and 1398.9, respectively. VNSB’s result is improved about 47.6% after introducing a best population immigrant scheme. Furthermore, the result of GVNSB is 1293.8, just 62.8% of that with GVNS. In addition, the result in A280-8 shows that VNSB obtains 9783.9 and is 39.8% of that from VNS, and GVNSB obtains 5328.5 and it is 58.7% of that from GVNS. Besides, the results in three cases of Rat 575 show that we obtain better results after introducing the best population immigrant scheme into VNS.

All the curves in Figure 6 show that the fitness decreases as increases. The reason is that the increase of city colors with enlarges the solution space of a problem. Thus, the algorithms may obtain better solutions in the new solution spaces. Furthermore, Figure 7 shows the results at , like Figure 6, where VNS and GVNS with a best population immigrant scheme can obtain better results than those of VNS and GVNS.

Figures 8 and 9 illustrate the dynamic performances in some test cases. The algorithms have different convergences. Obviously, the algorithms converge well when the best population immigrant scheme is applied. For example, the fitness value of the first generation in VNS is 34764 and 112337 in A280-15 and Rat575-15, at dynamic environment and , respectively. After one generation, they are 33745.6 and 108974, respectively. Although the fitness of value in the first generation in VNSB is similar to that in VNS, after one-generation evolution, they are 56.4% and 60.2% of those in VNS, respectively.

Table 3 shows the standard deviation of 50 runs for each test case. The obtained results illustrate that the standard deviations of each algorithm are markedly different at the beginning. But they decrease significantly by introducing the best population immigrant scheme into the algorithms. For example, for Eil101–5, A280-5, and Rat575–15 in the environment with and , the standard deviations of VNS are 23.9, 119, and 279.3, while those of VNSB are 20.6, 73.8, and 152.8, falling about 13.8%%, 37.9%, and 45.3%, respectively. Similarly, the standard deviations in GVNSB are all less than those of GVNS. The reason is that VNS can maintain the population evolution with high-quality genes and better stability by means of the best population immigrant scheme.

Tables 1 and 2 illustrate the t-test results of the algorithms in dynamic environments with increasing from 0.1 to 1.0, while and 30. Concretely, the t-test results of Eil101, A280, and Rat575 show that VNSB is significantly better than VNS, and GVNSB is significantly better than GVNS. The results are sufficient for us to validate that the best population immigrant scheme is very effective for VNS to solve CTSP-VCC.

4.3.3. Performance Comparison between Greedy-Initialization and Best-Population Immigrant

In Tables 1 and 2, the performance of GVNS is significantly worse than that of VNSB in three cases of Eil101 with , 0.2, and 0.5. This result is also illustrated more clearly in Figure 6. In particular, in dynamic environment at and , the results in GVNS in Eil101–4, Eil101–5, and Eil101-6 are 2342, 2015, and 2132.1, respectively. Those results obtained by VNSB are 1494.5, 1561.8, and 1734.6, respectively, all less than their corresponding results by GVNS.

In addition, we find that the pros and cons of GVNS and VNSB swap with the increase of the number of cities. For example, in Figure 7, the results obtained by GVNS are better than those by VNSB in A280–8 and A280-15, but in A280-5 with and 0.2, the result from GVNS is worse than that from VNSB. While in the dynamic environment at and 1.0, the results have changed, that is, the result from GVNS is better than that from VNSB. Similarly, the results obtained by GVNS are better than those by VNSB in cases of Rat575–15 and Rat575–20.

Figures 8 and 9 show that GVNSB always achieves the best results among the algorithms. Furthermore, Tables 1 and 2 suggest that the introduction of the best population immigrant scheme into GVNS can guide the algorithm to track the change of the optimal solution rapidly in a dynamic environment. Hence, GVNSB outperforms significantly other three algorithms in terms of the offline performance, dynamic performance, and standard deviation.

In summary, both the best population immigrant scheme and greedy-initialization scheme can help VNS converge rapidly and obtain much better solutions, and they are beneficial for VNS to track the dynamic environment of CTSP-VCC.

5. Conclusions

This work proposes a dynamic CTSP in which city colors change with time. It can be applied to a supply decision problem of online retailers with multiwarehouses and varying supply availability. Then, a variable neighborhood search algorithm is proposed to address this new CTSP. It uses direct-route encoding and a two-stage greedy-initialization algorithm to obtain an optimal/near-optimal solution. In addition, a best population immigrant scheme is adopted to track the change of the optimal solution rapidly in a dynamic CTSP. Furthermore, to mimic the dynamic environment of CTSP-VCC, we construct a dynamic environment simulator that can be easily tuned via two parameters, i.e., change speed and severity.

To test the performances of the proposed algorithm, i.e., greedy-initialization VNS with the best population immigrant, extensive experiments are conducted in terms of offline performance, dynamic performance, and standard deviation.

The results show that VNS can obtain a desired solution in its initialization by means of a greedy-initialization scheme. Solution quality and stability can be significantly improved with the help of the best population immigrant scheme. Specially, because of the two schemes, the results of the baseline VNS can be improved about 30%–50%. In summary, the proposed best population immigrant scheme and greedy-initialization scheme are both effective for VNS to track the change of optimal solutions in the new CTSP and help the algorithm obtain better solutions. Our ongoing work is to apply CTSP-VCC and VNSs to some real-life problems [35, 36].

Data Availability

The data used to support the findings of this study have been deposited in the Github (Link:https://github.com/opt-mlearing/vehicle-routing-problems).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61773115, the Natural Science Foundation of Anhui Province under Grant 2008085QF300, the Youth Foundation of Anhui University of Technology under Grant QZ201911, the Shenzhen Fundamental Research Program under Grant JCYJ20190813152401690, and the Fundo para o Desenvolvimento das Ciencias e da Tecnologia under Grant 0047/2021/A1.

Supplementary Materials

Figure S1 : the flowchart of VNS. (Supplementary Materials)