Research Article  Open Access
ShiQiang Wang, JianChun Xing, ZiYan Jiang, YunChuang Dai, "Decentralized Optimization Algorithms for Variable Speed Pumps Operation Based on Local Interaction Game", Journal of Control Science and Engineering, vol. 2018, Article ID 5468398, 12 pages, 2018. https://doi.org/10.1155/2018/5468398
Decentralized Optimization Algorithms for Variable Speed Pumps Operation Based on Local Interaction Game
Abstract
A fully distributed optimal control strategy for the parallel variable speed pumps in heating, ventilation, and airconditioning (HVAC) systems is proposed. Compared with the traditional centralized method, the efficient control and coordination are scattered to every updated smart pump without the need for a monitoring host. Similar to the structure, mechanism, and characteristics of biological communities, a smart pump can communicate with adjacent nodes and operate collaboratively to complete pumps group operation with the least total power consumption under load demand and system constraints. And a decentralized optimization method that is decentralized estimation of distribution algorithm (DEDA) under local interaction games framework has been transplanted to the proposed structure to optimize the pumps working in parallel mode. Besides, convergence property of the two novel mechanisms is analyzed theoretically. Finally, simulation studies have been conducted based on the models of a physical pumps system, and the performance of the proposed algorithm is compared with centralized algorithms in terms of both effectiveness and stability. The results provide support for the validity of the proposed algorithms and control structure.
1. Introduction
A pumping system, which generally consists of several circulation pumps, is one of the main energy consuming parts in a chilled water based HVAC system. According to the International Energy Agency, electrical motors have consumed 46% of global electricity demand by enduse [1]. Furthermore, this rate is somewhat higher in the industrial area: up to almost 65% of generated electrical power [2]. And for the HVAC system, 60–70% of the power consumption is attributed to the water pumps and fanbased energy transmission in the water distribution system. These data has reflected the fact that there exists huge potential for energy conserving. And energy efficiency of a pumping system depends not only on the design but also, even more, on its operation. Thus an effective optimization should be proposed to improve the operating efficiency.
Currently, frequency converters are widely used with induction motordriven pumps, enabling the pumps speed variation to control the head and flow rate of pumps under different working conditions in an energyefficient way, that is, variable speed pumps (VSPs). However, it makes the moderating process more complicated in that not only the combination of pumps but also the frequency of each pump needs to be determined compared to the nonvariablespeed pumps.
On the one hand, the physical models of pumps operation are difficult to be designed accurately and the pumps unit commitment is always a mixed integer programming problem, which leads to conventional optimization methods difficult to be used. In this case, the majority of existing researches focus on adopting different kinds of heuristic algorithms to solve such problems. Kecebas et al. utilized the artificial neural network to optimize the geothermal district heating systems [3]. Edson Bortoni had used the dynamic programming algorithm for optimizing a complex pumping system with a set of parallel centrifugal pumps and the efficiency of the method is verified through experiment[4]. Wang et al. introduced an enhanced evolutionary algorithm for biobjective pump scheduling in water supply [5]. Arun Shankar has conducted a comprehensive review of different methods for energy efficiency enhancement initiatives in centrifugal pumping system in recent years, and several practical evolutionary methods were also introduced [6]. However, the theory analysis of heuristic algorithms is not easy so that its convergence characteristic has not been studied well. Therefore, a more valid solving method needs to be applied to the pumps control in some critical application.
On the other hand, in most recent studies, the keynote has been put on updating the existing optimization methods or developing more effective ones[7, 8]. However, most of the current algorithms are developed based on a centralized structure, in which all the sensors and actuators are connected to one master controller and the field bus technology is usually used to handle the communication. Figure 1 has shown a typical physical structure of an HVAC system (Figure 1(a)) and a corresponding centralized control system (Figure 1(b))[9]. The sensors and actuators of each separate equipment are gathered to the master controller level by level through the linkers (RS485/Ethernet <> analog quantities) on the field bus.
(a) Structure of the physical system
(b) Structure of the centralized control system
From the engineering perspective, the centralized control structure is not consistent with the physical system, so a mapping mechanism between the two systems is needed, such as configuring and commissioning. Therefore, the development incurs high maintenance and labor costs and somehow diminishes the flexibility and universality of a construction.
After that the key procedure is to write the control model and algorithm into the monitoring center. The mathematical model for the total system is always complex and difficult to be obtained. In the algorithm writing process, a lot of work is needed such as system recognizing, software developing, and operating debugging. Moreover, traditional centralized methods require information transmission to the supervising computer during operations, which can cause severe link congestion and operational lag. Besides, since all the devices are managed by the master controller, malfunctions in one device will also bring about influence on other devices which will cause the entire control system running abnormally or even paralysis.
Recently, distributed multiagent control systems which are being focused on by many learners have provided a possible solution to this problem [10]. And Andrew Windham has analyzed the application prospects of the multiagent in HVAC control system[11]. However, the structures still require several local central nodes which are not fully distributed in our sense. And, in fact, the challenge is how to achieve the same performance as in a centralized manner where only local state information is available via each smart unit and is not considered in the above studies[12].
In this paper, a novel distributed control structure where each pump and chiller are updated to a smart unit by an embedded controller is proposed. These independent units can work independently and cooperate together to fulfill the global optimizing task.
To achieve the global optimization in a fully distributed way, a local interaction game is introduced into cognitive ratio networks in [13]. And using the loglinear algorithm[14–18], the network throughput is maximized. However, the loglinear algorithm is not applicable to the pumps optimal load distribution. Therefore, learning from the local state interaction games concept, a decentralized estimation of distribution algorithm (DEDA) is proposed in this paper. Simulation studies have been conducted based on physical models of the chilled water pumps system in a refrigeration station. The performance of DEDA is validated through comparison with centralized manner.
The rest of this paper is outlined as follows: In Section 2 the pumps system model is presented. Besides, potential game is introduced. Then a decentralized optimization model adaption is formulated in Section 3. And a decentralized algorithm is derived to solve the adapted mathematical model in this section. Section 4 focuses on performance assessment through simulations and experiments. Conclusions are drawn in Section 5.
2. System Model and Problem Formulation
2.1. Pumps Model and Its Decentralized Control System
The pump head and flow rate of a single VSP i (i=1,2,…, N) running at nonrated speed can be scaled from those of the pump running at the rated speed. According to the affinity laws of centrifugal pumps, the similarity working conditions of a VSP can be determined aswhere n_{0} is the rated pump speed and n is the pump speed under nonrated conditions. Q_{i} is the flow rate, H_{i} is the pump head of each branch, and η_{i} is the efficiency.
The speed ratio for each pump i is described in (2) and is the lower limitation of the speed ratio.
And, the fitting formulas of pumps running at nonrated speed can be expressed aswhere H_{set} is the demanded pressure difference on the main pipe. W is the total energy consumption of the pumps and W_{i}=ρgH_{i}Q_{i}/η_{i}. ρ is the density of water, is the gravitational acceleration, N is the quantity of pumps. a_{i}, b_{i}, c_{i} and j_{i}, k_{i}, l_{i} are static physical characteristics of different branches for pump i (i=1,2,…, N).
If the detected pressure difference H_{o} is not equal to H_{set}, the control system will calculate the demanded total flow rate Q_{p} as shown in (6). After that the moderating process will be conducted to ensure the pressure difference by moderating w_{i} and make the calibration of each Q_{i} satisfy Q_{p}.where S is the resistance of the current pipe net and H_{o} and Q_{o} are the current pressure difference and flow rate detected by the sensors.
In the largest pump systems, the pump groups are composed by several identical big pumps and one or two small pumps for energy saving. As shown in Figure 2, the decentralized control system consists of N smart updated pump by embedded microprocessors. A flow meter and a pressure meter will be connected to one of the smart units to detect the current state of the pipe net.
Each smart pump is connected hand to hand with its neighbor building up a chainlike form which corresponds to its actual engineering installation layout as shown in Figure 2. The model of each pump is stored in its smart unit as local variables and there is no need to model for the entire system as that in the centralized structure. And the control algorithm and instructions will be written into each smart pump and are identical. The load difference between supply and demand will be transmitted back and forth from one smart unit to another on the chain. And the operating state of each smart pump will be updated with the load difference between supply and demand transmitted from its neighbors. In such way, each smart device can be removed or substituted with little configuration making the system convenient to update and extend.
2.2. Problem Formulation
The operation object can be described as finding a combination of the running pumps and different pump can adopt a number of speed ratio strategies that can satisfy Q_{p} with the least energy consumption. Thus, it can be built up aswhere and denote the power outputs limit of pump i.
Implementation of the centralized model (8) requires a central processor with the total system information. The fully distributed approaches remove the requirement of monitoring host and enable each updated smart DG to complete optimal load distribution task only based on local and neighboring information. In this case, the centralized model (8) is split on each smart pump to be executed in a fully distributed and parallel manner across every processor core in each pump. Each part i (i=1, 2, …, N) is a suboptimization problem of (8) as decentralized optimization.
Definition 1 (decentralized optimization for pumps load distribution). The decentralized optimization problem for each node i (i=1, 2, …, N) is defined as
Indeed, (9) corresponds to part of the objective function (5). Note that each energy consumption W_{i} of the pump i (i=1, 2,…, N) is locally known by smart pump i only. The penalty term is constructed by load difference and added to the utility function as (11) for pump i (i=1, 2,…, N).where β is the penalty coefficient. The parameter β balances the tradeoff between exploration and exploitation. Smaller β implies that the smart pumps are more willing to choose a suboptimal action to explore, whereas higher β implies that they are prone to choose the best response action. Therefore, it is advisable that, at the beginning phase, the value of β is set to small number and it keeps increasing as the optimization iterates[19, 20]. Q is the supplydemand difference. Then, (11) means that each pump i should select a certain speed ratio strategy from its speed space to satisfy Q_{p} with the least energy consumption.
Thus, the key problem lies in designing the mechanism to achieve global optimization via local interaction among nodes (the terms of agent, node, and smart pump refer to the same concept in this paper) only with direct communication links. As we all know, it is local interaction game. In this manner, optimal load distribution can be completed on the field level. In this paper, any method that solves (9)(10) without using a central node aggregating data is called decentralized algorithm.
2.3. Potential Game
Coordination and combinatorial optimization, when viewed from a game theory perspective, can form a subset of the class of potential games.
Definition 2 (potential games, [21]). Player action sets , and , with player objective functions; is a potential game if, for some potential function Φ: S→R,for every player P_{i}∈P where P = is a group of players (or agents) and s_{i} is the complimentary set of s_{i}.
And a number of learning algorithms can be found for the potential game. Most of the learning algorithms for potential games guarantee convergence to a (pure) Nash equilibrium.
Definition 3 (Nash equilibrium). A joint strategy profile, , such that no individual agent has an incentive to change to a different strategy, that is,is a Nash equilibrium.
It is easy to see that, in potential games, any action profile maximizing the potential function is a pure Nash equilibrium. Hence, every potential game possesses at least one such equilibrium.
Consequently, each smart pump can be treated as a player and the energy consumption (11) is the utility function in potential game. And a potential game, as previously defined, requires perfect alignment between the global objective and the players’ local objective functions in the following sense: if a player unilaterally changed its action, the change in its objective function would be equal to the change in the potential function. The pumps total cost function is taken as the potential function in the optimization. Obviously, (9) subjected to (10) is a potential game.
However, there may also exist suboptimal pure Nash equilibrium that do not maximize the potential function[22]. Therefore, the key problem lies in how to design the mechanism to achieve the global optimization in a fully distributed way for the VSPs.
3. Decentralized Optimization Based on Probability Parallel VariableFrequency Speed Pumps
In fact, there exist many evolutionary and swarm intelligent algorithms for coordination and combinatorial optimization in engineering[23, 24], but they might not be applicable to decentralized pumps control system due to a number of reasons. Firstly, the existing evolutionary or swarm intelligent algorithm refers to quite identical individualities. That is, every population in swarm intelligent algorithm or chromosomes in evolutionary algorithm involves a global variable, but only local information is available in the decentralized control structure of a parallel pump system. As an exploration, an example of multiple autonomous robots following simple local rules and collectively provided by [25] is quite similar to the principles of the decentralized control system in this paper. However, the challenge is how to achieve the same performance as in a centralized manner where only local information is available.
3.1. Decentralized Estimation of Distribution Algorithm
Estimation of distribution algorithm (EDA) is an evolutionary optimization method that guides the search for the optimum by building and sampling explicit probabilistic models of promising candidate solutions[26]. Provided that a solution has N factorsx_{i}, i = 1, 2, …, N, the probability distribution of observing x is estimated by the product of density for each factor as follows:where θ_{i} is the vector of parameters for the probability density of factor x_{i}.
The EDA is adapted into decentralized fashion in this study. DEDA is different from traditional evolutionary or swarm intelligent algorithms, where the populations of each smart pump only cover its own variable as shown in Figure 3.
And the detailed description of DEDA is illustrated in Figure 4. Further, from the potential game theory perspective, an adjustment mechanism can typically produce sequential or parallel actions by agents (smart pump). Observed by the characteristic of decentralized parallel pumps control structure, sequential random schedule with local interaction is adopted in the present study. And an arbitrary agent can be picked as the indicator in the pumps optimal load distribution.
3.2. Convergence Proof
The convergence proof of the DEDA is presented in Proposition 4 and illustrated in the following paragraph.
Proposition 4. The solution x^{de}= [x_{1}^{de}, …, x_{i}^{de}, …,x_{N}^{de}] for the decentralized optimization (11) generated by DEDA can converge to the optimal Nash equilibrium with a probability of 1.
Proof. Assume the global solution space is defined as Ω = Ω_{1}∩ Ω_{2}∩ …Ω_{N}, where Ω_{i}, i =1, 2, …, N, is the space of the ith agent and its corresponding variable x_{i}. An elitepreserving operator is used in the presented algorithm. This operator favors the g elites of a population by giving them an opportunity to be directly carried over to the next generation. Thus, the new population consists of (L − g) new chromosomes, with g < L.
Firstly, the optimality convergence of each agent i (i =1, 2, …, N) is discussed. The present study assumes that the search space Ω_{i} of problem (14) is a closed and bounded region. The objective function is taken as the fitness function J_{i}(x_{i}), and the optimal solution set is expressed aswhere = minJ_{i}(x_{i}): ∈Ω_{i}.
For agent i (i=1, 2,…, N), the L chromosomes of EDA can be divided into the following properties:
(I) At least one chromosome belongs to D_{0}, which is written as S_{0}.
(II) All L chromosomes belong to D_{1}, which is written as S_{1}, whereAnd if q_{ij} (i,j = 0,1) represents the probability that the (k+1)th generation x_{i}(k+1) transfers to S_{j} when the kth generation x_{i}(k) keeps the state of S_{i}, then the following conditions hold:
(I) x_{i} (k) at S_{0} and q_{00} =1.
Condition (I) is obviously valid because the elitepreserving operator is used in this paper.
(II) x_{i} (k) at S_{1} and q_{11} ≤ c, where c∈(0,1).
Conditions (II) is analyzed as follows: For any ε > 0, if x_{i0}∈, there exists r > 0 satisfyingwhenDefineso thatdue toThe probability that transfers to S_{0} can be defined bywhere is the chromosome of a new generation and i = 1, 2, …, N. Given that the evolutionary computation of EDA is based on probability, each element of the chromosome generates a series of the probability function (x_{i}), with i =1, 2, …, N.
For , and thusFor simplicity, P can be denoted byand thenDefineso thatAsthe following result can be achieved:where the constant c isFurther, for any ε0, setandand, thus, the following equation is obtained:so thatThen the following theorem is introduced to complete the proof process.
(BorelCantelli theorem). The present study assumes that A_{1}, A_{2},… is the event sequence based on probability and defines = P. If thenIfand A_{k} are independent of one another, then
According to Theorem 5,is true. Therefore, x_{i}^{t}(m), where t = 1, 2, …, L, is the population of the mth generation of EDA for agent i (i=1,2,…, N), which consists of L chromosomes. If the fitness function J_{i}(x_{i}) is continuous on the bounded region Ω_{i}, the optimal solution (m) converges to the optimum for agent i with a probability of 1, andThen, the validity of the global optimization is deduced in the subsequent paragraphs.
According to the above analysis, the solution x_{i}^{de} can converge to the optimum for agent i with a probability of 1. Define the probability as p_{i}, that is,and
According to (24), the global combined probability density can be described as
For the coupled variables, a similar result is also obtained:
Then the present study directly obtainswhere = [, …, , …,] is a Nash equilibrium of problem (11). In conclusion, x^{de} converges to an optimal solution of the centralized optimization problem with a probability of 1 as the iteration step m→∞. Then Proposition 4 can be obtained as follows.
4. Case Study
4.1. Experimental Setup
This case study is carried out to validate the performance of DOABP by applying it to the model of a physical pump system under different load demands. The physical parameters (PAR) corresponding to performance curves of the pumps are shown in Table 1, and these parameters are recognized from the practical operating data of a district freezing station. As seen from Table 1, the performances of pumps of the same type are close to each other. The pump system is composed of four pumps working in parallel mode including two big pumps (KP10203 457mm in impeller diameter) and two smaller pumps (KP10203 406mm in impeller diameter) manufactured by Grundfos. A determined pressure difference control is applied here where the designed pressure difference and flow rate demand for the entire system are 45m and 3234 m^{3}/h, respectively.

4.2. Simulation Result
The strategy space is discretized, and it becomes a limited strategy space to ensure that the potential game is a finite game. And, the speed ratio (SR) of each pump, as selected action set, is shown in Table 2.
 
Note. The speed ratio of 0 means that the pump is off. 
In the case study, the proposed algorithms will be triggered as follows: when the pipe net has been changed, the smart unit will detect that the pressure difference H_{o} is not equal to H_{set} and Q_{o} which can be got through the flow meter on the trunk; thus Q_{i} can be solved in (3).
DEDA can be downloaded to microprocessor chip in each smart pump i (i=1,2, 3,4), and then each smart pump can be active. And, each smart pump can communicate and cooperate with other smart pump nodes in serial mode. The corresponding results by the proposed DEDA are shown in Figure 5.
As shown in Figure 5, the probability distribution (PD) on each pump is dynamic during the iterative process in DEDA. And the optimal solution of each pump fluctuates and finally reaches a new equilibrium state under mutual negotiation and adjustment. By about 60 iteration steps, the pumps optimal load distribution task can be achieved. It can be seen that the probability of the optimal output flow rate tends to approach 1. Conversely, the probability of the other solution space approaches 0.
The iterative process of each pump i(i=1,2,3,4) cost is illustrated in Figure 6. Further, the iterative process of total energy cost is shown in Figure 7.
Comparing Figure 6 and Figure 7, we find that although not all the costs of the four pumps decrease, the total cost decreases during the iterative process. This can validate the effectiveness of DEDA. For a comparison, the iterative process of EDA in centralized method is also illustrated in Figure 8. As shown in Figures 5 and 8, the DEDA can achieve the actual optima which are equivalent to that obtained with the centralized algorithm.
Further, a more detailed calculation result is shown in Table 3, where EDA and DEDA are adopted, respectively.

5. Conclusion
Most of the optimizing methods for parallel pump systems in HVAC system are based on a centralized structure under which all the management tasks have to be settled with one master controller. In this structure, the computation efficiency and stability are relatively low in that all the data and inspection have to be processed by one controller and that one malfunctioning device will influence the whole system. Besides, the control strategy is a casebycase one which cannot be transplanted easily to other systems.
In this study, a decentralized control strategy has been applied to the parallel pump systems in which the traditional master controllers have been substituted by a list of independent smart units embedded in each pump.
(i) A new fully distributed mathematical model for pumps optimal distribution and decentralized flat architecture are presented. With the rapid development of the electronic industry, smart hardware has been widely utilized in different fields. According to the vision of the decentralized method, traditional units can be upgraded to smart agents by incorporating a microcontroller chip inside. The decentralized algorithm can be written into the chip. The smart unit communicates with neighboring nodes such that they can work collaboratively to achieve the optimal load distribution task. In this case, the complicated onsite modeling, configuration, commissioning, and other secondary developing work can be simplified to the wiring of communication connection among different nodes because the smart unit can selforganize and plugandplay.
(ii) Decentralized optimization is used to solve pumps optimal load distribution under potential game framework. And, to achieve effectiveness of global goals, DEDA using local interaction is introduced. The convergence property of the novel method is also analyzed theoretically. Simulation results presented in the preceding paragraph indicate that the proposed method can achieve optimal load distribution.
This scenario is extremely motivating for further investigation in the field of distributed networked control in other largescale interconnected nonlinear systems. And, there are still several potential issues of the presented method that needed to be emphasized here. Firstly, the proposed mechanism is executed in sequence. Therefore, the proposed distributed algorithms should in principle be applicable to chainlike networks. Each smart pump is connected hand to hand with its neighbor, but the meshed network should also be considered. Secondly, future work will consider the hardware test and implementation on practical engineering.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Acknowledgments
This work is supported by National Key Research and Development Program of China No. 2017YFC0704100 (entitled New Generation Intelligent Building Platform Techniques). And the authors are grateful for the support provided by the Tsinghua UniversityUTC Research Center for Integrated Building Energy, Safety, and Control Systems.
References
 P. Waide and C. U. Brunner, Energyefficiency policy opportunities for electric motordriven systems, Iea Energy Papers, 2011.
 P. Olszewski, “Genetic optimization and experimental verification of complex parallel pumping station with centrifugal pumps,” Applied Energy, vol. 178, pp. 527–539, 2016. View at: Publisher Site  Google Scholar
 A. Keçebaş and I. Yabanova, “Thermal monitoring and optimization of geothermal district heating systems using artificial neural network: A case study,” Energy and Buildings, vol. 50, pp. 339–346, 2012. View at: Publisher Site  Google Scholar
 E. da Costa Bortoni, R. A. Almeida, and A. N. C. Viana, “Optimization of parallel variablespeeddriven centrifugal pumps operation,” Energy Efficiency, vol. 1, no. 3, pp. 167–173, 2008. View at: Publisher Site  Google Scholar
 J.Y. Wang, T.P. Chang, and J.S. Chen, “An enhanced genetic algorithm for biobjective pump scheduling in water supply,” Expert Systems with Applications, vol. 36, no. 7, pp. 10249–10258, 2009. View at: Publisher Site  Google Scholar
 V. K. Arun Shankar, S. Umashankar, S. Paramasivam, and N. Hanigovszki, “A comprehensive review on energy efficiency enhancement initiatives in centrifugal pumping system,” Applied Energy, vol. 181, pp. 495–513, 2016. View at: Publisher Site  Google Scholar
 Y.F. Wang and Q. Chen, “A direct optimal control strategy of variable speed pumps in heat exchanger networks and experimental validations,” Energy, vol. 85, pp. 609–619, 2015. View at: Publisher Site  Google Scholar
 Z. Tianyi, Z. Jili, and M. Liangdong, “Online optimization control method based on extreme value analysis for parallel variablefrequency hydraulic pumps in central airconditioning systems,” Building and Environment, vol. 47, no. 1, pp. 330–338, 2012. View at: Publisher Site  Google Scholar
 H. Yu, T. Zhao, and J. Zhang, “Development of a distributed artificial fish swarm algorithm to optimize pumps working in parallel mode,” Science and Technology for the Built Environment, pp. 1–11, 2017. View at: Google Scholar
 A. Viehweider and S. Chakraborty, “MultiAgent based Distributed Optimization Architecture for EnergyManagement Systems with Physically Coupled Dynamic Subsystems,” IFACPapersOnLine, vol. 48, no. 30, pp. 251–256, 2015. View at: Publisher Site  Google Scholar
 A. Windham and S. Treado, “A review of multiagent systems concepts and research related to building HVAC control,” Science and Technology for the Built Environment, vol. 22, no. 1, pp. 50–66, 2015. View at: Publisher Site  Google Scholar
 Y. C. Dai, Z. Y. Jiang, Q. Shen et al., “A decentralized algorithm for optimal distribution in HVAC systems,” Building & Environment, vol. 95, no. 2016, pp. 21–31, 2016. View at: Google Scholar
 Y. Xu, J. Wang, Q. Wu, A. Anpalagan, and Y.D. Yao, “Opportunistic spectrum access in cognitive radio networks: global optimization using local interaction games,” IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 2, pp. 180–194, 2012. View at: Publisher Site  Google Scholar
 J. R. Marden, G. Arslan, and J. S. Shamma, “Regret based dynamics: Convergence in weakly acyclic games,” in Proceedings of the the 6th international joint conference, pp. 194–201, Honolulu, Hawaii, May 2007. View at: Publisher Site  Google Scholar
 J. R. Marden, G. Arslan, and J. S. Shamma, “Joint strategy fictitious play with inertia for potential games,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 54, no. 2, pp. 208–220, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 H. P. Young, Individual Strategy and Social Structure, Princeton University Press, Princeton, NJ, USA, 1998.
 C. H. Sun and H. B. Duan, “An evolutionary potential game theoretic approach for the Kcover problem in multiUAV sensor networks,” Scientia sinica Technologica, vol. 46, no. 10, pp. 1016–1023, 2016 (Chinese). View at: Google Scholar
 Q. Zhang and H. Mühlenbein, “On the convergence of a class of estimation of distribution algorithms,” IEEE Transactions on Evolutionary Computation, vol. 8, no. 2, pp. 127–136, 2004. View at: Publisher Site  Google Scholar
 Y. Song, C. Zhang, and Y. Fang, “Joint channel and power allocation in wireless mesh networks: A game theoretical perspective,” IEEE Journal on Selected Areas in Communications, vol. 26, no. 7, pp. 1149–1159, 2008. View at: Publisher Site  Google Scholar
 M. V. Dolgopolik, “Smooth exact penalty functions: a general approach,” Optimization Letters, vol. 10, no. 3, pp. 635–648, 2016. View at: Publisher Site  Google Scholar  MathSciNet
 D. Monderer and L. S. Shapley, “Potential games,” Games and Economic Behavior, vol. 14, no. 1, pp. 124–143, 1996. View at: Publisher Site  Google Scholar  MathSciNet
 J. R. Marden, G. Arslan, and J. S. Shamma, “Cooperative control and potential games,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 39, no. 6, pp. 1393–1407, 2009. View at: Publisher Site  Google Scholar
 G. Chen, L. Liu, P. Song, and Y. Du, “Chaotic improved PSObased multiobjective optimization for minimization of power losses and L index in power systems,” Energy Conversion and Management, vol. 86, pp. 548–560, 2014. View at: Publisher Site  Google Scholar
 N. Radhakrishnan, S. Srinivasan, R. Su, and K. Poolla, “LearningBased Hierarchical Distributed HVAC Scheduling With Operational Constraints,” IEEE Transactions on Control Systems Technology, 2017. View at: Google Scholar
 J. Werfel, K. Petersen, and R. Nagpal, “Designing collective behavior in a termiteinspired robot construction team,” Science, vol. 343, no. 6172, pp. 754–758, 2014. View at: Publisher Site  Google Scholar
 P.Y. Yin and H.L. Wu, “CyberEDA: estimation of distribution algorithms with adaptive memory programming,” Mathematical Problems in Engineering, vol. 2013, Article ID 132697, 11 pages, 2013. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2018 ShiQiang Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.