Research Article  Open Access
A UserOriented Pricing Design for Demand Response in Smart Grid
Abstract
Demand response (DR) programs are designed to affect the energy consumption behavior of endusers in smart grid. However, most existing pricing designs for DR programs ignore the influence of endusers’s diversity and personal preference. Thus, in this paper, we investigate an incentive pricing design based on the utility maximization rule with consideration of endusers’ preference and appliances’ operational patterns. In particular, the utility company determines the pricing policy by trading off the budget revenue and social obligation, while each enduser aims to maximize their own utility profits with high satisfaction level by scheduling multiclass appliances. We formulate the conflict and cooperative relationship between the utility company and endusers as a Stackelberg game, and the equilibrium points are obtained by the backward induction method, which exists and is unique. At the equilibrium, the utility company adopts realtime pricing (RTP) scheme to coordinate endusers to fulfill the benefit of themselves, i.e., under such price, endusers automatically maximize overall utility profits of the overall system. We propose a distributed algorithm and an adaptive pricing scheme for the utility company and endusers to jointly achieve the best performance of the entire system. Finally, extensive simulation results based on real operation data show the effectiveness of the proposed scheme.
1. Introduction
Demand response (DR) program plays an important role in peak shaving, demand leveling, and load consumption reduction in distribution network by affecting the energy consumption of endusers [1, 2]. As an essential element of a smart grid, useroriented DR allows heterogeneous endusers participate in the electricity markets to earn customized utility by coordinating interaction between utility companies [3, 4]. The utility company offers DR service to improve customers’ satisfaction, and in turn, the amount of power consumption requested by customers affects the DR policies. Furthermore, in a modernized distribution system, elastic appliances (e.g., energy storage system (ESS)) are deployed closer to endusers. The operational patterns of elastic appliances can be combined with DR services to increase utility benefits and reliability of the smart distribution grid [4–6]. To complement with customers’ preference and appliances’ operational patterns, useroriented pricing design for DR programs has recently been regarded as a promising solution in smart grid.
Recently, in useroriented DR programs, the utility company offers a variety of utility benefits, such as bill savings for participants, quality of satisfactions improvement, and better market performance. In practice, it is a challenging problem for a utility company to design appropriate DR programs. The utility company cares not only about what the customers pay but also about social obligation, e.g., social fairness that addressed customers’ payment based on their income levels. There are several benchmark designs focusing on billing mechanism in which customers are rewarded by their contribution in achieving systemwide welfare [7]. In general, the utility company adopts adequate incentive pricing schemes to achieve a tradeoff between minimizing the electricity payment and maximizing the satisfaction levels of endusers as well as to achieve a minimum peaktoaverage ratio (PAR) to help shift usage away from peak hours to less congested times [8, 9]. In recent years, useroriented pricing design has attracted growing attention both in academia and in industry, especially with the emerging development of smart grid [10]. Mostly, flat pricing, timeofuse (TOU) pricing (e.g., peak time vs. offpeak time), and realtime pricing (RTP) are among the most popular pricing schemes. Flat pricing scheme refers to those methods where the utility company announces a fixed price for all time periods. In TOU pricing scheme, the intended time cycles are divided into several time periods and the distinct price value is set to encourage users to shift demand to offpeak hours and further reduce the demand deviation.
In smart grid environment, techniques such as smart metering and domestic energy management devices are available for endusers to collect energy consumption data in realtime fashion, which enables endusers pay much more attention to their energy consumption patterns. However, the different characteristic type of customers and appliances’ operational patterns affect the responses of endusers. Some previous works have studied how to classify appliances into several categories based on their energy consumption patterns, but it is difficult to consider the proper appliance classes to develop a more efficient and reliable DR program, and there are great needs to combine appliances’ power scheduling with endusers’ preference jointly to design useroriented pricing DR programs [11–13]. Consequently, balancing endusers’ preference and appliances’ operational scheduling is another unresolved challenge. In addition, the different responses or sensitivities to different incentive pricing scenarios are modeled as several levels of satisfaction by adopting the concept of utility function from microeconomics [8], but lack of knowledge about how to formulate endusers’ preference is a barrier for useroriented DR program design. Also, the adverse impact of pricing manipulation from the utility company is still challenging for useroriented DR programs, which may diminish the economic saving effort of an individual [14].
In this paper, we study a useroriented pricing for DR with consideration of endusers’ preference and appliances’ operational patterns. In the useroriented DR mechanism, the utility company plays a key role, i.e., designing incentive pricing policies and balancing social revenue and power network stability, which are important adaptive processes to maintain the reliability and resilience of the power grid in face of unanticipated energy consumption demand. Endusers respond to price policies and maximize their own utility profits with high satisfaction level by scheduling multiclass appliances. The complicated interactions and inherent hierarchical relationship among the utility company and endusers motivate us to use a game theoretical framework. Therefore, we propose a twostage Stackelberg game model to capture the interactions, in which the utility company is the leader and endusers are followers. In order to eliminate the adverse effect of pricing manipulation from the utility company, we propose an adaptive balancing scheme for the utility company to explore the tradeoff between the revenue and the stability of power grid over peak/offpeak power demand time.
Our contributions can be summarized as follows:(i)We establish an interactive useroriented pricing DR model with consideration of endusers’ satisfaction and appliances’ operational patterns by a Stackelberg game. At the Stackelberg equilibrium, the utility company and endusers achieve the optimal demand/response strategies with the best performance of the entire system.(ii)We design a distributed algorithm for the utility company and endusers, where each entity can independently determine its best demand/response strategies with only local information sharing such that it protects endusers’ privacy. We propose an adaptive balancing scheme for the utility company to explore the tradeoff between budget revenue and the stability of power network over peak/offpeak power demand time.(iii)The effectiveness of the proposed pricing scheme is verified under a special case of adaptive balancing scenario by extensive simulations in terms of total utility profits at the system level and the stability of power network measurement.
The paper is organized as follows. We describe the current state of the art in Section 2. The mathematical models for the system, multiclass appliances, endusers’ preference, and the profits utility function model are presented in Section 3. Next, in Section 4, we formulated the incentive pricing DR mechanism as a twostage Stackelberg model and proposed a distributed algorithm and an adaptive pricing scheme. In Section 5, the numerical examples are demonstrated and analyzed. Finally, Section 6 concludes the whole paper.
2. Related Works
In useroriented DR programs, the interactive profits between the utility company and endusers, two rational entities with conflicting objectives, are characterized as a nonlinear function of power transmission scheduling, such as endusers’ satisfaction level improvement, operation cost reduction, bill saving, and demand and supply balance. Usually, endusers are eager to earn minimal billing payment and maximal satisfaction level which are modeled as the utility function [8]. However, due to the large and distributed deployment of appliances with different energy consumption patterns, it is uneasy to improve the economy and reliability of energy supply [6]. In addition, appliances with different operational patterns may respond to the incentive prices differently for the operation cost reduction [15]. Besides, the profits of the utility company are formulated as economy and reliability metrics, which are indicated by billing revenue and squared Euclidean distance (SED) between the instantaneous energy demand and average demand of power system [5, 7]. To achieve both optimality and social obligation for the utility company, the weighted summation billing revenue and network stability metrics are pretty suit for the utility company, and the weights or balance criteria can be adjusted to the tradeoff between billing revenue and peak load shaving [16]. However, all those above studies are limited in the sense that there is either only single type of endusers or multiclass appliances treated as one entity or absence of the adjustable balance criteria in the useroriented incentive price designing. Differently in our study, we conclude the operational patterns of appliances and design a multitype enduser satisfaction function whose goal is to selfishly maximize its own utility profits while adapting to the adjustable balancing scheme for the utility company so as to achieve the tradeoff between budget revenues and the stability of power network over peak/offpeak load demand time at the system level.
In most cases, the optimization problem of pricing design in DR program is formulated as a nonlinear optimization problem which can be solved by convex optimization methods [8, 17] or game theory methods [6, 18]. Na et al. approximated the utility maximization problem as a convex problem and designed a distributed algorithm for the utility company and endusers to jointly compute optimal price and demand schedule based on a primedual decomposition and gradient algorithm [8, 17]. While in practice, for different objectives, the strong duality of the objective function cannot always hold and thus the obtained solutions are nearoptimal solutions. Game theory has been seen as a useful mathematical tool to handle these intractable problems even when the convexity of the objective function cannot be guaranteed. Specially, due to the inherent hierarchical relationship framework of the Stackelberg game model, various works have modeled the DR program as Stackelberg game [19, 20]. The authors introduced a distributed algorithm that schedules power loads to meet an optimization objective using game theoretical approach and showed the advantage of the particular effectiveness in capturing the interaction among customers [6, 18]. Considering inherent vulnerabilities of privacy and security issues, Sabita et al. proposed a scheme to eliminate the threat of price manipulation from data communications on the reliability of power supply [21], even though much more reliable encryption and communication technologies are available nowadays. It is observed that endusers’ preference diversities in the noncooperative subgame of the Stackelberg game could cause reactive fluctuations in terms of price response for the utility company [16]. For the virtue of privacy protection in the distributed algorithm, there is great motivation for us to design distributed methods exploited in the Stackelberg game to protect privacy and preference information for optimization from attackers in the data communications network. However, limited work has emphasized on the circumstance where the Stackelberg game is designed to protect privacy parameters of heterogeneous endusers and alleviate the impact of pricing manipulation from the utility company.
3. System Model
We consider a distribution network with one utility company; set of heterogeneous endusers and numerous appliances as shown in Figure 1. The utility company collects DR information from customers through the DR aggregator. For each enduser, we assume there is an energy management controller (EMC) unit which is embedded in enduser’s smart meters. EMC units are connected with each other including the utility company through a communication channel using wireless technologies, e.g., WiFi, WiMAX, or LTE, which play the role of controlling and coordinating. The intended time cycle for operation is divided into T time slots, where and is the set of time slots. The utility company adopts different pricing schemes (e.g., flatrate pricing, TOU, and RTP), and denotes the incentive price for per unit power in time slot t. The aggregator and EMC units coordinate incentive price in each time slot, and the final decision is broadcast by the utility company. Customers operate a set of appliances, and each appliance is controlled by an EMC unit. denotes power consumption rate of appliances a for customer i in time slot t. denotes total power consumption rate for all appliances in time slot t. also represents the actual power transmission rate between the utility company and customer i, which is constraint by maximal and minimal capacity constraint, i.e., .
3.1. Operational Pattern Model of Appliances
In a distribution network, the total set of appliances is classified into three categories according to their energy consumption patterns and operational properties. Here, we briefly introduce each appliance class and its power consumption rate constraints [15].
3.1.1. Inelastic Appliances
The amount of power consumption rate of inelastic appliances is fixed in each time slot. However, they can be intermittently turned on/off without any performance degradation. For example, appliances such as battery chargers with fixed charging rates and vacuum cleaners can be classified into this set. The power consumption rate is constrainted by the following equation:where means the appliances a are always running during time slot t.
3.1.2. Elastic Appliances with Memoryless Property
Different from inelastic appliances, the power consumption rate of elastic appliances with memoryless property can be flexibly adjusted within the subinterval time slot, whose performance (or satisfaction) depends only on the current power consumption level, for example, appliances such as light bulbs with controllable brightness and electric fans with controllable speeds. Appliances have the maximum and minimum values for power consumption rate in time slot t, that is,where the maximum power consumption rate represents the power transmission level that are running with maximal power consumption rate. The minimum power consumption rate represents the loads are always running during the day with lowest power rate requirements.
3.1.3. Elastic Appliances with Memory Property
The energy consumption rate of elastic appliances with memory property can also be flexibly adjusted within time slot , whose performance depends not only on the total amount of power transmission but also on the previous memory level. For example, appliances such as ESS and EVs with controllable power charging/discharging rates usually have an upper bound on power charging rate (when ), denoted by , and an upper bound on power discharging rate (when ), denoted by . Let denote memorybased appliance capacity. Thus, the following constraints are present on power consumption rate of appliances :where denotes the dynamics of the memorybased energy storage level under the assumption that the power leakage is negligible and is the initial memorybased energy storage level.
Considering the high expense of memorybased elastic appliances, the extra economic damage is modeled by function , which captures the economic damage caused by charging/discharging operations, e.g., fast charging or deep discharging:where are weight factors that evaluate total extra cost of memorybased elastic appliances. By appropriately controlling the values of weight factors, customers can adjust the tradeoff between its achieved utility and electric cost corresponding to fast charging and deep discharging. The cost function is convex function of vector .
3.2. EndUsers’ Preference and Utility Function Model
The power transmission demands of endusers varied from different conditions, such as the type of endusers, the shape of supplydemand requirements, and sensitivity to incentive price. Meanwhile, endusers are independent entities in the local distribution network, e.g., household customers respond to the same incentive price differently from industrial customers. The reaction of endusers can be modeled as utility functions by adopting the concept of the satisfaction function from microeconomics [22], and the corresponding satisfaction functions can be modeled as , where is a preference parameter that highly depends on endusers’ diversity and time. The satisfaction function quantitatively models endusers’ preference as a function of actual power transmission characterized by different features of various types of customers. Given the incentive price , endusers are willing to maximize the summation of overall utility profits that is defined as utility function :
For announced incentive price , customer i tries to adjust power consumption rate to maximize their own utility, and the optimal power transmission scheduling is formulated by the following optimization problem:
The objective function of (6) is concave, and the feasible set is convex. Therefore, an optimal point can be solved by convex programming techniques such as the interior point method (IPM) in a central fashion. However, the problem arising in (6) from a central manner is that the central processor needs to know the exact utility function parameters of customers, which violates customers’ privacy. In Section 4, there is a distributed solution method that solves the optimization problem in local EMC, and the private parameters are protected.
3.3. Utility Company’s Utility Function Model
In a distribution network, the utility company serves as an intermediary that participates in wholesale markets, including dayahead, realtime balancing, and ancillary services, to provide enough electricity supply from generators and then sell it to customers in a retail market. The utility company wishes to maximize the profit, as well as fulfill its obligation to serve the public and meet customers’ satisfaction. Namely, the utility company is regulated so that not only do maximize its revenue through selling electricity, but induce customers to realize maximal social welfare. Hence, the utility company’s utility function is defined as the weighted summation of economic revenue and SED [5]:where is the marginal price of electricity, is the average power demand during the day, and and are weight factors measuring the total utility of budget and the deviation of customers’ daily consumption, respectively. The optimization problem of utility company is formulated aswhere and are power transmission rate thresholds for all customers in local distribution network.
In this problem, if and , the problem becomes a maximization problem of the total utility profit of revenue. On the other hand, if and , the problem becomes a minimization problem of power supply deviation. By deciding weight factors appropriately, the utility company can adjust the tradeoff between achievable budget revenue and the stability of power network.
4. TwoStage Stackelberg DR Scheduling
In this section, we formulate a twostage Stackelberg game model [23] to capture the interactions between the utility company and endusers. The first stage of this game is that the utility company determines the incentive pricing mechanism, and the second stage is that customers decide how much power to be consumed by appliances. It is natural to assume that the utility company is the first mover and customers are followers making their decision according to the price . To obtain the Stackelberg equilibrium of the game, the backward induction method is used to derive the closedform expressions of power transmission rate [23]. In particular, we first consider the power transmission rate determined by customers for given incentive price .
4.1. Optimal Response of EndUsers
Since not all customers respond to the incentive price in the same way, endusers’ preference model in Section 2 can be extended to heterogeneous customer scenario. In this paper, we define customers’ satisfaction function by different parameters as follows:where denotes the ratio between actual power transmission and maximal possible demand transmission with the utility company in normalized form. Let denote valuation of unit power transmission for customer i and be independent from time. is varied from different customer types, e.g., valuation of industrialtype customers can be much greater than that of residentialtype customers.
To analyze the Stackelberg equilibrium, we use backward induction and first consider the second stage of the game, i.e., given , customers maximize their welfare function (6) by choosing the power transmission rate . The optimal solution always exists and can be expressed aswhere is the inverse function of firstorder derivative of the satisfaction function . When the satisfaction function is concave, the optimal solution is . On the other hand, the optimal total power transmission rate of all customers in time slot t cannot exceed the power transmission rate capacity of utility company in a distribution network:
In addition, the secondorder derivative of is
Since diagonal elements of the Hessian matrix are all negative, the offdiagonal elements are all zero. The Hessian matrix is positive definite, meaning that strong duality holds, and each customer and utility company can simply solve their local optimization problem determined by (10) and (11).
4.2. Optimal Response of Utility Company
In the above section, customers’ optimal response and the total power transmission rate are obtained. Next, the optimal pricing incentive strategy of the first stage will be analyzed based on the responses of customers. Knowing the optimal power transmission rate responses of customers, the utility company calculates the optimal incentive pricing by solving the optimization problem (8). Substituting (10) into (8), we obtain the utility function of the utility company corresponding to incentive price as follows:
Given the optimal response of customers (10), a function of incentive price , the constraints on customers’ power transmission rate can be rewritten as
Since (14) is a decreasing function with , the constraints on incentive price can be written aswhere and , and the constraints are linear.
The optimization of with respect to incentive price now becomes
To ensure that the solution is the optimum, we need to check the negativedefiniteness of the Hessian matrix. In this problem, the negativedefiniteness of the Hessian matrix of p is parameter dependent and has been derived [18].
Theorem 1. There exists a unique Nash equilibrium and , and thereby a unique Stackelberg equilibrium.
Proof. We write the summation of endusers and utility company’s utility function from the overall system:The feasible set is convex set defined by constraints. Clearly, the optimal solution exists. Moreover, there exist Lagrange multipliers , such that (taking derivative with respect to )Since the righthand side is independent of customer i, the Lagrange multipliers for all customers. Check the KKT condition for system utility function, since both the utility problems of customers and utility company are concave, the KKT conditions are necessary and sufficient for the optimality.
4.3. Distributed Pricing Incentive DR Algorithm
The above theorem derives the existence and uniqueness of an equilibrium in the pricing incentive DR problem and also motivates a distributed solution, that utility company coordinates customers to jointly compute an equilibrium based on utility functions. The operation of the proposed algorithm and the interaction between the utility company and endusers are depicted in Figure 2.
As described in Algorithm 1, within one loop, the utility company updates power transmission rate capacity according to (11) and further calculates and at the beginning of time slot t and then constructs utility function optimization problem according to (13). Eventually, the utility company figures out the optimal price by solving (16) and broadcasts new value of price and keeps on receiving customers’ response of . On the other hand, customers keep on receiving incentive price information from the utility company all the time. As described in Algorithm 2, at the beginning of time slot , EMCs update the operational properties of appliances models. By solving the constructed utility function locally, the EMC in customer i gets the optimal power rate and corresponding to the given and then sends the power rate information to the utility company. Until it converges, the EMC applies the power consumption rate scheduling to appliances.


The complexity of the algorithm is mainly driven by the number of iterations and the number of customers participating in the framework. Denote k as the number of iterations to satisfy the convergence with some precision; the complexity of the algorithm is . Indeed, the amount of k depends on the number of customers and the shape of supply and demand.
4.4. Proposed Adaptive Balancing Scheme
In the incentive price design process, the utility company has one important functionality to adjust the weights of the summation in utility function (7) to make a balance of achievable revenue and stability of the power networks over peak/offpeak power demand time. While the bidirectional interaction between the utility company and endusers performs in a more timely and effective way, it is crucial for the utility company to carry out adaptive strategies for smoothing the fluctuation of energy demand. Next, we proceed to analyze the adaptive scheme with the goal of achieving the tradeoff between social revenue and stability of power supply. We define the balance criteria corresponding with time slot t as . Using in (13), the Stackelberg equilibrium of Theorem 1 can be derived as the following proposition.
Proposition 1. There exists a unique Nash equilibrium and , and thereby a unique Stackelberg equilibrium.
As proven in the proof of Theorem 1, there exists only one positive solution for the incentive price design given by (17). Since and , the utility company selects the balance criteria with the constraint of . Therefore, the Nash equilibrium in the adaptive balancing scheme scenario exists and is unique, and hence the Stackelberg game also admits a unique equilibrium in Proposition 1.
Utility function (7) indicates that the deviation of energy supply will decrease (increase) if the balance criteria are increased (decrease) by the adaptive setting. In other words, when the utility company attempts to maintain the stability of the power supply, it might suffer economic revenue damage by updating the incentive price . Theoretically, the utility company can acquire the best status of utility profits by balancing social revenue and power supply deviation at the equilibrium balance criteria point . In practice, it is impossible for most cases to adapt since the utility company has to fulfill the social obligation that the electricity price should be accepted by most endusers according to their income levels. Consequently, we propose interesting adaptive balancing schemes by setting :(1): considering the worst case when , the optimal response of the utility company is merely to maintain the stability of the power network, while it may sacrifice the budget revenue from making energy transactions with endusers. In this scenario, it is appropriate for peak/offpeak power demand periods so as to minimize the deviation of power supply by setting relative larger balance criteria .(2): the worst impact that the adaptive scheme can cause is by setting so low that the stability measurement of power network occupies rarely any weight in the utility profit . In other words, out of peak/offpeak power demand time periods, to maximize budget revenue, the balance criteria should be set as smaller, as long as the deviation of power supply stays in a tolerable degree.(3): when , the adaptive balancing scheme reaches a possible best performance of the entire system, in which the utility company achieves a systemlevel balance of budget revenue and deviation of power supply.
5. Numerical Example
5.1. General Setup
We consider a distribution network with one utility company and set of heterogeneous consumers and various appliances. The optimization period is set as 24 hours (i.e., ), and the length of each time interval is 1 hour. We randomly generate the daily customers’ demand data based on the daily report released by the U.S. Federal Energy Regulatory Commission (FERC) [24] for different types of endusers. Customers have a random number of appliances that follow the strict energy consumption scheduling constraints with power scheduling limits , and , unless mentioned otherwise. The valuation of unit power is set equally for different types of endusers.
Due to the inherent diversity of customers, the customer preference model in Section 3 is extended to multipletype features with preference parameter . On the one hand, indicates customertype variation and illustrates the satisfaction preference for heterogeneous customers. Different preference parameter reflects the different preferences of customers. For example, industrial customers will make more profits than commercial customers with the same power transmission rate. In other words, the satisfaction valuation can be ranked corresponding to and smaller represents customers earning high profits. On the other hand, indicates power transmission sensitivity. For instance, satisfaction valuation of industrialtype customers drops rapidly when decreases. This is because low power transmission rate will lead to low productive effect. In contrast, the satisfaction valuation of residential customers may still be high even if is low. This is because residential customers usually need a few amount of power to support daily life, and they can drain power from memorybased elastic appliances instead of transporting power from a utility company. Moreover, residential customers are much more sensitive to power transmission rate, and they are more flexible to coordinate power transmission rate to reduce daily bills, so the firstorder derivative of satisfaction valuation to is larger than other types of customers.
In this section, we consider three types of customers, i.e., residentialtype customers, commercialtype customers, and small industrialtype customers. Different types of customers are characterized by satisfaction function with different parameters, i.e., customers are divided into three types evenly, , , and , as shown in Figure 3. Preference parameter of customer i is randomly chosen from the customer category range according to typevarying characteristics. Valuation of per power transmission rate is randomly chosen from . Specially, the satisfaction function satisfies and . Also, is a nodecreasing, twicedifferentiable function, and it is concave in the interval . Thus, customers’ valuation of power transmission rate during time slot t is fulfilling the assumed properties described in our previous work [16].
5.2. Discussion on Adaptive Balance Criteria
Since the major cost of utility company is on maintaining of stability of power grid, we ignore the cost on infrastructure constructions and stress on the tradeoff between power transmission revenue and stability of distribution network. The balance criteria trade off between total budget revenue of the utility company and the deviation of power supply. The utility company has the authority to decide the total revenue and coordinate provided power deviation by adopting different balance criteria . Based on this game framework, we ran the twostage Stackelberg game algorithm and analyzed the Stackelberg equilibrium under different balance criteria via the utility profits at the system level.
We exploited how the change in incentive price and the deviation of power network and, in turn, how the billing cost of endusers and utility profits of overall system are affordable and achievable at equilibrium, when the utility company set the balance criteria , which varied from 0.2 to 2. Figure 4 shows the optimal incentive price and deviation of power network measured by PAR (i.e., ) at equilibrium corresponding to different balance criteria μ from the view of the utility company. It is important to note that the optimal incentive price increases and the deviation decreases corresponding to the increase of balance criteria μ. Therefore, larger balance criteria μ will incur a higher stability of the power network which verifies the effectiveness of the proposed adaptive balance criteria scheme in Section 4.4. From the view of customers, the billing cost increases linearly with the system scale when they purchase energy from the utility company, as depicted in Figure 5. However, it is not linear with the balance criteria for the different responses of energy usage amount from the endusers to the optimal incentive price under balance criteria at equilibrium.
For the sake of illustration, we use and with the granularity for the plot. Figure 6 depicts the utility profits (i.e., ) of the overall system obtained by the twostage Stackelberg game method at equilibrium versus compared with relevant utility maximization DR by distributed primaldual decomposition methods [17]. It shows that whatever the pricing methods are studied, the proposed twostage game theoretic approach outperforms the existing methods at equilibrium. And the utility profits reach the maximal value when the balance criteria are set . In other words, the optimal balance criteria enable achieving the best possible performance tradeoff between economic budgets cost and power supply deviation of the overall system.
5.3. Results with a Fixed Balancing Scheme
In order to analyze the impact of endusers’ preference and power scheduling of appliances, we show the power response scheduling of three types of endusers (i.e., residential, commercial, and industrial customers) under a fixed balancing scheme with the optimal balance criteria and system scale . Figure 7 shows the load profile of the three regular endusers, which indicates that customers have shifted the peak load demand to offpeak time. However, the load curve of each customer is fluctuating over time. In practice, customers can decide their preference parameters and schedule the power consumed by appliances flexibly with more consideration of billing cost reduction or highlevel satisfaction. Nevertheless, the aggregated power provision of the utility company is well balanced, and the peak power demand has reduced from 447.04 kW to 433.99 kW and PAR reduced from 1.377 to 1.134. Considering the elasticity of energy storage facilities in achieving peak shaving and bill saving, Figure 8 using box plot depicts the statistics of daily bill savings for 12 endusers who are randomly selected and includes six regular customers and six customers with energy storage facilities. It shows that the absolute bill savings of customers with energy storage facilities are much higher than those of the regular customer without energy storage facilities as the energy storage facilities provide partial energy demand in peak/offpeak power demand times when the incentive price is much higher.
(a)
(b)
(c)
(d)
(e)
(f)
5.4. Results with Adaptive Balancing Scheme
In this section, we show numerical simulations by employing an adaptive balancing scheme. In the adaptive balancing scheme, the utility company set larger balance criteria (i.e., ) to maintain the stability of power network during peak/offpeak load demand times and much smaller out peak/offpeak load demand times. In this scheme, customers are induced by the utility company to adapt power consumption so as to make a contribution to flat power scheduling and, in turn, are rewarded with a reduction in billing cost. For comparison, the fixed balancing scheme is set with to indicate the best possible systemlevel performance status. Table 1 shows the comparative results between fixed and adaptive balancing mechanisms. It can be concluded from the table that even though the fixed balancing scheme achieves high utility profits of the overall system, the adaptive balancing scheme obtains highlevel stability of power network with a relatively high utility profit.

6. Conclusion
In this paper, we propose a useroriented pricing DR program based on the utility maximization rule with considerations of endusers’ preference and appliances’ operational patterns as well as the adaptive dynamic pricing scheme for the utility company. We formulate the conflict interaction between the utility company and endusers as a twostage Stackelberg game, in which the utility company determines the pricing policy by trading off the budget revenue and the stability of the power network. Endusers aim to minimize their own billing cost and operation cost of appliances with high satisfaction level by scheduling energy consumption of appliances. We design a distributed algorithm using the backward induction method to obtain the Stackelberg equilibrium for the utility company and endusers to jointly compute the best performance possible of the entire system. At the equilibrium, when endusers selfishly optimize their own utility profits, they automatically maximize the utility profit of the overall system. The effectiveness of our proposed pricing scheme is verified under a special case of adaptive balancing DR scenario in terms of utility profits at the system level. In the future, it will interesting to study whether this work can be improved by considering the competition among endusers with an oligopoly utility company market.
Data Availability
The data used to support the findings of this study are available from daily report released by the U.S. Federal Energy Regulatory Commission (FERC) [24].
Disclosure
A portion of this paper was presented at the Proceedings IEEE ICC, Kansas City, MO, USA, May 2018 [16].
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This study was supported by the State Grid Corporation of China Science and Technology Project, “Research and Application on Flexibility Improvement of Power Distribution System Based on Distributed/Mobile Energy Storage,” under Grant no. SGTJDK00DWJS1800008.
References
 P. Siano, “Demand response and smart gridsa survey,” Renewable and Sustainable Energy Reviews, vol. 30, pp. 461–478, 2014. View at: Publisher Site  Google Scholar
 M. H. Albadi and E. F. ElSaadany, “A summary of demand response in electricity markets,” Electric Power Systems Research, vol. 78, no. 11, pp. 1989–1996, 2008. View at: Publisher Site  Google Scholar
 S. Maharjan, Y. Zhang, S. Gjessing, and D. H. K. Tsang, “Usercentric demand response management in the smart grid with multiple providers,” IEEE Transactions on Emerging Topics in Computing, vol. 5, no. 4, pp. 494–505, 2017. View at: Publisher Site  Google Scholar
 Y. Shimomura, Y. Nemoto, F. Akasaka, R. Chiba, and K. Kimita, “A method for designing customeroriented demand response aggregation service,” CIRP Annals, vol. 63, no. 1, pp. 413–416, 2014. View at: Publisher Site  Google Scholar
 H. K. Nguyen, J. B. Song, and Z. Han, “Distributed demand side management with energy storage in smart grid,” IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 12, pp. 3346–3357, 2015. View at: Publisher Site  Google Scholar
 H. M. Soliman and A. LeonGarcia, “Gametheoretic demandside management with storage devices for the future smart grid,” IEEE Transactions on Smart Grid, vol. 5, no. 3, pp. 1475–1485, 2014. View at: Publisher Site  Google Scholar
 Z. Baharlouei, M. Hashemi, H. Narimani, and H. MohsenianRad, “Achieving optimality and fairness in autonomous demand response: benchmarks and billing mechanisms,” IEEE Transactions on Smart Grid, vol. 4, no. 2, pp. 968–975, 2013. View at: Publisher Site  Google Scholar
 P. Samadi, A.H. MohsenianRad, R. Schober, V. W. Wong, and J. Jatskevich, “Optimal realtime pricing algorithm based on utility maximization for smart grid,” in Proceedings of the 2010 First IEEE International Conference on Smart Grid Communications (SmartGridComm), pp. 415–420, Gaithersburg, MD, USA, October 2010. View at: Publisher Site  Google Scholar
 A.H. MohsenianRad, V. W. S. Wong, J. Jatskevich, R. Schober, and A. LeonGarcia, “Autonomous demandside management based on gametheoretic energy consumption scheduling for the future smart grid,” IEEE Transactions on Smart Grid, vol. 1, no. 3, pp. 320–331, 2010. View at: Publisher Site  Google Scholar
 L. P. Qian, Y. J. A. Zhang, J. Huang, and Y. Wu, “Demand response management via realtime electricity price control in smart grids,” IEEE Journal on Selected Areas in Communications, vol. 31, no. 7, pp. 1268–1280, 2013. View at: Publisher Site  Google Scholar
 S. Moon and J.W. Lee, “Multiresidential demand response scheduling with multiclass appliances in smart grid,” IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 2518–2528, 2016. View at: Publisher Site  Google Scholar
 A.H. MohsenianRad and A. LeonGarcia, “Optimal residential load control with price prediction in realtime electricity pricing environments,” IEEE Transactions on Smart Grid, vol. 1, no. 2, pp. 120–133, 2010. View at: Publisher Site  Google Scholar
 S. Tang, Q. Huang, X.Y. Li, and D. Wu, “Smoothing the energy consumption: peak demand reduction in smart grid,” in Proceedings of the 2013 IEEE INFOCOM, pp. 1133–1141, Turin, Italy, April 2013. View at: Publisher Site  Google Scholar
 C. Wang and M. De Groot, “Managing enduser preferences in the smart grid,” in Proceedings of the 1st International Conference on EnergyEfficient Computing and Networking, pp. 105–114, ACM, Passau, Germany, April 2010. View at: Publisher Site  Google Scholar
 J.W. Lee and D.H. Lee, “Residential electricity load scheduling for multiclass appliances with timeofuse pricing,” in Proceedings of the 2011 IEEE GLOBECOM Workshops (GC Wkshps), pp. 1194–1198, IEEE, Houston, TX, USA, December 2011. View at: Publisher Site  Google Scholar
 Y. Zhou, S. Ci, H. Li, and Y. Yang, “Designing pricing incentive mechanism for proactive demand response in smart grid,” in Proceedings of the 2018 IEEE International Conference on Communications (ICC), pp. 1–6, IEEE, Kansas City, MO, USA, May 2018. View at: Publisher Site  Google Scholar
 N. Li, L. Chen, and S. H. Low, “Optimal demand response based on utility maximization in power networks,” in Proceedings of the 2011 IEEE Power and Energy Society General Meeting, pp. 1–8, IEEE, Detroit, MI, USA, July 2011. View at: Google Scholar
 P. Yang, G. Tang, and A. Nehorai, “A gametheoretic approach for optimal timeofuse electricity pricing,” IEEE Transactions on Power Systems, vol. 28, no. 2, pp. 884–892, 2013. View at: Publisher Site  Google Scholar
 M. Yu and S. H. Hong, “A realtime demandresponse algorithm for smart grids: a Stackelberg game approach,” IEEE Transactions on Smart Grid, vol. 7, pp. 879–888, 2016. View at: Google Scholar
 J. Chen, B. Yang, and X. Guan, “Optimal demand response scheduling with Stackelberg game approach under load uncertainty for smart grid,” in Proceedings of the 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm), pp. 546–551, IEEE, Taiwan, China, November 2012. View at: Google Scholar
 S. Maharjan, Q. Zhu, Y. Zhang, S. Gjessing, and T. Basar, “Dependable demand response management in the smart grid: a Stackelberg game approach,” IEEE Transactions on Smart Grid, vol. 4, no. 1, pp. 120–132, 2013. View at: Publisher Site  Google Scholar
 A. MasColell, M. D. Whinston, J. R. Green et al., Microeconomic Theory, vol. 1, Oxford University Press, New York, NY, USA, 1995.
 M. J. Osborne and A. Rubinstein, A Course in Game Theory, MIT Press, Cambridge, MA, USA, 1994.
 FERC, Miso Daily Report, FERC, Washington, DC, USA, 2012, http://www.ferc.gov/marketoversight/mktelectric/midwest/misoarchives.asp.
Copyright
Copyright © 2019 Yanglin Zhou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.