Abstract

Heterogeneous network (HetNet) is considered to be the most promising approach for increasing communication capacity. However, HetNet control problems are difficult due to their intertier interference. Recently, the enhanced intercell interference coordination (eICIC) technology is introduced to offer several benefits, including a more equitable traffic load distribution across the macro and embedded small cells. In this paper, we design a new resource allocation scheme for the eICIC-based HetNet. Our proposed scheme is formulated as a joint cooperative game to handle conflicting requirements. By adopting the ideas of Kalai and Smorodinsky solution (KSS), multicriteria Kalai and Smorodinsky solution (MCKSS), and sequential Raiffa solution (SRS), we develop a hybrid control algorithm for an adaptive resource sharing between different base stations. To effectively adjust the eICIC fraction rates, the concepts of MCKSS and SRS are applied in an interactive manner. For mobile devices in the HetNet, the assigned resource is distributed by using the idea of KSS. The key insight of our algorithm is to translate the originally competitive problem into a hierarchical cooperative problem to reach a socially optimal outcome. The main novelty of our approach is its flexibility to reach a reciprocal consensus under dynamic HetNet environments. Exhaustive system simulations illustrate the performance gains along different dimensions, such as system throughput, device payoff, and fairness among devices. The superiority of our proposed scheme is fully demonstrated in comparison with three other existing eICIC control protocols.

1. Introduction

As the commercial deployment of the fifth-generation (5G) of cellular networks is well underway in many countries of the world, academia as well as industrial research organizations turn their attention to how to improve the performance of the network system. With the exponential growth of mobile Internet of Things (IoT) devices, the 5G wireless communication system is designed to enhance the capacity 1000 times compared with the fourth-generation (4G) network system. The 5G network system integrates diverse communication technologies, such as mobile edge computing, cloud computing, cloud radio access networks, and device-to-device communications, to realize the IoT paradigm. However, the integration of different communication technologies brings some problems, such as limited wireless spectrum resources, high cost of underpinning infrastructure, and the difficulty of service quality maintenance. To solve these various control problems arising from the 5G network system, many researchers direct their notice to new innovative technologies [1].

From the aspect of network architecture, heterogeneous networks (HetNets) have attracted interests for their enhanced system performance. The deployment of low-power small base stations (SBSs) within a macrobase station (MBS) coverage area is a cost-effective solution to handle the extended traffic requests. To meet growing traffic loads, a large number of SBSs can be deployed in HetNet so that simultaneous transmissions of multiple IoT devices become possible. Compared with homogeneous networks (HomNets), HetNets can increase the opportunity in the spatial resource reuse by developing small cells into the coverage of macrocells. Specifically, HetNets allow different types of small cells to coexist with a macrocell by sharing the same spectrum resources. This approach can extremely improve the spectrum efficiency while reducing uncovered areas. Due to these merits, wireless networks have evolved from HomNets to HetNets [1, 2].

Motivated by the abovementioned advantages and characteristics of HetNets, many studies on HetNets have begun to be investigated. One of the main challenges in HetNets is the macrocell to small-cell interference. In HetNets, SBSs are characterized by low transmission power. Generally, most IoT devices refer to the maximal signal to interference and noise ratio (SINR) criterion to select their corresponding cells. Therefore, IoT devices may connect to a distant MBS due to its high transmission power rather than to any nearby SBS. It leads to an inefficient load distribution. Due to this reason, it is clear that the benefits of HetNets strongly depend on an efficient resource management between high-power MBS and low-power SBS [35].

For the resource management of HetNets, the 3rd Generation Partnership Project (3GPP) has proposed the notion of enhanced intercell interference coordination (eICIC). As a time-domain solution, the eICIC uses two mechanisms, i.e., Cell Range Extension (CRE) and Almost Blank Subframes (ABSs), to protect the small-cell transmissions by mitigating the interference from the MBS. The CRE is a technique to expand a small-cell range virtually by adding a bias value to the received power; it can be realized by performing user association. Therefore, small-cell coverage, cell-edge throughput, and overall network throughput can be improved. The ABS is a technique to mitigate the interference experienced by small-cell devices in cell range expansion region. During certain time intervals, the MBS is muted except for overhead signal transmissions to improve SINRs to the small-cell devices. These intervals are called ABS. Thus, multiple IoT devices can transmit to their corresponding SBSs over ABS with very little interference from the MBS [35].

To implement the eICIC technology, joint resource allocation among MBSs and SBSs is vitally important to reduce the mutual interference and achieve spectrum sharing. Since the proportion of ABSs is closely related to the association of device and the resource allocation scheme adopted by the SBSs, it is of critical importance that the proportion of ABSs, user association, and the resource allocation decisions should be jointly optimized so as to achieve the HetNet performance gain. In this paper, we aim to design a novel control scheme for the joint resource allocation problem involving the following three fundamental issues: (i) how to determine user association for load balancing, (ii) how to decide the optimal proportion of ABSs and which devices are allocated on ABSs or non-ABSs in time domain, and (iii) how to allocate spectrum resource in frequency domain. These three control issues are tightly coupled with each other. To optimize the system performance and realize the potential of HetNets, it is necessary to study these control problems jointly [6, 7].

Cooperative optimization is inspired by the principle of coordination work, which considers the interactions among agents to optimize their payoffs through their objective functions. It has a solid theoretical foundation and outstanding practical performance, which has aroused widespread attention and research interest. As a branch of cooperative optimization, cooperative game theory is concerned with the game players forming alliances and working together to achieve their common goals. In the cooperative games, how to decompose the reward generated by the grand alliance to each participant has always been a hot research topic. At present, cooperative game models are present in almost every field of research such as economics, biology, sociology, politics, computer science, and telecommunications. In this study, we adopt the basic idea of cooperative game theory to develop a novel resource control scheme for the eICIC-based HetNet platform. From the perspective of coordination, the MBS, SBSs, and IoT devices cooperate and diffuse information so as to obtain a globally optimal solution to maximize the HetNet system performance [8, 9].

The rest of this article is organized as follows. In Section 2, we describe the basic ideas of cooperative game solutions and main contributions of this study. Section 3 summarizes the state-of-the-art research papers related to the control issues for eICIC-based HetNets. Section 4 presents the scenario of HetNet system platform and formulates the control problem. And then, our proposed scheme is elaborated in detail by using different solution concepts. To help readers understand better, we also provide the primary steps of the proposed algorithm. Section 5 presents the testbed implementation setup and simulation results are shown along with the achieved experimental results. Finally, a conclusion is drawn and future research plans are explained in Section 6.

2. Technical Concepts and Main Contributions

In a cooperative game, multiple players have to agree on a feasible utility allocation. The key idea is that players can achieve superior outcomes by working together rather than working against each other. In 1950, it was originated in a fundamental paper by J. Nash. He introduced an idealized representation of the cooperative problem and developed a methodology that gave the hope that the uncertainty of cooperation could be resolved. Nash solution for cooperative games is that under certain axioms, there is a unique solution. However, one of his axioms, i.e., independence of irrelevant alternatives (IIAs), came under criticism. Since then, different solution concepts have been provided with alternative axiom; they also lead to another unique solutions. The most famous of them is the Kalai and Smorodinsky solution (KSS). It is suggested as an alternative to Nash’s solution, which was suggested 25 years earlier. The main difference between the two solutions is that the Nash solution satisfies the IIA axiom, while the KSS solution satisfies the axiom of monotonicity [9, 10].

Recently, multicriteria cooperative games are concerned with situations in which a number of players must take into account several criteria, each of which depends on the decision of all players. A multicriteria cooperative game is a generalization of the classic cooperative game, where each player has a set of criteria for the evaluation of any decision. In these situations, there are two decision issues to be jointly considered: one related to the preferences of individual players with respect to their own criteria and the other related to the problem of selecting a solution that could be accepted by all the rational game players. However, until now, the literature on multicriteria cooperation is scarce. In 2009, the idea of multicriteria Kalai and Smorodinsky solution (MCKSS) was introduced while maintaining the multidimensional nature of each player’s payoff. An important feature of MCKSS is that the set of feasible outcomes is a polyhedron, and as a consequence, if the solution can be rationalized by means of linear functions, then the outcomes induced by the solution can be computed by solving multicriteria linear problems [11].

As another cooperative game solution, H. Raiffa introduced the concept of sequential Raiffa solution (SRS) for a two-player cooperative problem. Based on the arbitration protocol, the SRS can be characterized by the standard cooperative game axioms. In addition, an additional specific axiom expresses the key concept of repeated negotiation of the same procedure to the decreasing sequence of remaining games. Given a disagreement point, the most preferred outcome for a player is the one that gives his maximal utility while keeping the other player at his disagreement payoff. The interim agreement is the average of these two, most preferred points. By using each interim agreement as a new disagreement point, the SRS sequentially repeats this cooperative game process and converges to a Pareto optimal point of the cooperative game set. By doing so, the SRS bridges the gap between cooperative and noncooperative game processes via relative gains and concessions [12, 13].

In this study, we aim to optimize the performance of eICIC-based HetNets. Based on the KSS, MCKSS, and SRS, our proposed scheme is designed as a joint control paradigm in a step-by-step repeated manner. During the interactions between the MBS and SBSs, the situation of multicriteria cooperation arises. Therefore, we formulate the MBS-SBSs control problem as a multicriteria cooperative game. In the viewpoint of each individual SBS, control issues can be modeled as a two-player cooperative game. For individual IoT devices, the assigned resource can be shared according to the single-criterion cooperative game. In the proposed scheme, these three cooperative game models are sophisticatedly combined in a dynamic interactive manner and work together during HetNet operations. In the eICIC-based HetNet system infrastructure, our joint control approach can harness the synergies of cooperation among MBS, SBSs, and IoT devices to achieve a socially optimal solution. The significant major contributions of our study are summarized as follows:(1)To maximize the resource efficiency in the HetNet platform, we design a joint resource allocation scheme based on cooperative games. To the best of our knowledge, our cooperative game-based resource control paradigm is the first in the literature for the eICIC-based network infrastructure.(2)To decide the fraction ratio for the MBS-SBSs control problem, we formulate a multicriteria cooperative game model and select best strategies based on the idea of MCKSS. To choose the fraction rate for each individual SBS service, we formulate a two-person cooperative game model and adopt the idea of SRS.(3)For multiple IoT devices in the coverage areas of MBS or SBS, the resource distribution problem is solved based on the KSS. In a dynamically changing eICIC-based HetNet environment, three cooperative game processes are operated in a step-by-step repeated manner.(4)Our cooperative game models are jointly combined and work together to get reciprocal advantages. With the eICIC technology, our hybrid approach explores the sequential interactions between MBS, SBSs, and IoT devices and reaches a consensus for the excellent HetNet performance.(5)Extensive simulation results demonstrate the performance superiority of our proposed scheme by comparing to the existing state-of-the-art eICIC control protocols. Especially, the excellency of our cooperative game-based control paradigm is confirmed in terms of system throughput, device payoff, and fairness.

After 3GPP has proposed the eICIC standard, academic research papers are largely focused on advancing the practical implication of eICIC-based HetNets. In this section, we touch on currently published papers relevant to the research topic of our study. In [14], Deb et al. proposed a novel radio resource sharing (RRS) scheme for eICIC in HetNets. Two important challenges in the RRS scheme are (i) to determine the amount of radio resources for the SBSs and (ii) to determine the device association rules for the SBSs. The RRS scheme addresses these two tightly coupled control issues in a joint manner. By using the notion of ABS and CRE, the RRS scheme can account for network topology, traffic load, and MBS-SBS interference map to guarantee the HetNet network performance. Therefore, the SBS transmissions are ensured without badly hit by interference from the MBS based on the enhanced intercell interference coordination implementation. Extensive simulations are conducted to study the performance evaluation, and numerical results show that RRS scheme can achieve better reliability and sustainability [14].

The paper [15] investigates the concept of dual-connectivity, joint device association, and resource allocation for HetNets. The benefits of dual-connectivity paradigm necessitate the careful device association and resource allocation techniques in the dense HetNet scenario. To control the problem of intertier interference, the dual-connectivity resource allocation (DRA) scheme is developed. First, in dual-connectivity enabled HetNets, the joint problem of device association and resource allocation is formulated as a mixed integer nonlinear programming problem. Second, by linearizing the products of the variables, the original problem is reformulated as a tractable linear problem, which is optimized to maximize the overall network throughput. Third, a new low-complexity heuristic method is designed to achieve the near-optimal system solution. Last, numerical results confirm that the DRA scheme outperforms in the average system throughput with less computation-time and low complexity [15].

The joint association and fairness (JAF) scheme is designed for the eICIC-based HetNet. [16]. This scheme concentrates on the joint device association and interference coordination problem, and it is formulated as a network-wide max-min fairness problem. However, it is a mixed integer nonlinear programming problem, which is NP-hard. To overcome this computation difficulty, this NP-hard problem is decomposed into two phase subproblems. The first subproblem is defined as the ABS ratio problem for given device association; it figured out the explicit expression of the optimal ABS ratio. Based on this derived result, the second subproblem is defined to maximize network utility through the device association. Based on the marginal utility, a new low complexity greedy algorithm with polynomial complexity is proposed to solve the second subproblem. Finally, simulation results show that the JAF scheme has good performance in terms of system throughput and fairness among mobile devices [16].

As discussed above, the earlier schemes in [1416] have been studied on the resource allocation problem for the eICIC-based HetNet. Although these studies tackled the same control issues, which we concern in this study, they did not consider a joint control paradigm based on the cooperative game theory. Unlike the aforementioned RRS, DRA, and JAF schemes, our proposed scheme concerns the combination of different cooperative game solutions for controlling the activities of MBS, SBSs, and mobile IoT devices and guides them toward a fair-efficient outcome in the HetNet platform.

4. Proposed Resource Control Scheme for eICIC-Based HetNets

This section introduces the HetNet platform that we focus on. Then, we explain the basic ideas of KSS, MCKSS, and SRS, which are adopted to design our proposed joint control scheme. After that, our proposed resource allocation algorithm is described strategically in the nine-step procedures.

4.1. HetNet System Infrastructure and Cooperative Game Models

This paper focuses on an orthogonal frequency-division multiple-access HetNet consisting of MBSs overlaid with multiple open access low-power SBSs. Assume that in the two-tier HetNets, SBSs are randomly distributed within the coverage of each MBS, and the sets of MBSs and SBSs are denoted by and , respectively. MBSs and SBSs are cochannel deployed and synchronous configured. The IoT devices , which are connected to MBSs or SBSs, are assigned a number of subchannels. Assume the whole channel is flat fading and each base station allocates same power on every subchannel. Individual IoT devices are randomly placed in the cellular network area following a uniform distribution. Base stations carry out the spectrum resource management, scheduling, admit control, and more functionalities for their corresponding devices. As depicted in Figure 1, IoT devices can access different base stations, such as MBS or SBS, and we summarize the notations used in this paper in Table 1 [1416].

To alleviate the traffic load of MBSs in HetNets, we employ time-domain eICIC mechanism. Assume a same ABS pattern that each MBS has the same ABS ratio , where fraction is assigned to ABS and (1 − ) fraction is assigned to non-ABS. MBS maintains silence in the ABS position and transmits at normal power in a non-ABS position. Therefore, each MBS can only use the non-ABSs mode to serve its corresponding devices. However, SBSs can serve their corresponding devices by using the ABS or non-ABS mode. In the HetNet platform, we define the IoT devices within the nominal coverage of the SBS as SBS-centric devices. By assigning a positive bias to the reference signal received power, the SBS coverage area can be extended. The devices in the SBS-extended range are defined as SBS-extended devices. Over the non-ABS mode, the SBS-extended devices suffer excessive interference from MBS, while the SBS-centric devices receive relatively less interference [7, 1416].

Without loss of generality, it is assumed that the SBS-centric and SBS-extended devices are served by non-ABS and ABS, respectively. However, some SBS-centric devices are seriously interfered by MBS. In order to solve this problem, we configure a certain proportion of ABS fraction by using ratio factor . Therefore, the resource scheduling policy of SBS is to serve the SBS-extended devices by using the proportion of ABS fraction, while (1 − ) proportion of ABS fraction is assigned for the SBS-centric devices. Based on the eICIC technology, the values of and are dynamically adjusted to share the limited spectrum resource to maximize the HetNet system. By combining the time domain and the frequency domain, the diagram of spectrum allocation for the MBS and SBS is shown in Figure 2.

During the eICIC operations, each SBS has two type devices. Devices are served on ABS mode (the set denoted by ), and the other devices are served on non-ABS mode (the set denoted by ). Each MBS only uses the non-ABS mode to serve their corresponding devices, which are denoted by the set . Therefore, we have virtual base stations in total. The SINR of from virtual base station is given by the following equation [16]:where is the transmission power of , is the channel gain from to , and is the noise power of each base station. denotes the interfering device set of . When is served on ABS mode, ; otherwise, . Based on the quasistatic fading channel, is assumed to be constant during an allocation period. According to the Shannon capacity, the instantaneous communication rate from to , i.e., , can be obtained, and we finally get the normalized link rate from to , i.e., as follows [3, 16]:where is the channel bandwidth from to . In this paper, we develop three cooperative games, which are hierarchically organized based on the joint control paradigm. The first cooperative game decides the ABS ratio , and the second cooperative game decides the proportion ratio factor for each SBS. Finally, the third cooperative game distributes the assigned resource for corresponding IoT devices. Through the , , and games, the MBS, SBSs, and devices are sequentially interacted with each other to reach a mutually acceptable solution, which is called social optimal consensus. It is noteworthy that we formulate the -- association in an iterative coordinated manner. Formally, we define the tuple entities in our proposed , , and game models, such as(1), , and represent the sets of MBSs, SBSs, and IoT devices, respectively(2)In the first game for , i.e., , represents the set of SBSs, which exist in ’s coverage area, and we assume that is an individual game player. is ’s spectrum resource amount.(3)In , and are the game players, and (1 − ), are their strategies, and and are their utility functions, respectively.(4)In the second game for , i.e., , is the set of -extended devices, and is the set of -centric devices. We also assume that and are individual game players.(5)In , , are the game players, and , (1 − ) are their strategies, and , are their utility functions, respectively.(6)In the third game for IoT devices, i.e., , there are three subgames such as , , and . When is included in ’s covering area, is the set of ’s corresponding devices, is the set of -extended devices, and is the set of -centric devices.(7)In , , and , devices in , , and are game players, respectively. For , and are ’s strategy and utility function, respectively.(8)Discrete time model is represented by a sequence of time steps. The length of matches the event time-scale of , , and .

4.2. Technical Concepts and Ideas of KSS, MCKSS, and SRS

In this subsection, we quickly review the fundamental concepts of KSS, MCKSS, and the sequential Raiffa solution for cooperative games.

4.2.1. Multicriteria Kalai and Smorodinsky Solution for Cooperative Games

To characterize the basic concept of MCKSS, we preliminarily define some mathematical expressions. Let be the set of players, and each player considers the same criteria, , to value the possible agreements. An -person multicriteria cooperative game is formally described by the pair , where is the set of all feasible outcomes and is the disagreement point or status quo. The outcomes in are obtained as the result of a joint decision of all the players. Therefore, there exists an agreement that gives the player an outcome vector , where is the payoff of player in criterion . is the result obtainable if the players fail to reach an agreement. In a multicriteria cooperative game, individual rationality establishes that each player will only negotiate at or above those outcomes that improve upon the disagreement point . Thus, the set of outcomes where players will negotiate is [11].

Usually, a multicriteria cooperative game solution is a procedure to incorporate partial information on the importance of the criteria in multicriteria linear problems. Based on this idea, MCKSS takes into account each player’s maximum payoffs with respect to the criteria, which are represented by the ideal outcomes; they are denoted as . MCKSS is obtained by replacing the payoff gains of players by the proportion with respect to their ideal outcomes. Therefore, for each feasible outcome , the quotient is a major decision factor, where and . Originally, E. Kalai and M. Smorodinsky introduced the idea of KSS as a single criterion cooperative game solution. It provides a payoff that is proportional to the achievable maximum payoff while ensuring efficiency. Therefore, each player gets the same fraction of his maximum possible payoff in KSS. Geometrically, KSS is the intersection point between the cooperative game set and the straight line between the disagreement point and the utopian point. By considering single criterion and , the KSS, i.e., , must satisfy the following equation [10, 11]:

To define MCKSS, let denote the minimum proportional payoff vector whose components are . For each feasible outcome , the minimum utility gains vector is , where . Each component of represents the guaranteed minimum utility gains of the set of players for the corresponding criterion. MCKSS is based on the idea that the players jointly agree on those outcomes whose minimum utility gain levels cannot be simultaneously improved with respect to all the criteria. Therefore, the players will choose an outcome such that there is no other outcome whose minimum utility gain vector is better in terms of components. For the multicriteria cooperative game , a feasible outcome is MCKSS, if there does not exist such that . Mathematically, MCKSS, i.e., , is given by the following equation [11]:

Therefore, MCKSS is the Pareto optimal by criteria in and the set of efficient solutions for multicriteria cooperative game .

4.2.2. Sequential Raiffa Solution for Cooperative Game

To characterize the fundamental idea of SRS, we assume a two-player cooperative game problem. is a real number set, and denotes the two-dimensional Euclidean space. Let be a nonempty and finite set, and is a set of natural numbers. For any , we write (, resp.) if for any , (, resp.). A pair is a cooperative game with , where . The set of all two-person cooperative games is denoted as . For any nonempty subset of , a mapping is called a cooperative solution on . With , let be the indicator function of , where . For any game , we consider the mapping ; it defined as follows [13]:

Now consider the sequence defined by the following equation [13]:

According to (6) and (7), SRS is defined by the following equation [13]:

4.3. The Proposed Joint Cooperative Game Model for the eICIC-Based HetNets

To develop our joint control scheme for the eICIC-based HetNet platform, we construct the , , and game models. For MBSs in , total game models are operated in a parallel manner. is designed to decide the ABS ratio for and . In the game, we concern two decision criteria such as real-time sensitivity and service productivity for communication services. Therefore, we adopt the idea of MCKSS for ’s solution concept. In the game, and are the game players. For the game player , we define his utility function . However, consists of two subfunctions for the criteria of sensitivity and productivity , where . They are given as follows:where and are the control parameters for . is the total resource request sum from the set of ’s corresponding devices, and is ’s spectrum resource amount. is a control parameter for . For the another game player , we define his utility function as the same manner as , where . They are given as follows:where is a control parameter for . is the total resource request sum from the corresponding devices in . , , and are the control parameters for . For the multicriteria game, MCKSS, i.e., , is obtained as follows:where and are the ideal outcomes, and and are the disagreement points of sensitivity and productivity criteria, respectively. , are obtained by maximizing , and the value is given. Finally, and values for the game are decided as follows:

To decide the value in , we construct the game. In this game, and are the game players, and they are interacting sequentially to reach a mutual consensus. In this case, SRS is preferred for the solution concept. Through the interactive process, the utility functions of and , i.e., and , are defined as follows:where is a control parameter for the , and , are the control parameters for . and are total requested resource amounts from and , respectively. Based on the gradual negotiation, the SRS for the game, i.e., , converges to a fair-efficient solution while maintaining the viewpoints of and . It is obtained as follows:where and are the disagreement points for and , respectively. When the change between and is within a predefined minimum bound , this change can be negligible. At this time, we can think that we converge a fair-efficient solution, and our negotiation process is terminated. Finally, we can get the value, and the resource amount is proportionally distributed based on .

For the devices in , the game is designed to distribute the assigned resource. In , each individual device belongs to one of , , and sets, where . Devices in , , and operate the , , and games separately, in a parallel manner. For , its utility function is defined as follows:where and are the requested and allocated resource amounts for , respectively. Based on the corresponding devices, the , , and games are operated in a distributed fashion. For , devices in the share the assigned resource, i.e., , according to the idea of KSS. Based on the utility function in (15), KSS, i.e., , is obtained as follows:where is the ideal outcome for the . For the and games, the utility function for each game player is defined as the same by using (15). Finally, devices in and share the assigned resources, i.e., and , respectively, as the same manner as the game.

4.4. Main Steps of Our Hierarchical Joint Cooperative Game Algorithm

By deploying different network infrastructures, such as MBSs and dense deployment of SBSs, the HetNet platform for IoT paradigm is widely seen as a solution for the 5G mobile networks. However, the performance of SBSs could be impacted by the interference from the MBS. To protect the SBS transmissions by mitigating the MBS interference, the eICIC technology is introduced. In this study, we design a hierarchical game model for the eICIC-based HetNet system. Our proposed game consists of different cooperative games such as , , and . In these games, game players can obtain, through cooperation, better outcomes than those obtained when they do not cooperate. The , , and games are operated in a distributed parallel fashion according to MCKSS, SRS, and KSS. In dynamically changing HetNet system environments, our joint control paradigm is especially appropriate to negotiate conflicting requirements. The primary steps of the proposed scheme are described as follows:Step 1: To carry out the simulation analysis, the parameter and control factor settings are shown in Table 2. Our simulation scenario is described in Section 5.Step 2: At a sequence of time steps, the , , and games are operated sequentially and interactively to reach a mutually consensus.Step 3: First, the game is designed as a two-player game with two decision criteria. In this game, and are game players, and their utility functions are defined using (9) and (10).Step 4: For the game, MCKSS is adopted as a solution; it is obtained based on the equations (5) and (11). Finally, the value is calculated by using (12).Step 5: Second, the game is designed as a single criterion two-player game. In this game, and are the game players, and their utility functions are defined using (13). For the game, the SRS is adopted as a solution. Finally, the value is obtained based on the equations (5)–(7) and (14).Step 6: Third, the game consists of three subgames such as , , and games. For each game, devices in , , and are the game players, and their utility functions are defined using (15).Step 7: For , , and games, individual devices in , , and share the assigned resources based on KSS. Finally, for each device is obtained based on equations (4) and (16).Step 8: In our joint control approach, the , , and games are sophisticatedly combined and work together to achieve reciprocal advantages.Step 9: Constantly, individual MBS, SBSs, and IoT devices are self-monitoring the current eICIC-based HetNet system condition, and it proceeds to Step 2 for the next game iteration.

5. Performance Evaluation

This section presents the numerical results derived to validate the proposed method. By comparing with the existing RRS, DRA, and JAF schemes [13, 14, 15], we confirm that our approach outperforms other schemes via Matlab simulations. System parameters and their values are listed in Table 2, and the simulation environment and system scenario are given as follows [17, 18]:(1)Simulated the eICIC-based HetNet system platform consists of five MBSs, twenty-five SBSs, and two-hundred fifty IoT devices, i.e.,  = 5,  = 25, and  = 250(2)Each MBS has five SBSs, and IoT devices are randomly distributed over in the MBS covering area(3)Each IoT device generates six different type service requests (4)The arrival process of is the rate of the Poisson process (). The offered range is varied from 0 to 3.0.(5)The total spectrum resource of each MBS is 500 Gbps(6)We assume the absence of physical obstacles in the network area(7)The resource allocation process through the cooperative games is specified in terms of basic allocation units (BAUs), where one BAU is 16 Mbps in this study(8)The predefined minimum bound for the SRS is one BAU (16 Mbps)(9)The disagreement points for cooperative games, i.e., , , , and , are zeros(10)The eICIC-based HetNet system performance measures obtained on the basis of 100 simulation runs are plotted as functions of the Poisson process ().

To evaluate the proposed scheme, we compare its performance in terms of system throughput, IoT device payoff, and fairness over offered service request generation ratios. Table 2 shows the control parameters and system factors used in the simulation.

Figure 3 shows the system throughput in the eICIC platform as a function of IoT device service request ratios. It is observed that our joint game approach consistently outperforms all other existing protocols. This is expected because when our proposed scheme is operated, the MBS SBSs, and devices work together to improve the resource efficiency. Especially, MCKSS is applied between the MBS and SBSs, SRS is adopted for each SBS’s intraresource sharing process, and KSS is used to distribute the assigned resources for each device. Therefore, there will be more room to effectively exploit an available resource in order to maximize the overall system capacity. Based on the desirable features, our cooperative game model can guide selfish network agents to effectively share their limited resources in a coordinated manner. So, we can attain the highest system throughput among the four different schemes.

Figure 4 reports the normalized device payoff achieved by all considered schemes under different workload ratio. Compared with the other existing schemes, IoT devices in our proposed scheme adaptively share the resource in a step-by-step dynamic coordinated fashion. Finally, the assigned resource for each different device set is adaptively distributed based on the KSS; it ensures a fair-efficient solution for the resource allocation problem. Therefore, our approach is quite flexible to maximize the device payoff under widely different and diversified eICIC-based HetNet situations. Due to this reason, it can be seen that the proposed scheme achieves a higher device payoff over the existing RRS, DRA, and JAF protocols.

For different protocols, the Jain’s fairness index of IoT devices is shown in Figure 5. It can be used to evaluate the degree of fairness, and a larger Jain’s index corresponds to a fairer allocation. As shown in Figure 5, our proposed scheme outperforms the RRS, DRA, and JAF protocols by a large margin. In the proposed scheme, individual IoT devices can dynamically adjust their strategy through the cooperative game process, which is implemented as a hierarchical interactive manner. Therefore, IoT devices can collectively capture how to adapt their strategies to achieve the better benefit while getting reciprocal advantages. Therefore, all devices fairly share the limited resource in the eICIC-based HetNet system. Simulation results confirm the excellency of our proposed method for the fairness index; we maintain the highest fairness compared to other methods.

6. Summary and Conclusion

Traditionally, network traffic load in the cellular network varies continuously as a result of user mobility and traffic dynamics. The HetNet architecture is one of the most promising solutions to adaptively handle traffic fluctuations while enhancing the network coverage, spatial spectrum reuse, and system throughput. In this paper, we investigate a joint resource allocation scheme for the eICIC-based HetNet system, which offers several benefits, including a more equitable distribution of network traffic across the MBS and SBSs. For the eICIC technology, previous work did not consider dynamically changing network conditions in HetNets. Therefore, they studied the benefits of the eICIC-based HetNet with static optimization of eICIC parameters. Our proposed scheme is dynamic and can improve the system performance by using a hierarchical and repeated cooperative game model. Especially, we take into account both the ratio of non-ABS for MBS devices and the ratio of ABS fraction for SBS-extended devices. These ratios are adaptively adjusted based on the concept of MCKSS and SRS through the and game models. And then, the assigned resources for MBS, SBS-centric, and SBS-extended devices are fair-efficiently distributed by using the idea of KSS through the game. By tightly coupling the , , and games, we can lead to consensus outcomes that may be accepted by all IoT devices of MBS and SBSs. The main novelty of our joint game approach is to explore the reciprocal advantages through sequential interactions among the MBS, SBSs, and IoT devices. Under dynamically changing eICIC-based HetNet environments, our proposed scheme achieves a socially optimal solution in a step-by-step repeated manner. The extensive simulation results demonstrate the efficiency of the proposed algorithm and verify the superiority of our hierarchical control paradigm by comparing the existing RRS, DRA, and JAF schemes.

As a future work, we will study the concept of dual connectivity and joint association in the eICIC-based HetNet platform. Furthermore, it is interesting to formulate the resource allocation process as a multiobjective optimization problem. Moreover, we will take the ABS ratio issue to design a network-wide max-min fairness process and develop a new low complexity greedy algorithm based on the marginal utility. In addition, considering the privacy protected downlink and uplink decoupling is also an interesting research topic.

Data Availability

The data used to support the study are available from the corresponding author ([email protected]).

Conflicts of Interest

The author, Sungwook Kim, declares that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (grant no. IITP-2023-2018-0-01799) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation), and was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (grant no. 2021R1F1A1045472).