Wireless Communications and Mobile Computing

Research Article

State Aware-Based Prioritized Experience Replay for Handover Decision in 5G Ultradense Networks

Table 2

Comparisons of different handover methods according to their characteristics.


Ref.	Problems and scenarios	Method	Contributions	Simulations	KPIs

[6]	Coordinated multipoint handover in 5G UDN	User-centric CoMP handover schemes	Characterize the movement trend through dwell time	Numerical simulation	HOR; Th
[7]	Handover triggering policy in 5G UDN	Clustering-based RL	Multiple decision criteria-based handover triggering mechanism	MATLAB; SD	HON; HOF; PPE; Th; latency
[12]	Handover failures and ping-pong effect in HetNet	HO triggers mechanism	Recursive least squares-based SINR prediction method	SD	HOF; PPE
[15]	Handover decision issue in LTE-A	AHP-TOPSIS; Q-learning	UE rank; the optimal triggering points of HO	MATLAB; SD	HOR; PPE
[17]	Handover in HetNets	Markov-based handover strategy	Context-aware handover policies	Monte Carlo simulations	Capacity
[22]	Handover in 5G	DNN	Reduce the handover problem to a classification problem	SD	RLF; PPE
[23]	Frequent handover in 5G UDN	Frequent handover mitigation algorithm	Dwell time estimation; user detection	NS3;	HON; Th
[27]	Handover decision in HetNets	Q-learning	Q-learning-based handover decision	SD	Cost; utility
[30]	Frequent handover in UDN	DQN	SDN-based UDN architecture; DQN-based handover decision	Mininet;	HOR; Th
[31]	VHO in HetNets	ES-DQN	Training the parameters of main Q-network with ES	Python; SD	HOF; Th; delay
[33]	Frequent handover in 5G	Double DRL	Trajectory-aware HO optimization approach	Wireless Insite software; SD	HON; Th
[34]	Handover decision in HetNets	Distributed DRL	MDP formulation; distributed DRL	SD	HON; energy cost
[36]	Handover in UDN	A3C	Mobility pattern-based user clustering; A3C-based HO policy	SD	HOR
[37]	Handover and power allocation in HetNets	Multiagent DRL	Proximal policy optimization; cooperative multiagent DRL	SD	HOR; Th
[43]	Load balancing and handover in 5G UDN	LB-DDQN	Load balancing strategy; load coefficient; load balancing evaluation function	Python; SD	HOR; Th
This paper	Handover decision in 5G UDN	SA-PER	State aware; analysis of dwell time; the relationships between VHO and HHO	Python; SD	RLF; HON; PPE; Th

VHO: vertical handover; HHO: horizontal handover; HON: handover number; HOR: handover rate; Th: throughput; HOF: handover failure rate; RLF: radio link failure; PPE: ping-pong rate; SD: simulated data.