Energy-Aware Smart Connectivity for IoT Networks: Enabling Smart Ports

Algorithm 2

Second stage learning.

Data: Action selected by the first stage, available computational capacity in gateway and eNB, budget

Result: Share of data to be offloaded

13 initialization;

14 for  all IoT devices  do

15Determine the current state using Table 4;

16Evaluate all the actions;

17Calculate the penalty using Table 4;

18Select the best action;

19Jump to the next state;

20Update the -table;

21 end