Network Capacity Optimization for Cellular-Assisted Vehicular Systems by Online Learning-Based mmWave Beam Selection

Algorithm 2

Algorithm for getting and .

Input: null

Output: and

1: ;

2: For each l=1, …, Ldo

3:  Observe vehicle contexts

4:  Find such that

5:  Compute the set of under-explored beams in (5)

6:  Ifthen    ■ Exploration

7:   

8:   Ifthen

9:    Select randomly from

10:    Add to

11:   Else

12:    Select as the beams from and then add them to

13:    Select , …, as the beams , …, from (6) and then add them to

14:   End if

15:  Else    ■ Exploitation

16:   Select , …, as the beams , …, from (7) and then add them to

17:  End if

18: End for