Enhancing Video Games Policy Based on Least-Squares Continuous Action Policy Iteration: Case Study on StarCraft Brood War and Glest RTS Games and the 8 Queens Board Game

Table 2

LSCAPI case ().

State (row)	Action performance inside the chain (column)
8	0	0	0	4	0	0	0	0
7	1/21	0	0	0	0	0	0	0
6	0	0	0	0	1/21	0	0	0
5	0	0	0	0/21	0	0	0	2/21
4	0	3/21	0	3/21	0	0	0	0
3	3/21	0	0	0	4/21	0	5/21	0
2	3/21	5/21	6/21	2/21	0	0	0	6/21
1	0	0	0	0	0	6	0	0
	1	2	3	4	5	6	7	8
Total performance = 18/21 = 0.857
Problem	6	4	5	2	1	5	6	4
Solution	6	3	7	2	8	5	1	4