Enhancing Video Games Policy Based on Least-Squares Continuous Action Policy Iteration: Case Study on StarCraft Brood War and Glest RTS Games and the 8 Queens Board Game

Table 7

Protoss versus Zerg Case.

LSCAPI
Evaluation metrics	State 1 (old)		State 2 (new)		Reward
	Zerg (agent)	Protoss (enemy)	Zerg (agent)	Protoss (enemy)
Drone units health	0.85		0.6		0.2
Larva units health	0.95		0.8
Probe units health		0.85		0.65
Dragon units health		0.9		0.5
SARSA
Evaluation metrics	State 1 (old)		State 2 (new)		Reward
	Zerg (agent)	Protoss (enemy)	Zerg (agent)	Protoss (enemy)
Drone units health	0.65		0.5		0.08
Larva units health	0.65		0.6
Probe units health		0.9		0.85
Dragon units health		0.85		0.58