Survey of Attack Graph Analysis Methods from the Perspective of Data and Knowledge Processing

Table 3

Four categories of Markov models.

	No consideration of decision action	With consideration of decision action
Visible state	Markov chain (MC)	Markov decision process (MDP)
Invisible state	Hidden Markov model (HMM)	Partially observable Markov decision process (POMDP)