A Review on Deep Sequential Models for Forecasting Time Series Data

Table 9

Optimization method used in each model in the reviewed articles.

Optimization	Number of articles that used model-based optimization
	ANN	LSTM	TCNN
Adam	1	14	5
SGD	1	6	1
CSA	1	0	0
Global optimizer	1	0	0
BRKGA	1	0	0
PSO	3	0	0
NADAM	0	1	0
Cross-entropy loss function	0	0	1