Online Learning for DNN Training: A Stochastic Block Adaptive Gradient Algorithm

<div>Running time with epochs for ResNet-34 and DenseNet-121 on CIFAR-10: a comparative summary. (a) Runtime for ResNet-34. (b) Runtime for DenseNet-121.</div>

Computational Intelligence and Neuroscience

fig1

Figure 1

Figure 1: Online Learning for DNN Training: A Stochastic Block Adaptive Gradient Algorithm 