Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Table 8

Learning rate of .

	learning Rate
ResNet-56	0.01
ResNet-110	0.001
ResNet-224	0.001
ResNet-362	0.001