Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Figure 7

Hybrid training convergence.