Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Figure 2

Schedule of computations.