Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Figure 1

Partitioning of layers.