Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

<div>Memory increase vs batch size for 4-stage pipelined training for VGG-16 on ImageNet.</div>

Applied Computational Intelligence and Soft Computing

Figure 9: Pipelined Training with Stale Weights in Deep Convolutional Neural Networks 