Research Article
Pipelined Training with Stale Weights in Deep Convolutional Neural Networks
Table 1
Pipeline placement vectors for CNNs.
| | CNN | Number of layers | 4-Stage | 6-Stage | 8-Stage | 10-Stage |
| | LeNet-5 | 5 | (1) | (1, 2) | (1, 2, 3) | (1, 2, 3, 4) | | AlexNet | 8 | (1) | (1, 2) | (1, 2, 3) | — | | VGG-16 | 16 | (2) | (2, 4) | (2, 4, 7) | (2, 4, 7, 10) | | ResNet-20 | 20 | (7) | (7, 13) | (7, 13, 19) | — |
|
|
