A Novel Memory-Scheduling Strategy for Large Convolutional Neural Network on Memory-Limited Devices

Table 4

Memory usage in each layer for AlexNet.

AlexNet layer	Memory limit(MB)
	200	100	50	10	5
1	0.72	0.72	0.72	0.72	0.72
2	1.70	1.70	1.70	1.70	1.70
3	2.28	2.28	2.28	2.28	2.28
4	2.22	2.22	2.22	2.22	2.22
5	1.37	1.37	1.37	1.37	1.37
6	0.98	0.98	0.98	0.98	0.98
7	4.09	4.09	4.09	4.09	4.09
8	1.42	1.42	1.42	1.42	1.42
9	0.88	0.88	0.88	0.88	0.88
10	0.41	0.41	0.41	0.41	0.41
11	2.78	2.78	2.78	2.78	2.78
12	0.50	0.50	0.50	0.50	0.50
13	1.94	1.94	1.94	1.94	1.94
14	0.41	0.41	0.41	0.41	0.41
15	144.18	72.17	48.17	0.17	0.17
16	0.20	0.20	0.20	0.20	0.20
17	0.05	0.05	0.05	9.65	4.85
18	64.03	64.03	32.02	0.02	0.02
19	0.03	0.03	0.03	9.18	4.96
20	0.16	0.16	0.16	0.16	0.16
21	0.02	0.02	0.02	0.02	0.02