Research Article
The Relationship between Sparseness and Energy Consumption of Neural Networks
Table 1
The value of
and
and the corresponding value of
and
.
| All neurons () | Active neurons () | | (normalized) | Ratio () |
| 100 | 50 | | 1.000 | 50% | 101 | 45 | | 0.999 | 46% | 104 | 40 | | 0.986 | 38% | 116 | 33 | | 0.982 | 29% | 119 | 32 | | 0.996 | 27% | 131 | 29 | | 0.988 | 22% | 143 | 27 | | 1.034 | 19% | 170 | 24 | | 0.987 | 14% | 199 | 22 | | 0.993 | 11% | 219 | 21 | | 1.016 | 9.5% | 276 | 19 | | 1.030 | 6.9% | 373 | 17 | | 1.008 | 4.6% | 558 | 15 | | 0.993 | 2.7% | 971 | 13 | | 1.002 | 1.3% |
|
|