Research Article

Local Epochs Inefficiency Caused by Device Heterogeneity in Federated Learning

Table 10

The mean ranking of convolutional feature weights.

FeaturesP100_ConvV100_ConvK40_ConvMeanRank

Batchsize8.6929.5745.7027.989333333
Elements_matrix5.83968.68247.56087.360933333
Elements_kernel11.295211.701410.111.0322
Channels_in1.091.03341.01121.044866667
Channels_out7.06085.607212.09928.255733333
Padding14.134413.709613.914413.91946667
Strides8.91089.88268.48529.092866667
Use_bias14.595614.59515.717614.9694
Opt_SGD6.32646.8534.23285.804066667
Opt_Adadelta3.7647.30487.08286.050533333
Opt_Adagrad7.7325.35386.37526.487
Opt_Momentum5.24765.358411.07247.226133333
Opt_Adam10.19443.68145.14486.3402
Opt_RMSProp2.97364.1075.95124.343933333
Act_relu15.823215.65767.333212.938
Act_tanh14.057615.816415.51415.12933333
Act_sigmoid15.262814.08215.703215.016