Research Article

Local Epochs Inefficiency Caused by Device Heterogeneity in Federated Learning

Table 9

The standard deviation of dense feature weight ranking.

FeaturesP100_DenseV100_DenseK40_DenseMeanRankStd

Batchsize1.89271.44651.55561.6316
Dim_input3.38422.20992.32962.6412
Dim_output2.44912.70881.79202.3166
Opt_SGD2.83952.94432.18402.6559
Opt_Adadelta3.38512.99031.38912.5882
Opt_Adagrad2.04813.03052.08402.3875
Opt_Momentum2.85272.91681.98852.5860
Opt_Adam2.74882.98042.47062.7333
Opt_RMSProp3.47881.72322.04692.4163
Act_relu1.82731.48561.09201.4683
Act_tanh2.12892.22910.73191.6966
Act_sigmoid2.22412.17971.14571.8498