Table 1: Error rate over the testing dataset, O: our algorithm, PL: linear Pegasos, NL: linear NORMA, PG: Pegasos using Gaussian RBF kernel with 𝛾 = 0 . 0 1 , NG: NORMA with the same kernel.

Dataset O PL NL PG NG

Linear 0.04 0.03 0.09 0.07 0.1
Linear + noise 0.02 0.002 0.005 0.02 0.08
Bayesian 0.03 0.17 0.22 0.08 0.15
Drifting 0.04 0.28 0.35 0.150.18
Switching 0.11 0.20 0.21 0.32 0.13
Covertype 0.19 0.2 0.35 0.43 0.48