Research Article

SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine

Table 4

The comparison results between SGB-ELM and other representative algorithms on 5 classification datasets.

Dataset Algorithm Training time Training accuracy (Dev) Testing accuracy (Dev) Hidden nodes Iterations

Segmentation 
()
ELM 0.0431 0.9465 0.0055 0.9351 0.0064 180N/A
V-ELM 0.4487 0.9463 0.0061 0.9374 0.0060 1807
EN-ELM 43.9234 0.9472 0.0048 0.9353 0.0063 180 ()50
Bagging 3.1853 0.9474 0.0035 0.9353 0.0050 18050
Adaboost 3.5372 0.9853 0.0052 0.9466 0.0067 100 Max = 100
SGB-ELM 134.2969 0.9761 0.00300.9558 0.0049 100 ()100

Texture  
()
ELM 0.0338 0.9954 0.0011 0.9945 0.0016 100N/A
V-ELM 0.4275 0.9965 0.0007 0.9950 0.0013 1007
EN-ELM 44.4969 0.9963 0.0008 0.9946 0.0011 100 ()50
Bagging 3.0959 0.9965 0.0007 0.9957 0.0013 10050
Adaboost 10.3628 0.9996 0.0017 0.9972 0.0024 60Max = 100
SGB-ELM 193.2019 0.9992 0.00050.9982 0.0008 60 ()100

Spambase   
()
ELM 0.0459 0.9174 0.0044 0.9080 0.0061 150N/A
V-ELM 0.4213 0.9192 0.0042 0.9115 0.0053 1507
EN-ELM 62.6000 0.9183 0.0054 0.9071 0.0060 150 ()50
Bagging 2.9869 0.9219 0.0039 0.9145 0.0051 15050
Adaboost 7.6875 0.9620 0.00460.9234 0.0072 100Max = 100
SGB-ELM 129.0922 0.9522 0.0033 0.9222 0.0043 100 ()100

Banana  
()
ELM 0.0550 0.6838 0.0253 0.6787 0.0263 180N/A
V-ELM 0.4906 0.6860 0.0261 0.6848 0.0264 1807
EN-ELM 67.5578 0.6821 0.0227 0.6780 0.0250 180 ()50
Bagging 3.3253 0.6808 0.0164 0.6777 0.0178 18050
Adaboost 7.5100 0.7457 0.0288 0.7448 0.0320 100Max = 100
SGB-ELM 133.0791 0.7610 0.00850.7563 0.0082 100 ()100

Ring  
()
ELM 0.0897 0.9492 0.0024 0.9418 0.0035 200N/A
V-ELM 0.7609 0.9532 0.0024 0.9466 0.0032 2007
EN-ELM 114.0641 0.9517 0.0028 0.9418 0.0031 200 ()50
Bagging 5.5241 0.9539 0.0027 0.9468 0.0030 20050
Adaboost 17.2109 0.9940 0.0023 0.9524 0.0038 150Max = 100
SGB-ELM 363.7976 0.9750 0.00210.9567 0.0027 150 ()100