Research Article

Effect Improved for High-Dimensional and Unbalanced Data Anomaly Detection Model Based on KNN-SMOTE-LSTM

Table 4

Model parameters of the basic classifier.

ModelParameters

Gaussian naive Bayes (GaussianNB)priors = None, var_smoothing = 1e-09

Logistic regressionpenalty = “l2,” dual = False, tol = 0.0001, C = 1.0, fit_intercept = True, intercept scaling = 1, class weight = None, random_state = 0, solver = “warn,” max_iter = 100, multi_class = “warn,” verbose = 0, warm_start = False,

AdaBoost classifierbase_estimator = none, n_estimators = 50, learning_rate = 1.0, algorithm = “SAMME.R,”, random_state = 0

k-Nearest neighbor classifier (kNN)n_neighbors = 5, weights = “uniform,” algorithm = “auto,” leaf_size = 30, , metric = “minkowski,” metric_params = none, n_jobs = none

BP neural networkhidden_layer_sizes = (100), activation = “relu,” solver = “Adam,” alpha = 0.0001, batch_size = “auto,” learning_rate = “constant,” learning_rate_init = 0.001, power_t = 0.5, max_iter = 200, shuffle = true, random_state = 0, tol = 0.0001, verbose = false, warm_start = false, momentum = 0.9, nesterovs_momentum = True, early_stopping = false, validation_fraction = 0.1, beta_1 = 0.9, beta_2 = 0.999, epsilon = 1e-08, n_iter_no_change = 10

Gradient boosted decision tree (GBDT)loss = “deviance,” learning_rate = 0.1, n_estimators = 100, subsample = 1.0, criterion = “friedman_mse,” min_samples_split = 2, min_samples_leaf = 1, min_weight_fraction_leaf = 0.0, max_depth = 3, min_impurity_decrease = 0.0, min_impurity_split = None, init = None, random_state = 0, max_features = None, verbose = 0, max_leaf_nodes = None, warm_start = False, presort = “auto,” validation_fraction = 0.1, n_iter_no_change = None, tol = 0.0001

Support vector machine (SVM)penalty = “l2,” loss = “squared_hinge,” dual = True, tol = 0.0001, C = 6, multi_class = “ovr,” fit_intercept = True, intercept_scaling = 1, class_weight = None, verbose = 0, random_state = 0, max_iter = 1000

Random forest (RF)n_estimators = “warn,” criterion = “mse,” max_depth = None, min_samples_split = 2, min_samples_leaf = 1, min_weight_fraction_leaf = 0.0, max_features = “auto,” max_leaf_nodes = None, min_impurity_decrease = 0.0, min_impurity_split = None, bootstrap = True, oob_score = False, n_jobs = None, random_state = 0, verbose = 0, warm_start = False

LSTMtrainRate = 0.7, timeStep = 3, dropout = 0.5, epochs = 30, batchSize = 100 nodes = [32, 64, 16, 1], chooseAct = “relu”