| Fold | HN | LRRBM | n | ni | LR | Nb | Search direction |
| 1 | Linear (−) | Concave | Linear (−) | Linear (+) | Linear (−) | Linear (+) | Increase HN, N, LR, and fix LRRBM, ni, Nbat min. MAE | 2 | Convex | Linear (+) | Linear (−) | Linear (+) | Linear (−) | Linear (+) | Increase N, LR, and fix HN, LRRBM, ni, Nbat min. MAE | 3 | Linear (−) | Linear (−) | Linear (−) | Linear (+) | Linear (−) | Linear (+) | Increase HN, LRRBM, N, LR, and fix ni, Nbat min. MAE | 4 | Linear (−) | Linear (−) | Linear (−) | Linear (−) | Linear (−) | Linear (+) | Increase HN, LRRBM, N, ni, LR, and fix, Nbat min. MAE | 5 | Linear (+) | Linear (−) | Linear (−) | Linear (−) | Linear (−) | Linear (+) | Increase LRRBM, N, ni, LR, and fix HN, Nbat min. MAE | 6 | Linear (−) | Linear (+) | Linear (−) | Linear (−) | Linear (−) | Linear (+) | Increase HN, N, ni, LR, and fix LRRBM, Nbat min. MAE | 8 | Linear (−) | Convex | Linear (−) | Convex | Linear (−) | Concave | Increase HN, N, LR, and fix LRRBM, ni, Nbat min. MAE | 9 | Linear (−) | Linear (−) | Linear (−) | Linear (+) | Linear (−) | Linear (+) | Increase HN, LRRBM, N, LR, and fix ni, Nbat min. MAE | 10 | Linear (+) | Linear (+) | Linear (−) | Linear (+) | Linear (−) | Linear (+) | Increase N, LR, and fix HN, LRRBM, ni, Nbat min. MAE |
|
|