Research Article
Smartwatch-Based Legitimate User Identification for Cloud-Based Secure Services
Table 4
Statistical results for four different classifiers using accelerometer and gyroscope sensors data.
| Metric | Method | Accelerometer sensor | Gyroscope sensor | User 1 | User 2 | User 3 | User 4 | User 5 | User 6 | User 1 | User 2 | User 3 | User 4 | User 5 | User 6 |
| TPR | DT | 0.9495 | 0.9483 | 0.9005 | 0.9448 | 0.9455 | 0.9083 | 0.9540 | 0.9188 | 0.9041 | 0.9465 | 0.9401 | 0.9150 | SVM | 0.8393 | 0.8727 | 0.7996 | 0.8580 | 0.8481 | 0.8861 | 0.8805 | 0.8713 | 0.8487 | 0.9192 | 0.8756 | 0.8746 | KNN | 0.8746 | 0.8437 | 0.8646 | 0.8893 | 0.8969 | 0.8489 | 0.9183 | 0.7752 | 0.8589 | 0.8773 | 0.9157 | 0.8811 | NB | 0.6412 | 0.8111 | 0.6583 | 0.5917 | 0.6566 | 0.6361 | 0.6927 | 0.7457 | 0.6366 | 0.3963 | 0.5460 | 0.5495 |
| TNR | DT | 0.9837 | 0.9897 | 0.9882 | 0.9859 | 0.9811 | 0.9897 | 0.9786 | 0.9942 | 0.9848 | 0.9919 | 0.9770 | 0.9872 | SVM | 0.9730 | 0.9664 | 0.9632 | 0.9749 | 0.9669 | 0.9766 | 0.9648 | 0.9873 | 0.9761 | 0.9819 | 0.9687 | 0.9751 | KNN | 0.9673 | 0.9736 | 0.9722 | 0.9821 | 0.9714 | 0.9745 | 0.9646 | 0.9906 | 0.9767 | 0.9839 | 0.9555 | 0.9677 | NB | 0.9197 | 0.9400 | 0.9198 | 0.9258 | 0.9464 | 0.9455 | 0.8888 | 0.9354 | 0.9037 | 0.9105 | 0.8909 | 0.9570 |
| FPR | DT | 0.0505 | 0.0517 | 0.0995 | 0.0552 | 0.0546 | 0.0918 | 0.0459 | 0.0812 | 0.0959 | 0.0535 | 0.0599 | 0.0849 | SVM | 0.1607 | 0.1273 | 0.2004 | 0.1419 | 0.1519 | 0.1139 | 0.1195 | 0.1287 | 0.1513 | 0.0808 | 0.1244 | 0.1254 | KNN | 0.1254 | 0.1563 | 0.1354 | 0.1107 | 0.1030 | 0.1511 | 0.0817 | 0.2248 | 0.1411 | 0.1227 | 0.0843 | 0.1189 | NB | 0.3588 | 0.1889 | 0.3417 | 0.4084 | 0.3434 | 0.3639 | 0.3072 | 0.2543 | 0.3634 | 0.6037 | 0.4539 | 0.4505 |
| FNR | DT | 0.0164 | 0.0104 | 0.0119 | 0.0141 | 0.0189 | 0.0103 | 0.0214 | 0.0057 | 0.0152 | 0.0081 | 0.0229 | 0.0128 | SVM | 0.0269 | 0.0336 | 0.0368 | 0.0250 | 0.0330 | 0.0234 | 0.0352 | 0.0127 | 0.0239 | 0.0181 | 0.0313 | 0.0248 | KNN | 0.0326 | 0.0263 | 0.0278 | 0.0178 | 0.0286 | 0.0255 | 0.0354 | 0.0094 | 0.0234 | 0.0161 | 0.0445 | 0.0323 | NB | 0.0803 | 0.0599 | 0.0802 | 0.0741 | 0.0536 | 0.0545 | 0.1112 | 0.0647 | 0.0963 | 0.0895 | 0.1091 | 0.0429 |
| PPV | DT | 0.9495 | 0.9483 | 0.9005 | 0.9448 | 0.9455 | 0.9082 | 0.9541 | 0.9188 | 0.9041 | 0.9465 | 0.9401 | 0.9150 | SVM | 0.8393 | 0.8727 | 0.7996 | 0.8580 | 0.8481 | 0.8861 | 0.8805 | 0.8713 | 0.8487 | 0.9192 | 0.8756 | 0.8746 | KNN | 0.8746 | 0.8437 | 0.8646 | 0.8893 | 0.8969 | 0.8489 | 0.9183 | 0.7752 | 0.8589 | 0.8773 | 0.9157 | 0.8811 | NB | 0.6412 | 0.8111 | 0.6582 | 0.5916 | 0.6566 | 0.6361 | 0.6928 | 0.7457 | 0.6366 | 0.3963 | 0.5460 | 0.5495 |
| NPV | DT | 0.9837 | 0.9896 | 0.9881 | 0.9859 | 0.9811 | 0.9897 | 0.9786 | 0.9942 | 0.9848 | 0.9919 | 0.9770 | 0.9872 | SVM | 0.9730 | 0.9664 | 0.9632 | 0.9749 | 0.9669 | 0.9765 | 0.9648 | 0.9873 | 0.9761 | 0.9819 | 0.9687 | 0.9751 | KNN | 0.9673 | 0.9737 | 0.9722 | 0.9821 | 0.9714 | 0.9745 | 0.9646 | 0.9906 | 0.9767 | 0.9839 | 0.9555 | 0.9677 | NB | 0.91975 | 0.9400 | 0.9198 | 0.9259 | 0.94643 | 0.9455 | 0.8888 | 0.9353 | 0.9037 | 0.9105 | 0.8909 | 0.9570 |
| SEN | DT | 0.9189 | 0.9498 | 0.9426 | 0.9283 | 0.8900 | 0.9529 | 0.8605 | 0.9742 | 0.9297 | 0.9588 | 0.8749 | 0.9447 | SVM | 0.8544 | 0.8374 | 0.8239 | 0.8777 | 0.8113 | 0.8936 | 0.8212 | 0.9400 | 0.8775 | 0.9064 | 0.8185 | 0.8935 | KNN | 0.8323 | 0.8754 | 0.8632 | 0.9047 | 0.8293 | 0.8931 | 0.8095 | 0.9559 | 0.8849 | 0.9195 | 0.7488 | 0.8565 | NB | 0.5606 | 0.7015 | 0.5766 | 0.6028 | 0.7495 | 0.7624 | 0.3432 | 0.6759 | 0.5148 | 0.5984 | 0.3603 | 0.8315 |
| SPE | DT | 0.9901 | 0.9893 | 0.9787 | 0.9893 | 0.9911 | 0.9791 | 0.9936 | 0.9811 | 0.9788 | 0.9893 | 0.9896 | 0.9799 | SVM | 0.9698 | 0.9745 | 0.9571 | 0.9704 | 0.9744 | 0.9747 | 0.9778 | 0.9712 | 0.9697 | 0.9846 | 0.9797 | 0.9702 | KNN | 0.9765 | 0.9660 | 0.9725 | 0.9789 | 0.9838 | 0.9625 | 0.9863 | 0.9439 | 0.9708 | 0.9745 | 0.9874 | 0.9738 | NB | 0.9413 | 0.9662 | 0.9419 | 0.9226 | 0.9185 | 0.9043 | 0.9718 | 0.9531 | 0.9394 | 0.8176 | 0.9458 | 0.8463 |
| FDR | DT | 0.0505 | 0.0517 | 0.0995 | 0.0552 | 0.0545 | 0.0918 | 0.0459 | 0.0812 | 0.0959 | 0.05349 | 0.0599 | 0.0849 | SVM | 0.1607 | 0.1273 | 0.2004 | 0.1419 | 0.1519 | 0.1139 | 0.1195 | 0.1287 | 0.1513 | 0.0808 | 0.1244 | 0.1254 | KNN | 0.1254 | 0.1563 | 0.1354 | 0.1107 | 0.1030 | 0.1511 | 0.0817 | 0.2248 | 0.1411 | 0.1227 | 0.0843 | 0.1189 | NB | 0.3588 | 0.1889 | 0.3417 | 0.4084 | 0.3434 | 0.3639 | 0.3072 | 0.2543 | 0.3634 | 0.6037 | 0.4539 | 0.4505 |
| FOR | DT | 0.0163 | 0.0104 | 0.0119 | 0.0142 | 0.0189 | 0.0103 | 0.0214 | 0.0057 | 0.0152 | 0.0081 | 0.0229 | 0.0128 | SVM | 0.0269 | 0.0336 | 0.0368 | 0.0250 | 0.0330 | 0.0234 | 0.0352 | 0.0127 | 0.0239 | 0.0181 | 0.0313 | 0.02486 | KNN | 0.0327 | 0.0263 | 0.0278 | 0.0179 | 0.0286 | 0.0255 | 0.0354 | 0.0094 | 0.0233 | 0.0161 | 0.0445 | 0.0323 | NB | 0.0803 | 0.0599 | 0.0802 | 0.0741 | 0.0536 | 0.0545 | 0.1112 | 0.0647 | 0.0963 | 0.0895 | 0.1091 | 0.0429 |
| ACC | DT | 0.9781 | 0.9826 | 0.9725 | 0.9792 | 0.9762 | 0.9744 | 0.9756 | 0.9798 | 0.97007 | 0.9843 | 0.9716 | 0.9733 | SVM | 0.9518 | 0.9509 | 0.9342 | 0.9547 | 0.9499 | 0.9601 | 0.9517 | 0.9658 | 0.9547 | 0.9719 | 0.9558 | 0.9558 | KNN | 0.9528 | 0.9503 | 0.9540 | 0.9672 | 0.9614 | 0.9492 | 0.9581 | 0.9459 | 0.9564 | 0.9655 | 0.9504 | 0.9522 | NB | 0.8814 | 0.9209 | 0.8826 | 0.8724 | 0.8894 | 0.8787 | 0.8737 | 0.9063 | 0.8668 | 0.7811 | 0.8561 | 0.8436 |
|
|