Review Article

Exploring Sign Language Detection on Smartphones: A Systematic Review of Machine and Deep Learning Approaches

Table 6

Techniques of sign language recognition using deep learning.

StudyYearTechniquesEvaluation metric

[153]2023DeepVision transformersAccuracy, precision
[154]20238-Layer CNNAccuracy
[155]2023KNNAccuracy
[161]2023Attention-based Bi-LSTMAccuracy
[150]2023Deep learning (DL) combined with CNN and RNNAccuracy
[147]2023DNNAccuracy with [email protected]
[146]2022CNNAccuracy
[144]2022SVMAccuracy
[143]2022Inaudible acoustic signal to estimate channel information and capture the sign language in real timeAccuracy
[162]2022Hybrid convolutional neural network + bidirectional long short-term memory (CNN + Bi-LSTM)Peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), Fréchet inception distance (FID), temporal consistency metric (TCM)
[163]20223D convolution netAccuracy
[156]2022CNNAccuracy
[157]2022CNN, DCGANAccuracy
[164]2022VGG-19PSNR, SSIM, FID, TCM
[141]2021SVMAccuracy, precision, recall, F1 score
[158]2021CNNAccuracy
[159]20213DCNNAccuracy
[160]2021CNN, RNNAccuracy
[139]2021Spyder, TensorFlow, OpenCV, KerasAccuracy
[140]2021KNNAccuracy
[142]20212D CNN, SVD, and LSTMTime recognition, accuracy
[125]20203D CNN Siamese networkAccuracy
[131]2020Conv3DSentence error rate (SER), accuracy
[122]2020ResNet-D modelAccuracy, time
[134]2020CNNAccuracy, precision, recall, F1 score
[135]2020Hidden Markov model (HMM)Accuracy
[123]2020CNN-LSTM-HMMAccuracy
[136]2020CNNAccuracy
[126]2020CNNAccuracy
[130]2020Stochastic multistate (SMS)WER
[124]2020CNN LSTMAccuracy, precision, recall, F1 measure
[116]2019CNNNA
[99]20193D-ResNet, CTCWER
[97]2019Visual Geometry Group (VGG)-16, VGG-19Accuracy
[94]2019CNNAccuracy
[93]2019Convolutional-based attention module (CBAM)-ResNetAccuracy
[86]2019Neural network and QuadroConvPoolNetAccuracy
[95]2019MLP, SVM, and CNNAccuracy
[106]2019ANN, SVM, HMMAccuracy
[117]2019CNNAccuracy
[114]2019CNN, LSTMAccuracy
[118]2019VGG-19Recognition rate
[100]2019K-means clusteringAccuracy
[96]2019Inception v3, MobileNetPrecision, recall, F1 score, accuracy
[107]2019LSTMAccuracy
[108]2019ResNet50-BiLSTM, MobileNetV2-BiLSTMPrecision, recall, F1 score, accuracy
[98]2019Deep feedforward neural networkAccuracy
[113]2019CNNPrecision, recall, F1 score, accuracy
[88]2019WebGL, SiGML, CoreNLPRecognition rate
[112]2019CNNAccuracy
[92]20193DCNNAccuracy
[89]2019CNNPrecision, recall, F1 score, accuracy
[71]2018SVM, KNN, CNN, ANNSuccess rate
[72]2018LSTM and VGG-16Accuracy
[73]2018CNNAccuracy
[77]2018CNNAccuracy
[80]2018CNNAccuracy
[85]2018Adaptive graph matchingAccuracy, TWRF, FWRF
[81]2018Restricted Boltzmann machineTop-1 accuracy, Top-5 accuracy
[78]2018Inception v3Accuracy
[69]2018RNNAccuracy
[76]2018LSTMAccuracy
[68]2017Dynamic vision sensor, CNN, RNNAccuracy
[64]20173D signing avatar, Blender animation softwareAccuracy
[58]2017Nearest neighborAccuracy
[63]2017CNNAccuracy
[59]2017Finite Legendre transform, linear discriminant analysis, KNNAccuracy
[55]2017LSTMAccuracy
[65]2017CNNAccuracy
[48]2016CNNTop-1 accuracy, Top-5 accuracy
[47]2016Hybrid-CNN HMMAccuracy
[3]2016Correlation classification algorithmAccuracy, precision, recall
[44]2016CNNAccuracy
[46]2016SVMAccuracy
[54]2016Maximum a posteriori (MAP)Accuracy
[43]2015Leap Motion TechnologyAccuracy
[36]2015CNNAccuracy
[34]2014ANN, vision-basedAccuracy, MSE
[31]2014A skin and motion detector, hand detection using multiple proposals, chains modelAccuracy
[29]2014KNN, cross-correlationAccuracy
[30]2014Deep belief networkPrecision, recall
[32]2014MicrocontrollerPrecision, recall
[27]2013K-nearest neighborAccuracy
[25]2012Multilayer perceptronMean, standard deviation, aspect ratio hand cropping algorithm (ARHCA), no ARHCA