Table of Contents Author Guidelines Submit a Manuscript
Wireless Communications and Mobile Computing
Volume 2018, Article ID 1013234, 12 pages
https://doi.org/10.1155/2018/1013234
Research Article

A Novel Technique for Speech Recognition and Visualization Based Mobile Application to Support Two-Way Communication between Deaf-Mute and Normal Peoples

1Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan
2College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia
3College of Computer and Information Systems, Al-Yamamah University, Riyadh 11512, Saudi Arabia
4Department of Computer Engineering, Umm Al-Qura University, Makkah 21421, Saudi Arabia
5Department of Mathematics, University of Engineering and Technology, Taxila 47050, Pakistan
6Department of Statistics and Finance, University of Science and Technology of China, Hefei 23026, China

Correspondence should be addressed to Kanwal Yousaf; kp.ude.alixatteu@fasuoy.lawnak

Received 15 January 2018; Accepted 17 April 2018; Published 24 May 2018

Academic Editor: Seyed M. Buhari

Copyright © 2018 Kanwal Yousaf et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. W. Tin, Z. Lin, -. Swe, and N. K. Mya, “Deaf mute or Deaf,” Asian Journal of Medical and Biological Research, vol. 3, no. 1, pp. 10–19, 2017. View at Publisher · View at Google Scholar
  2. I. W. Leigh and J. F. Andrews, Deaf People and Society: Psychological, Sociological and Educational Perspectives, Psychology Press, 2016.
  3. WHO, “Deafness and Hearing Loss,” Fact Sheet, vol. 300, 2017. View at Google Scholar
  4. J. G. Clark, “Uses and abuses of hearing loss classification,” Asha, vol. 23, no. 7, pp. 493–500, 1981. View at Google Scholar
  5. B. H. Jacobson, A. Johnson, C. Grywalski et al., “The Voice Handicap Index (VHI): development and validation,” American Journal of Speech-Language Pathology, vol. 6, no. 3, pp. 66–70, 1997. View at Google Scholar · View at Scopus
  6. P. Vostanis, M. Hayes, M. Du Feu, and J. Warren, “Detection of behavioural and emotional problems in deaf children and adolescents: Comparison of two rating scales,” Child: Care, Health and Development, vol. 23, no. 3, pp. 233–246, 1997. View at Publisher · View at Google Scholar · View at Scopus
  7. F. Soltani, F. Eskandari, and S. Golestan, “Developing a gesture-based game for deaf/mute people Using microsoft kinect,” in Proceedings of the 2012 6th International Conference on Complex, Intelligent, and Software Intensive Systems, CISIS 2012, pp. 491–495, July 2012. View at Publisher · View at Google Scholar · View at Scopus
  8. D. G. Blazer, S. Domnitz, C. T. Liverman, C. on Accessible, A. H. H. C. for Adults, E. National Academies of Sciences, and Medicine, Hearing Loss: Extent, Impact, and Research Needs. 2016.
  9. WHO, “Global costs of unaddressed hearing loss and cost-effectiveness of interventions: a WHO report, 2017, in Global costs of unaddressed hearing loss and cost-effectiveness of interventions: a WHO report,” Tech. Rep., 2017. View at Google Scholar
  10. T. Humphries, “Of Deaf-mutes, the Strange,” in Deaf World: A Historical Reader and Primary Sourcebook, 2001. View at Google Scholar
  11. List of Sign Languages, n.d.
  12. J. Gugenheimer, K. Plaumann, F. Schaub et al., “The impact of assistive technology on communication quality between deaf and hearing individuals,” in Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, CSCW 2017, pp. 669–682, March 2017. View at Publisher · View at Google Scholar · View at Scopus
  13. A. Piquard-Kipffer, O. Mella, J. Miranda, D. Jouvet, and L. Orosanu, “Qualitative investigation of the display of speech recognition results for communication with deaf people,” in Proceedings of SLPAT 2015: 6th Workshop on Speech and Language Processing for Assistive Technologies, pp. 36–41, Dresden, Germany, September 2015. View at Publisher · View at Google Scholar
  14. B. Chigier, “Automatic speech recognition,” Google Patents, 1997. View at Google Scholar
  15. J.-C. Liu, F.-Y. Leu, G.-L. Lin, and H. Susanto, “An MFCC-based text-independent speaker identification system for access control,” Concurrency Computation, vol. 30, no. 2, Article ID e4255, 2018. View at Publisher · View at Google Scholar · View at Scopus
  16. L.-S. Lee, J. Glass, H.-Y. Lee, and C.-A. Chan, “Spoken Content Retrieval - Beyond Cascading Speech Recognition with Text Retrieval,” IEEE Transactions on Audio, Speech and Language Processing, vol. 23, no. 9, pp. 1389–1420, 2015. View at Publisher · View at Google Scholar · View at Scopus
  17. R. Vergin, D. O'Shaughnessy, and A. Farhat, “Generalized mel frequency cepstral coefficients for large-vocabulary speaker-independent continuous-speech recognition,” IEEE Transactions on Audio, Speech and Language Processing, vol. 7, no. 5, pp. 525–532, 1999. View at Publisher · View at Google Scholar · View at Scopus
  18. M. Holmberg, D. Gelbart, and W. Hemmert, “Automatic speech recognition with an adaptation model motivated by auditory processing,” IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 1, pp. 43–49, 2006. View at Publisher · View at Google Scholar · View at Scopus
  19. F. S. Al-Anzi and D. AbuZeina, “The Capacity of Mel Frequency Cepstral Coefficients for Speech Recognition,” World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering, vol. 11, no. 10, pp. 1094–1098, 2017. View at Google Scholar
  20. J. L. Pray and I. K. Jordan, “The deaf community and culture at a crossroads: Issues and challenges,” Journal of Social Work in Disability and Rehabilitation, vol. 9, no. 2, pp. 168–193, 2010. View at Publisher · View at Google Scholar · View at Scopus
  21. S. Barnett, “Communication with deaf and hard-of-hearing people: A guide for medical education,” Academic Medicine: Journal of the Association of American Medical Colleges, vol. 77, no. 7, pp. 694–700, 2002. View at Publisher · View at Google Scholar · View at Scopus
  22. N. Glickman, “Cultural Identity, Deafness, and Mental Health,” Journal of Rehabilitation of the Deaf, vol. 20, no. 2, pp. 1–10, 1986. View at Google Scholar
  23. R. E. Perkins-Dock, T. R. Battle, J. M. Edgerton, and J. N. McNeill, “A Survey of Barriers to Employment for Individuals Who Are Deaf,” Journal of the American Deafness & Rehabilitation Association (JADARA), vol. 49, no. 2, 2015. View at Google Scholar
  24. L. Sirch, L. Salvador, and A. Palese, “Communication difficulties experienced by deaf male patients during their in-hospital stay: findings from a qualitative descriptive study,” Scandinavian Journal of Caring Sciences, vol. 31, no. 2, pp. 368–377, 2017. View at Publisher · View at Google Scholar · View at Scopus
  25. A. Kuenburg, P. Fellinger, and J. Fellinger, “Health Care Access Among Deaf People,” Journal of Deaf Studies and Deaf Education, vol. 21, no. 1, pp. 1–10, 2016. View at Publisher · View at Google Scholar · View at Scopus
  26. M. V. Sharma, N. V. Kumar, S. C. Masaguppi, S. Mn, and D. R. Ambika, “Virtual talk for deaf, mute, blind and normal humans,” in Proceedings of the 2013 1st Texas Instruments India Educators' Conference, TIIEC 2013, pp. 316–320, April 2013. View at Publisher · View at Google Scholar · View at Scopus
  27. K. Rojanasaroch and T. Laohapensaeng, “Communication aid device for illness deaf-mute,” in Proceedings of the 12th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, ECTI-CON 2015, June 2015. View at Publisher · View at Google Scholar · View at Scopus
  28. P. Vijayalakshmi and M. Aarthi, “Sign language to speech conversion,” in Proceedings of the 2016 International Conference on Recent Trends in Information Technology, ICRTIT 2016, April 2016. View at Publisher · View at Google Scholar · View at Scopus
  29. A. Arif, S. T. H. Rizvi, I. Jawaid, M. A. Waleed, and M. R. Shakeel, “Techno-talk: An American Sign Language (ASL) Translator,” in Proceedings of the 3rd International Conference on Control, Decision and Information Technologies, CoDIT 2016, pp. 665–670, April 2016. View at Publisher · View at Google Scholar · View at Scopus
  30. A. K. Tripathy, D. Jadhav, S. A. Barreto, D. Rasquinha, and S. S. Mathew, “Voice for the mute,” in Proceedings of the 2015 International Conference on Technologies for Sustainable Development, ICTSD 2015, February 2015. View at Publisher · View at Google Scholar · View at Scopus
  31. N. P. Nagori and V. Malode, “Communication Interface for Deaf-Mute People using Microsoft Kinect,” in Proceedings of the 1st International Conference on Automatic Control and Dynamic Optimization Techniques, ICACDOT 2016, pp. 640–644, September 2016. View at Publisher · View at Google Scholar · View at Scopus
  32. A. Sood and A. Mishra, “AAWAAZ: A communication system for deaf and dumb,” in Proceedings of the 5th International Conference on Reliability, Infocom Technologies and Optimization, ICRITO 2016, pp. 620–624, September 2016. View at Publisher · View at Google Scholar · View at Scopus
  33. M. Yousuf, Z. Mehmood, H. A. Habib et al., “A Novel Technique Based on Visual Words Fusion Analysis of Sparse Features for Effective Content-Based Image Retrieval,” Mathematical Problems in Engineering, vol. 2018, Article ID 2134395, 13 pages, 2018. View at Publisher · View at Google Scholar
  34. Z. Mehmood, S. M. Anwar, and M. Altaf, “A novel image retrieval based on rectangular spatial histograms of visual words,” Kuwait Journal of Science, vol. 45, no. 1, pp. 54–69, 2018. View at Google Scholar · View at MathSciNet
  35. Z. Mehmood, T. Mahmood, and M. A. Javid, “Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine,” Applied Intelligence, vol. 48, no. 1, pp. 166–181, 2018. View at Publisher · View at Google Scholar · View at Scopus
  36. N. Ali, K. B. Bajwa, R. Sablatnig, and Z. Mehmood, “Image retrieval by addition of spatial information based on histograms of triangular regions,” Computers & Electrical Engineering, vol. 54, pp. 539–550, 2016. View at Publisher · View at Google Scholar
  37. Z. Mehmood, S. M. Anwar, N. Ali, H. A. Habib, and M. Rashid, “A Novel image retrieval based on a combination of local and global histograms of visual words,” Mathematical Problems in Engineering, vol. 2016, Article ID 8217250, 12 pages, 2016. View at Publisher · View at Google Scholar · View at Scopus
  38. Z. Mehmood, F. Abbas, T. Mahmood, M. A. Javid, A. Rehman, and T. Nawaz, “Content-based image retrieval based on visual words fusion versus features fusion of local and global features,” Arabian Journal for Science and Engineering, pp. 1–20, 2018. View at Publisher · View at Google Scholar
  39. S. Jabeen, Z. Mehmood, T. Mahmood, T. Saba, A. Rehman, and M. T. Mahmood, “An effective content-based image retrieval technique for image visuals representation based on the bag-of-visual-words model,” PLoS ONE, vol. 13, no. 4, e0194526, 2018. View at Publisher · View at Google Scholar
  40. S. Ghanem, C. Conly, and V. Athitsos, “A Survey on Sign Language Recognition Using Smartphones,” in Proceedings of the the 10th International Conference on PErvasive Technologies Related to Assistive Environments, pp. 171–176, ACM, June 2017. View at Publisher · View at Google Scholar
  41. L.-B. Chen, C.-W. Tsai, W.-J. Chang, Y.-M. Cheng, and K. S.-M. Li, “A real-time mobile emergency assistance system for helping deaf-mute people/elderly singletons,” in Proceedings of the IEEE International Conference on Consumer Electronics, ICCE 2016, pp. 45-46, January 2016. View at Publisher · View at Google Scholar · View at Scopus
  42. R. Kamat, A. Danoji, A. Dhage, P. Puranik, and S. Sengupta, “MonVoix-An Android Application for the acoustically challenged people,” Journal of Communications Technology, Electronics and Computer Science, vol. 8, pp. 24–28, 2016. View at Publisher · View at Google Scholar
  43. G. Subhaashini, S. Divya, S. DivyaSuganya, and T. Vimal, “Ear Hear Android Application for Specially Abled Deaf People,” International Journal of Computer Science and Engineering, vol. 3, no. 3, pp. 1108–1114, 2015. View at Google Scholar
  44. D. Bragg, N. Huynh, and R. E. Ladner, “A personalizable mobile sound detector app design for deaf and hard-of-hearing users,” in Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2016, pp. 3–13, October 2016. View at Publisher · View at Google Scholar · View at Scopus
  45. M. A. M. Abushariah, “TAMEEM V1.0: speakers and text independent Arabic automatic continuous speech recognizer,” International Journal of Speech Technology, vol. 20, no. 2, pp. 261–280, 2017. View at Publisher · View at Google Scholar · View at Scopus
  46. F. Leu and G. Lin, “An MFCC-Based Speaker Identification System,” in Proceedings of the 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA), pp. 1055–1062, March 2017. View at Publisher · View at Google Scholar
  47. K. Mannepalli, P. N. Sastry, and M. Suman, “MFCC-GMM based accent recognition system for Telugu speech signals,” International Journal of Speech Technology, vol. 19, no. 1, pp. 87–93, 2016. View at Publisher · View at Google Scholar · View at Scopus
  48. S. Elouahabi, M. Atounti, and M. Bellouki, “Amazigh Isolated-Word speech recognition system using Hidden Markov Model toolkit (HTK),” in Proceedings of the International Conference on Information Technology for Organizations Development, IT4OD 2016, April 2016. View at Publisher · View at Google Scholar · View at Scopus
  49. J. P. Bigham, R. Kushalnagar, T. K. Huang, J. P. Flores, and S. Savage, “On How Deaf People Might Use Speech to Control Devices,” in Proceedings of the the 19th International ACM SIGACCESS Conference, pp. 383-384, October 2017. View at Publisher · View at Google Scholar
  50. M. Gales and S. Young, “The application of hidden Markov Models in speech recognition,” Foundations and Trends in Signal Processing, vol. 1, no. 3, pp. 195–304, 2008. View at Publisher · View at Google Scholar · View at Scopus
  51. S. J. Young and S. Young, The HTK hidden Markov model toolkit: Design and philosophy, University of Cambridge, Department of Engineering, 1993.
  52. M. Anusuya and S. K. Katti, “Speech recognition by machine, a review,” https://arxiv.org/abs/1001.2267.
  53. D. Gupta, P. Bansal, and K. Choudhary, “The State of the Art of Feature Extraction Techniques in Speech Recognition,” in Speech and Language Processing for Human-Machine Communications, pp. 195–207, Springer, 2018. View at Google Scholar
  54. W. Han, C.-F. Chan, C.-S. Choy, and K.-P. Pun, “An efficient MFCC extraction method in speech recognition,” in Proceedings of the ISCAS 2006: 2006 IEEE International Symposium on Circuits and Systems, pp. 145–148, May 2006. View at Scopus
  55. M. A. Hossan, S. Memon, and M. A. Gregory, “A novel approach for MFCC feature extraction,” in Proceedings of the 4th International Conference on Signal Processing and Communication Systems, ICSPCS'2010, December 2010. View at Publisher · View at Google Scholar · View at Scopus
  56. S. Memon, M. Lech, and L. He, “Using information theoretic vector quantization for inverted MFCC based speaker verification,” in Proceedings of the 2009 2nd International Conference on Computer, Control and Communication, IC4 2009, February 2009. View at Publisher · View at Google Scholar · View at Scopus
  57. M. R. Hasan, M. M. G. Jamil, Rabbani., and M. S. Rahman, “Speaker identification using mel frequency cepstral coefficients,” Variations, vol. 1, no. 4, 2004. View at Google Scholar