Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2013 (2013), Article ID 898714, 7 pages
http://dx.doi.org/10.1155/2013/898714
Research Article

Identification of Code-Switched Sentences and Words Using Language Modeling Approaches

1Department of Information Management, Yuan Ze University, 135 Yuan-Tung Road, Chung-Li 32003, Taiwan
2Information Technology Center, National Taiwan Normal University, 162 Heping East Road, Section 1, Taipei 10610, Taiwan

Received 3 May 2013; Revised 22 July 2013; Accepted 19 August 2013

Academic Editor: Orwa Jaber Housheya

Copyright © 2013 Liang-Chih Yu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. P. Fung and T. Schultz, “Multilingual spoken language processing,” IEEE Signal Processing Magazine, vol. 25, no. 3, pp. 89–97, 2008. View at Publisher · View at Google Scholar · View at Scopus
  2. D. Hymes, “The ethnography in speaking,” in Anthropology and Man Behaviour, T. Gladwin and W. C. Sturtevant, Eds., Anthropology Society of Washington, Washington, DC, USA, 1962. View at Google Scholar
  3. C. Hoffmann, An Introduction to Bilingualism, Longman, London, UK, 1991.
  4. C. Myers-Scotton, Social Motivations for Code Switching: Evidence from Africa, Oxford University Press, New York, NY, USA, 1993.
  5. M. O. Ayeomoni, “Code-switching and code-mixing: style of language use in childhood in yoruba speech community,” Nordic Journal of African Studies, vol. 15, no. 1, pp. 90–99, 2006. View at Google Scholar
  6. Y. Liu, “Evaluation of the matrix language hypothesis: evidence from Chinese-English code-switching phenomena in blogs,” Journal of Chinese Language and Computing, vol. 18, no. 2, pp. 75–92, 2008. View at Google Scholar
  7. I. Ipsic, N. Pavesic, F. Mihelic, and E. Noth, “Multilingual spoken dialog system,” in Proceedings of the IEEE International Symposium on Industrial Electronics (ISIE '99), pp. 183–187, Bled, Slovenia, July 1999. View at Scopus
  8. H. Holzapfel, “Building multilingual spoken dialogue systems,” Archives of Control Sciences, vol. 15, no. 4, pp. 555–566, 2005. View at Google Scholar
  9. D. C. Lyu, C. N. Hsu, Y. C. Chiang, and R. Y. Lyu, “Acoustic model optimization for multilingual speech recognition,” International Journal of Computational Linguistics and Chinese Language Processing, vol. 13, no. 3, pp. 363–386, 2008. View at Google Scholar
  10. C.-H. Wu, Y.-H. Chiu, C.-J. Shia, and C.-Y. Lin, “Automatic segmentation and identification of mixed-language speech using delta-BIC and LSA-based GMMs,” IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 1, pp. 266–275, 2006. View at Publisher · View at Google Scholar · View at Scopus
  11. J. Y. C. Chan, P. C. Ching, T. Lee, and H. Cao, “Automatic speech recognition of Cantonese-English code-mixing utterances,” in Proceedings of the INTERSPEECH and 9th International Conference on Spoken Language Processing (INTERSPEECH—ICSLP '06), pp. 113–116, Pittsburgh, Pa, USA, September 2006. View at Scopus
  12. W. T. Hong, H. C. Chen, I. B. Liao, and W. J. Wang, “Mandarin/English mixed-lingual speech recognition system on resource-constrained platforms,” in Proceedings of the 21st Conference on Computational Linguistics and Speech Processing (ROCLING '09), pp. 237–250, Taichung, Taiwan, September 2009.
  13. B. H. A. Ahmed and T. P. Tan, “Automatic speech recognition of code switching speech using 1-best rescoring,” in Proceedings of the International Conference on Asian Language Processing (IALP '12), pp. 137–140, Hanoi, Vietnam, November 2012. View at Publisher · View at Google Scholar
  14. N. T. Vu, D. C. Lyu, J. Weiner et al., “A first speech recognition system for Mandarin-English code-switch conversational speech,” in Proceedings of the 37th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '12), pp. 4889–4892, Kyoto, Japan, March 2012.
  15. D.-C. Lyu, C.-L. Zhu, R.-Y. Lyu, and M.-T. Ko, “Language identification in code-switching speech usingword-based lexical model,” in Proceedings of the 7th International Symposium on Chinese Spoken Language Processing (ISCSLP '10), pp. 460–464, Tainan, Taiwan, December 2010. View at Publisher · View at Google Scholar · View at Scopus
  16. Y.-L. Yeong and T.-P. Tan, “Applying grapheme, word, and syllable information for language identification in code switching sentences,” in Proceedings of the International Conference on Asian Language Processing (IALP '11), pp. 111–114, Penang, Malaysia, November 2011. View at Publisher · View at Google Scholar · View at Scopus
  17. Y. Qian, H. Liang, and F. Soong, “A cross-language state sharing and mapping approach to bilingual (Mandarin-English) TTS,” IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 6, pp. 1231–1239, 2009. View at Publisher · View at Google Scholar
  18. H.-P. Shen, C.-H. Wu, Y.-T. Yang, and C.-S. Hsu, “CECOS: a Chinese-English code-switching speech database,” in Proceedings of the International Conference on Speech Database and Assessments (Oriental COCOSDA '11), pp. 120–123, Hsinchu, Taiwan, October 2011. View at Publisher · View at Google Scholar · View at Scopus
  19. Y. Seki, N. Kando, and M. Aono, “Multilingual opinion holder identification using author and authority viewpoints,” Information Processing and Management, vol. 45, no. 2, pp. 189–199, 2009. View at Publisher · View at Google Scholar · View at Scopus
  20. H.-C. Yang, H.-W. Hsiao, and C.-H. Lee, “Multilingual document mining and navigation using self-organizing maps,” Information Processing and Management, vol. 47, no. 5, pp. 647–666, 2011. View at Publisher · View at Google Scholar · View at Scopus
  21. Y. Zhang, F. S. Tsai, and A. T. Kwee, “Multilingual sentence categorization and novelty mining,” Information Processing and Management, vol. 47, no. 5, pp. 667–675, 2011. View at Publisher · View at Google Scholar · View at Scopus
  22. C. de Pablo-Sánchez, I. Segura-Bedmar, P. Martínez, and A. Iglesias-Maqueda, “Lightly supervised acquisition of named entities and linguistic patterns for multilingual text mining,” Knowledge and Information Systems, vol. 35, no. 1, pp. 87–109, 2013. View at Google Scholar
  23. F. C. Gey, N. Kando, and C. Peters, “Cross-language information retrieval: the way ahead,” Information Processing and Management, vol. 41, no. 3, pp. 415–431, 2005. View at Publisher · View at Google Scholar · View at Scopus
  24. M.-F. Tsai, H.-H. Chen, and Y.-T. Wang, “Learning a merge model for multilingual information retrieval,” Information Processing and Management, vol. 47, no. 5, pp. 635–646, 2011. View at Publisher · View at Google Scholar · View at Scopus
  25. J. J. Jung, “Cross-lingual query expansion in multilingual folksonomies: a case study on flickr,” Knowledge-Based Systems, vol. 42, pp. 60–67, 2013. View at Google Scholar
  26. A. Segev and A. Gal, “Enhancing portability with multilingual ontology-based knowledge management,” Decision Support Systems, vol. 45, no. 3, pp. 567–584, 2008. View at Publisher · View at Google Scholar · View at Scopus
  27. Y. L. Wu, C. W. Hsieh, W. H. Lin, C. Y. Liu, and L. C. Yu, “Unknown word extraction from multilingual code-switching sentences,” in Proceedings of the 23rd Conference on Computational Linguistics and Speech Processing (ROCLING '11), pp. 349–360, Taipei, Taiwan, September 2011.
  28. C.-H. Wu, C.-H. Liu, M. Harris, and L.-C. Yu, “Sentence correction incorporating relative position and parse template language models,” IEEE Transactions on Audio, Speech and Language Processing, vol. 18, no. 6, pp. 1170–1181, 2010. View at Publisher · View at Google Scholar · View at Scopus
  29. L. C. Yu, W. C. He, and W. N. Chien, “A language modeling approach to identifying code-switched sentences and words,” in Proceedings of the 2nd CIPS-SIGHAN Joint Conference on Chinese Language Processing (CLP '12), pp. 3–8, Tianjin, China, December 2012.
  30. L.-C. Yu, C.-H. Wu, R.-Y. Chang, C.-H. Liu, and E. Hovy, “Annotation and verification of sense pools in OntoNotes,” Information Processing and Management, vol. 46, no. 4, pp. 436–447, 2010. View at Publisher · View at Google Scholar · View at Scopus
  31. A. Islam and D. Inkpen, “Near-synonym choice using a 5-gram language model,” Research in Computing Science:, vol. 46, pp. 41–52, 2010. View at Google Scholar
  32. L. C. Yu and W. N. Chien, “Independent component analysis for near-synonym choice,” Decision Support Systems, vol. 55, no. 1, pp. 146–155, 2013. View at Publisher · View at Google Scholar
  33. W. Y. Ma and K. J. Chen, “Introduction to CKIP Chinese word segmentation system for the first international Chinese word segmentation bakeoff,” in Proceedings of the 2nd ACL SIGHAN Workshop on Chinese Language Processing (CLP '03), pp. 168–171, Sapporo, Japan, July 2003.
  34. W. Y. Ma and K. J. Chen, “A Bottom-up merging algorithm for Chinese unknown word extraction,” in Proceedings of the 2nd ACL SIGHAN Workshop on Chinese Language Processing (CLP '03), pp. 31–38, Sapporo, Japan, July 2003.
  35. A. Stolcke, “SRILM—an extensible language modeling toolkit,” in Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP '02), pp. 901–904, Denver, Colo, USA, September 2002.