Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm

Abstract

We propose a new multistage procedure for a real-time brain-machine/computer interface (BCI). The developed system allows a BCI user to navigate a small car (or any other object) on the computer screen in real time, in any of the four directions, and to stop it if necessary. Extensive experiments with five young healthy subjects confirmed the high performance of the proposed online BCI system. The modular structure, high speed, and the optimal frequency band characteristics of the BCI platform are features which allow an extension to a substantially higher number of commands in the near future.

References

1. N. Birbaumer, A. Kubler, and N. Ghanayim et al., “The thought translation device (TTD) for completely paralyzed patients,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 190–193, 2000. View at: Publisher Site | Google Scholar
2. J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, “Brain-computer interfaces for communication and control,” Clinical Neurophysiology, vol. 113, no. 6, pp. 767–791, 2002. View at: Publisher Site | Google Scholar
3. G. Pfurtscheller, C. Neuper, and C. Guger et al., “Current trends in Graz brain-computer interface (BCI) research,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 216–219, 2000. View at: Publisher Site | Google Scholar
4. G. R. Müller-Putz, R. Scherer, C. Brauneis, and G. Pfurtscheller, “Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components,” Journal of Neural Engineering, vol. 2, no. 4, pp. 123–130, 2005. View at: Publisher Site | Google Scholar
5. H. Lee, A. Cichocki, and S. Choi, “Nonnegative matrix factorization for motor imagery EEG classification,” in Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN '06), vol. 4132 of Lecture Notes in Computer Science, pp. 250–259, Springer, Athens, Greece, September 2006. View at: Publisher Site | Google Scholar
6. M. Middendorf, G. McMillan, G. Calhoun, and K. S. Jones, “Brain-computer interfaces based on the steady-state visual-evoked response,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 2, pp. 211–214, 2000. View at: Publisher Site | Google Scholar
7. L. J. Trejo, R. Rosipal, and B. Matthews, “Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, pp. 225–229, 2006. View at: Publisher Site | Google Scholar
8. M. Cheng, X. Gao, S. Gao, and D. Xu, “Design and implementation of a brain-computer interface with high transfer rates,” IEEE Transactions on Biomedical Engineering, vol. 49, no. 10, pp. 1181–1186, 2002. View at: Publisher Site | Google Scholar
9. S. P. Kelly, E. C. Lalor, R. B. Reilly, and J. J. Foxe, “Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 13, no. 2, pp. 172–178, 2005. View at: Publisher Site | Google Scholar
10. A. Materka and M. Byczuk, “Using comb filter to enhance SSVEP for BCI applications,” in Proceedings of the 3rd International Conference on Advances in Medical, Signal and Information Processing (MEDSIP '06), p. 33, Glasgow, UK, July 2006. View at: Publisher Site | Google Scholar
11. Z. Lin, C. Zhang, W. Wu, and X. Gao, “Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs,” IEEE Transactions on Biomedical Engineering, vol. 53, no. 12, part 2, pp. 2610–2614, 2006. View at: Publisher Site | Google Scholar
12. O. Friman, I. Volosyak, and A. Gräser, “Multiple channel detection of steady-state visual evoked potentials for brain-computer interfaces,” IEEE Transactions on Biomedical Engineering, vol. 54, no. 4, pp. 742–750, 2007. View at: Publisher Site | Google Scholar
13. E. C. Lalor, S. P. Kelly, and C. Finucane et al., “Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment,” EURASIP Journal on Applied Signal Processing, vol. 2005, no. 19, pp. 3156–3164, 2005. View at: Publisher Site | Google Scholar
14. L. Piccini, S. Parini, L. Maggi, and G. Andreoni, “A wearable home BCI system: preliminary results with SSVEP protocol,” in Proceedings of the 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '05), pp. 5384–5387, Shanghai, China, September 2005. View at: Publisher Site | Google Scholar
15. Y. Wang, R. Wang, X. Gao, B. Hong, and S. Gao, “A practical VEP-based brain-computer interface,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, pp. 234–240, 2006. View at: Publisher Site | Google Scholar
16. K. D. Nielsen, A. F. Cabrera, and O. F. do Nascimento, “EEG based BCI-towards a better control. Brain-computer interface research at Aalborg university,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, pp. 202–204, 2006. View at: Publisher Site | Google Scholar
17. V. Jaganathan, T. M. S. Mukesh, and M. R. Reddy, “Design and implementation of high performance visual stimulator for brain computer interfaces,” in Proceedings of the 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '05), pp. 5381–5383, Shanghai, China, September 2005. View at: Publisher Site | Google Scholar
18. X. Gao, D. Xu, M. Cheng, and S. Gao, “A BCI-based environmental controller for the motion-disabled,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 11, no. 2, pp. 137–140, 2003. View at: Publisher Site | Google Scholar
19. E. Niedermeyer and F. L. Lopes da Silva, Electroencephalography: Basic Principles, Clinical Applications and Related Fields, chapter 54, Lippincott Williams & Wilkins, Philadelphia, Pa, USA, 1982. View at: Google Scholar
20. F. Beverina, G. Palmas, S. Silvoni, F. Piccione, and S. Giove, “User adaptive BCIs: SSVEP and P300 based interfaces,” PsychNology Journal, vol. 1, no. 4, pp. 331–354, 2003. View at: Google Scholar
21. J.-S. R. Jang, “ANFIS: adaptive-network-based fuzzy inference system,” IEEE Transactions on Systems, Man and Cybernetics, vol. 23, no. 3, pp. 665–685, 1993. View at: Publisher Site | Google Scholar
22. A. Cichocki and S. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications, John Wiley & Sons, Chichester, UK, 2003. View at: Google Scholar
23. A. Savitzky and M. J. E. Golay, “Smoothing and differentiation of data by simplified least squares procedures,” Analytical Chemistry, vol. 36, no. 8, pp. 1627–1639, 1964. View at: Publisher Site | Google Scholar
24. M. M. Müller and S. Hillyard, “Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention,” Clinical Neurophysiology, vol. 111, no. 9, pp. 1544–1552, 2000. View at: Publisher Site | Google Scholar

Copyright

Copyright © 2007 Pablo Martinez et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.