Brain-Computer Interfaces: Towards Practical Implementations and Potential ApplicationsView this Special Issue
Research Article | Open Access
Robert Leeb, Doron Friedman, Gernot R. Müller-Putz, Reinhold Scherer, Mel Slater, Gert Pfurtscheller, "Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic", Computational Intelligence and Neuroscience, vol. 2007, Article ID 079642, 8 pages, 2007. https://doi.org/10.1155/2007/79642
Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic
The aim of the present study was to demonstrate for the first time that brain waves can be used by a tetraplegic to control movements of his wheelchair in virtual reality (VR). In this case study, the spinal cord injured (SCI) subject was able to generate bursts of beta oscillations in the electroencephalogram (EEG) by imagination of movements of his paralyzed feet. These beta oscillations were used for a self-paced (asynchronous) brain-computer interface (BCI) control based on a single bipolar EEG recording. The subject was placed inside a virtual street populated with avatars. The task was to “go” from avatar to avatar towards the end of the street, but to stop at each avatar and talk to them. In average, the participant was able to successfully perform this asynchronous experiment with a performance of 90%, single runs up to 100%.
- M. K. Holden, “Virtual environments for motor rehabilitation: review,” Cyberpsychology & Behavior, vol. 8, no. 3, pp. 187–211, 2005.
- J. Broeren and O. Scott, “Commentary on Holden, M. K., virtual environments for motor rehabilitation: review,” CyberPsychology & Behavior, vol. 8, no. 3, pp. 212–219, 2005.
- D. Jack, R. Boian, A. S. Merians et al., “Virtual reality-enhanced stroke rehabilitation,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 9, no. 3, pp. 308–318, 2001.
- M. Girone, G. Burdea, M. Bouzit, V. Popescu, and J. E. Deutsch, “Orthopedic rehabilitation using the “rutgers ankle” interface,” Studies in Health Technology and Informatics, vol. 70, pp. 89–95, 2000.
- J. S. Webster, P. T. McFarland, L. J. Rapport, B. Morrill, L. A. Roades, and P. S. Abadee, “Computer-assisted training for improving wheelchair mobility in unilateral neglect patients,” Archives of Physical Medicine and Rehabilitation, vol. 82, no. 6, pp. 769–775, 2001.
- R. V. Kenyon and M. B. Afenya, “Training in virtual and real environments,” Annals of Biomedical Engineering, vol. 23, no. 4, pp. 445–455, 1995.
- F. D. Rose, E. A. Attree, B. M. Brooks et al., “Training in virtual environments: transfer to real world tasks and equivalence to real task training,” Ergonomics, vol. 43, no. 4, pp. 494–511, 2000.
- E. Todorov, R. Shadmehr, and E. Bizzi, “Augmented feedback presented in a virtual environment accelerates learning of a difficult motor task,” Journal of Motor Behavior, vol. 29, no. 2, pp. 147–158, 1997.
- F. D. Rose, B. M. Brooks, and A. A. Rizzo, “Virtual reality in brain damage rehabilitation: review,” Cyberpsychology & Behavior, vol. 8, no. 3, pp. 241–262, 2005.
- N. Foreman and J. Stirk, “Commentary on Rose, F. D., Brooks, B. M. & Rizzo, A. A., virtual reality in brain damage rehabilitation: review,” CyberPsychology & Behavior, vol. 8, no. 3, pp. 263–271, 2005.
- G. Pfurtscheller and C. Neuper, “Motor imagery and direct brain-computer communication,” Proceedings of the IEEE, vol. 89, no. 7, pp. 1123–1134, 2001.
- J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, “Brain-computer interfaces for communication and control,” Clinical Neurophysiology, vol. 113, no. 6, pp. 767–791, 2002.
- E. C. Lalor, S. P. Kelly, C. Finucane et al., “Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment,” EURASIP Journal on Applied Signal Processing, vol. 2005, no. 19, pp. 3156–3164, 2005.
- J. D. Bayliss, “Use of the evoked potential P3 component for control in a virtual apartment,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 11, no. 2, pp. 113–116, 2003.
- R. Leeb, C. Keinrath, D. Friedman et al., “Walking by thinking: the brainwaves are crucial, not the muscles!,” Presence: Teleoperators and Virtual Environments, vol. 15, no. 5, pp. 500–514, 2006.
- G. Pfurtscheller, R. Leeb, C. Keinrath et al., “Walking from thought,” Brain Research, vol. 1071, no. 1, pp. 145–152, 2006.
- J. F. Borisoff, S. G. Mason, A. Bashashati, and G. E. Birch, “Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch,” IEEE Transactions on Biomedical Engineering, vol. 51, no. 6, pp. 985–992, 2004.
- S. G. Mason, J. Kronegg, J. E. Huggins, M. Fatourechi, and A. Schlögl, “Evaluating the performance of self-paced brain-computer interface technology,” Tech. Rep., Brain-Interface Laboratory, Neil Squire Society, Vancouver, Canada, 2006, http://www.bci-info.org/.
- J. R. Millán and J. Mouriño, “Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 11, no. 2, pp. 159–161, 2003.
- G. R. Müller-Putz, R. Scherer, G. Pfurtscheller, and R. Rupp, “EEG-based neuroprosthesis control: a step towards clinical practice,” Neuroscience Letters, vol. 382, no. 1-2, pp. 169–174, 2005.
- R. Scherer, G. R. Müller-Putz, C. Neuper, B. Graimann, and G. Pfurtscheller, “An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate,” IEEE Transactions on Biomedical Engineering, vol. 51, no. 6, pp. 979–984, 2004.
- G. Townsend, B. Graimann, and G. Pfurtscheller, “Continuous EEG classification during motor imagery-simulation of an asynchronous BCI,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 12, no. 2, pp. 258–265, 2004.
- G. Pfurtscheller, C. Guger, G. R. Müller-Putz, G. Krausz, and C. Neuper, “Brain oscillations control hand orthosis in a tetraplegic,” Neuroscience Letters, vol. 292, no. 3, pp. 211–214, 2000.
- G. R. Müller-Putz, R. Scherer, G. Pfurtscheller, and R. Rupp, “Brain-computer interfaces for control of neuroprostheses: from synchronous to asynchronous mode of operation,” Biomedizinische Technik, vol. 51, no. 2, pp. 57–63, 2006.
- G. Pfurtscheller, G. R. Müller-Putz, J. Pfurtscheller, H. J. Gerner, and R. Rupp, “‘Thought’—control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia,” Neuroscience Letters, vol. 351, no. 1, pp. 33–36, 2003.
- H. H. Jasper, “The ten-twenty electrode system of the international federation,” Electroencephalography and Clinical Neurophysiology, vol. 10, no. 2, pp. 370–375, 1958.
- G. Pfurtscheller, G. R. Müller-Putz, A. Schlögl et al., “15 years of BCI research at Graz university of technology: current projects,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 14, no. 2, pp. 205–210, 2006.
- rtsBCI, “Graz brain-computer interface real-time open source package,” http://sourceforge.net/projects/biosig/, 2004-2007.
- BioSig, “An open source software package for biomedical signal processing under matlab,” http://biosig.sf.net/, 2003-2007.
- C. Cruz-Neira, D. J. Sandin, and T. A. DeFanti, “Surround-screen projection-based virtual reality: the design and implementation of the CAVE,” in Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 135–142, Anaheim, Calif, USA, August 1993.
- M. Slater, A. Steed, and Y. Chrysanthou, Computer Graphics and Virtual Environments: From Realism to Real-Time, Addison-Wesley, Boston, Mass, USA, 2001.
- E. Frécon, G. Smith, A. Steed, M. Stenius, and O. Ståhl, “An overview of the COVEN platform,” Presence: Teleoperators and Virtual Environments, vol. 10, no. 1, pp. 109–127, 2001.
- VRPN, “Virtual reality peripheral network,” http://www.cs.unc.edu/Research/vrpn/.
- R. Scherer, A. Schlögl, F. Lee, H. Bischof, D. Grassi, and G. Pfurtscheller, “The self-paced Graz brain-computer interface: methods and applications,” to appear in Computational Intelligence and Neuroscience, 2007.
- J. R. Millán, F. Renkens, J. Mouriño, and W. Gerstner, “Noninvasive brain-actuated control of a mobile robot by human EEG,” IEEE Transactions on Biomedical Engineering, vol. 51, no. 6, pp. 1026–1033, 2004.
Copyright © 2007 Robert Leeb et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.