Motor Imagery-Based Brain-Computer Interface Coupled to a Robotic Hand Orthosis Aimed for Neurorehabilitation of Stroke Patients

Cantillo-Negrete, Jessica; Carino-Escobar, Ruben I.; Carrillo-Mora, Paul; Elias-Vinas, David; Gutierrez-Martinez, Josefina

doi:https://doi.org/10.1155/2018/1624637

Journal of Healthcare Engineering

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Rehabilitation Robotics and Systems

View this Special Issue

Research Article | Open Access

Volume 2018 | Article ID 1624637 | https://doi.org/10.1155/2018/1624637

Motor Imagery-Based Brain-Computer Interface Coupled to a Robotic Hand Orthosis Aimed for Neurorehabilitation of Stroke Patients

Jessica Cantillo-Negrete,¹Ruben I. Carino-Escobar,¹Paul Carrillo-Mora,²David Elias-Vinas,³and Josefina Gutierrez-Martinez¹

Academic Editor: Carlo Ferraresi

Received17 Dec 2017

Accepted13 Feb 2018

Published03 Apr 2018

Abstract

Motor imagery-based brain-computer interfaces (BCI) have shown potential for the rehabilitation of stroke patients; however, low performance has restricted their application in clinical environments. Therefore, this work presents the implementation of a BCI system, coupled to a robotic hand orthosis and driven by hand motor imagery of healthy subjects and the paralysed hand of stroke patients. A novel processing stage was designed using a bank of temporal filters, the common spatial pattern algorithm for feature extraction and particle swarm optimisation for feature selection. Offline tests were performed for testing the proposed processing stage, and results were compared with those computed with common spatial patterns. Afterwards, online tests with healthy subjects were performed in which the orthosis was activated by the system. Stroke patients’ average performance was 74.1 ± 11%. For 4 out of 6 patients, the proposed method showed a statistically significant higher performance than the common spatial pattern method. Healthy subjects’ average offline and online performances were of 76.2 ± 7.6% and 70 ± 6.7, respectively. For 3 out of 8 healthy subjects, the proposed method showed a statistically significant higher performance than the common spatial pattern method. System’s performance showed that it has a potential to be used for hand rehabilitation of stroke patients.

1. Introduction

Stroke is the first cause of disability worldwide [1]. Loss of motor function, known as hemiparesis, is one of the most disabling consequences of stroke, which usually affects both upper and lower limbs from one side of the body. If stroke patients engage in therapy in the first 6 months after the initial symptoms appear, they have a 70% chance of regaining motor function in their affected hand [2, 3].

Assistive technologies such as robotic devices could increase the number of patients that receive therapy within this time. In addition, robotic devices have produced stroke rehabilitation outcomes at least as effective as those achieved with traditional therapies [4]. Brain-computer interfaces (BCI) are another type of assistive technology; these systems provide an artificial communication channel between the brain and an external device such as a robotic orthosis [5, 6]. BCIs based on motor imagery (MI) of affected limbs have shown great potential as a tool for brain plasticity enhancement [7, 8].

MI is a mental rehearsal of movements of a limb, for example, the hand or foot, without muscle activation [9–11]. MI elicits distinctive patterns in the electrical activity of the sensory-motor cortex, mainly in the frequency bands known as mu (8–13 Hz) and beta (14–30 Hz) [9, 12]. An MI-based BCI system is comprised of four stages; the first one is an electrical signal acquisition module such as electroencephalography (EEG). EEG is a noninvasive technique, has a good time resolution, and is easy to accept by patients. Preprocessing is the second stage of a BCI system; in this stage, signal artefacts such as eye movements, power line noise, and muscle activity are filtered from EEG recordings [13, 14]. The third stage is encompassed by feature extraction methods which preserve only significant information of the BCI user’s intentions. Finally, the fourth stage is the classification phase, in which the extracted features are interpreted as the BCI user’s intentions; linear discriminant analysis (LDA) is the most used classification technique reported in BCI publications [15, 16]. One of the most effective feature extraction methods is the common spatial pattern (CSP) algorithm, which computes a set of spatial filters that optimally differentiate two classes of MI. To achieve good classification accuracies using the CSP algorithm, the temporal filtering of the EEG signal must be performed on a specific frequency band. Usually, this band is selected in the mu and beta frequency range. Two other parameters that need to be set up are the time interval from which the features are going to be extracted and the subset of spatial filters involved in the feature extraction process [17].

The performance of CSP can be enhanced by selecting subject-specific parameters. Therefore, modifications to the original CSP method have been proposed to include this aspect. One of such modifications is known as filter bank common spatial patterns (FBCSP); this method performs an automatic frequency band selection for temporal filtering of the EEG [18]. FBCSP algorithm employs a filter bank that decomposes the EEG into different frequency bands. Each frequency band is spatially filtered using the CSP algorithm; afterwards, the extracted features for each band are selected with either the Mutual Information-based Best Individual Feature (MIBIF) or the Mutual Information-based Rough Set Reduction (MIRSR) algorithms. Classification is performed only with the selected features [18, 19]. Although, FBCSP performance was higher than CSP, statistically significant differences were not observed between both methods. A bank of filters and CSP are useful for MI; however; in order to increase classification performance other feature selection algorithms could be implemented. Feature selection is an optimisation problem; therefore, artificial intelligence techniques, such as particle swarm optimisation (PSO), could be applied for finding a solution for it.

PSO was originally proposed by Shi and Eberhart [20] and inspired by the social behaviour of bird flocks while searching for food. PSO performs a search in the space of the problem, with the aid of a population (called swarm) of individuals (called particles). Each particle executes a search based on its current position and velocity in the search space. In each iteration (called generations), the position and velocity of the particles are updated according to their best previous position (local search) and the best position of the swarm (global search). In terms of EEG properties, PSO can be applied to select which combination of extracted EEG features provides higher classification accuracies if used as inputs for a classifier. In each iteration (generation), several combinations of selected EEG features (particles) comprise possible inputs for a classifier. After all combinations have been used to train the classifier, and afterwards test it, classification accuracies for each combination (or other optimisation metrics) can be used to compare the fitness of each combination of EEG features. With this fitness information obtained for each combination, a new set of EEG feature combinations can be generated (a new generation of particles), which could contain a solution with higher classification accuracy than the ones tested in previous generations. This process is repeated until a stop criterion (like a number of generations or achieving a fitness value) is met. To the authors’ knowledge, few reported studies describe the use of PSO as a feature selection algorithm for BCI systems. For example, Wei and Wei propose a frequency band selection using PSO and CSP algorithms; selection is based on the best classification accuracies achieved by the BCI. They evaluated their method using MI information from publicly available dataset IVa from BCI competition III. Classification performances were higher using the frequency bands selected by PSO than the ones computed with a broader frequency band [21]. Atyabi et al. proposed a PSO-based method to reduce the number of electrodes and the number of features used for MI classification. The authors evaluated their method with datasets IVa and IIIa from BCI Competition III [22]. Xu et al. evaluated a PSO-based algorithm for CSP frequency band and time selection using a database comprised of finger MI of 18 healthy subjects. They observed better offline performances with PSO than with a statistical approach for frequency and time band selection [23]. These works show that PSO can increase classification performance of MI while also decreasing the number of employed features; therefore, PSO could be a good feature selection method for BCI.

Recent studies have reported better motor rehabilitation outcomes using MI-based BCIs coupled to robotic assistive devices than the ones achieved with only robotic assistive devices [24, 25]. Some of the advantages of these combined systems are that they are noninvasive, are fully automated, and could increase brain plasticity. Some studies have evaluated the performances of these BCI systems with healthy subjects [6], as well as some proofs of concept [26, 27] and a randomised controlled trial [28] that have demonstrated positive rehabilitation outcomes for stroke patients. Even though BCI systems coupled to robotic assistive devices have shown promising outcomes for stroke rehabilitation, to date, none of such systems are used in clinical practice.

Reasons for this include the fact that most BCI systems are still under development in research centres and universities, are usually assessed offline, and have quite different performances in online tests. In addition, new processing stages designed for stroke rehabilitation BCI systems are not tested with EEG information of these patients. Therefore, tests must be performed to evaluate if an MI-based BCI is capable of classification of user’s intentions and activation of external devices in online implementations, with a processing stage previously tested with stroke patients’ data.

In this work, an MI-based BCI is implemented and tested; the system is aimed to be driven by hand MI. A novel signal processing stage comprised of a bank of filters, CSP for feature extraction, PSO for feature selection, and LDA for classification was designed. The proposed algorithm was evaluated offline with a sample of stroke patients’ and healthy subjects’ data and afterwards online tests were performed with the healthy subjects as users of the system. For online tests, MI was used to activate a robotic hand orthosis to evaluate the feasibility of the complete BCI system aimed for neurological rehabilitation of stroke patients.

2. Materials and Methods

2.1. Participants

The sample for this study comprised 8 healthy subjects (mean = 23.9 ± 1.3 years) and 6 patients diagnosed with stroke (mean = 55.8 ± 12 years). Both healthy subjects and stroke patients were required to have a normal performance in the subscales of digit detection and visual detection of the neuropsychological test NEUROPSI (this test has been validated for Spanish-speaking population) [29]. In addition, all subjects were naïve to BCI, with normal or corrected to normal vision, without any history of other neurological/psychiatric diseases and right-handed (at least 90% according to the Mexican adaptation of the Edinburgh handedness inventory [30]). In order to be considered for inclusion in the study, patients had to have a first stroke event of subcortical localisation, confirmed by a neurologist by means of neuroimaging studies (magnetic resonance or computed tomography) and total or partial paresis of one of their hands. Subcortical stroke patients were selected since their brain damage does not involve the brain cortex and, therefore, they were less likely to present significant cognition impairments. Before the EEG recordings were performed, the participants signed an informed consent approved by the Ethics and Research Committee of the National Institute of Rehabilitation in Mexico. Clinical and demographic data of the patients are shown in Table 1.

2.2. EEG Acquisition

A g.USBamp biosignal amplifier from g.tec was used for EEG acquisition. EEG was acquired with 24 bits of resolution and sampling rate of 256 Hz. Active EEG electrodes were used for acquisition, with 11 electrodes placed over the scalp of the participants, in positions C3, C4, Cz, T3, T4, F3, F4, Fz, P3, P4, and Pz of the international 10–20 system. Ground placement was set in the AFz position, and the reference electrode was placed in the right earlobe. To verify that no real movements were elicited during MI, electromyography (EMG) was recorded from the flexor digitorum superficialis and flexor digitorum profundus muscles of both forearms. For the offline tests, each healthy subject participated in two sessions and performed in consecutive days with 120 trials recorded in total. To avoid exhaustion, stroke patients participated in four recording sessions which were performed in consecutive days, with 120 trials recorded in total. For the online tests, healthy subjects performed in consecutive days two additional sessions, with another 120 trials recorded in total. Subjects were instructed to sit in a comfortable armchair, with a computer monitor placed at 1.5 m in front of them. They were directed, by visual cues shown in the monitor, to perform either rest with their open eyes or MI from their paralysed hand (dominant hand in case of healthy subjects). EEG acquisition was performed using a similar strategy as the one followed by the Graz paradigm [31]. Figure 1 shows that the rest interval of the trials lasted 3 s and the MI interval lasted 5 s.

2.3. Offline Implementation and Validation of the Processing Stage

For offline implementation, a window of one-second length was extracted from 1.5 s to 2.5 s to obtain the rest information for each trial (REST). Another window of one-second length was extracted from the 3.5 to 4.5 s time interval of each trial, to obtain the MI information of the trials, as observed in Figure 1. These time windows were selected based on previous studies which show that differentiation between MI and REST classes is higher in these time intervals [32]. The FBCSP algorithm encompassed the processing stage of the BCI system, and PSO was used for feature selection (named FBCSP + PSO). A block diagram of the algorithm’s implementation is shown in Figure 2.

The following is a detailed description of the algorithm’s implementation: (a)Temporal filtering: EEG data were filtered to obtain 6 frequency subbands, each 4 Hz broad and with 1 Hz of overlapping in order to avoid loss of information. Encompassing both alpha and beta frequency bands were as follows: 8–12 Hz, 12–16 Hz, 16–20 Hz, 20–24 Hz, 24–28 Hz, and 28–32 Hz. A 60 Hz band-stop filter was also applied to the EEG signals. All filters were FIR filters of the 30th order, selected for their linear phase features.(b)Spatial filter: For the EEG data filtered in each subband, spatial filters were computed with the CSP algorithm. CSP performs a linear transformation on the EEG data, to obtain features whose variances are optimal for classification of two classes of MI, in a specific frequency band. Details of the CSP implementation can be found in the works of Blankertz et al. [17] and Ramoser et al. [33]. In this work, spatial filters were computed using the MATLAB command as suggested in the abovementioned works. is the matrix containing the spatial filters, and and are the covariance matrices of MI and REST computed from the EEG data of each filtered frequency subband. In the implementation of the original CSP, only the first and last columns of the matrix ( is generally 2) are used to generate the feature vector used for classification. With the goal of having a greater chance of finding the optimal subband for each patient, in this work, all possible features were extracted with CSP. The feature vector generated in this work for each trial is comprised as follows: Therefore, CSP features computed for the training set comprised for trials are And the true class vector of the training set is (c)Feature selection: PSO was used for selecting a subset of features from , in order to decrease both the classification error and the number of selected features. Equation (4) describes PSO implementation. where and are the position and velocity of the th particle of the th generation. In this work, 50 particles and 50 generations were used. is the inertial weight of PSO which linearly descends from 0 to 1 as generations of PSO are computed. and are positive constants set to 1. and have random values between 0 and 1, which coupled to and set the local and global search properties of PSO. is the best position reached by the th particle in the th generation. is the best position () reached by the entire swarm in the th generation. The maximum position value that a particle could reach was 1 and the minimum was 0. Maximum speed of each particle was set to 1 and minimum speed to 0. In this work, the search space of PSO was , where equals 66 and was comprised of the 66 features that can be selected. Each computed solution with PSO is a subset of the selected features. Solution values are in the range from 0 to 1. If the value of an element of the solution was higher or equal to 0.5, then the corresponding feature was selected. The original CSP algorithm states that selected features must be paired, so in this work, complementary features of the selected ones were also included, in case they were not originally selected by PSO. Selected features from the training set were used for designing an LDA classifier. PSO fitness value was computed using where is the computed classification error from the training set. is the number of selected features. Variables and have values ranging from 0 to 1. Both parameters and are summed so that PSO is able to perform a reduction of both classification error and the number of features used for classification. The value was multiplied by 2 so that the optimization priority of PSO is the reduction of the classification error over the selection of a lower number of features. The stop criteria used for PSO was either achieving 0% of classification error or 50 generations.(d)Classification: With the final selected features () and the traing set, an LDA classifier was designed, which was later evaluated with the testing set. Features selected with PSO in the training stage were the same as the ones used for the testing stage of the classifiers. LDA performance was measured by computing the percentage of classification accuracy (%CA). In this offline stage, the necessary parameters for the online stage were computed. These parameters were the spatial filters for each frequency subband and the LDA coefficients.

A stratified cross-validation of 10 × 10-fold was used to avoid bias in the computation of %CA. Classifiers were tested using totally different datasets than the ones used for training. For each fold and repetition, the FBCSP + PSO algorithm was calculated. The 100 values of %CA obtained from this procedure were used to compute the average %CA for each participant.

The performance of the FBCSP + PSO was compared with that of the original CSP (on filtered data between 8 to 32 Hz) using the same training and test subsets. A preliminary version of the proposed algorithm was presented by Cantillo-Negrete et al. [34].

2.4. Robotic Hand Orthosis

Since rehabilitation of stroke patients with robotic assistive devices has advantages, a right-hand robotic orthosis was developed in previous works to couple it with the BCI [35, 36]. This orthosis comprised a 3D printed frame of polylactic acid (PLA). The orthosis linear actuators can provide passive flexion and extension movements to the fingers. A closed-loop system was used to sense the moment in which each finger reaches its maximum extension or flexion. The orthosis has a wireless Bluetooth communication with the processing stage of the BCI. The Bluetooth protocol was programmed in both MATLAB® and in a microcontroller attached to the electronic control circuit of the orthosis. The orthosis has four different actuators; however, for this study, all actuators were set to perform flexion and then extension of the hand fingers.

2.5. Online Implementation of the Designed BCI System

A graphical user interface (GUI) was programmed using MATLAB, comprised of user’s/patient’s data, a processing stage, a screen for visual cues presentation, and wireless Bluetooth configuration. Communication was established with the g.USBamp amplifier by means of an adaptor API (available from g.tec). The online processing stage was optimised to process windows of one-second length of the EEG signal. Healthy subjects’ spatial filters and LDA coefficients computed for each selected frequency subband in the offline stage were programmed in the online BCI system. The BCI paradigm used for the online implementation was the same as the one used for the offline one, with the addition of the feedback provided by the robotic orthosis. For the online implementation, 6 windows of one-second length each were analysed. The first 3 windows comprised REST and the next 3 windows for MI. As soon as each window had elapsed, data recorded from them were processed in the GUI using the proposed FBCSP + PSO method and the LDA classifier. Afterwards, a classification output was generated which indicated if the time window was classified as REST or as right hand MI. Therefore, for each trial, the system performed 6 classification outputs. A total of 20 trials were recorded for each run, and 3 runs were performed for each session. A total of 2 sessions were performed in consecutive days recording 720 LDA outputs for the REST class and 720 for the MI class. Online %CA was computed per healthy subject by comparing the expected output with the real one.

The robotic hand orthosis was activated by a Bluetooth command sent from the computer, immediately after the MI time interval, only if 2 out of 3 motor imagery time windows were correctly detected by the processing stage. Within the orthosis activation time, the monitor displayed a grey background. The percentage of trials in which the orthosis was activated, regarded as percentage of correct trials (%CT), was computed for all the 120 trials per healthy subject. Activation of the orthosis was comprised of the opening and closing of the healthy subjects’ fingers. After each run (20 trials), performance feedback was shown in the computer monitor by using faces with different degrees of smiling expressions. For example, if %CT was in the 100–90 interval, the most smiling face was shown to the subject, and if %CT was below 60%, the most serious face was shown. A depiction of the online processing stage is shown in Figure 3.

Averaged online processing time was computed for all the performed trials. This was the average time required by the preprocessing, FBCSP + PSO, and LDA stages to generate a classification output. A PC with a Core i5 processor of 2.53 GHz and 8 GB of RAM was used for running the GUI with the BCI processing stage. S1 Video shows the complete BCI system in an online test.

2.6. Statistical Analysis

In order to assess the reliability of the BCI system, the practical level of chance was computed as explained by Müller-Putz et al. [37]. This practical level of chance is defined as the upper confidence interval of a random classifier’s accsuracy. Practical level of chance was calculated with a binomial distribution using a significance level of 0.5, with 120 trials encompassing the data of each class. Equations (5) and (6) show the computation of the practical level of chance. where is the probability of correct classification, is the expected number of correctly classified trials, is the number of trials, is the quantile of the standard distribution, and is the level of significance. The computed %CAs were compared with the practical level of chance to assess if BCI performance was significantly higher than chance [37].

A Lilliefors-corrected Kolmogorov-Smirnov test () was used to test if stroke patients’ and healthy subjects’ %CAs for offline tests (obtained from 10 × 10-fold cross-validation) followed a Gaussian distribution. The tests showed that the offline %CAs computed with FBCSP + PSO, and CSP for both groups did not have a Gaussian distribution. Therefore, nonparametric Mann–Whitney U tests () were used for comparing the offline %CAs computed with FBCSP + PSO and CSP. A Lilliefors-corrected Kolmogorov-Smirnov test () showed that healthy subjects’ offline and online averaged %CAs had a Gaussian distribution. Therefore, a paired t-test () was used for comparing offline with online %CAs. Pearson’s correlation and linear regression analyses were performed for measuring relationships between online %CA and %CT.

3. Results

3.1. Offline Analysis

Figure 4 shows the offline %CA computed with stroke patients’ data with FBCSP + PSO and CSP. Results of the statistical analysis are also shown. The calculated practical level of chance for all experiments was 56.2%. It can be observed that for all patients %CAs were above the practical level of chance () for both methods. For 4 out of 6 patient’s data, %CA for the FBCSP + PSO algorithm was statistically significantly higher () than the %CA for the CSP algorithm. For 2 patients, there were no statistically significant differences () between the %CA for both methods. The averaged %CA for all stroke patients computed with FBCSP + PSO (74.1 ± 11%) was statistically significantly higher () than the %CA obtained with CSP (70.2 ± 12%).

Figure 5 shows the offline performance for healthy subjects’ using the FBCSP + PSO and CSP algorithms. The %CA for all subjects were above the practical level of chance () with both algorithms. For 3 out of 8 healthy subjects, FBCSP + PSO was statistically significantly higher () than CSP. For the other subjects, no statistically significant differences () were found between the %CA for both methods. Averaged %CA for the FBCSP + PSO method (76.2 ± 7.6%) was statistically significantly higher () than the one obtained with CSP (75.5 ± 7.8%).

3.2. Online Analysis

Figure 6 shows healthy subjects’ online and offline performances. For all subjects, online %CA was above the practical level of chance (). Averaged offline %CA (76.2 ± 7.6%) was higher compared to online tests (70 ± 6.7%); however, there was no statistically significant difference () between them.

Figure 7 shows subjects’ online %CA (70 ± 6.7%) and %CT (84.5 ± 12.1%). Using Pearson’s analysis, a 0.8 correlation between %CA and %CT was found. In addition, a linear regression analysis showed an ² value of 0.64. Averaged online processing time was of 0.04 ± 0.01 s.

4. Discussion

The proposed BCI system was tested with stroke patients’ and healthy subjects’ data. Offline performances computed with FBCSP + PSO and CSP were above the practical level of chance for all stroke patients and healthy subjects. However, for 4 out of 6 patients, FBCSP + PSO showed a statistically significant higher performance of their paralysed hand compared to CSP. In addition, 3 out of 8 healthy subjects’ offline tests using FBCSP + PSO also showed statistically significant higher performances than CSP. Furthermore, for none of the stroke patients and healthy subjects, FBCSP + PSO performance was significantly lower than CSP. Ang et al. also performed an evaluation of their FBCSP using MIRSR for MI classification. Their algorithm was tested with a public database comprised of 9 healthy subjects and compared with the performance of CSP. However, FBCSP trained with MIRSR performances were not statistically significantly higher than CSP (with a 7 to 35 Hz frequency band) [19], unlike FBCSP + PSO in which the performance was statistically significantly higher than CSP. Therefore, FBCSP + PSO could be a better option for an MI BCI processing stage than CSP since it showed significantly higher performances for both stroke patients and healthy subjects.

The heuristic nature of PSO implies that its performance will not be limited by statistical features of the search space, since the method does not need to compute inverse matrices or other computations which often present restrictions, especially for high dimensional search spaces. Offline performances of the BCI system show that PSO implementation for feature selection of FBCSP allows this method to have better performances than CSP. This performance is achieved by using a multiobjective optimisation for the PSO algorithm by setting a higher importance to the LDA’s classification than to the number of selected features in the fitness function.

The system’s average processing time (0.04 ± 0.01 s) was lower than the time window used for EEG acquisition (1 s), which makes possible the online implementation of the system.

Stroke patients’ offline performances (74.1 ± 11%) were similar to the ones reported by Ang et al. with a sample of 46 stroke patients, which achieved an average offline performance of 74% using 27 EEG channels and an FBCSP with MIBIF algorithm. However, in the present work, only 11 EEG channels were recorded. In addition, stroke patients’ offline performances were higher than online performances reported using other state-of-the-art BCI designs. For example, Morone et al. performed an acquisition of 61 EEG channels from 8 stroke patients. The goal of the study was to assess if the recruited patients could perform an online grasping of a virtual hand. They reported an average %CA of 57 ± 24% [26]. Performances computed with the proposed BCI were also higher than the ones reported by Zhang et al. They recruited 8 stroke patients for the evaluation of a BCI coupled to a functional electrical stimulator. They processed 19 EEG channels with a modified CSP algorithm for feature extraction and support vector machines for classification. The average performance of their BCI system was 66% [38].

Healthy subjects’ average online performance (70 ± 6.7%) was higher than the one reported in a study with a similar feedback, using a hand exoskeleton by Witkowski et al. [39]. In the study, a %CA of 67.4% was reported (63.59 ± 10.8 of sensitivity and 71.3 ± 11.02 of specificity), using 5 EEG channels, in a sample of 12 healthy subjects. In another study with a hand exoskeleton feedback reported by Tang et al., healthy subjects’ online performance was 84.29 ± 2.11%. However, only 4 subjects with good MI ability were recruited and 24 EEG electrodes were used [40]. Healthy subjects’ online performances using the proposed BCI system were not significantly lower than the offline ones. Therefore, the proposed FBCSP + PSO processing stage should be able to handle the increased signal artefacts present in an online acquisition.

Offline and online tests allow us to suggest that stroke patients’ online performance with the proposed BCI is likely to be around 70% or at least higher than the practical level of chance.

Online %CT was positively correlated with the %CA of the system, which implies that the feedback shown to users reflected their ability to voluntary elicit hand MI. This is important since showing a correct feedback to patients motivates them to keep a successful MI strategy or to seek different approaches if feedbacks indicate low performances.

This study showed that the proposed FBCSP + PSO processing stage and robotic orthosis feedback are suitable for a BCI aimed for neurorehabilitation. However, tests involving patients using the system are still required to evaluate its neuroplasticity-enhancement capabilities. The participants of these future tests should include patients with cortical stroke located in the dominant and nondominant hemisphere. The observed performance differences show that FBCSP + PSO could be a better option than CSP for feature extraction in an MI-based BCI. However, online acquisition data from a higher sample of patients participating in a randomized controlled trial are still necessary to completely describe the potential of the proposed BCI system as a neurorehabilitation tool for stroke patients. Another study limitation is that 2 sessions were performed per participant, and a higher number could provide information on performance variations across time. Therefore, the next step in the system’s assessment should be to define a therapy schedule, which should include the lessons learned from this study which are to use FBCSP + PSO as processing stage, %CT for patient’s feedback, 3 runs of 20 trials each per day, and a somatosensory feedback using a robotic hand orthosis.

5. Conclusions

This work presents a BCI system evaluation using a processing stage comprised of FBCSP + PSO combined with LDA and feedback provided by a robotic orthosis. PSO as a feature selection algorithm for FBCSP allows reducing the problem’s dimensionality and achieving better classification performances, compared to those obtained if only the original CSP is used.

The present study shows that with the proposed BCI design patients are likely to be able to control a hand robotic orthosis using motor imagery of their paralysed hand. Therefore, the next developing stage of the system will be to perform a randomised controlled study involving direct EEG acquisition from patients. The BCI system designed in this study combines the advantages of a robotic device and motor imagery, which have separately produced good results for stroke patients’ rehabilitation. Therefore, if the proposed BCI system design is introduced into the clinical practice it would provide medical facilities with a tool that could aid stroke patient’s functional recovery.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this article.

Acknowledgments

The authors would like to thank Consejo Nacional de Ciencia y Tecnología for the support under Grant SALUD-2015-2-262061. The authors would like to thank Marlene Galicia-Alvarado for her helpful comments and Jose Antonio Barraza-Madrigal for helping in the design of the graphical user interface used in this work. Special thanks are given to the patients and healthy subjects for their participation in this study.

Supplementary Materials

S1 Video shows a user of the proposed BCI system while performing right motor imagery. The robotic hand orthosis, computer screen with visual cues, and the graphical user interface can also be observed. In each trial, if the classifier stage of the BCI detected subject’s motor imagery, passive hand finger flexion and extension was provided by the orthosis. After all trials of one session had been presented to the user, its BCI performance was shown on the computer screen. (Supplementary Materials)

References

E. J. Benjamin, M. J. Blaha, S. E. Chiuve et al., “Heart disease and stroke statistics—2017 update: a report from the American Heart Association,” Circulation, vol. 135, no. 10, pp. e146–e603, 2017.
View at: Publisher Site | Google Scholar
A. Houwink, R. H. Nijland, A. C. Geurts, and G. Kwakkel, “Functional recovery of the paretic upper limb after stroke: who regains hand capacity?” Archives of Physical Medicine and Rehabilitation, vol. 94, no. 5, pp. 839–844, 2013.
View at: Publisher Site | Google Scholar
R. H. M. Nijland, E. E. H. van Wegen, B. C. Harmeling-van der Wel, G. Kwakkel, and on behalf of the EPOS Investigators, “Presence of finger extension and shoulder abduction within 72 hours after stroke predicts functional recovery: early prediction of functional outcome after stroke: the EPOS cohort study,” Stroke, vol. 41, no. 4, pp. 745–750, 2010.
View at: Publisher Site | Google Scholar
S. E. Farmer, V. Durairaj, I. Swain, and A. D. Pandyan, “Assistive technologies: can they contribute to rehabilitation of the upper limb after stroke?” Archives of Physical Medicine and Rehabilitation, vol. 95, no. 5, pp. 968–985, 2014.
View at: Publisher Site | Google Scholar
G. Pfurtscheller, C. Guger, G. Muller, G. Krausz, and C. Neuper, “Brain oscillations control hand orthosis in a tetraplegic,” Neuroscience Letters, vol. 292, no. 3, pp. 211–214, 2000.
View at: Publisher Site | Google Scholar
C. E. King, K. R. Dave, P. T. Wang et al., “Performance assessment of a brain-computer interface driven hand orthosis,” Annals of Biomedical Engineering, vol. 42, no. 10, pp. 2095–2105, 2014.
View at: Publisher Site | Google Scholar
M. Mihara, N. Hattori, M. Hatakenaka et al., “Near-infrared spectroscopy-mediated neurofeedback enhances efficacy of motor imagery-based training in poststroke victims: a pilot study,” Stroke, vol. 44, no. 4, pp. 1091–1098, 2013.
View at: Publisher Site | Google Scholar
N. Mrachacz-Kersting, N. Jiang, A. J. T. Stevenson et al., “Efficient neuroplasticity induction in chronic stroke patients by an associative brain-computer interface,” Journal of Neurophysiology, vol. 115, no. 3, pp. 1410–1421, 2016.
View at: Publisher Site | Google Scholar
G. Pfurtscheller and F. H. Lopes da Silva, “Event-related EEG/MEG synchronization and desynchronization: basic principles,” Clinical Neurophysiology, vol. 110, no. 11, pp. 1842–1857, 1999.
View at: Publisher Site | Google Scholar
S. Kraeutner, A. Gionfriddo, T. Bardouille, and S. Boe, “Motor imagery-based brain activity parallels that of motor execution: evidence from magnetic source imaging of cortical oscillations,” Brain Research, vol. 1588, pp. 81–91, 2014.
View at: Publisher Site | Google Scholar
G. Pfurtscheller, C. Brunner, A. Schlogl, and F. H. Lopes da Silva, “Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks,” NeuroImage, vol. 31, no. 1, pp. 153–159, 2006.
View at: Publisher Site | Google Scholar
C. Andrew and G. Pfurtscheller, “On the existence of different alpha band rhythms in the hand area of man,” Neuroscience Letters, vol. 222, no. 2, pp. 103–106, 1997.
View at: Publisher Site | Google Scholar
O. Bertrand, F. Perrin, and J. Pernier, “A theoretical justification of the average reference in topographic evoked potential studies,” Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section, vol. 62, no. 6, pp. 462–464, 1985.
View at: Publisher Site | Google Scholar
W. Y. Hsu, “Independent component analysis and multiresolution asymmetry ratio for brain-computer interface,” Clinical EEG and Neuroscience, vol. 44, no. 2, pp. 105–111, 2013.
View at: Publisher Site | Google Scholar
J. Muller-Gerking, G. Pfurtscheller, and H. Flyvbjerg, “Designing optimal spatial filters for single trial EEG classification in a movement task,” Clinical Neurophysiology, vol. 110, no. 5, pp. 787–798, 1999.
View at: Publisher Site | Google Scholar
J. Ye and T. Xiong, “Computational and theoretical analysis of null space and orthogonal linear discriminant analysis,” Journal of Machine Learning Research, vol. 7, pp. 1183–1204, 2006.
View at: Google Scholar
B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K. R. Muller, “Optimizing spatial filters for robust EEG single-trial analysis,” IEEE Signal Processing Magazine, vol. 25, no. 1, pp. 41–56, 2008.
View at: Publisher Site | Google Scholar
K. K. Ang, Z. Y. Chin, H. Zhang, and C. Guan, “Filter Bank common spatial pattern (FBCSP) in brain-computer Interface,” in 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp. 2390–2397, Hong Kong, China, June 2008.
View at: Publisher Site | Google Scholar
K. K. Ang, Z. Y. Chin, C. Wang, C. Guan, and H. Zhang, “Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b,” Frontiers in Neuroscience, vol. 6, 2012.
View at: Publisher Site | Google Scholar
Y. Shi and R. C. Eberhart, “A modified particle swarm optimizer,” in 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360), pp. 69–73, Anchorage, AK, USA, May 1998.
View at: Publisher Site | Google Scholar
Q. Wei and Z. Wei, “Binary particle swarm optimization for frequency band selection in motor imagery based brain-computer interfaces,” Bio-medical Materials and Engineering, vol. 26, no. s1, pp. S1523–S1532, 2015.
View at: Publisher Site | Google Scholar
A. Atyabi, M. H. Luerssen, and D. M. W. Powers, “PSO-based dimension reduction of EEG recordings: implications for subject transfer in BCI,” Neurocomputing, vol. 119, pp. 319–331, 2013.
View at: Publisher Site | Google Scholar
P. Xu, T. Liu, R. Zhang, Y. Zhang, and D. Yao, “Using particle swarm to select frequency band and time interval for feature extraction of EEG based BCI,” Biomedical Signal Processing and Control, vol. 10, pp. 289–295, 2014.
View at: Publisher Site | Google Scholar
B. Várkuti, C. Guan, Y. Pan et al., “Resting state changes in functional connectivity correlate with movement recovery for BCI and robot-assisted upper-extremity training after stroke,” Neurorehabilitation and Neural Repair, vol. 27, no. 1, pp. 53–62, 2012.
View at: Publisher Site | Google Scholar
S. R. Soekadar, N. Birbaumer, M. W. Slutzky, and L. G. Cohen, “Brain machine interfaces in neurorehabilitation of stroke,” Neurobiology of Disease, vol. 83, pp. 172–179, 2015.
View at: Publisher Site | Google Scholar
G. Morone, I. Pisotta, F. Pichiorri et al., “Proof of principle of a brain-computer interface approach to support poststroke arm rehabilitation in hospitalized patients: design, acceptability, and usability,” Archives of Physical Medicine and Rehabilitation, vol. 96, no. 3, pp. S71–S78, 2015.
View at: Publisher Site | Google Scholar
D. Broetz, C. Braun, C. Weber, S. R. Soekadar, A. Caria, and N. Birbaumer, “Combination of brain–computer interface training and goal-directed physical therapy in chronic stroke: a case report,” Neurorehabilitation and Neural Repair, vol. 24, no. 7, pp. 674–679, 2010.
View at: Publisher Site | Google Scholar
A. Ramos-Murguialday, D. Broetz, M. Rea et al., “Brain-machine interface in chronic stroke rehabilitation: a controlled study,” Annals of Neurology, vol. 74, no. 1, pp. 100–108, 2013.
View at: Publisher Site | Google Scholar
F. Ostrosky-Solis, E. Gómez-Pérez, A. Ardila et al., Batería Neuropsicológica NEUROPSI Atención y Memoria, 6 a 85 años de edad, Bookstore, Mexico, 2003.
R. Cuencas, B. V. Seggern, R. Toledo, and E. Harrell, “El inventario de Edimburgo: evaluación de la lateralidad cerebral en una población Mexicana,” Salud Mental, vol. 13, no. 2, pp. 11–17, 1990.
View at: Google Scholar
G. Pfurtscheller and C. Neuper, “Motor imagery and direct brain-computer communication,” Proceedings of the IEEE, vol. 89, no. 7, pp. 1123–1134, 2001.
View at: Publisher Site | Google Scholar
J. Cantillo-Negrete, J. Gutiérrez-Martínez, T. B. Flores-Rodriguez, R. I. Cariño-Escobar, and D. Elías-Viñas, “Characterization of electrical brain activity related to hand motor imagery in healthy subjects,” Revista De Investigacion Clinica, vol. 66, Supplement 1, pp. 111–121, 2014.
View at: Google Scholar
H. Ramoser, J. Muller-Gerking, and G. Pfurtscheller, “Optimal spatial filtering of single trial EEG during imagined hand movement,” IEEE Transactions on Rehabilitation Engineering, vol. 8, no. 4, pp. 441–446, 2000.
View at: Publisher Site | Google Scholar
J. Cantillo-Negrete, R. I. Carino-Escobar, and J. Gutierrez-Martinez, “Increasing stroke patients motor imagery classification by selecting features with particle swarm optimisation,” in Proceedings of the 7th Graz Brain-Computer Interface Conference 2017, pp. 52–57, Graz, Austria, September 2017.
View at: Google Scholar
M. Martinez-Valdes, J. L. Cruz-Vargas, J. Gutierrez-Martinez et al., “Mechanical structure prototype and control unit for an active orthosis for a human had,” in 2014 Pan American Health Care Exchanges (PAHCE), pp. 1–4, Brasilia, Brazil, April 2014.
View at: Publisher Site | Google Scholar
J. Cantillo-Negrete, R. I. Carino-Escobar, D. Elias-Vinas, and J. Gutierrez-Martinez, “Control signal for a mechatronic hand orthosis aimed for neurorehabilitation,” in 2015 Pan American Health Care Exchanges (PAHCE), pp. 1–4, Vina del Mar, Chile, March 2015.
View at: Publisher Site | Google Scholar
J. R. Müller-Putz, R. Scherer, C. Brunner, R. Leeb, and G. Pfurscheller, “Better than random? A closer look on BCI results,” International Journal of Bioelectromagnetism, vol. 10, pp. 52–55, 2008.
View at: Google Scholar
H. Zhang, H. Liang, Y. Liu, H. Wang, and L. Zhang, “An iterative method for classifying stroke subjects’ motor imagery EEG data in the BCI-FES rehabilitation training system,” in Foundations and Practical Applications of Cognitive Systems and Information Processing, S. Fuchun, H. Dewen, and L. Huaping, Eds., pp. 363–373, Springer Berlin Heidelberg, Berlin, 2014.
View at: Google Scholar
M. Witkowski, M. Cortese, M. Cempini, J. Mellinger, N. Vitiello, and S. R. Soekadar, “Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG),” Journal of Neuroengineering and Rehabilitation, vol. 11, no. 1, p. 165, 2014.
View at: Publisher Site | Google Scholar
Z. Tang, S. Sun, S. Zhang, Y. Chen, C. Li, and S. Chen, “A brain-machine interface based on ERD/ERS for an upper-limb exoskeleton control,” Sensors, vol. 16, no. 12, 2016.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Jessica Cantillo-Negrete et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3990

Downloads

1682

Citations