An EEG Tool for Monitoring Patient Engagement during Stroke Rehabilitation: A Feasibility Study

Bartur, Gadi; Joubran, Katherin; Peleg-Shani, Sara; Vatine, Jean-Jacques; Shahaf, Goded

doi:https://doi.org/10.1155/2017/9071568

BioMed Research International

On this page

Abstract Introduction Methods Results Discussion Abbreviations Disclosure Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Special Issue

Approaches in Physical Activity: From Basic to Applied Research 2017

View this Special Issue

Clinical Study | Open Access

Volume 2017 | Article ID 9071568 | https://doi.org/10.1155/2017/9071568

An EEG Tool for Monitoring Patient Engagement during Stroke Rehabilitation: A Feasibility Study

Gadi Bartur,^1,2Katherin Joubran,^2,3Sara Peleg-Shani,²Jean-Jacques Vatine,^2,4and Goded Shahaf^1,5

Academic Editor: Danilo S. Bocalini

Received08 Jun 2017

Accepted13 Aug 2017

Published24 Sept 2017

Abstract

Objective. Patient engagement is of major significance in neural rehabilitation. We developed a real-time EEG marker for attention, the Brain Engagement Index (BEI). In this work we investigate the relation between the BEI and temporary functional change during a rehabilitation session. Methods. First part: 13 unimpaired controls underwent BEI monitoring during motor exercise of varying levels of difficulty. Second part: 18 subacute stroke patients underwent standard motor rehabilitation with and without use of real-time BEI feedback regarding their level of engagement. Single-session temporary functional changes were evaluated based on videos taken before and after training on a given task. Two assessors, blinded to feedback use, assessed the change following single-session treatments. Results. First part: a relation between difficulty of exercise and BEI was identified. Second part: temporary functional change was associated with BEI level regardless of the use of feedback. Conclusions. This study provides preliminary evidence that when BEI is higher, the temporary functional change induced by the treatment session is better. Further work is required to expand this preliminary study and to evaluate whether such temporary functional change can be harnessed to improve clinical outcome. Clinical Trial Registration. Registered with clinicaltrials.gov, unique identifier: NCT02603718 (retrospectively registered 10/14/2015).

1. Introduction

Stroke is one of the leading causes for long-term functional impairment worldwide. The mechanisms underlying effective rehabilitation following stroke have been the subject of extensive research. There is growing evidence that rehabilitation is most effective when therapists promote active patient participation in the process and full commitment to it, for example, following stroke [1, 2]. Significantly better outcome was achieved by engaged than by nonengaged patients [3, 4]. The underlying factors that seem to define the basic engagement of the patients include their emotional state and level of cognitive function [1, 5]. Factors that have a transient effect during a given rehabilitation session include the importance of the patient ascribing to the session goal, patient-therapist relations, and the exercises used [6, 7]. Other transient factors contributing to engagement are the match between the degree of exercise difficulty and the patient’s current functional level [8], as well as boredom and tiredness [1]. In neuropsychological terms, increased engagement appears to correlate with increased patient attention during exercise [3]. Positive clinical outcomes, such as reduced depression and better cognitive and motor outcome, have been shown to correlate with the amount of effective recruitment of attention [1, 9, 10]. There is neurophysiologic evidence suggesting that enhanced recruitment of attention and engagement increases significantly the activation of brain regions involved in motor rehabilitation [11, 12]. Such increased activation may form compensatory connections to overcome reduced activity in these regions due to neurological disease. Increased activation driven by attention results in greater brain plasticity, which may underlie effective rehabilitation [13].

The practical role of engagement was also demonstrated in the improved clinical outcome achieved with robot-assisted rehabilitation when active patient participation is encouraged, as compared to passive protocols [14]. Nevertheless, we are not aware of any currently established marker for patient engagement or attention and therefore the generation of such marker seems to be of clinical importance.

To date, multielectrode EEG (ElectroEncephaloGraphy) systems have been shown to provide effective markers for attention [15]. But obtaining such markers necessitates a relatively long sampling time (in the range of at least several minutes) [15]. Furthermore, it is too cumbersome and therefore impractical to connect patients to a multielectrode EEG system on a regular basis for rehabilitation sessions. Effective harnessing of EEG-based measures for use in a rehabilitation setting should enable real-time feedback as opposed to feedback after many minutes [16, 17]. A tool that provides therapists with real-time feedback on attention recruitment can serve as an objective basis for real-time adjustments during treatment, which can significantly improve rehabilitation outcome in general and after stroke in particular [18].

Our previous research showed that it is possible to extract effective markers for attention from a single-channel EEG system [19, 20]. Furthermore, we simplified EEG analysis to adjust the extraction of relevant attention-related markers from ongoing EEG, without the need for external cues, on the basis of component template matching of the pattern identified by the averaged event-related potential (ERP). [21]. Template matching is the search in the sampled EEG data for a specific a priori pattern. We follow in this regard a known methodology, which scans the raw EEG data for patterns, which were identified in the averaged ERP signal [22]. Since the template we use is a marker for attention [19] we assume that the matched marker we use in this study (termed BEI, Brain Engagement Index) is also a marker for attention. It should be emphasized that, based on the above, a marker for engagement or for attention would be relevant to almost any poststroke dysfunction regardless of its precise localization. Therefore we chose in this preliminary feasibility study a variable population of patients in terms of functional level and site of injury.

The aim of the present study was to evaluate the applicability of a single-channel EEG marker, the Brain Engagement Index (BEI), during standard motor rehabilitation treatment sessions. In the first part we aimed at evaluating the relation of the BEI and functional performance in control participants, hypothesizing that BEI would peak when the participant is required to perform on a higher level, yet the demands are still not overly difficult. The level of difficulty in this part was set using a robotic training system. In the second part we evaluated the relationship between the BEI level during standard stroke rehabilitation sessions and temporary functional changes induced during these sessions. On the basis of the importance ascribed to brain engagement, as presented above [1–4], we hypothesized that higher BEI will be associated with better temporary functional change. For the sake of evaluating the temporary functional change, induced by the single physiotherapy session, we followed an established method of filming the target movements before and after sessions for evaluation of change by blinded observers [23].

2. Methods

The study consisted of two parts. The first part evaluated the effects of exercise difficulty and repetition on the BEI. The evaluation was standardized by using a robotic training system (ArmTutor) and by sampling normally functioning control patients. The second part evaluated the applicability of the BEI to patients undergoing standard, nonrobotic, motor rehabilitation sessions after stroke. Both parts of the study were approved by the Institutional Review Board of Reuth Rehabilitation Hospital, and all the participants signed informed consent forms.

3. Participants

3.1. First Part

Thirteen unimpaired controls (43–67 years old; 11 females, 2 males), without any neurological or psychiatric deficit, were included. The control participants, a convenience sample, were recruited from the personnel of Reuth Rehabilitation Hospital, Tel Aviv, Israel.

3.2. Second Part

Twenty poststroke patients were recruited to the second part of the study. We recruited patients with a full understanding, lack of self-report or documentation of major prestroke neurological and/or psychiatric disorders, and a score of 2–4/5 according to the Kendall muscle grading (https://www.niehs.nih.gov/research/resources/assets/docs/muscle_grading_and_testing_procedures_508.pdf) [24] of the relevant muscle groups. One patient was transferred to another hospital after the first session. For another patient there was disagreement between the blinded observers regarding the degree of session effect. Therefore the sample size of the second part of the study included the remaining 18 patients (39–90 years old, 4 females, 14 males), 1–3 months following stroke.

4. Tools

EEG was sampled using the MindWave dry electrode system [25], with one frontal electrode (~Fpz) and one reference electrode on the earlobe, at a sampling rate of 512 Hz. Positioning of the electrode conforms with the goal of monitoring prefrontal activity, which may correlate with attention regardless of the site of lesion [26]. The sampled data were transferred through a wireless connection to the experiment computer, where the BEI was processed.

4.1. First Part

We used the ArmTutor [27], a device developed for functional motor rehabilitation of the upper extremity, in this case elbow flexion/extension, with the track task (maintaining a ball within a moving track, with changing slopes). The ArmTutor makes it possible to specify the track width on a continuous scale of ArmTutor-specific units. Four exercise levels of increasing difficulty were selected for this evaluation. The difficulty of the task was mediated by narrowing the track width in even steps from 40 ArmTutor units in level 1 to 10 ArmTutor units in level 4. The ArmTutor is a tool in the arsenal of robotic rehabilitation tools developed by MediTouch Ltd. [28, 29].

4.2. Second Part

The second part did not involve the use of designated tools. The study aimed at evaluating a general relation between BEI monitoring and temporary treatment effect for different treatment goals and functional levels. Therefore we included patients and treatments of various types; the objectives of standard physiotherapy for the individual patients are presented in Table 1.

5. Experimental Protocol

5.1. First Part

Each participant was tested in two blocks in each of the four levels of difficulty (1–4). Each participant performed twice two-minute exercises at levels 1, 2, 3, and 4. A 30-second rest period was given between blocks. The ArmTutor software provided a performance grade (in %) per participant. All tests were conducted in a single session, moving consecutively from one level of difficulty to the next. The control participants were blinded with regard to their BEI level during exercise.

5.2. Second Part

Each patient underwent an initial evaluation to select a treatment goal for a specific motor function, which matched the patient’s functional level. Following this evaluation, each patient completed two treatment sessions. One session involved real-time feedback, with the treating physiotherapist using the BEI; the other session involved BEI monitoring that was not available for the physiotherapist. The order of the two sessions (feedback and no-feedback) was pseudorandomized for each patient through alternate allocation. Altogether, half the patients (9/18) started with the feedback session (FB+) and half (9/18) with the no-feedback session (FB−). During the feedback session, the physiotherapist responded to BEI decreases (of more than 10%) lasting 30 seconds or more by either encouraging the patient to concentrate or by changing the difficulty level of the exercise. A change in difficulty level was based on patient performance: difficulty level was reduced if the exercise seemed to the physiotherapist too difficult for the patient and increased if the exercise seemed too easy. Figure 1 shows the intervention algorithm used by the therapist. If the BEI level did not decrease, the exercise continued unchanged. Based on these general recommendations, when the BEI level dropped, the physiotherapist did adaptations to the current exercise or switched between exercises. The specific switches in exercise were selected by the physiotherapist, based on his clinical judgment. It should be emphasized that this involvement of judgment by the physiotherapist did not impact the main research question of this study. Note that the main comparison of temporary functional change is between the higher BEI session and the lower BEI session for each patient, regardless of whether feedback was used in the session or not and regardless of the specific exercises selected by the physiotherapist. For some patients the higher BEI session was the session with the feedback, while for others it was the session without the feedback.

Figure 1

Algorithm for use of the BEI during treatment sessions. If the BEI level was stable, the current exercise continued. When BEI level dropped consistently below average for at least 30 seconds, the patient was first encouraged to concentrate on the exercise, and if this did not help, the therapist evaluated the exercise level. If it was too easy, the therapist intensified the exercise. If it was too difficult, the therapist reduced the intensity of the exercise. If this did not improve the BEI, the therapist suggested rest or used supportive and passive exercises for a few minutes. that both BEI level and functional level are evaluated relatively for each patient.

Treatment sessions lasted on average 35 minutes. Each session was preceded and followed by a 30-second evaluation period, in which the motor function targeted by the treatment was tested and filmed. The two pairs of evaluation films (FB+ pre/post and FB− pre/post) were evaluated by two physiotherapists, who were blinded to all aspects of the session. The blinded evaluators did not know whether feedback was used and what the BEI level was for the session. Each evaluating physiotherapist was asked to quantify the functional change achieved at the end of each treatment session on a 7-point Likert scale [−3, +3]. The evaluators were instructed to focus their evaluation upon changes in the quality, range, and speed of movement. A positive score indicated improvement and a negative one deterioration. The degree of improvement or deterioration was specified on a scale ranging from 1 (minor) to 3 (major). A score of 0 indicated no significant functional change between the pre- and postsession evaluations. This method of evaluation was suggested by Altschuler et al., 1999. Video-based evaluation was employed in multiple additional studies [30, 31].

6. EEG Analysis

The Brain Engagement Index (BEI) was developed by BrainMARC LTD and is available to researchers (see http://brainmarc.com/wp-content/uploads/2015/12/BrainMarc-Brochure.pdf). It is an embodiment of template matching between the averaged ERP signal and the raw EEG sample, which is a prevalent method in advanced EEG analysis, in which a basic template is compared with the sampled signal [21]. The BEI was computed with a moving window of 10 seconds for the period of the preceding 60 seconds. The template was a 1500 milliseconds attention-related averaged ERP delta bandpass activity [19], which was matched with a moving window of the same size in the sampled signal. The matching was performed in real-time every 10 seconds, as follows: (i) the last 60-second sample was divided into segments of 10 seconds; (ii) each segment was filtered in the delta bandpass [1–4 Hz]; (iii) the data points in the filtered segment were normalized to the range, where −1 denoted the most negative deflection in the filtered segment and +1 the most positive one; (iv) filtering and normalization to were also performed for the 1500 ms averaged delta ERP wave, shown in Figure 2 (top inset), to generate the template; (v) the normalized sampled segment was scanned by a moving window of 1500 ms; (vi) the averaged distance between the moving window data and both the template and the template opposite (1-template) were computed; (vii) if the averaged distance was less than a threshold of 0.5 from the template (see Figure 2), the count of matches was increased, provided that no other match was found in a previous window, partly overlapping the current one; (viii) if the averaged distance was more than the threshold, the count of no-matches was increased, provided that no other no-match was found in a previous overlapping window; (ix) the BEI is the division of the counts of matches by the no-matches; the maximum BEI value is set to +1, so that the BEI scale has a range of ; (x) the median of the six 10-second segment BEIs, from the last sampling minute, is taken as the current BEI (as the BEI is calculated every 10 seconds, there is a 50-second overlap in the period analyzed for consecutive BEI values); (xi) for every 1500-millisecond window, we also computed the standard deviation/mean ratio of delta activity. If this ratio was greater than 1, the sampling was likely to be noisy (based on previous analysis) and therefore this 1500-millisecond sample was rejected and not included in the above computation. If multiple (>1) nonoverlapping 1500 millisecond windows were rejected within a given 10-second segment, the entire segment was automatically rejected. At least three nonnoisy 10-second segments were required within the last 1 minute to generate a valid BEI for the entire minute. Otherwise the entire minute was rejected as noisy and no BEI was reported for it. When two consecutive BEI values were not reported (no-value was reported in the monitor graph), the therapist was asked to check and improve the contact of the NeuroSky system with the patient’s head, verifying a green connection marker in the application window. Such intervention was required, on average, about 1-2 times in a treatment session. Of potential practical value is the use of dry electrodes below the hairline, Fpz referenced to earlobe. We showed previously the feasibility of extracting significant markers from this region [19]. Obviously sampling from the forehead is always susceptible to noise, especially due to eye movements, but with the use of effective noise rejection method [32] together with adjustment of the device, we were able to obtain 3–6 BEI values in ~90% of the sampling minutes.

7. Data Analysis

We used the following indices in the analysis.

7.1. First Part

(1)Start-of-exercise BEI: we used the first BEI acquired during each exercise block.(2)End-of-exercise BEI: we used the last BEI acquired during each exercise block.The BEI for each difficulty level was acquired by averaging the 2 blocks of the same difficulty level. In levels 1 and 2 ArmTutor performance grade of all participants was above the MediTouch recommended threshold for good performance. On level 4 all participants showed long drop in performance level below the recommended performance threshold. Level 3 was intermediate with short drops below the recommended performance threshold and thereafter correction to above threshold performance. The recommended performance threshold is used by MediTouch automatically to tune exercise difficulty, but in the current study we deactivated this automatic tuning to maintain constant level difficulties.

7.2. Second Part

(1) BEI Session. We computed BEI values every 10 seconds for both sessions of each patient. Next, we computed the mean BEI and standard deviation of all sampled values from both sessions of each patient. For each session, the number of samples above the mean + one standard deviation was counted and was divided by the total number of samples for the session. This value was used as the entire grade of the session, the BEI session. For the sake of demonstration of the computation of the BEI session, we present Figure 3, which shows the computation of the BEIs session of a representative patient. For each patient, the basic BEI samples are shown as a function of time. The mean BEI for both sessions, taken together, is shown as a dashed line. The mean + one standard deviation is shown as a thick line. The count of BEI samples above this threshold of mean + one standard deviation was divided by the total number of BEI samples from the entire session, to generate the BEI session. Thus if in one of the two sessions of a given patient there was a larger portion of BEI values above threshold than in the other session, this session received a higher BEI session.

Figure 3

Computation of BEI session. For the sake of clarifying the computation of the BEI session from the basic 10 seconds BEI values, we show an example from one patient of the basic BEI values from the two sessions he underwent. BEI values were computed every 10 seconds for both sessions. The mean BEI (dashed line) and +1 standard deviation (thick line) of all sampled values obtained from both sessions were computed. For each session, the number of samples above the mean + 1 standard deviation was counted and was divided by the total number of samples for this session. This value was used as the BEI session, and it is shown for each of the two sessions for demonstration. The same BEI computation session was followed for all patients.

(2) Session Temporary Functional Change Index. We used the average of the session effect evaluations of the two blinded evaluators as the session outcome index. The evaluation scores given by the two evaluators differed, but the data analysis compared the effect of the two sessions for each participant, and the difference between the two sessions was largely similar between the evaluators; the difference did not exceed 1 point for all patients included in the analysis (one patient, with greater interrater differences, was excluded from data analysis).

8. Statistical Analysis

8.1. First Part

The comparisons are based on repeated measures ANOVA with Tukey HSD correction and on paired sample -test.

8.2. Second Part

The major comparison is based on Wilcoxon-signed ranks test of the session temporary functional change indices. Wilcoxon-signed ranks test is designed for paired-comparison of ordered scales.

A secondary post hoc evaluation was based on chi-square comparison. In this evaluation we compared patients who started with a feedback session, which was followed by a no-feedback session, with patients who started with a no-feedback session, which was followed by a feedback session.

9. Results

9.1. First Part

We noted a tendency of increase in average BEI among control participants from levels of exercise difficulty 1 and 2 to level 3. This tendency was reversed in level 4, in which average BEI dropped (Figure 4(a)). To assess the significance of the BEI change, we performed a repeated measures ANOVA between levels with a within-participant factor. We found a significant level effect ( = 5.99, ). Follow-up paired sample -tests were conducted separately to compare pairs of difficulty levels and were found to be significant between the first and second levels on the one hand and the third level on the other hand (paired -tests, both with ) and between the 3rd and 4th levels (decrease) (paired -test, ). After correction for repeated measures with Tukey HSD, the difference between the 3rd level and 4th level was still significant ( = 4.29, ), but the difference between the 1st and 2nd levels and the third level was not significant. The significant drop in BEI between the third and fourth levels was accompanied by reduced performance as reported automatically by the ArmTutor device (Figure 4(a), inset). Participants received an average performance grade of >90% for the first three levels and of ~80% for the fourth level.

Figure 4

BEI association with exercise difficulty and practice. (a) Dynamics of BEI as a function of exercise difficulty. At each level, the BEI is averaged for both exercises over all participants (±SD). The arrows mark the tendency of BEI change between 3 exercise levels: an average of levels 1 and 2 (owing to functional similarity), level 3, and level 4. The inset shows the percent of success, reported by ArmTutor. The success rate reduced in the 4th level. (b) Dynamics of BEI between start and end of the exercises. The figure shows the decrease of the index between start-of-exercise and end-of-exercise. The start and end columns present averages (±SD) from all 4 levels of exercise (2 exercises in each level) over all 13 controls.

Within each level of exercise difficulty there was a decrease in the BEI value from level start to level end (Figure 4(b)). This tendency was statistically significant (paired -test, ).

9.2. Second Part

The main comparison in this study was between sessions with higher BEI and sessions with lower BEI. As each patient participated in two sessions, one of them had by definition a higher BEI than the other. We grouped the temporary functional changes of the sessions with higher BEI and of the sessions with lower BEI across patients (Figure 5). In the figure the -axis shows the accumulative percentage of patients with a session-induced temporary functional change index above thresholds, which are presented in the -axis. For example, 72% of the sessions with higher BEI of the various patients were rated with temporary functional change ≥+1, but only 39% of the sessions with lower BEI were rated with temporary functional change ≥+1. The difference between sessions with higher BEI and sessions with lower BEI was statistically significant (Wilcoxon-signed ranks test: Z ≈ −1.76, ). It should be noted that this comparison is independent of the physiotherapist involvement in the protocol and exercise selection. The comparison is between higher BEI sessions and lower BEI sessions, regardless of whether feedback was used in the session or not. We further computed the effect size (for categorical variables, [33]) of the higher BEI sessions compared with the lower BEI sessions. This effect size was d ≈ 0.71.

Figure 5

Comparison of the temporary functional change between the sessions in which the BEI was higher for each patient and the sessions in which the BEI was lower for each patient. As each patient participated in two sessions, one of them had by definition higher BEI than the other and the data in the figure aggregates all sessions with higher BEI and all sessions with lower BEI over patients. For some patients the session with higher BEI was the feedback session, while for other patients the session with higher BEI was the no-feedback session. The -axis shows the percentage of patients with a session temporary functional change index above thresholds, which are presented in the -axis. This BEI-based comparison revealed a significant difference in temporary functional change ().

In a secondary post hoc analysis we compared between patients whose first session was with feedback and patients whose first session was without feedback (Figure 6). For participants who started with a feedback+ session, both first feedback+ and second feedback− sessions were included in the analysis. For participants who started with a feedback− session, both first feedback− and second feedback+ sessions were similarly included in the analysis. The purpose of the comparison was to evaluate whether the use of feedback in the first session had any effect that may have been carried over to the second session. Post hoc statistical analysis showed a significant preference of the maximal temporary functional change (≥+2) for the patients with feedback in the first session in comparison with the patients with no feedback in the first session (, ).

Figure 6

Accumulative histogram comparisons between patients who started with a feedback session and those who started with a no-feedback session. The -axis shows the percentage of sessions with temporary functional change indices above the thresholds, which are presented in the -axis. For participants who started with a feedback+ session, both the first feedback+ and the second feedback− session were included in the count. For participants who started with a feedback− session, both the first feedback− and the second feedback+ session were included in the count. Post hoc analysis of the highest possible temporary functional change (≥+2) revealed a significant difference () between patients who started with feedback in the first session and patients who started with no feedback in the first session. This difference is emphasized with the dashed rectangle.

10. Discussion

The first part of the study suggests there might be a possible association between the BEI and exercise difficulty in a standardized protocol with control participants. BEI at least tended to be lower when the exercise level was easier and it reduced again when exercise level was too difficult and performance was compromised. Thus, BEI may be at its peak when exercise level is challenging, yet not overchallenging. The implication may be that BEI is more related to neurophysiologic processes of sustained attention than with processes of global arousal [34], which may remain high during the phase that is too difficult [35]. It seems possible to distinguish in the EEG signal between sustained attention and alertness markers [36].

Nevertheless, it should be remembered that this is only a preliminary study and more elaborative manipulations of exercise difficulty in various environments are needed in order to establish the relation between the BEI and exercise challenge. If indeed higher BEI will be established further, as related to effective exercise challenge, it may be a useful tool for neural rehabilitation. At times it might be challenging to deduce quickly from good patient performance alone whether a given exercise is sufficiently engaging and the patient works intensively and engagingly or alternatively the exercise is simple for the given patient and does not require intense work. Another required differentiation, in cases of suboptimal functional performance, is between instances in which the patient still works intensively and engagingly and instances in which suboptimal performance is related to reduced engagement. In both cases it is necessary to establish the added value of the BEI for identifying engagement, beyond deduction from performance alone, of both experienced and less experienced therapists.

Supportive evidence for the possible applicability of the BEI as an index for brain engagement comes from its reduction over time within the same level of exercise difficulty. This could be interpreted as habituation secondary to improved dexterity, which develops during practice.

In the second part of the study we evaluated the relation between the BEI of the standard rehabilitative session of poststroke patients and the temporary functional change induced by the session. The assumption was that patient engagement is related to session effectiveness, at least in terms of temporary functional change. As expected, we found a relation between BEI level during the rehabilitative session and the temporary functional change as it was evaluated by skilled blinded observers. The design of the study was not rigorous in terms of interventions employed by the therapist [37]. Furthermore, the target treatment goal was selected individually for each patient, without any attempt at uniformity in treatment goals across patients. Instead it was more naturalistic and the therapist could have selected any intervention he employs in standard rehabilitation sessions. The individualized selection of treatment goals was also chosen because of the expected relation between the relevancy of the treatment goal and the patient’s engagement [6]. The main aim was to compare two sessions for each patient. By definition one of such two sessions had a higher BEI than the other and thus it was possible to show that when BEI was higher the temporary functional change was better. The evaluation of temporary functional change had to rely on a short test (so effect will not wear out), which is applicable for multiple functional levels. We used for this purpose the method offered by Altschuler et al. [23]. Similar methods were used also by others [30, 31].

It should be stressed that the subjective involvement of the physiotherapist in the study did not affect the evaluation of the main research question of relation between BEI session and temporary functional change. This is because, all in all, each patient participated in two sessions; in one the BEI was higher than the other. For some patients the higher BEI was in the feedback session, while for others, the higher BEI was in the no-feedback session. But still, as is evident from Figure 5, higher BEI seems to be related to better temporary functional change.

The two treatment sessions for each patient were nevertheless different. In one session the therapist received real-time BEI feedback every 10 seconds and in the other session no feedback was given. The therapist was instructed to change the exercise once the BEI reduced, according to the given algorithm. This enabled post hoc analysis regarding the effect of feedback use on the temporary change in functionality. The seminaturalistic structure of the study and the lack of blinding of the therapist set heavy limitations regarding possible conclusions regarding this secondary question. Nevertheless the therapist was blinded to the type of analysis employed, which compared between patients, who started with a feedback session, and patients who started with no-feedback session. This post hoc analysis revealed that patients, who started with a feedback session, had significantly greater likelihood to demonstrate the highest possible temporary functional change (≥+2). This might mean that the therapist can use the real-time feedback to learn about the best exercises for the specific patient and might further use this information to improve also the second no-feedback session.

This study is only preliminary and of limited sample size and protocol. We believe that the results obtained in such seminaturalistic settings justify further studies with larger samples. It is necessary to establish further the association between BEI and temporary functional change and particularly the use of feedback to improve the temporary functional change. Thereafter it would be of value to evaluate the effect of repetitive use of the BEI in multiple treatment sessions in terms of sustained clinical improvement. This will require a conservative study design of more homogeneous patient populations.

Abbreviations

BEI:	Brain Engagement Index
ERP:	Event-related potential.

Disclosure

The study was conducted in the Department of Rehabilitation, “Reuth” Rehabilitation Hospital, Tel Aviv, Israel.

Conflicts of Interest

The first author Gadi Bartur is a consultant to BrainMARC Ltd., the company which developed the BEI. The last author Goded Shahaf is the cofounder of BrainMARC Ltd., the developer of the marker used in this work. The other authors do not have any involvement with BrainMARC or any other conflicts of interest.

Authors’ Contributions

Gadi Bartur, Goded Shahaf, and Sara Peleg-Shani participated in the design of the study. Katherin Joubran and Gadi Bartur collected and interpreted the data. Goded Shahaf and Gadi Bartur performed data analysis and wrote the manuscript. Jean-Jacques Vatine made a major contribution in writing the manuscript. All authors read and approved the final manuscript.

Acknowledgments

The authors wish to thank the participants for their cooperation in the experiment. This project is funded by the Israeli Ministry of Science, Technology and Space under Grant Alona14835.

References

A. H. Lequerica, C. S. Donnell, and D. G. Tate, “Patient engagement in rehabilitation therapy: Physical and occupational therapist impressions,” Disability and Rehabilitation, vol. 31, no. 9, pp. 753–760, 2009.
View at: Publisher Site | Google Scholar
O. Pyöriä, U. Talvitie, H. Nyrkkö, H. Kautiainen, T. Pohjolainen, and V. Kasper, “The effect of two physiotherapy approaches on physical and cognitive functions and independent coping at home in stroke rehabilitation. a preliminary follow-up study,” Disability and Rehabilitation, vol. 29, no. 6, pp. 503–511, 2007.
View at: Publisher Site | Google Scholar
M. M. Danzl, N. M. Etter, R. O. Andreatta, and P. H. Kitzman, “Facilitating neurorehabilitation through principles of engagement,” Journal of Allied Health, vol. 41, no. 1, pp. 35–41, 2012.
View at: Google Scholar
S. Paolucci, A. Di Vita, R. Massicci et al., “Impact of participation on rehabilitation Results: a multivariate study,” European Journal of Physical and Rehabilitation Medicine, vol. 48, no. 3, pp. 455–466, 2012.
View at: Google Scholar
F. A. S. Bright, N. M. Kayes, L. Worrall, and K. M. McPherson, “A conceptual review of engagement in healthcare and rehabilitation,” Disability and Rehabilitation, vol. 37, no. 8, pp. 643–654, 2015.
View at: Publisher Site | Google Scholar
R. Colombo, F. Pisano, A. Mazzone et al., “Design strategies to improve patient motivation during robot-aided rehabilitation,” Journal of NeuroEngineering and Rehabilitation, vol. 4, article 3, 2007.
View at: Publisher Site | Google Scholar
S. Horton, A. Howell, K. Humby, and A. Ross, “Engagement and learning: an exploratory study of situated practice in multi-disciplinary stroke rehabilitation,” Disability and Rehabilitation, vol. 33, no. 3, pp. 270–279, 2011.
View at: Publisher Site | Google Scholar
A. A. Blank, J. A. French, A. U. Pehlivan, and M. K. O’Malley, “Current trends in robot-assisted upper-limb stroke rehabilitation: promoting patient engagement in therapy,” Current Physical Medicine and Rehabilitation Reports, vol. 2, no. 3, pp. 184–195, 2014.
View at: Publisher Site | Google Scholar
A. H. Lequerica, L. J. Rapport, R. D. Whitman et al., “Psychometric properties of the rehabilitation therapy engagement scale when used among individuals with acquired brain injury,” Rehabilitation Psychology, vol. 51, no. 4, pp. 331–337, 2006.
View at: Publisher Site | Google Scholar
C. E. Brett, C. Sykes, and R. Pires-Yfantouda, “Interventions to increase engagement with rehabilitation in adults with acquired brain injury: a systematic review,” Neuropsychological Rehabilitation, pp. 959-–982, 2015.
View at: Publisher Site | Google Scholar
A. Conte, F. Gilio, E. Iezzi, V. Frasca, M. Inghilleri, and A. Berardelli, “Attention influences the excitability of cortical motor areas in healthy humans,” Experimental Brain Research, vol. 182, no. 1, pp. 109–117, 2007.
View at: Publisher Site | Google Scholar
M. Jueptner, K. M. Stephan, C. D. Frith, D. J. Brooks, R. S. J. Frackowiak, and R. E. Passingham, “Anatomy of motor learning. I. Frontal cortex and attention to action,” Journal of Neurophysiology, vol. 77, no. 3, pp. 1313–1324, 1997.
View at: Google Scholar
K. Stefan, M. Wycislo, and J. Classen, “Modulation of associative human motor cortical plasticity by attention,” Journal of Neurophysiology, vol. 92, no. 1, pp. 66–72, 2004.
View at: Publisher Site | Google Scholar
X. L. Hu, K.-Y. Tong, R. Song, X. J. Zheng, and W. W. F. Leung, “A comparison between electromyography-driven robot and passive motion device on wrist rehabilitation for chronic stroke,” Neurorehabilitation and Neural Repair, vol. 23, no. 8, pp. 837–846, 2009.
View at: Publisher Site | Google Scholar
G. Shahaf, A. Reches, N. Pinchuk et al., “Introducing a novel approach of network oriented analysis of ERPs, demonstrated on adult attention deficit hyperactivity disorder,” Clinical Neurophysiology, vol. 123, no. 8, pp. 1568–1580, 2012.
View at: Publisher Site | Google Scholar
W. N. Park, G. H. Kwon, D.-H. Kim, Y.-H. Kim, S.-P. Kim, and L. Kim, “Assessment of cognitive engagement in stroke patients from single-trial EEG during motor rehabilitation,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 23, no. 3, pp. 351–362, 2015.
View at: Publisher Site | Google Scholar
G. Tacchino, M. Gandolla, S. Coelli, R. Barbieri, A. Pedrocchi, and A. M. Bianchi, “EEG Analysis During Active and Assisted Repetitive Movements: Evidence for Differences in Neural Engagement,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 6, pp. 761–771, 2017.
View at: Publisher Site | Google Scholar
A. M. Goldfine and N. D. Schiff, “What is the role of brain mechanisms underlying arousal in recovery of motor function after structural brain injuries?” Current Opinion in Neurology, vol. 24, no. 6, pp. 564–569, 2011.
View at: Publisher Site | Google Scholar
G. Shahaf, T. Fisher, J. Aharon-Peretz, and H. Pratt, “Comprehensive analysis suggests simple processes underlying EEG/ERP - Demonstration with the go/no-go paradigm in ADHD,” Journal of Neuroscience Methods, vol. 239, pp. 183–193, 2015.
View at: Publisher Site | Google Scholar
G. Shahaf and H. Pratt, “Thorough specification of the neurophysiologic processes underlying behavior and of their manifestation in EEG - Demonstration with the go/no-go task,” Frontiers in Human Neuroscience, 2013.
View at: Publisher Site | Google Scholar
K. Vijayalakshmi and A. M. Abhishek, “Spike Detection in Epileptic Patients EEG Data using Template Matching Technique,” International Journal of Computer Applications, vol. 2, no. 6, pp. 5–8, 2010.
View at: Publisher Site | Google Scholar
P. Jaskowski and R. Verleger, “Amplitudes and latencies of single-trial ERP's estimated by a maximum-likelihood method,” IEEE Transactions on Biomedical Engineering, vol. 46, no. 8, pp. 987–993, 1999.
View at: Publisher Site | Google Scholar
E. L. Altschuler, S. B. Wisdom, L. Stone et al., “Rehabilitation of hemiparesis after stroke with a mirror,” The Lancet, vol. 353, no. 9169, pp. 2035-2036, 1999.
View at: Publisher Site | Google Scholar
F. Peterson-Kendall, E. Kendall-McCreary, P. Geise-Provance, M. McIntyre-Rodgers, and W. A. Romani, Muscles Testing And Function with Posture and Pain, 2005.
G. Rebolledo-Mendez, I. Dunwell, E. A. Martínez-Mirón et al., “Assessing neurosky's usability to detect attention levels in an assessment exercise,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5610, no. 1, pp. 149–158, 2009.
View at: Publisher Site | Google Scholar
S. K. Meehan, B. Randhawa, B. Wessel, and L. A. Boyd, “Implicit sequence-specific motor learning after subcortical stroke is associated with increased prefrontal brain activations: an fMRI Study,” Human Brain Mapping, vol. 32, no. 2, pp. 290–303, 2011.
View at: Publisher Site | Google Scholar
E. Carmeli, S. Peleg, G. Bartur, E. Elbo, and J.-J. Vatine, “HandTutorTM enhanced hand rehabilitation after stroke - a pilot study,” Physiotherapy Research International, vol. 16, no. 4, pp. 191–200, 2011.
View at: Publisher Site | Google Scholar
M. J. Fu, J. S. Knutson, and J. Chae, “Stroke rehabilitation using virtual environments,” Physical Medicine and Rehabilitation Clinics of North America, vol. 26, no. 4, pp. 747–757, 2015.
View at: Publisher Site | Google Scholar
J. C. Perry, S. Balasubramanian, C. Rodriguez-De-Pablo, and T. Keller, “Improving the match between ability and challenge: Toward a framework for automatic level adaptation in game-based assessment and training,” in Proceedings of the 2013 IEEE 13th International Conference on Rehabilitation Robotics, ICORR 2013, Seattle, Wash, USA, June 2013.
View at: Publisher Site | Google Scholar
C. James, L. MacKenzie, and M. Capra, “Inter-and intra-rater reliability of the manual handling component of the WorkHab Functional Capacity Evaluation,” Disability and Rehabilitation, vol. 33, no. 19-20, pp. 1797–1804, 2011.
View at: Publisher Site | Google Scholar
C. J. Winstein, S. L. Wolf, A. W. Dromerick et al., “Interdisciplinary comprehensive arm rehabilitation evaluation (ICARE): a randomized controlled trial protocol,” BMC Neurology, vol. 13, article 5, 2013.
View at: Publisher Site | Google Scholar
D. B. Shahaf, G. Shahaf, J. Mehta, and L. Venkatraghavan, “Intracarotid etomidate decreases the interhemispheric synchronization in electroencephalogram (EEG) during the wada test,” Journal of Neurosurgical Anesthesiology, vol. 28, no. 4, pp. 341–346, 2016.
View at: Publisher Site | Google Scholar
D. Yang and J. E. Dalton, “A unified approach to measuring the effect size between two groups using SAS®,” In SAS Global Forum, vol. 335, pp. 1–6, 2012.
View at: Google Scholar
B. Reimer and B. Mehler, “The impact of cognitive workload on physiological arousal in young adult drivers: A field study and simulation validation,” Ergonomics, vol. 54, no. 10, pp. 932–942, 2011.
View at: Publisher Site | Google Scholar
M. R. Sutherland, D. A. McQuiggan, J. D. Ryan, and M. Mather, “Perceptual salience does not influence emotional arousal's impairing effects on top-down attention,” Emotion, vol. 17, no. 4, pp. 700–706, 2017.
View at: Publisher Site | Google Scholar
R.-S. Huang, T.-P. Jung, and S. Makeig, “Event-related brain dynamics in continuous sustained-attention tasks,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4565, pp. 65–74, 2007.
View at: Google Scholar
P. Masterson-Algar, C. R. Burton, and J. Rycroft-Malone, “Process evaluations in neurological rehabilitation: A mixed-evidence systematic review and recommendations for future research,” BMJ Open, vol. 6, no. 11, Article ID e013002, 2016.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2017 Gadi Bartur et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2350

Downloads

1349

Citations