Abstract

Background. Stroke commonly affects upper extremity motor abilities, yet there has been very limited success in developing effective rehabilitation interventions to remediate motor impairments, particularly for the upper extremity. Objective. To determine if task-oriented practice administered soon after stroke is more effective than usual care in improving poststroke upper extremity motor recovery and to explore the optimal amount of practice. Methods. A systematic review of the literature was performed from 1950 to November 2012, to identify randomized controlled trials of task-oriented practice compared to usual care, or to different amounts of task-oriented practice to improve motor impairment and activity. Studies were excluded if specific types of interventions were used as comparators or if they were of poor methodological quality. Results. Six studies met the review criteria. Three of the six studies demonstrated a statistically significant effect of task-oriented practice. Study results could not be pooled because of a lack of homogeneity in populations and intervention. Conclusions. The results demonstrate that an increase in the amount of task-oriented practice after stroke may result in less upper extremity impairment; further research on both effect and required dosage is needed as results are inconsistent.

1. Introduction

Stroke is the fifth leading cause of disability internationally [1] and it is likely that this is an underestimate of the absolute level of functioning that is lost, especially in low-income countries [2]. Stroke results in disability through loss of function from motor, cognitive, or sensory impairments either individually or in combination. Although stroke survivors can compensate for some of these losses, they often experience substantial residual functional deficits.

Motor impairment is the most common deficit after stroke and the major contributor to functional limitations [3]. Motor impairments are a principal target of rehabilitation interventions, and many novel therapeutic approaches for motor recovery have emerged in recent decades [318]. Research has focused on lower limb motor impairment more than upper limb partly because lower limb interventions are more easily described, outcomes are more easily quantified, and mobility is considered a key functional consideration after stroke. However, among those who have had a stroke, upper limb recovery is also considered important because it is integral to independence in many activities of daily living [19]. Therefore, interventions designed and tested specifically for upper extremity motor recovery are required.

Motor recovery interventions have been developed based on a variety of theoretical paradigms. Interventions may look similar; however, the expected mechanism of effect differs. Rigorous evaluation of novel interventions has been a major challenge due to the complexity of the interventions [20] and the variability of the poststroke populations (e.g., acute, subacute, and chronic). Furthermore, the methodological limitations of completed trials (e.g., small sample sizes) have resulted in studies that are underpowered to detect the modest effects expected from rehabilitation interventions [21]. In situations where there are numerous underpowered clinical trials, meta-analysis may prove useful in estimating a potential treatment effect. However, conducting and interpreting meta-analyses of clinical trials evaluating interventions for upper limb recovery has been challenging because of the heterogeneity of interventions and outcomes. This has made interpretation of the evidence difficult for guideline committees as well as clinicians trying to determine “best practice.”

One promising upper extremity motor recovery intervention is task-oriented practice [3, 6, 22, 23]. While the role of task practice in improving general motor performance has long been recognized as important [24], the evidence to support its effect on poststroke motor recovery is based on small clinical trials and observational studies. A meta-analysis of clinical trials evaluating task-oriented practice has reported modest benefits in functional outcomes for lower limb motor, but not for upper limb impairments [6]. The studies included in the meta-analysis were small, heterogeneous in terms of population and outcome, and some used active comparators that may have also used task practice. Therefore, it is not surprising that an effect on upper extremity impairment was not evident.

Determining whether task-oriented practice is effective depends in part at least, on understanding the “amount” of practice necessary to improve motor performance, or as it has been called by some, the “dosage” of task-oriented practice. Dosage is a commonly used term when prescribing pharmaceuticals, and it describes the concentration of the active ingredient as well as the frequency and duration of administration. Although the application of this concept to rehabilitation therapies was first proposed over 15 years ago [25], implementation in clinical and research settings has been slow, potentially because of a lack of consensus regarding the definition [26]. Most rehabilitation clinicians and researchers agree that the frequency and duration of an intervention can be quantified using minutes per day and number of days over which an intervention is administered. There is less agreement about the definition of intensity, with some considering the more physiologic interpretation (e.g., the energy expenditure, which can be measured by scales such as Metabolic Equivalent of Task (MET)) [27, 28] while others define it as the minutes per day on a prescribed protocol, where the goal is the maximum amount of task practice in the time provided [29, 30]. Given that intensity describes the concentration of the active ingredient in task-oriented practice, time on task, as opposed to the energy expended on task, is the more appropriate measure. The argument is however somewhat academic, as studies generally do not measure intensity. In their systematic review, Langhorne et al. [3] noted that high-intensity rehabilitation may be beneficial; however, the available data did not allow for quantification of the level of intensity, a conclusion that is consistent with other studies and reviews [6, 13, 28, 31, 32]. Therefore, although there is recognition of the importance of understanding the elements of dosage, studies to date have not been able to clearly determine the parameters, and in particular to quantify intensity. This limitation, along with the methodological limitations of many studies, may lead to inaccurate conclusions, such as those reported in a recent review, that higher intensity rehabilitation does not improve functional recovery [33].

Studies providing upper extremity task-oriented practice, given during the subacute phase (prior to the development of long-term compensatory strategies), in an inpatient setting (most likely the highest dosage) where the comparator group is usual practice (as opposed to other interventions that have not proven effective), would provide the most accurate estimate of the effect of task-oriented practice on upper extremity motor recovery in the first months after stroke and may allow for quantification of a threshold dose for motor recovery. Therefore, we performed a systematic review (a) to determine if task-oriented practice, administered early after stroke, is more effective than usual care in improving poststroke upper extremity motor recovery and (b) to explore whether there is a “dose” response within clinical trials in terms of duration, frequency and intensity.

2. Methods

2.1. Inclusion/Exclusion Criteria

Studies considered for inclusion in this systematic review met the following criteria:(a)randomized participants (i.e., randomized controlled trials (RCTs)), as these studies provide the most valid estimate of effectiveness;(b)included an adult population with upper extremity motor deficits, three months or less after stroke (with or without lower extremity deficits);(c)used upper extremity task practice as the intervention, with enough information to quantify the amount of upper extremity task practice (not necessarily the intensity, but at least frequency and duration);(d)used at least one outcome measure that quantified upper extremity motor recovery (either at the International Classification of Functioning and Health level of Body Function or Activities and Participation [34]);(e)published in full in English.

Studies were excluded from the review if they met the following criteria:(a)used any specific intervention method (e.g., NeuroDevelopmental Therapy, Motor Relearning Program, Constraint Induced Movement Therapy, exercise, Virtual Reality, Mental Imagery, Therapeutic Electrical Stimulation, and Transcranial Magnetic Stimulation), for either the intervention or control groups. Studies comparing specific interventions were excluded because it is difficult to quantify the amount of task performance and task is not necessarily the focus of the intervention or the “active ingredient”;(b)were of poor methodological quality that is, a score of <4 using the Centre for Evidence Based Medicine, Randomized Controlled Trial Critical Appraisal sheet (http://www.cebm.net/index.aspx?o=1157) which assessing internal validity. This scale is similar to other scales of clinical trial quality, but focuses specifically on issues of internal validity that are key to obtaining valid results.

2.2. Information Sources, Search, and Study Collection

The search for studies was done in multiple phases. Given the lack of consistency in the use of both subject headings and keywords, an initial search was performed using the following terms in various combinations; “stroke,” “motor learning,” “task,” “arm,” and similar terms (e.g., cerebrovascular accident, motor recovery, practice) in the following databases: CINAHL (EBSCO Host, 1981–November 2012), MEDLINE R (Ovid) (1950–November 2012), EMBASE (OvidSP, 1980–November 2012). Two reviewers (Jackie Bosch (JB), Susan Barreca (SB)) independently reviewed the list of titles and chose articles for abstract review based on the inclusion criteria provided above. The same two researchers (JB, SB) independently reviewed the abstracts and if selected by either reviewer the articles went for complete text review. Full articles were then reviewed against the inclusion and exclusion criteria, and the methodological quality of the studies was appraised using the Centre for Evidence Based Medicine Randomized Controlled Trial Critical Appraisal sheet (http://www.cebm.net/index.aspx?o=1157). Agreement rates for study inclusion were 85%, and a consensus approach was used when there was discrepancy.

A final review of the remaining articles was performed by Laurie Wishart (LW) and Martin O’Donnell (MO) to confirm appropriateness for inclusion.

2.3. Data Collection Process, Data Items, and Risk of Bias in Individual Studies

Data were extracted from studies by JB and independently reviewed by LW and MO. Data included mean age, inclusion criteria for upper extremity movement, time since stroke, amount of practice in each group (minutes per day, days per weeks, and number of weeks), upper extremity motor recovery outcome measures (either at the Body Structure or Activities and Participation level, based on the International Classification of Functioning Disability and Health by the World Health Organization [35]), and timing of the assessment of the primary outcome measure. If the authors did not indicate which outcome was primary, measures were chosen based on the expected sensitivity to the intervention and administration time in closest proximity to the end of the intervention period, as this is when the largest effect is expected to occur, opposed to weeks or months thereafter. All data were extracted from publications.

2.4. Risk of Bias within and across Studies

Using the Centre for Evidence Based Medicine Randomized Controlled Trial Critical Appraisal sheet (http://www.cebm.net/index.aspx?o=1157, internal validity section), one point was given for a “yes” to each question, with a maximum score of 6 for each study. Because of the nature of the interventions, participants were not blinded to their treatment group in any study; however, outcome assessment was often completed by assessors who were blinded to treatment allocation and in such circumstances, one point was given for blinded outcome assessment.

In terms of potential for bias across the studies, there is always a risk of publication bias; that is, studies that are positive are more likely to get published. Half of the studies in this review demonstrated a statistically significant effect (3 out of 6).

2.5. Data Synthesis

The reporting of the results of this review is done in accordance with the PRISMA guideline [36]. Studies meeting the inclusion criteria were heterogeneous in study population (i.e., amount of upper extremity motor deficit) and interventions evaluated (i.e., different task-oriented approaches); and such as, the authors concluded that meta-analysis would not be appropriate. Therefore, the results are reported descriptively with some narrative summaries.

3. Results

3.1. Study Selection

The initial search resulted in a list of 309 titles, of which 60 were excluded and 299 abstracts were reviewed. A hand search of bibliographies resulted in an additional 62 citations for review. A total of 361 abstracts were reviewed of which 136 (38%) were found eligible for full text review. From the full review, 23 (17%) studies were eligible for inclusion and underwent a third review by a second set of reviewers, who excluded an additional 17 articles. The remaining 6 articles represent 6 unique studies that were included in the review (see Figure 1).

The three most common reasons for excluding articles/studies were (a) use of a specific intervention as a comparator (38%), (b) the article was a review (critical or systematic) (23%), and (c) the study design was not a randomized controlled trial or practice was not used as an intervention (20%).

3.2. Study Characteristics

The key characteristics of the six studies included in this review are provided in Table 1. The mean age for the participants’ varied from 50 to 75 years. All studies required participants to have motor impairment in the affected upper extremity and two also required that participants had some upper extremity movement. Although tools used to measure severity of deficits at baseline varied across studies, results indicated moderate upper extremity impairment in each study. Participants were recruited within about six weeks of stroke onset. Ethics approval from the local institution was obtained for each study and informed consent was obtained from each study participant.

All studies provided a brief explanation of the experimental (E) and control (C) interventions, with functional task practice and repetition as key elements of the experimental intervention. Strength training was also included in the experimental intervention for 5 of the 6 studies [3741]. Additional details on the experimental intervention protocol were publically available for one study [40] (http://www.neostrokenetwork.com/newportal/Portals/0/Education%20Documents/videoconf%20handout/GRASP_Manual11492.pdf), while two authors indicated that protocols were developed but were not publically available [41, 42]. One study formally evaluated different durations of the same intervention [39]. In this three arm study, the same intervention was given for 1, 2 and 3 hours per day to each of the groups, 5 days per week for six weeks.

The most commonly used outcome assessment was the Action Research Arm Test (ARAT) which uses usual activities and movements to assess grasp, grip, pinch, and overall upper extremity movement. It was the primary outcome measure in three of the studies [38, 39, 41] and a secondary outcome measure in another [40], and was therefore the outcome measure reported for each of these studies, to allow for comparison between studies. The remaining two studies used measures of upper extremity motor recovery after stroke as the primary outcome, and data for each of these measures were provided [37, 42].

All studies included in this review received a score of 4 or higher using the Centre for Evidence Based Medicine Randomized Controlled Trial Critical Appraisal sheet (see, Table 2). The most common limitations in the studies were lack of complete follow up of participants at study end (five studies), followed by an imbalance of key prognostic variables between groups at baseline (three studies).

3.3. Study Outcomes

Table 3 provides both the baseline score and end of intervention score for each of the studies. In three of the six studies, statistically significant between group differences in the ARAT at study end were demonstrated in favour of additional, deliberate, task-oriented practice ( ≤ 0.01) [3941]. Two other studies suggested an improvement in the task-oriented practice group (versus control); however, this was not statistically significant [38, 42]. One study did not show any significant difference [37].

The issue of the effect of differing amounts of therapy was addressed by one study, where a dose response effect was suggested with higher dosages of task-oriented practice resulting in improved activity, although a statistically significant difference was evident only between the lowest and highest dose group [39].

4. Discussion

4.1. Main Findings

Based on the six studies identified in this systematic review, there is some evidence of a potentially beneficial effect of task-oriented practice in upper extremity motor recovery after stroke. Results of the study by Han et al. [39] indicate there may be a dose response relationship, suggesting that more practice results in better poststroke upper extremity motor recovery. However, data were limited and we were unable to conclude if there is a minimum threshold of practice that will result in improved upper extremity motor function after stroke.

4.2. Strengths and Limitations

Data from the available studies are promising, but have been interpreted with caution, as there are limitations of this review. First, developing both sensitive and specific search criteria to identify appropriate articles was difficult. Ideally, search criteria will identify articles based on the population, intervention, outcomes, and methodology of interest. While a poststroke population could be identified, initial attempts to use search strategies to identify any specific types of poststroke interventions were unsuccessful, primarily because of a lack of consistency in the use of subject headings or keywords. The decision was made to use broad search terms that would provide a sensitive, albeit unspecific list of studies and this resulted in the large number of titles initially searched. This issue emphasizes the need for diligence by authors in using consistent terminology when submitting studies in this field. The search was further enhanced by hand searching bibliographies, which has been shown to be an effective supplement to electronic searches [43]. Therefore, while we believe the search is thorough, it is possible that other studies exist, especially in languages other than English.

Second, an important aspect of our questions was whether the active ingredient of task produced better outcomes than usual therapy. It was clearly evident that the definition of task is not consistent across studies, ranging from exercise to reaching activities to the practice of usual daily activities like dressing. A lack of clarity in terms of definition as well as terminology (e.g., task specific training, task-oriented training, and functional training) made it difficult to accurately identify studies of task-oriented practice. We chose to focus on studies comparing task-oriented practice as defined by Winstein and Wolf [23], which focuses on remediating activity limitations, as opposed to individual upper extremity impairments and skill development opposed to movement. Studies that described the use of another type of intervention in either the experimental or control group (e.g., NeuroDevelopmental Therapy or Constraint Induced Movement Therapy) were excluded since they were not evaluating task-oriented practice per se; however, it is possible that some element of task-oriented practice was used in these interventions. Although we suspect that this is not a likely scenario, without thorough and detailed descriptions of the interventions in each study, it is possible.

Third, while all studies scored four or above in the methodological evaluation, only one study was free from bias [40], while three studies had a lack of similarity in baseline characteristics, probably due to small sample sizes [3739]. These baseline differences, especially in upper extremity motor function, may have made it difficult to demonstrate a statistically significant effect (and there was no indication whether statistical adjustments were made in the analysis). In addition, four of the six studies did not have complete follow-up of participants (one of the studies had less than 80% follow-up [42]). The methodological problems of small sample size and differences in baseline characteristics between groups was most likely compounded by loss to follow-up, further decreasing the likelihood finding an effect.

Fourth, not all studies identified a primary outcome measure so we chose to use the measure that theoretically should show the greatest effect, and that was administered at the end of the intervention period. This approach provided results under ideal circumstances (i.e., outcomes measured after the largest dose of the intervention and with the most sensitive tool) and could result increase the potential for Type 1 error. Of the three studies that demonstrated a statistically significant effect of practice, two had identified the ARAT as a primary outcome measure [39, 41] so the results of the third study by Harris et al. should be interpreted cautiously [40].

Finally, although each of the studies used deliberate task-oriented practice as the fundamental component of the intervention, there was variation in how interventions were delivered. For example, the study by Harris et al. [40] used a self-administered intervention, while the intervention in the study by Kwakkel et al. [41] was therapist administered. The lack of consistency between interventions made it inappropriate to meta-analyse study results, and therefore a minimum threshold of task-oriented practice could not be determined.

Although there are issues in terms of the design, conduct and analysis of some of the studies, it should be noted that five out of the six journals in which the studies were published have adopted the CONSORT statement for reporting clinical trials, and adherence to the statement is intended to improve the quality of reporting [44].

4.3. Clinical Perspectives

Although there are limitations to this review, it highlights two key messages; the use and definition of task varies greatly in clinical studies as well as clinical practice and that we do not know the optimal “dose” (intensity, frequency and duration) of task to improve upper extremity motor impairment. The problem of lack of clarity in defining task has been discussed previously in this review and by other authors [30]. The issue of the optimal dose remains important and unanswered. Studies on the use of task in clinical settings report that task is used in only about half of the therapy sessions [45] and for about 1/3 of the length of the session [46]. It is possible that a lack of clarity in terms of “what is task” and “minimum dose” is leading therapists to underutilize task-oriented practice. Implementing a treatment regimen based on frequency and duration alone is not difficult, but the quantification and implementation of intensity remains problematic due to these uncertainties and is further complicated if therapists are uncertain of the specifics of task-oriented practice. Recent efforts to define intensity in terms of poststroke motor rehabilitation offer a definition based on the amount of work the patient performs [26]. This definition does not consider the amount of the “active ingredient” included in the intervention. For task-oriented practice, quantification of intensity has to incorporate the amount of task practice occurring. Working harder will only produce better poststroke motor recovery if the work (i.e., task-oriented practice) is aimed at producing the desired neurophysiologic changes and subsequent improvement in activity, and does not invoke adverse effects.

In summary, we chose to look specifically at the effect of task-oriented practice on poststroke upper limb motor recovery compared to usual care, using randomized controlled trials of patients in the subacute phase after stroke, a group that is understudied but most likely to benefit from interventions aimed at maximizing neuroplasticity [30]. The criteria for review do not seem outwardly restrictive and yet they resulted in only six studies eligible for consideration. The differences between included studies, specifically the intervention and dosage of the intervention, made it inappropriate to further combine these data in any statistical manner. These considerations highlight the need for research that (a) clearly defines the intervention, (b) clearly defines the intensity, frequency, and duration of the intervention (dosage), and (c) uses similar outcome measures.

While the results of this review are inconclusive, they do provide evidence of a possible effect of task-oriented practice, although a specific amount required could not be quantified. These conclusions are consistent with Canadian and international guidelines that either provide minimum amounts of therapy required, with little evidence in terms of effect, or call for increased intensity in therapy without further clarification or quantification of the meaning of increased or intensity [47, 48]. With limited rehabilitation resources, governments need to support well-designed clinical trials that address the question of intensity, frequency, and duration of task-oriented practice. Alternative solutions for enabling additional practice must be considered such as self-administered task-oriented practice as was shown effective by Harris and colleagues [40]. Standardized protocols, along with studies designed and powered to examine the dose response, will provide the needed information in terms of the effect and the optimal dosage threshold.

5. Conclusions

There are few studies that have looked solely at the effectiveness of task-oriented practice on poststroke upper extremity motor recovery in the subacute phase. The available evidence indicates that task-oriented practice may result in improved motor recovery and may ultimately result in improvements in poststroke activity. Large, well designed, and conducted randomized controlled trials, using standardized protocols with consistent definitions, that examine the response to various doses of task-oriented practice, are required to confirm the effect of task-oriented practice and to determine a minimum threshold of practice at which motor recovery occurs.

Conflict of Interests

The authors declared they have no conflict of interest.

Acknowledgment

The authors would like to thank Shannon Buckley for her help and insights to identify appropriate search terms and her assistance in performing the searches.