Abstract

Objective. The aim of this study was to perform a meta-analysis to examine whether virtual reality (VR) training is effective for lower limb function as well as upper limb and overall function in chronic stroke patients. Methods. Three databases, OVID, PubMed, and EMBASE, were used to collect articles. The search terms used were “cerebrovascular accident (CVA),” “stroke”, and “virtual reality”. Consequently, twenty-one studies were selected in the second screening of meta-analyses. The PEDro scale was used to assess the quality of the selected studies. Results. The total effect size for VR rehabilitation programs was 0.440. The effect size for upper limb function was 0.431, for lower limb function it was 0.424, and for overall function it was 0.545. The effects of VR programs on specific outcomes were most effective for improving muscle tension, followed by muscle strength, activities of daily living (ADL), joint range of motion, gait, balance, and kinematics. Conclusion. The VR training was effective in improving the function in chronic stroke patients, corresponding to a moderate effect size. Moreover, VR training showed a similar effect for improving lower limb function as it did for upper limb function.

1. Introduction

Stroke is a major cause of death in the modern world; it also causes sensory, motor, cognitive, and visual impairments and restricts performance of activities of daily living (ADL) [1]. Motor impairments are observed in 80% of stroke patients, and these can include loss of balance and gait [2]. These problems are important targets of rehabilitation, because they reduce the ability of individuals to perform ADL and this result in impaired community activities [3, 4].

Most studies on balance and gait rehabilitation have shown positive effects. However, training-based methods often become tiresome are resource-intensive and require specialized facilities or equipment. Therefore, there is a demand for economical and safe methods of rehabilitation [2].

Virtual reality (VR) is defined by “the use of interactive simulations created with computer hardware and software to present users with opportunities to engage in environments that appear and feel similar to real world objects and events.” Participants interact with projected images, maneuver virtual objects and perform activities programmed into the task, giving the user a sense of immersion in the simulated environment. Various forms of feedback are provided through the environment, the most common being visual and auditory, to enhance enjoyment and motor learning through real-time feedback and immediate results [5]. VR training using these features has recently been widely used in the field of stroke rehabilitation [3]. VR training aims to improve neural plasticity by providing a safe and enriched environment to perform functional task-specific activities with increased repetitions, intensity of practice, and motivation to comply with the intervention [1].

In the field of stroke rehabilitation, VR training is reported to be mostly effective at increasing upper limb joint range of motion, improving sensation, muscle strengthening, reducing pain, and improving functional processes. Recently, various VR programs have been developed and implemented for the lower limbs as well as the upper limbs, and their effects are being tested. VR training for stroke patients has been shown to be safe and cost-effective at improving lower limb function, specifically improving balance, stair climbing speed, ankle muscle strength, range of motion, and gait speed [1]. Compared with existing treatment methods, it may be more effective at improving dynamic balance control and preventing falls in subacute and chronic stroke patients [6].

Treatment methods using VR provide a virtual environment for ADLs that are difficult to perform in a hospital, and therefore, it could be very effective at improving both upper limb and lower limb function. However, because the lower limbs have to support the weight of the body, various elements are required, including muscle strength and balance to control body weight, joint movements, and cognitive ability to integrate these other elements. Although studies related to VR training have been increasing in recent years, VR intervention has been used more extensively to improve upper limb function, which is relatively easier to apply than lower limb function.

Furthermore, doubts could be raised as to whether VR treatment methods for the lower limbs can improve these elements; these doubts related to lack of VR equipment or programs, as well as safety issues or dizziness during treatment. For this reason, we aimed to perform a meta-analysis as a scientific method to test the effects of uncertain treatment methods using statistical methods, in order to examine whether VR training is effective for lower limb function as well as upper limb function.

2. Methods

2.1. Study Search Procedures and Inclusion Criteria

Using the PICOS (Patients, Intervention, Comparison, Outcomes, Study designs) method [7], we investigated patients (P) who had been diagnosed with chronic stroke (more than 6 months after stroke); the intervention (I) was VR rehabilitation therapy, and we compared (C) this with a control group not receiving VR rehabilitation. The outcomes (O) were changes in upper limb function, lower limb function and overall function on daily activity as a primary outcome. Upper limb function was assessed if the chosen instrument measured the impact of upper limb function of individual as FMA-UL, muscle strength related to upper limb, JHFT (Jebsen Taylor Hand Function Test), Pinch ability related to hand, Wolf Motor Function Test, ROM related to upper limb, Kinematic data related to upper limb, Grooved Pegboard Test. MAS of upper limb, Motor Activity Log-quality of movement. Lower limb function was assessed if the chosen instrument measured the impact of lower limb function individual as gait variable like speed and cadence, the tools related to balance, Tinetti Performance Oriented Mobility Assessment, FMA-LL, MAS of lower limb, muscle strength test related to lower limb. Overall function was assessed if the chosen instrument measured the impact of total function of individual on every life style like functional independence measure, total FMA, Barthel index score, quality of life. Study design (S) was randomized control designs. Using OVID, PubMed, and EMBASE, during the same period, two researchers independently searched studies published in English from January 2000 up to June 2018. The search terms used were ‘cerebrovascular accident (CVA),’ “stroke”, and “virtual reality” (Table 1), and discrepancies in the search results were resolved by consensus after a discussion.

A total of 1667 studies were retrieved from the databases after the first search. The inclusion criteria were as follows: studies of patients diagnosed with chronic stroke, studies using VR as a therapeutic intervention, studies that measured function-related changes, and studies that used a randomized controlled trial (RCT) design [8, 9]. The exclusion criteria were graduation theses, books, conference proceedings, single case studies, and quasi-randomized or other qualitative studies. Eventually, 21 articles were included in the meta-analysis based on the PRISMA protocol (Figure 1).

2.2. Quality Assessment

The PEDro scale [31] was used to assess the quality of the selected studies. PEDro scale scores of 9–10 are considered to be of excellent quality, scores of 6–8 points and 4–5 points to be of good and fair quality, respectively, and scores below 4 are of poor quality [32]. The mean PEDro scale score of the selected studies was 6.28 (range from 6 to 8), indicating good quality (Table 2).

2.3. Coding and Data Analysis

For data coding, the authors’ names, year of publication, type of publication, research model, study participants, assessment instruments, type of program, and effects of the program were recorded by consensus between a physiotherapist and a meta-analysis expert. Data analysis was performed using CMA 2.0 (Biostat, Englewood, NJ, USA). Heterogeneity was assessed by means of the value of the I2 statistic, where an I2 value greater than 50% indicated significant heterogeneity. When there was little heterogeneity, pooled analyses were conducted using a fixed effects model. Likewise, when there was great heterogeneity between studies, a random effects model was used [33]. Data were synthesized using a meta-analytic method based on a random effects model due to the small studies even though the results of heterogeneity testing for the studies were not significant (Q(20) = 27.499, I2=27.269, p > 0.05) [7]. All effect sizes were changed to the Hedges g statistic because it contains a small sample bias correction [34, 35]. Sensitivity analysis is an analytical method that examines how results change according to the criteria and contents of analysis. We drop the study that score below 4 point in methodological quality of trials from the meta-analysis to confirm its effect on results for sensitivity analysis [7].

3. Results

3.1. Data and General Characteristics of the Selected Studies

We used 33 effect sizes from 21 studies. There were 562 patients in total. General information about the studies included in the analysis is shown in Table 3.

3.2. Testing for Publication Bias

In the analysis of publication bias, the funnel plot (Figure 2) was symmetrical, and a trim and fill analysis gave a result of 0.440 for both the observed and the adjusted values, 0.440 (0.360–0.520). When we tested Kendall’s tau based on the method by Begg and Mazumdar (1994) [36, 37], there was no significant correlation (τ = .281, p > 0.05). Therefore, we were able to conclude that the studies in this analysis did not show publication bias.

3.3. Analysis of the Total Effect

To analyze the effects of VR rehabilitation programs, we calculated the effect size as the ‘standardized mean difference;’ the total effect size for a random effects model was 0.440, corresponding to a moderate effect size [33], and this was statistically significant (p < 0.05) (95% CI: 0.360–520). A forest plot for all 21 studies is shown in Figure 3. Sensitivity analysis showed that the total effect size of the random effects model was 0.446 and the 95% confidence interval was 0.361-530, which was statistically significant. As a result of the sensitivity analysis, there is little difference in total effect size except for low quality research.

3.4. The Effects of VR Rehabilitation Programs on Functional Improvement

The effect size for upper limb function was 0.431, for lower limb function it was 0.424, and for overall function it was 0.545; these results were statistically significant (p≤0.001) (Table 4). Sensitivity analysis showed that the effect size of the upper limb function was the same as that of the overall function, and the effect size of the lower limb function was 0.432 (CI; 0.339-0.526), which was statistically significant. In other words, there was no significant difference in results except for low quality studies.

3.5. The Effects of VR Rehabilitation Programs on Specific Aspects of Functional Improvement

We compared the effects of VR programs on specific outcomes, and found that, in descending order, it was most effective for improving muscle tension, followed by muscle strength, ADL, joint range of motion, gait, balance, and kinematics. In particular, very large effect sizes were observed for improvements in muscle tension, muscle strength, and ADL. Statistically significant results were observed for all items (p < 0.05) (Table 5).

Sensitivity analysis showed the same results except for balance and gait, but there was no significant difference in balance and gait. In the case of the balance, the effect size of before and after sensitivity analysis were 0.364 (CI: 0.244-0.484) and 0.354 (CI: 0.226-0.482) respectively. In the case of gait, the effect size was 0.445 (CI: 0.309-0.582) before the sensitivity analysis, but the effect size was 0.469 (CI: 0.325-0.613) after the sensitivity analysis.

3.6. Analysis by Program Mode

In a meta-regression analysis by duration of intervention, the slope coefficient was 0.019 (95% CI: −0.022–0.061), and longer duration was associated with larger effect size; however, the slope coefficient was not statistically significant (P > 0.05). Nevertheless, the slope showed a high effect size as the duration approached 8 weeks (Figure 4). In a meta-regression analysis by weekly frequency of intervention, the slope coefficient was –0.016 (95% CI: −0.078–0.046), and as the frequency increased, the effect size decreased; h the slope coefficient was not statistically significant (P > 0.05) (Figure 5).

The sensitivity of the meta-regression analysis was 0.029 for the treatment duration and -0.012 for the frequency per week, which was not statistically significant.

4. Discussion

VR treatment methods are economical, provide clear motivation, can improve the effects of treatment, and can provide opportunities for the user to participate in a realistic environment resembling real objects and events by integrating multiple sensory stimuli through visual, auditory, tactile, and somatosensory systems [1, 3, 5, 14, 38]. For these reasons, VR rehabilitation training has recently emerged as an important method to promote functional recovery after a stroke.

We performed a systematic review and meta-analysis to investigate whether VR rehabilitation training is effective at improving function in chronic stroke patients, and observed moderate effect size (ES = 0.440). Aminov et al. [39] reported that VR provides additional benefits compared to conventional methods, and that it can bring immediate and long-term improvement in post-stroke motor function. We also observed moderate effect size for VR rehabilitation training, suggesting that this technique may be used as a complementary treatment method alongside traditional rehabilitation therapy.

When we performed a subgroup analysis of the effects on functional improvement, the effect size was moderate for upper limb function (ES = 0.431), lower limb function (ES = 0.424), and overall function (ES = 0.545). Therefore, VR rehabilitation training improved lower limb function, including balance and gait, to a similar degree as upper limb function in chronic stroke patients, and it also improved overall physical function. Previous studies reported that use of VR in chronic stroke patients produced significant improvements in functional balance, gait velocity, cadence, and stride length [1], and that performing VR training alongside balance and gait treatment was more effective for improving gait speed and TUG than balance and gait training alone [2]. Other meta-analyses suggested that VR training improves BBS and TUG in chronic stroke patients compared to conventional rehabilitation [3, 40]. Chen et al. [6] provided moderate evidence to support the claim that VR training is effective as a complementary therapy to a standard rehabilitation program to improve balance in chronic stroke patients; however the effects were unclear in acute or subacute stroke patients. In a systematic review, Moreira et al. [4] claimed that training using VR had potential as a method to improve gait parameters in chronic stroke patients, irrespective of the number of participants in the study, participant characteristics, and protocol diversity. Similarly, we found that, although VR programs can cause some discomfort, including dizziness [41], they are as effective at improving lower limb function as they are at improving upper limb function. This is thought to be because most programs included in the analysis consisted of game-based tasks, using equipment such as the Nintendo Wii or Xbox Kinect, meaning that subjects had little difficulty using the programs. Programs in the form of games have similar beneficial effects on upper limb function, lower limb function, and overall function.

Laver et al. [42] reported that VR and interactive video games were no better at improving upper limb function in stroke patients than was conventional treatment, and that their effects on gait speed, balance, participation, and quality of life were also unclear. Nevertheless, implementing VR training together with conventional treatment significantly improved upper limb function and helped improve ADLs in a similar way to extending the overall treatment duration. Most of the studies in our analysis also increased the overall treatment time by adding VR training to conventional treatment, and it is possible that this is the reason we observed effects for both the upper and lower limbs, despite most studies also using game-based programs.

When we investigated the effects of VR rehabilitation training on specific aspects of function in chronic stroke patients, we observed relatively strong effects on muscle tension (ES = 0.755) and muscle strength (ES = 0.722), but only moderate to relatively weak effects on (in descending order of effect size) ADLs, joint range of motion, gait, function, balance, and kinematics (ES = 0.627–0.274). Lee [43] reported that voluntary mobility training using Xbox Kinect improved muscle strength, resulting in improved ability to perform ADLs. In a meta-analysis by Laver et al. [42], VR was found to have a moderate size effect at improving ADLs. Meanwhile, in another systematic report and meta-analysis, Aminov et al. [39] reported that VR training had significant effects on body structure/function and activity level as a complementary measure to conventional treatment methods for post-stroke rehabilitation.

Like previous studies, we also found that VR training could be very helpful for improving muscle strength and ADL. This is thought to be because VR training can enhance high-intensity, repeated, task-oriented training typically used as an evidence-based intervention method in chronic stroke patients.

When we analyzed the effects of VR training by treatment duration, a longer duration was associated with a stronger effect, and analysis of the slope showed that a duration closer to 8 weeks resulted in a strong effect. However, it was not statistically significant (p=0.364).

Also, in the meta-regression analysis by weekly treatment frequency, a higher frequency was actually associated with a reduced effect. However, it was not statistically significant (p=0.614).

Given that physical adaptation to exercise usually occurs after 6–8 weeks [44], our results suggest that duration of at least 8 weeks is required to obtain an effect from VR. However, most of the studies included in our analysis had a duration of 6 weeks or less, and there were only three studies with a duration over 6 weeks. We believe that this is because the characteristics of chronic stroke patients make long-term VR treatment difficult. Nevertheless, researchers should consider the fact that a duration of at least 8 weeks is required for physical adaptation. In other words, it seems that there was not a significant difference in treatment effect because it took some time to adapt to VR treatment in patients with chronic phase. However, since it is not statistically significant, it will be necessary to conduct additional analysis on more research items in the future.

While the treatment duration of most of the included studies was short, there were many studies that increased the weekly treatment frequency. Nevertheless, the meta-regression analysis showed that the studies that increased frequency showed a smaller effect than the studies with lower treatment frequencies. In particular, there was a slight decrease in cases of more than four times. This demonstrates that chronic stroke patients require rest to learn movements. However, the number of studies included in this study was limited and the results were not statistically significant. Therefore, it is considered that there is a limit to interpretation, and it will be necessary to reanalyze more researches in future.

This study had several limitations. First, the lack of studies caused some difficulties performing a subgroup analysis. This is thought to be because we restricted the years of publication and only used three databases. For this reason, further meta-analysis will be required. Second, the type of VR program could also affect the therapeutic effect; however, the intervention types in the studies included in our analysis were mostly game programs, and there were limitations in categorizing these. Therefore, if more diverse training programs are developed in the future, it will be necessary to perform an analysis by program type. Third, even though VR training has been demonstrated to be effective at improving ADLs, because the number of studies included in the analysis was very small, there are limitations in generalizing the results. There have been very few researchers who have measured ADLs, and therefore, in the future, we recommend that researchers plan to study VR by investigating the effects of VR on ADLs.

5. Conclusions

This was a systematic review and meta-analysis to examine whether VR rehabilitation training helps to improve function in chronic stroke patients, and the results showed a moderate-sized effect. Moreover, VR rehabilitation training showed a similar effect for improving lower limb function as it did for upper limb function. Finally, we verified that VR training requires a duration of at least 8 weeks, and that occasional treatment is actually more effective than treatment every day.

This study has a moderate evidence to support the effect of VR on lower extremity function in patients with chronic stroke. Therefore, VR training would be helpful in improving functional outcomes with chronic stroke patients such as gait (speed, cadence, 10MWT, 6MWT), balance (BBS, TUG, postural sway), lower limb movement (FMA, RMI), lower limb strength, and lower limb muscle tone. However, the details on how to use VR program must be set according to the therapeutic goals.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This study was funded by Grant No. EJBS 18-05 from Eulji University in 2018.