Abstract

Background. Mirror therapy has been used in rehabilitation for multiple indications since the 1990s. Current evidence supports some of these indications, particularly for cerebrovascular accidents in adults and cerebral palsy in children. Since 2000s, computerized or robotic mirror therapy has been developed and marketed. Objectives. To map the extent, nature, and rationale of research activity in robotic or computerized mirror therapy and the type of evidence available for any indication. To investigate the relevance of conducting a systematic review and meta-analysis on these therapies. Method. Systematic scoping review. Searches were conducted (up to May 2018) in the Cochrane Library, Google Scholar, IEEE Xplore, Medline, Physiotherapy Evidence Database, and PsycINFO databases. References from identified studies were examined. Results. In sum, 75 articles met the inclusion criteria. Most studies were publicly funded (57% of studies; n = 43), without disclosure of conflict of interest (59% of studies; n = 44). The main outcomes assessed were pain, satisfaction on the device, and body function and activity, mainly for stroke and amputees patients and healthy participants. Most design studies were case reports (67% of studies; n = 50), with only 12 randomized controlled trials with 5 comparing standard mirror therapy versus virtual mirror therapy, 5 comparing second-generation mirror therapy versus conventional rehabilitation, and 2 comparing other interventions. Conclusion. Much of the research on second-generation mirror therapy is of very low quality. Evidence-based rationale to conduct such studies is missing. It is not relevant to recommend investment by rehabilitation professionals and institutions in such devices.

1. Introduction

Mirror therapy was originally described by Ramachandran and Rogers-Ramachandran, who suggested its use in amputees with phantom limb pain [1]. They introduce an inexpensive new device: a mirror was placed vertically on a table so that the mirror reflection of the patient’s intact hand was superimposed on the felt position of the phantom [1]. This standard mirror therapy has been used in rehabilitation for multiple indications since the 1990s [2]. A good level of evidence supports some of these indications, particularly for cerebrovascular accidents in adults [3, 4] and cerebral palsy in children [5]. Cost is very low, because a simple little and not specifically dedicated mirror can be used [1]. Dedicated mirror boxes cost about $65 each [6].

Since 2000s, virtual reality or robot has been developed and marketed to treat various diseases as a more technologically sophisticated version of the standard mirror therapy introduced in 1996 [7, 8]. Robotic devices and virtual reality are increasingly used and assessed in rehabilitation and research [9, 10]. This second-generation devices are probably much more expensive than standard mirror therapy: they often present a technological complexity that requires investment, constant maintenance, and highly qualified operators [11]. Low cost virtual reality device costs about $252 to purchase [12]. Low cost robotic device for robotic gait rehabilitation was estimated to cost $25,000, which is less than 10% of the price of device currently available in Brazil for the same indication [13]. For some indications, virtual reality such as robotics has no greater effectiveness than more conventional techniques [14, 15]. Studies evaluating the impact on various outcomes of these mirror therapy devices exist [8, 16, 17], but no review summarizes the available data.

The purpose of this review was as follows: (1) to map the extent, nature, and rationale of research activity in robotic or computerized mirror therapy; (2) to summarize the main sources and types of evidence available about the effectiveness of these therapies for any indication; (3) to investigate the relevance of conducting a systematic review and meta-analysis on these therapies.

2. Methods

Systematic scoping review was conducted. The methods are based on literature-based guidelines [18, 19].

2.1. Search Strategy

An extensive search of the published and grey literature was conducted. The following electronic databases were searched for articles published in 1996 up to May 2018: Cochrane Library, Google Scholar, IEEE Xplore, Medline, Physiotherapy Evidence Database (PEDRO), and PsycINFO. The search combined terms for mirror therapy and computerized or robotic system. More details on the search strategies used within each database are in Table 1. In addition, the references lists of included studies were reviewed (complementary strategy).

2.2. Eligibility Criteria

The inclusion criteria were as follows:(i)Type of study design: randomized controlled trials (RCTs), nonrandomized controlled trials (NRCTs), interrupted time series (ITS), before-after studies (controlled or not), cohort studies, case-control studies, cases series or case reports, systematic or scoping review, and meta-analysis.(ii)Type of intervention: computerized or robotic based on mirror therapy or full body illusion (with or without additional techniques).(iii)Type of participants: healthy subjects or any kind of patients.(iv)Type of control: none of any kind of control.(v)Type of outcomes: any kind of outcomes.(vi)Languages: English, Esperanto, French, German, Italian, Portuguese, and Spanish.

The exclusion criteria were as follows:(i)Type of study design: feasibility study not on patients or healthy volunteers, technical or development description, protocol, expert opinion, and personal observation.(ii)Type of intervention: transcranial stimulation, electrostimulation, real mirror, or standard mirror box (without computerized or robotic mirror therapy), and computerized or robotic therapy not based on mirror therapy or full body illusion.(iii)Type of participants: nonhuman animal.(iv)Accessibility: only an abstract being available.(v)Originality: data and method not original, already included in the review.

2.3. Study Selection

First, the selection was made by title. Secondly, the abstracts of each study were analysed. Studies that did not meet the eligibility criteria on the basis of the content of their abstracts were excluded. Full-texts of the remaining studies were obtained and the eligibility criteria were again applied.

For references obtained with the complementary approach, the study abstracts were analysed. If required, the full-text versions were obtained to determine whether the studies met our eligibility criteria.

2.4. Level of Evidence

The methodological quality or risk of bias of the included studies has not been appraised. This is consistent with guidance on scoping review conduct [18, 19]. Only the general level of evidence has been specified, according to The Oxford 2011 Levels of Evidence [20]. The general level of evidence for each study was appraised by one reviewer. For RCTs on second-generation mirror therapy versus standard mirror therapy or conventional rehabilitation, the presence or absence of single or double-blindness procedure and primary outcome were noted.

2.5. Data Extraction

Data were extracted by one reviewer into standardised and structured tables. The main data extracted were year of publication, continent, funding, conflict of interest disclosure, rationale for conducting the study, design, type of intervention, number, length and frequency of sessions, type and number of participants, type of outcomes, follow-up duration, main findings, side effects, and suggested indications for using computerized or robotized mirror therapy.

2.6. Data Synthesis

Flow diagram has been created to show the study selection process. The findings were summarized with a narrative description and tables. Considering the large number of studies included and the research objectives, only RCTs on second-generation mirror therapy versus standard mirror therapy or conventional rehabilitation were presented individually.

3. Results

3.1. Selection of Studies

Of the 752 article titles identified by the standard search procedure, 50 articles met the inclusion criteria [12, 16, 2169]. The complementary search strategy gave 25 more articles [7, 8, 17, 7091]. Reasons for exclusion after reading the abstract or the full-text were the following: type of study design (n = 14), type of intervention (n = 17), originality (n = 3), or language (n = 1). Figure 1 shows flow diagram of the study selection process.

3.2. General Characteristics of Included Studies

The first paper was published in 2002 [7]. Sixteen percent of the papers (n = 12) were published in the 2000s and 84% (n = 86) in the 2010s (Table 2).

The studies were conducted in Europe (n = 29), Asia (n = 23), North America (n = 19), and Australia or New Zealand (n = 8) (Table 3).

Most studies were publicly sponsored (57% of studies; n = 43), 9 were privately sponsored, 2 were not sponsored, and for 21 studies funding sources were not reported (Table 4).

A disclosure of conflict of interest was missing from 59% of the studies (n = 44). For those who reported them, 72% (n = 18) declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest, and 28% (n = 7) reported disclosures relevant to the manuscript (Table 5).

3.3. Rationales of Included Studies

The authors justified the relevance of studying second-generation mirror therapy rather than standard mirror therapy in 65% (n = 49) of the included studies. The three most frequent justifications were as follows: to facilitate neuroplasticity through multisensory feedback (not visual only), to increase the range and difficulty of possible training task, and to stimulate patient motivation and engagement (Table 6). For an exhaustive list of rationales, see Table S1 in Supplementary Materials.

3.4. Design of Included Studies

Case series/reports are the most common design (68% of studies; n = 51) (Table 7). Only 12 RCTs and 3 NRCTs are included. In the 12 RCTs included, 5 trials compare standard mirror therapy to virtual mirror therapy [2124, 78]. The others compare second-generation mirror therapy to conventional rehabilitation [6, 27, 51, 52, 58] or different modalities of computer-based mirror therapy [32, 40].

3.5. Type of Intervention

The studies mainly assess the effect of virtual reality (65%; n = 49) [8, 16, 2123, 2832, 3743, 4548, 5053, 5759, 6165, 67, 69, 7274, 7780, 82, 8489] and robotic system (23%; n= 17) [7, 12, 25, 26, 34, 49, 5456, 60, 66, 70, 71, 75, 76, 81, 83] (Table 8). The names of the devices evaluated in the different studies are as follows: Bi-Manu-Track, BioPatRec, Dulex-II, HapticMASTER, Mirror Image Movement Enabler (MIME), Neuromotus, Picdae Robot, Pictogram round (Orange Foundation), TheraMem, Trinus Virtual Reality, Virtual Reality-based Mirror Visual Feedback, VR-Mirror (MedICLab), and YouRehab. The names used to designate the different types of second-generation mirror therapy devices are listed exhaustively in Table S3 (in Supplementary Materials).

Additional treatment or device is present in 12 studies: myoelectric control (n = 3), electro-encephalogram (n = 1), transcranial magnetic stimulation (n = 3), force platform (n = 1), tendon vibration (n = 1), functional electrical simulation (n = 1), machine learning (n = 1), and electromyography signal (n = 1).

Most often only one session was performed (40% of studies; n = 30) (Table 9). When several sessions occurred, they were most often conducted 5 times a week (12% of studies; n = 9) and 2 to 4 times a week (11% of studies; n = 8) (Table 10). The duration of the sessions was most often not mentioned (39% of studies; n = 29). When mentioned, it was most often a 30-minute session (12% of studies; n = 9) (Table 11).

Only one study mentioned the cost of the device [12]. The device was described as low cost and cost for parts and materials was about $252. The installation time before each session was given in only 4 studies; it was 3 to 5 minutes.

3.6. Type and Number of Participants

Participants in each included study were from 1 to 54 (Table 12). A significant number of studies involved only one participant (15%; n = 11).

Twenty-eight studies were conducted on healthy patients. The three most frequent pathologies in patients included were hemiplegia after stroke (n = 30), amputees with phantom limb pain (n = 18), and complex regional pain syndrome (n = 2) (Table 13).

3.7. Type of Outcomes

Forty-five different outcomes are used in all studies. The three most frequently used outcomes are pain, satisfaction with the system, and body functions and activities (Table 14). See Table S2 in Supplementary Materials for an exhaustive list.

Most often these outcomes were assessed over a period of less than 24 hours (43%; n = 32). Seven studies did not report the duration of follow-up (Table 15).

3.8. Findings of Included Studies

Most studies found a positive effect after second-generation mirror therapy sessions (such as decreased pain, increased motor skills or satisfaction, or decreased spasticity) for some outcomes or patients (81% of studies; n = 61). Fourteen studies showed a positive effect for all outcomes and patients (19% of studies) (Table 16).

Many studies have not mentioned anything about the recording of possible side effects (84% of studies; n = 55) (Table 17). The side effects identified are as follows: increment in pain for a period, muscle cramp, lack of comfort, and intensification of phantom experience.

3.9. Suggested Indications

Various possible indications of second-generation mirror therapy were mentioned by the authors of the included studies. The three most frequent were as follows: stroke patients (55% of studies; n = 41), phantom limb pain (33% of studies; n = 25), and complex regional pain syndrome (8% of studies; n = 6) (Table 18).

3.10. Level of Evidence

General level of evidence of included studies was very low (Oxford level of evidence: 2 to 4), with a large majority of 4/5 level studies (1/5 is the best level, 5/5 is the worst) (Table 19).

RCTs on conventional versus second-generation mirror therapy are presented in Table 20. None of them indicate a primary outcome; two are single-blinded, and three were without blindness procedure. RCTs on second-generation mirror therapy versus conventional rehabilitation are presented in Table 21. Two of them indicate a primary outcome; four are single-blinded, and one was without blindness procedure. The others two RCTs compare different virtual reality modalities [82, 90].

4. Discussion

4.1. Summary of Findings

We have mapped the extent, nature, and rationale of research activity in robotic or computerized mirror therapy. The main sources and types of evidence available about the effectiveness of these therapies for any indication are case series or reports. Only five RCTs on conventional versus second-generation mirror therapy exist, and five on second-generation mirror therapy versus conventional rehabilitation. Owing to the heterogeneity of included studies, a meta-analysis was not considered to be appropriate. There is either an absence of a rationale, or a nonevidence-based rationale to justify the conduct of studies on the efficacy of second-generation mirror therapy, despite public funding. Disclosure of conflict of interest was missing for a majority of the included studies.

4.2. Strengths and Weaknesses of the Review

The major strength of this review is the extensive search in 6 electronic databases, especially in the search engine of the world’s largest technical professional organization dedicated to advancing technology (IEEE Xplore). Moreover, the inclusion criteria were broad: seven languages were accepted, as well as any type of design. A potential limitation is that the search was conducted only in English or French in the electronic databases. However, about 1/3 of the studies included come from the Asian continent. Scientific document in Asian language (and particularly Chinese) being prevalent [92], it is possible that there are other studies of better quality in Asian language. However, we systematically reviewed the references lists of included studies, and we have not identified bibliographic references in Asian language in articles by Asian authors. The large number of different types of device name (see Table S3 in Supplementary Materials) probably explains the high number of studies included thanks to the complementary search. The main search did not take into account all the keywords, but this scoping review allowed identifying these keywords in a more exhaustive way.

4.3. Interpretation of Findings
4.3.1. Very Low Level of Evidence

Many studies on second-generation mirror therapy, although publicly funded, have very low levels of evidence. Indeed, internal validity of case series or reports is usually very low, due to the lack of a control group [93]. For example, the effects observed may be wholly or partly due to the placebo effect, research participation effects [94], or the natural history effect [95]. Case series and reports have a great role in pharmacovigilance, rare diseases, or medical education, but not to assess the effectiveness of techniques on relatively common pathologies such as hemiplegia after stroke [96]. Similar limitations exist regarding the internal validity of noncontrol before-after studies.

One explanation for the prevalence of these poor quality studies is the cost and time already invested for the development of the devices [11, 97]. To conduct randomized controlled trials rather than case studies is indeed more costly and time-consuming [98].

4.3.2. Meta-Analysis Not Relevant

If performed, a meta-analysis on second-generation mirror therapy could have as therapeutic control group standard mirror therapy, placebo, or conventional rehabilitation. Ten RCTs meet this requirement (See Tables 20 and 21). However, owing to the heterogeneity of interventions (virtual reality or robot, for arm, leg, or full body), settings (from only one session to 24 sessions during 2 months), participants (healthy participants and various stroke patients), outcome measures (such as perceptions, corticospinal excitability, balance, facial movements, motor impairment), and control groups (real mirror or various rehabilitation training), a meta-analysis is not considered to be appropriate, although it is always difficult deciding just how similar they need to be [99]. This is compounded by the risk of bias in these studies: only 2 have defined primary outcome, and 3 have no blindness procedures.

Even for the most studied population (hemiplegia after cerebral stroke), a meta-analysis does not seem relevant: 7 RCTs are interested in this population, but the interventions are different (robotic mirror therapy (n=4) and virtual reality mirror therapy (n=4)), as are the outcomes investigated (general motor function (n=4), corticospinal excitability (n=1), pusher syndrome (n=1), balance (n=1), lower extremity motor function (n=1), lower limb function (n=1), reach extent (n=1), measure of abnormal synergies (n=1), hemiplegic arm activity (n=1), bilateral arm coordination (n=1), facial movement (=1)), and the number of sessions (9 to 30). The only corpus of studies sufficiently homogeneous to conduct a meta-analysis would be that constituted by the studies of Lum et al. 2002 [7] and 2006 [25], Burgar et al. 2011 [26], and Liao et al. 2011 [81]. However, they include only 131 patients in total. Moreover, the risk of bias in these studies is probably high (simple blinding procedure and no primary outcome for 2 studies). Consequently, conducting a meta-analysis is not relevant.

Batson et al. [100] assessed the quality of evidence used in manufacturers’ submissions for technology appraisal in United Kingdom. It is an important factor in receiving a positive recommendation to recommend the use of new technology in guidelines by National Institute for Health and Care Excellence. They mention the frequent risks of bias in included studies and the failure to explore heterogeneity.

4.3.3. No Evidence-Based Rationales

Rationales to conduct studies on computerized or robotic mirror therapy rather than standard mirror therapy often mention the possibility of intensive and repetitive training and a better or faster recovery (see Results/Rationale of included studies). However, these arguments are not evidence-based. In the present included studies, computerized or robotic sessions occurred mainly 5/weeks during 30 minutes (see Results/Type of intervention). However, standard mirror therapy sessions are also frequent [4, 5]. In addition, the greater effect of robotic or virtual reality rehabilitation rather than conventional rehabilitation is not sure. Cochrane systematic reviews on this topic concluded that “virtual reality and physiotherapy may have similar effects on gait, balance, and quality of life” for Parkinson disease [14] or that “the use of virtual reality and interactive video gaming was not more beneficial than conventional therapy approaches in improving upper limb function” after stroke [101]. When there is effect of robot-assisted training, the quality of evidence is very low or low for improving arm functions after stroke [102] or moderate for improving independent walking in people after stroke [103]. Researchers who have conducted systematic reviews on the topic suggest that the effectiveness of robot-assisted therapy is more due to the high intensity of training than to the treatment modality [102106]: “it seems unlikely that therapy provided by robots will lead to better results than therapy provided by humans under the premise that intensity, amount and frequency of therapy are exactly comparable” [104]. In the specific field of robotic mirror therapy, Burgar et al. give weight to this hypothesis [26].

The absence of a rationale or evidence-based rationale to justify the conduct of studies on the efficacy of second-generation mirror therapy can be explained in several ways. First, researchers would not be trained and encouraged enough to justify the relevance of their research. Therefore, funders may not have sufficient trained staff to rigorously assess the rationale for research projects. Bujar et al. show that quality process during drug development, regulatory review, and health technology assessment is poor, because there is limited training in the science of decision-making from pharmaceutical companies and regulatory authorities [107]. Intellectual bias occur during meeting, which may lead the committee members to believing information which appears more favourable or familiar [108]. Secondly, the commercial interests can take precedence over the public health justification of investing money and time in research in this field. Gøtzsche argues that research ethics committees should require a systematic review of similar previous trials in the application to allow a study to be carried out, so that economic interests do not outweigh the social benefits [109].

4.3.4. Conflict of Interest

Conflict of interest statements may temper the enthusiasm for dataregarding a new device because of the risk of bias of the investigator. Indeed, “sponsorship of drug and device studies by the manufacturing company leads to more favourable efficacy results and conclusions than sponsorship by other sources” [110]. In the included studies in this review, disclosure of conflict of interest was missing from 59% of the studies, and funding sources were not reported for 28%. For those who reported them, 28% reported disclosures relevant to the manuscript, and 12% were privately sponsored. But undeclared payments or funding may occur. Patel et al. show that it was common for payments from Intuitive (the manufacturer of the Da Vinci Robotic Surgery system) to be undeclared in robotic surgery articles [111].

4.3.5. Choice of Control Group Intervention

Among the 10 randomized controlled trials evaluating the efficacy of the second-generation mirror therapy, 5 have as control group conventional rehabilitation and not first-generation mirror therapy.

However, there is evidence of the effectiveness of first-generation mirror therapy for some indications [35]. Second-generation therapies are also more expensive. With the purchase, a mirror box costs about $65 [6], and it is possible to manufacture one so that it is less expensive. Second-generation low cost installations cost at least $250 [12] and $25,000 [13], respectively (ritual virtuality and robotics). The costs of maintenance and professional training to learn how to use the devices must be added.

If the efficiency of second-generation devices is not higher than that of first-generation devices, they are therefore not to be preferred given their costs. Only trials comparing second-generation therapy to first-generation therapy can clarify this point.

4.4. Implications for Practice, Research, and Policy

Given the absence of good empirical evidence of second-generation mirror therapy efficiency, it is not relevant to recommend investment by rehabilitation professionals and institutions in such devices. The practice of mirror therapy with a real mirror, less costly to acquisition, maintenance, and training should be preferred.

Investigators should no longer conduct any more case or report studies on computerized or robotic mirror therapy. They should conduct randomized controlled trials, registered on clinicaltrial.org to limit publication bias. Investigators should use first-generation mirror therapy as control group and systematic and comprehensive disclosure of funding and conflicts of interest. It does not seem reasonable to develop new devices given the costs, time, and resources required, but rather to assess existing devices, especially in the case of public funding. On the other hand, research on mirror therapy with a real mirror or mirror box should continue to emerge given the good quality of evidence already available for certain indications [35]. If a new literature review is conducted on second-generation mirror therapy, search engine queries to identify studies should use comprehensive keywords (see Table S3 in Supplementary Materials).

Public funders and research ethics committees should require evidence-based rationale (with, for example, systematic review of similar previous trials) for ethics of funding approval.

4.5. Conclusion

Despite public funding, much of the research devoted to second-generation mirror therapy is of very low quality. The main sources and types of evidence available about the effectiveness of these therapies for any indication are case series or reports. Only five RCTs on conventional versus second-generation mirror therapy exist and five on second-generation mirror therapy versus conventional rehabilitation. Evidence-based rationale to conduct such studies is often missing. It is not relevant to recommend investment by rehabilitation professionals and institutions in such devices. It does not seem reasonable to develop new devices given the costs, time, and resources required, but rather to assess existing devices with well-conducted randomized controlled trials, especially in the case of public funding.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Supplementary Materials

Table S1. Exhaustive list of rationales cited in the studies for conducting research on mirror robotic systems or mirror virtual reality rather than standard mirror therapy. Table S2. Exhaustive list of outcomes nature used in the included studies. Table S3. Exhaustive list of names used in the included studies to designate the different types of second-generation mirror therapy device. (Supplementary Materials)