Effect of Foot Reflexology Intervention on Depression, Anxiety, and Sleep Quality in Adults: A Meta-Analysis and Metaregression of Randomized Controlled Trials

Wang, Wei-Li; Hung, Hao-Yuan; Chen, Ying-Ren; Chen, Kuang-Huei; Yang, Szu-Nian; Chu, Chi-Ming; Chan, Yuan-Yu

doi:https://doi.org/10.1155/2020/2654353

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusions Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 2654353 | https://doi.org/10.1155/2020/2654353

Effect of Foot Reflexology Intervention on Depression, Anxiety, and Sleep Quality in Adults: A Meta-Analysis and Metaregression of Randomized Controlled Trials

Wei-Li Wang,¹Hao-Yuan Hung,^2,3,4Ying-Ren Chen,^5,6Kuang-Huei Chen,¹Szu-Nian Yang,^1,7,8Chi-Ming Chu,⁹and Yuan-Yu Chan^1,10

Academic Editor: Gerhard Litscher

Received31 Jan 2020

Revised20 Aug 2020

Accepted05 Sept 2020

Published15 Sept 2020

Abstract

Objectives. The aim of this study was to conduct a systematic review, meta-analysis, and metaregression to determine the current best available evidence of the efficacy and safety of foot reflexology for adult depression, anxiety, and sleep quality. Methods. Electronic databases (PubMed, ClinicalKey, ScienceDirect, EMBASE, PsycINFO, and the Cochrane Library) were searched till August, 10, 2020, and the validity of the eligible studies was critically appraised. Randomized controlled trials comparing foot reflexology groups with control groups for adult depression, anxiety, and sleep quality were included. Twenty-six eligible studies were included to assess the effect of foot reflexology intervention on the reducing symptoms of depression and anxiety and improving quality of sleep, respectively, as the primary outcome. Results. Twenty-six randomized controlled trials involving 2,366 participants met the inclusion criteria. The meta-analyses showed that foot reflexology intervention significantly improved adult depression (Hedges’ = −0.921; 95% CI: −1.246 to −0.595; < 0.001), anxiety (Hedges’ = −1.237; 95% CI −1.682 to −0.791; < 0.001), and sleep quality (Hedges’ = −1.665; 95% CI −2.361 to −0.970; < 0.001). Metaregression reveals that an increase in total foot reflexology time ( = 0.002) and duration ( = 0.01) can significantly improve sleep quality. Conclusions. Foot reflexology may provide additional nonpharmacotherapy intervention for adults suffering from depression, anxiety, or sleep disturbance. However, high quality and rigorous design RCTs in specific population, along with an increase in participants, and a long-term follow-up are recommended in the future.

1. Introduction

Foot reflexology is a systemic practice in which a practitioner applies some pressure to any pressure points on the feet to stimulate the body and provide health benefits to different parts of the body. Foot reflexology is commonly practiced as a complementary therapy and is one of the nonpharmacological therapies to alleviate our mental, emotional, and spiritual health, while improving the quality of our life [1].

Foot reflexology is a reflexology intervention that has been applied in different cultures around the world for thousands of years. It is defined as a type of therapy that is based on the stimulation of the nerves and circulatory system of the body in which all the reflexology points, corresponding to different parts of the human body, are considered [2]. It is still ambiguous regarding the mechanism behind the function of foot reflexology, but it certainly has been shown to have potent physiological and psychological effects, perhaps attributed to the relaxation derived from the placebo effect, the therapeutic communication techniques, and impact of touching behavior. The explication for the mechanism of action in foot reflexology is based on the theory that helps to equilibrate the energy in the whole physical structure [3, 4]. Currently, the most promising theory suggests that the benefits of foot reflexology may be caused by modulating our autonomic nervous system [5]. The effects are well known to relieve the psychological symptoms of stress by reducing anxiety and muscle tension [6], calming our mood [7], improving the quality of sleep [8], and facilitating the feeling of well-being [9]. Pharmacological treatment of prevalent symptoms such as depression, anxiety, and sleep disturbance may contribute to the high strain on the body, creating additional side effects [10]. Foot reflexology provides an advantage to certain groups and generally does not cause any damaging effects during certain medical circumstances. Every person’s body circumstance is unique, so outcomes from foot reflexology intervention could differ from one person to another [11].

The previous systematic review had reported physiological and biochemical outcomes associated with foot reflexology intervention [12]. However, there are insufficient number of evidence-based studies that expound the effects of foot reflexology on improving our psychological symptoms such as depression, anxiety, and sleep disturbance. To our knowledge, this is the first systematic review and meta-analysis on the psychological effect of foot reflexology and to identify the possible related factors of foot reflexology in adult participants.

2. Methods

2.1. Reporting Standards

The present study was designed, executed, and adopted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement guidelines [13] and the suggestions by the Cochrane Collaboration [14]. The protocol for this systematic review and meta-analysis is registered with PROSPERO under registration number CRD42020162545.

2.2. Eligibility Criteria

2.2.1. Types of Studies

Randomized controlled trials (RCTs), randomized crossover trials, and cluster randomized trials all met our inclusion criteria. The language of the studies was restricted to English.

2.2.2. Types of Participants

Adults aged 18 years or older without restrictions on sociodemography, race, gender, or health status were participants. All studies that reported on depression, anxiety, or sleep quality were included. There was no restriction on the baseline for these.

2.2.3. Types of Interventions

No further restrictions were made regarding the foot reflexology zone, constitution, length, frequency, or duration of intervention programs. Studies on cointerventions that included foot reflexology as a part of multimodal interventions were excluded because it would be hard to evaluate the influence of foot reflexology from additional modalities. Shame intervention, care-as-usual, nontreatment waitlists, and psychoeducation about depression, anxiety, or sleep hygiene information are considered as the nonactive control group.

2.2.4. Types of Outcome Measures

Studies include, at least, one efficacy outcome index related to depression, anxiety, and sleep quality. Our primary outcome measures of this study were depression, anxiety, and sleep disturbance. Data are presented both at baseline and after intervention. We take various clinical outcomes that were informed in the selected RCTs to show improvements in the symptoms of depression, anxiety, and sleep disturbance into consideration. No restrictions were set on the scales of measurement used to evaluate these outcomes because a wide variety of measures in the outcomes were applied in the studies.

Our secondary outcome of this study was intervention safety, which assessed the number of participants with adverse events, including serious adverse events or nonserious events. Adverse events resulting in death, life-threatening situations, hospitalization, disability or permanent damage, congenital anomaly/birth defect, or the need for medical or surgical intervention to prevent the aforementioned outcomes were defined as serious [15]. All other adverse events were regarded as nonserious.

2.3. Search Methods

The following electronic databases were searched from their inception to August 10, 2020: PubMed, ClinicalKey, ScienceDirect, EMBASE, PsycINFO, and the Cochrane Library. The search was performed using the keywords “foot reflexology,” “depression,” “anxiety,” and “sleep quality.” The complete search through PubMed was conducted using the medical subjective headings (MeSHs) as follows: (foot reflexology [MeSH] OR foot reflexology [Title/Abstract] OR foot massage [MeSH] OR foot massage [Title/Abstract] OR reflexology [MeSH] OR reflexology [Title/Abstract]) AND (depression [MeSH] OR depression [Title/Abstract] OR depressive disorder [MeSH] OR depressive disorder [Title/Abstract] OR anxiety [MeSH] OR anxiety [Title/Abstract] OR anxiety disorder [MeSH] OR anxiety disorder [Title/Abstract] sleep quality [MeSH] OR sleep quality [Title/Abstract] OR insomnia [MeSH] OR insomnia [Title/Abstract] OR sleep disturbance [MeSH] OR sleep disturbance [Title/Abstract]). The search strategy was adapted for each database as necessary.

The references of our retrieved studies and previous systematic reviews were manually screened to ensure a comprehensive search. Additionally, Google Scholar search engine was utilized to identify extra articles that had not yet been included in the previously mentioned electronic databases.

The titles and abstracts were scanned independently by two independent reviewers. When there was disagreement on eligibility, we discussed with a third reviewer to reach a consensus.

2.4. Data Extraction Method

Two reviewers independently extracted general information from the aforementioned selected publications on design and study sample (e.g., article setting, first author’s name/year of publication, and origin), participants (e.g., mean age, gender, clinical characteristics, comorbid conditions, and the number of participants), interventions (e.g., foot reflexology zone, components, frequency, duration, and length of foot reflexology), control interventions (e.g., shame intervention, treatment-as-usual, and waitlist), and outcomes (e.g., outcome measurement tools, measured outcomes, adherence, eventual follow-up time, and adverse events). Any disagreements between the two reviewers should refer to the third reviewer’s opinion.

2.5. Quality and Risk-of-Bias Assessments

Two reviewers independently assessed the risk of bias in each study. There were seven domains of assessment for the risk of bias including the following: (1) random sequence generation, (2) allocation concealment, (3) blinding of participants and personnel, (4) blinding of outcome assessment, (5) incomplete outcome data, (6) selective reporting, and (7) other biases using the Cochrane Systematic Review Manual risk-of-bias assessment tool [16]. These rates were then labeled as “low risk,” “high risk,” or “unclear risk” of bias. A risk-of-bias table was completed for each included study. To improve accuracy, any disagreements would refer to a third reviewer’s opinion.

2.6. Data Synthesis and Statistical Analysis

Meta-analysis was performed using Comprehensive Meta-Analysis Software. The random-effects model was used to calculate the pooled effect size of the included studies. Hedges’ was calculated to determine the effect size [17]. The effect size represents the difference between two groups in the number of standard deviations. An effect size of 0.2–0.49 was considered a small effect, 0.5–0.79 was a moderate effect, 0.8 and higher was a large effect [18]. The meta-analysis results were expressed as the pool effect, with corresponding 95% and value. The heterogeneity data were evaluated using a random-effects model because it accommodated the possibility that the underlying effect differed across studies.

2.7. Assessment of Heterogeneity

Heterogeneity between studies was evaluated using the I² statistic with a cutoff point >50%, and a value ≤0.1 was regarded as a significant degree of heterogeneity. The most common I² scale considered values lower than 25% as low heterogeneity; values between 25%–50% as mean heterogeneity; values between 50%–74% as substantial heterogeneity; and values between 75%–100% as considerable heterogeneity [14]. Random effects of univariate and multivariate meta-regressions were used to explore the source of heterogeneity if I² > 50% and value ≤0.1.

2.8. Moderator Analyses

We performed subgroup meta-analysis and metaregression analysis to examine possible sources of heterogeneity and survey the possible confounding effects of clinical variables. The subgroup analysis produced prespecified covariates, including outcome measurement instruments, study quality, and participant details. Additionally, continuous covariates were obtained from the metaregression analysis to investigate whether relationships were linear and consistent with the results of the categorical analysis. A metaregression model was performed to test between-subgroup interaction, and a value <0.05 indicated a significant difference.

2.9. Risk of Publication Bias

Publication bias was explored if there were up to ten eligible trials included in the meta-analysis. Funnel plots generated using Comprehensive Meta-Analysis Software were estimated from individual studies against each study’s standard error. The presence of asymmetry with a visual inspection in funnel plots was considered potentially indicative of publication bias [19]. Potential publication bias was tested using the calculation of Egger's regression method, with values <0.05 suggesting the presence of bias.

3. Results

3.1. Research Material

The search strategy identified 959 research articles through electronic databases. A total of 912 records were excluded after removal of duplicates and screening of abstracts and titles. Then, all full-text articles were evaluated for eligibility, and 21 records were excluded for reasons such as they were not randomized [20–30], did not include relevant outcomes [31–33], included foot reflexology as a part of a multimodal intervention [34–38], lacked adequate control group [39], has yet to be officially published [40]. Finally, 26 remaining articles with 2,366 participants were investigated by qualitative analyses. All articles were published in English. The flowchart of the study selection process is presented in Figure 1.

3.2. Characteristics of Eligible Studies

The characteristics of the 26 eligible studies are presented in Tables 1 and 2. All study assessed outcomes are listed directly at the end of foot reflexology intervention. Among the 26 RCTs selected for our study efficacy, the psychological symptoms of depression, anxiety, and sleep quality, respectively, were assessed as the primary outcome. Our studies were conducted in Iran, Turkey, Taiwan, South Korea, Japan, and Israel. All of the included studies were published between 2011 and 2020. The sample sizes ranged from 50 to 189 individuals (total 2,366 participants). The average age ranged from 27 to 72 years, and all the participants were adults (age > 18 years). In each study, foot reflexology intervention for one session lasted between 10–60 min (total treatment sessions ranged from 1 to 18 in each study). Also, the total treatment periods ranged from 1 to 8 weeks. Adherence to the foot reflexology was reported in all studies as the percentage in foot reflexology session dropouts. Adherence was >90% in all studies. Evidence of safety issue evaluation was limited because only a few studies report safety-related adverse effects as the secondary outcome. Most of the included studies failed to report on this aspect making research difficult.

3.3. Risk of Bias

3.3.1. Quality of Methods

Risk-of-bias assessment is shown in Table 3. Twenty-six studies were assessed as high or unclear risk of bias in at least one of the domains. All studies reviewed stated they were randomized, whether or not this is true remains uncertain as eight studies did not show their content and method of random sequencing [7, 41–47]. A small proportion of studies were low risk due to the state of detailed randomization and allocation methods [20, 48–52]. Most studies yielded no data material on bias concealment. One study had insufficient data on attrition rates [44]. We found no included studies with potential bias in the domain of selective reporting. Other potential sources of bias were high in 9 RCTs due to poor compliance, incomplete outcome data, small sample size, or obvious baseline differences [41–46, 48, 52, 53].

3.3.2. Publication Bias

The funnel plots on the efficacy of foot reflexology for psychological symptoms for depression, anxiety, and sleep disturbance were executed including 4 RCTs, 16 RCTs, 10 RCTs, respectively. The visual inspection of the funnel plots indicated some risk of publication bias for the effects of foot reflexology only in the domain of anxiety symptoms (shown in Figure 2). Those plots examined were shown to be asymmetrical, suggesting the possible risk of publication bias. Moreover, results of Egger’s regression test indicated no significant publication bias (Egger test intercept = −7.32; = 0.11). Therefore, the overall population effect size was likely to be relatively robust.

3.4. Efficacy Analysis (Results from Each Meta-Analysis) Primary Outcomes

The sizes of effect for selected studies were prominent in depression, anxiety, and sleep disturbance. The data revealed in Table 4 that foot reflexology intervention resulted in significant improvement in adults with depression, anxiety, and sleep problems.

3.4.1. Depression

Four studies [7, 50, 54, 55] investigated depression as the primary outcome following foot reflexology intervention by using different depression outcome measurement tools. These tools included the Beck Depression Inventory Scale; hospital anxiety and depression scale; and depression, anxiety, and stress scale-21 and were used in our meta-analysis. Hedges’ for the overall effect size was −0.921, and the 95% CI was −1.246 to −0.595 (Figure 3). The sample collection sizes of effect for sample collection all came out negative, with Hedges’ ranging from −0.511 to −1.298. Reviewing the results, it is clear that there was significant reduction in depression following foot reflexology intervention, with a large effect size. There was mean heterogeneity among the studies of depression (Q = 5.42, = 0.143, I² = 44.74).

3.4.2. Anxiety

The sixteen studies [45–48, 50, 52–62] examined anxiety as the primary outcome following foot reflexology intervention by using different anxiety outcome measurement tools such as the hospital anxiety and depression scale; depression, anxiety, and stress scale-21; State-Trait Anxiety Inventory; and Visual Analogue Scale of Anxiety and were included in our meta-analysis. Hedges’ for the overall effect size was −1.237, and the 95% CI was −1.682 to −0.791 (Figure 4). The sample collection effect sizes all came out negative, with Hedges’ ranging from −0.259 to −3.644. These results suggested that the overall reduction in anxiety following foot reflexology intervention was significant, with a large effect size. Heterogeneity among the studies of anxiety was considerably large (Q = 217.41, < 0.001, I² = 93.10).

3.4.3. Sleep Quality

Hedges’ of the ten studies [8, 41–44, 49, 51, 62–64] examined sleep quality following foot reflexology intervention by using different outcome measurement tools such as the Pittsburgh Sleep Quailty Index; the Verran and Snyder-Halpern Sleep Scale; St. Mary’s Hospital Sleep Questionnaire; and Richard–Campbell Sleep Questionnaire which were included in our meta-analysis. Hedges’ for the overall effect size was −1.665, and the 95% CI was −2.361 to −0.970 (Figure 5). The effect sizes for sample collection were unsurprisingly all negative, with Hedges’ ranging from −0.548 to −3.621. The meta-analysis revealed that the overall improvement in sleep quality following foot reflexology intervention was significant, with a large effect size. Considerable heterogeneity was observed among the studies in sleep quality where the outcomes measured (Q = 144.87, < 0.001, I² = 93.78).

Substantial heterogeneity was found in the anxiety and sleep quality studies. Therefore, subgroup analyses along with moderator and metaregression analyses were conducted to further explore the determinations of the heterogeneity.

3.5. Secondary Outcomes (Safety)

No adverse events were reported in the few RCTs on foot reflexology intervention for depression, anxiety, and sleep quality. Most of the included studies failed to report this aspect. Dropouts were not treated as adverse events not only because they were not explicitly explaining their personal reasons for dropout in the original study but also because our research material lacked subject commentary.

3.6. Subgroup Analyses and Metaregression Analyses of Anxiety and Sleep Quality

Subgroup analyses and metaregression analyses to investigate any possible confounding clinical variables within the studies are presented in Table 5.

3.6.1. Anxiety

Four RCTs revealed evidence for the effects of foot reflexology when compared with the control group in reducing the anxiety level before adult undergoing coronary angiography (Hedges’ = −1.426, 95% CI was −2.278 to −0.575, < 0.001). Two RCTs revealed evidence for the effects of foot reflexology compared with the control group in reducing the anxiety level for delivering women (Hedges’ = −0.869, 95% CI was −1.702 to −0.869, = 0.041). Significant subgroup differences were identified for the outcome measures (STAI vs. Others; Hedges’ = −1.534 vs. −0.894, < 0.001). Our subgroup analysis performed one session of foot reflexology intervention, before or after interventional surgery, which would be more effective than numerous sessions of foot reflexology intervention, as according to other interventional surgeries or procedure studies (one session vs. numerous sessions; Hedges’ = −1.553 vs. −0.849, < 0.001). Other subgroup analysis indicated cardiovascular surgery or an interventional procedure was less effective than other surgery or interventional procedures (cardiovascular vs. other surgery; Hedges’ = −1.060 vs. −2.340, < 0.001), which significantly reduced the anxiety level of psychological symptoms. The selection bias including random sequence generation and allocation concealment of study also showed significant differences in interactions between subgroups ( < 0.05).

In the exploratory metaregression analysis of anxiety, no significant relationship was observed between the effect size for mean age ( = 0.852) and total length of intervention in one time period ( = 0.903).

3.6.2. Sleep Quality

Subgroup analysis was performed using the parameters study group and participants type. However, results of the subgroup analysis indicated that heterogeneity may have resulted from the abovementioned factors. While performing the metaregression, the mean age of participants, duration of intervention sessions, and total foot reflexology intervention time were required as possible moderating variables. The selection bias including random sequence generation and allocation concealment of study also showed significant differences in interactions between subgroups ( < 0.05).

Regression analyses revealed a positive correlation with the total length of foot reflexology intervention time ( = 0.002) and duration of intervention sessions ( = 0.01), indicating that the more the total length of foot reflexology intervention time and duration of intervention sessions, the more likely it is to have significant results. However, the mean age of participants did not report any significant impact ( = 0.897).

4. Discussion

4.1. Summary of Evidence

We analyzed the impact on foot reflexology on depression, anxiety, and sleep quality. Meta-analysis for improvement of psychological symptoms indicated that the foot reflexology could effectively relieve depression, anxiety, and sleep quality. However, effect sizes of various studies were heterogeneous. In addition, not only did we focus on the possible moderating clinical factors but also investigated the possible confounding effect by the different measurement tools.

Overall, the application of foot reflexology was not associated with degradation of psychological symptoms or a rapid increase in adverse effects. Only a few studies explicitly assessed safety-related, nonserious adverse events. Foot reflexology is most likely a comparatively safe practice for this population. However, future RCTs should take more measures to establish even more accurate reporting of adverse events and personal reasoning for dropouts from participants.

4.2. Comparison with Prior Reviews

No systematic review explicitly focusing on foot reflexology for improving psychological symptoms including depression, anxiety, and sleep quality was accessible. Ours is the first systematic review and meta-analysis with 26 RCTs to focus on the effects of foot reflexology on depression, anxiety, and sleep quality. We identified there is no direct correlation or evidence on previous meta-analysis reports on self-administered foot reflexology with subjective and objective outcomes for healthy persons [65], benefits of foot reflexology for insomnia [66], or effects of foot reflexology on fatigue, sleep, and pain [67]. The studies of these analyses are nonrandomized trials before-and-after studies, and the sample size of these studies was too small. Future research should ensure detailed and precise methodology and adequate sample size to better evaluate the impact of foot reflexology intervention. Results of previous reviews published on 2019 reveal effectiveness of reflexology intervention on premenstrual syndrome [68] and anxiety of patients undergoing cardiovascular interventional procedures [69]. These two recent reviews illustrated that all reflexology intervention practices including hand reflexology and foot reflexology benefited participants in specific groups. Our meta-analysis with 26 RCTs emphasized foot reflexology intervention on depression, anxiety, and sleep quality and conducted further exploration on the determinants of the heterogeneity with subgroup analysis for both categorical and continuous moderators to find significant factors for perceived heterogeneity.

4.3. External and Internal Validity

Major threats to external validity included specific variables of sampled participants and multiple foot reflexology intervention types. The majority of RCTs included participants from Asia. The lack of studies from America, Europe, and Africa was apparent. It might not be applicable to other areas. Heterogeneity is high due to wide variability in participant groups, foot reflexology technique, selection of reflexology zones, foot reflexology intervention duration, and frequency.

Internal validity is limited due to the methodological quality of the included studies. All of the included studies used self-reported questionnaires for depression, anxiety, and sleep quality; thus, recall bias could not be excluded. It remains to be determined whether differences in these parameters could affect results. All of our studies asserted that they had applied randomization methods; however, not all of the studies elaborate on the design protocol and methods of randomization, and some of the included studies seem to not have been truly randomized. It also proves difficult to properly blinding. Only one of the reviewed RCTs successfully implemented blinding in the participants [62]. Erroneous random sequence generation and allocation concealment have been empirically revealed to be a significant source of bias in RCTs [70]. Our included studies only had a low risk or an unclear risk of selection bias with no high risk selection bias. All the effects were robust against potential risk of selection bias, and the internal validity of the review, while limited, is still acceptable.

4.4. Strengths and Weaknesses

This is the first and latest comprehensive systematic review and meta-analysis available on foot reflexology for depression, anxiety, and sleep quality with a large number of randomized controlled trials. None of studies provided any adverse effects of foot reflexology, thereby indicating the importance of using foot reflexology as an effective and less complicated intervention practice. There were seven primary limitations of this review [71]. First, despite great efforts to locate all relevant RCTs of foot reflexology intervention for psychological symptoms, there may be a degree of uncertainty due to a limitation in interlanguage communication, limited resources, and bias in publication. Due to language constraints, we did not include Arab States, Japanese, and Korean database. Second, only one of the studies provided the methods of blinding. Participant blinding is sometimes impossible to fully control; for example, trials in sport, surgical intervention, nonpharmacological therapy, were all not valued as appropriate, lacking pragmatic and systemic aim. Previous studies provided empirical evidence of pronounced bias due to deficiency in patient bias control in related randomized clinical trials with patient-reported outcomes [72]. Third, the critical flaw of this study was the relative lack of high-quality RCTs. The small number of participating studies meant that the statistical power to detect differences was suboptimal. Future large-scale trials may be recommended to demonstrate this effect. Fourth, masseuses often chat with their clients which has a psychological effect which may influence this research. Social interaction has been known to reduce stress and anxiety. If some practitioners speak to their clients while others do not, this would impact results greatly. Control over social interaction is needed for further research. The fifth limitation is the severity of the complaints concerning psychological symptoms and health status of the participants. This was not considered appropriate and was not individually listed in each study. Differences in self-reported questionnaires were found between intervention and control groups in some studies. This may have led to heterogeneity. The sixth limitation was that the intensity (size of strength), frequency (sessions of per week), and duration (time of each session) of foot reflexology interventions were all heterogeneous. Most of the studies were short-term applications without long-term follow-up effects. Lastly, a lack of priority in safety evaluation may have caused each study to produce minimal occurrences in serious adverse events or nonserious events. It only can be assumed that foot reflexology intervention is a low-risk treatment option.

4.5. Implications for Further Research

If possible, we should expand research parameters to include western countries such as Canada or the United States. Different countries may include foot reflexology under their national health insurance or private healthcare plans. If a client has free access to this treatment, they naturally are more inclined to continue (adherence rate would increase). However, if foot reflexology is not covered under a client’s healthcare provided, they would be less likely to continue (adherence rate would decrease). This systematic review and meta-analysis were limited by the low methodological quality of included studies. Further RCTs should enforce thorough methodology and reports, which would mean appropriate sample size, adequate randomization, allocation concealment, intention-to-treat analysis, and bias control of the least one outcome assessors [73]. In order to achieve successful bias control of participants and minimize any physiological effects, a physical force less than the minimal force is required in foot reflexology at nonreflexology areas and may be regarded as a sham control. According to the funnel plots, there could be a publication bias in which authors lose confidence in their published trials if their results produced negative conclusions. The quality of the results of meta-analysis was determined by the quality of the RCT and by sufficient clinical evidence. Thus, if we want to draw a reasonable conclusion for a meta-analysis, we need larger sample sizes and more rigorously randomized controlled trials. Researchers for study interventions may need to apply a standard protocol to specific demographic group. Objective psychological symptoms measuring tools, such as actigraphy or heart rate variability analysis, should be incorporated to more accurately evaluate the effect of foot reflexology. There is a lack of evidence in follow-up effects of foot reflexology in psychological symptoms. So, long-term follow-ups should be necessary in future RCTs. Ample reporting of safety issues with foot reflexology intervention should be utilized in future randomized controlled trials. Limited evidence impaired our research because no studies reported safety-related adverse effects. Most of the included studies failed to report on this aspect.

5. Conclusions

Results of this systematic review and meta-analysis demonstrated that foot reflexology intervention has benefits compared to nonactive control practices in terms of ameliorate the burden of depression, anxiety, and sleep disturbance. Furthermore, metaregression reveals that an increase in total foot reflexology time would decrease anxiety and improve sleep quality. Despite certain flaws in methodology in our included studies, foot reflexology may be recommended as a complementary intervention to improve our depression, anxiety, and sleep quality. However, advanced strength of evidence with future understanding of the mechanisms of foot reflexology and long-term follow-up should be a priority for future preparation and implementation for sensitive groups, such as delivering women or cancer patients, who may be unable to use other means of care and benefit from such care.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that they do not have any conflicts of interest with the conducted research.

Authors’ Contributions

Wei−Li Wang and Ying−Ren Chen conceived and designed the experiments. Wei−Li Wang, Ying−Ren Chen, Hao−Yuan Hung, Yuan−Yu Chan, Kuang−Huei Chen, and Szu−Nian Yang analyzed the data. Hao−Yuan Hung, Yuan−Yu Chan, Chi−Ming Chu. Wrote the paper: Wei−Li Wang, Hao−Yuan Hung, and Yuan−Yu Chan contributed reagents/materials/analysis tools.

Acknowledgments

The authors acknowledge the grant support from the Taoyuan Armed Forces General Hospital, Taiwan (TYAFGH−E−109056). This funding agency did not influence the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

Y. M. Lee, “Effect of self-foot reflexology massage on depression, stress responses and immune functions of middle aged women,” Journal of Korean Academy of Nursing, vol. 36, no. 1, pp. 179–188, 2016.
View at: Publisher Site | Google Scholar
T. Evyapan, Reflexology for Hands and Feet, Arkadas Publishing, Ankara, Turkey, 2012.
K. Cevik, “Complementary and alternative therapies in nursing: reflexology,” International Journal of Nursing, vol. 29, pp. 71–82, 2015.
View at: Google Scholar
N. H. Embong, Y. C. Soh, L. C. Ming, and T. W. Wong, “Perspectives on reflexology: a qualitative approach,” Journal of Traditional and Complementary Medicine, vol. 7, no. 3, pp. 327–331, 2017.
View at: Publisher Site | Google Scholar
C. M. Hughes, S. Krirsnakriengkrai, S. Kumar, and S. M. McDonough, “The effect of reflexology on the autonomic nervous system in healthy adults: a feasibility study,” Alternative Therapies in Health and Medicine, vol. 17, no. 3, pp. 32–37, 2011.
View at: Google Scholar
D. Tiran and H. Chummun, “The physiological basis of reflexology and its use as a potential diagnostic tool,” Complementary Therapies in Clinical Practice, vol. 11, no. 1, pp. 58–64, 2005.
View at: Publisher Site | Google Scholar
F. Mahdavipour, Z. Rahemi, Z. Sadat, and N. M. Ajorpaz, “The effects of foot reflexology on depression during menopause: a randomized controlled clinical trial,” Complementary Therapies in Medicine, vol. 47, Article ID 102195, 2019.
View at: Publisher Site | Google Scholar
L. Zengin and R. Aylaz, “The effects of sleep hygiene education and reflexology on sleep quality and fatigue in patients receiving chemotherapy,” European Journal of Cancer Care, vol. 28, no. 3, Article ID e13020, 2019.
View at: Publisher Site | Google Scholar
A. Ozdelikara and M. Tan, “The effect of reflexology on the quality of life with breast cancer patients,” Complementary Therapies in Clinical Practice, vol. 29, pp. 122–129, 2017.
View at: Publisher Site | Google Scholar
A. Holbrook, R. Crowther, A. Lotter, and Y. Endeshaw, “The role of benzodiazepines in the treatment of insomnia: meta−analysis of benzodiazepine use in the treatment of insomnia,” Journal of the American Geriatrics Society, vol. 49, no. 6, pp. 824–826, 2011.
View at: Publisher Site | Google Scholar
I. Dougans, Complete Illustrated Guide to Reflexology, Element, London, UK, 2nd edition, 1996.
J. E. McCullough, S. D. Liddle, M. Sinclair, C. Close, and C. M. Hughes, “The physiological and biochemical outcomes associated with a reflexology treatment: a systematic review,” Evidence-Based Complementary and Alternative Medicine, vol. 2013, Article ID 502123, 16 pages, 2013.
View at: Publisher Site | Google Scholar
D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and P. Group, “Preferred reporting items for systematic reviews and meta-analyses: the prisma statement,” PLoS Medicine, vol. 6, no. 7, Article ID e1000097, 2009.
View at: Publisher Site | Google Scholar
J. Higgins and S. Green, Cochrane Handbook for Systematic Reviews of Interventions, Wiley, Hoboken, NJ, USA, 2008.
Food and Drug Administration (FDA), What is a Serious Adverse Event? Food and Drug Administration (FDA), White Oak, MD, USA, 2016.
J. P. T. Higgins and G. A. Douglas, “Assessing risk of bias in included studies,” in Cochrane Handbook for Systematic Reviews of Interventions, P. T. H. Julian and S. Green, Eds., pp. 187–241, Wiley-Blackwell, Chichester, UK, 2018.
View at: Publisher Site | Google Scholar
M. Borenstein, L. Hedges, and H. Rothstein, Introduction to Meta-Analysis, Wiley, Chichester, England, 2009.
J. Cohen, Statistical Power Analysis for the Behavioral Science, Lawrence Erlbaum Associates, Hillsdale, NJ, USA, 2nd edition, 1969.
M. Egger, G. Davey Smith, M. Schneider, and C. Minder, “Bias in meta-analysis detected by a simple, graphical test,” BMJ, vol. 315, no. 7109, pp. 629–634, 1997.
View at: Publisher Site | Google Scholar
A. Abbasi Fakhravari, F. Bastani, and H. Haghani, “The effect of foot reflexology massage on the sleep quality of elderly women with restless leg syndrome,” Journal of Client-Centered Nursing Care, vol. 4, pp. 96–103, 2018.
View at: Publisher Site | Google Scholar
M. Asltoghiri and Z. Ghodsi, “The effects of reflexology on sleep disorder in menopausal women,” Procedia—Social and Behavioral Sciences, vol. 31, pp. 242–246, 2012.
View at: Publisher Site | Google Scholar
N. L. Stephenson, S. P. Weinrich, and A. S. Tavakoli, “The effects of foot reflexology on anxiety and pain in patients with breast and lung cancer,” Oncology Nursing Forum, vol. 27, no. 1, pp. 67–72, 2000.
View at: Google Scholar
A. Ozdelikara and S. Agcadiken Alkan, “The effects of reflexology on fatigue and anxiety in patients with multiple sclerosis,” Alternative Therapies in Health and Medicine, vol. 24, no. 4, pp. 8–13, 2018.
View at: Google Scholar
A. Kheyri, F. Bastani, and H. Haghani, “Effect of reflexology on sleep quality of elderly women undergoing abdominal surgery,” Journal of Client-Centered Nursing Care, vol. 2, pp. 11–18, 2016.
View at: Publisher Site | Google Scholar
A. Rahmani, M. Naseri, M. M. Salaree, and B. Nehrir, “Comparing the effect of foot reflexology massage, foot bath and their combination on quality of sleep in patients with acute coronary syndrome,” Journal of Caring Sciences, vol. 5, no. 4, pp. 299–306, 2016.
View at: Publisher Site | Google Scholar
R. Tarrasch, N. N. Carmel Neiderman, S. Ben Ami et al., “The effect of reflexology on the pain-insomnia-fatigue disturbance cluster of breast cancer patients during adjuvant radiation therapy,” The Journal of Alternative and Complementary Medicine, vol. 24, no. 1, pp. 62–68, 2018.
View at: Publisher Site | Google Scholar
Y. Aydin, E. Aslan, and O. Yalcin, “Effect of reflexology to depressive symptoms in women with overactive bladder,” Holistic Nursing Practice, vol. 30, no. 5, pp. 294–300, 2016.
View at: Publisher Site | Google Scholar
S. Moghimi Hanjani, Z. Mehdizadeh Tourzani, and M. Shoghi, “The effect of foot reflexology on anxiety, pain, and outcomes of the labor in primigravida women,” Acta Medica Iranica, vol. 53, no. 8, pp. 507–511, 2015.
View at: Google Scholar
Z. Yilar Erkek and S. Aktas, “The effect of foot reflexology on the anxiety levels of women in labor,” The Journal of Alternative and Complementary Medicine, vol. 24, no. 4, pp. 352–360, 2018.
View at: Publisher Site | Google Scholar
G. Mahmoudirad, M. G. Moslo, and H. Bahrami, “Effect of foot reflexology on anxiety of patients undergoing coronary angiography,” Iranian Journal of Critical Care Nursing, vol. 4, pp. 235–242, 2014.
View at: Google Scholar
J. E. M. McCullough, S. D. Liddle, C. Close, M. Sinclair, and C. M. Hughes, “Reflexology: a randomised controlled trial investigating the effects on beta-endorphin, cortisol and pregnancy related stress,” Complementary Therapies in Clinical Practice, vol. 31, pp. 76–84, 2018.
View at: Publisher Site | Google Scholar
G. Wyatt, A. Sikorskii, I. Tesnjak et al., “A randomized clinical trial of caregiver-delivered reflexology for symptom management during breast cancer treatment,” Journal of Pain and Symptom Management, vol. 54, no. 5, pp. 670–679, 2017.
View at: Publisher Site | Google Scholar
J. Williamson, A. White, A. Hart, and E. Ernst, “Randomised controlled trial of reflexology for menopausal symptoms,” BJOG, vol. 109, no. 9, pp. 1050–1055, 2002.
View at: Publisher Site | Google Scholar
N. Cheraghbeigi, M. Modarresi, M. Rezaei, and A. Khatony, “Comparing the effects of massage and aromatherapy massage with lavender oil on sleep quality of cardiac patients: a randomized controlled trial,” Complementary Therapies in Clinical Practice, vol. 35, pp. 253–258, 2019.
View at: Publisher Site | Google Scholar
S. Azima, H. R. Bakhshayesh, M. Kaviani, K. Abbasnia, and M. Sayadi, “Comparison of the effect of massage therapy and isometric exercises on primary dysmenorrhea: a randomized controlled clinical trial,” Journal of Pediatric and Adolescent Gynecology, vol. 28, no. 6, pp. 486–491, 2015.
View at: Publisher Site | Google Scholar
K. K. Sozen and N. Karabulut, “Efficacy of hand and foot massage in anxiety and pain management following laparoscopic cholecystectomy: a controlled randomized study,” Surgical Laparoscopy, Endoscopy & Percutaneous Techniques, vol. 30, no. 2, 2020.
View at: Publisher Site | Google Scholar
H. S. Alimohammad, Z. Ghasemi, S. Shahriar, S. Morteza, and K. Arsalan, “Effect of hand and foot surface stroke massage on anxiety and vital signs in patients with acute coronary syndrome: a randomized clinical trial,” Complement Ther Clin Pract, vol. 31, pp. 126–131, 2018.
View at: Publisher Site | Google Scholar
J. Hattan, L. King, and P. Griffiths, “The impact of foot massage and guided relaxation following cardiac surgery: a randomized controlled trial,” Journal of Advanced Nursing, vol. 37, no. 2, pp. 199–207, 2002.
View at: Publisher Site | Google Scholar
S. Dehghanmehr, G. H. Sargazi, A. Biabani, S. Nooraein, and J. Allahyari, “Comparing the effect of acupressure and foot reflexology on anxiety and depression in hemodialysis patients: a clinical trial,” Medical—Surgical Nursing Journal, vol. 8, 2020.
View at: Publisher Site | Google Scholar
F. Davodabady, V. Naseri-Salahshour, M. Sajadi, A. Mohtarami, and F. Rafiei, “Randomized controlled trial of the foot reflexology on pain and anxiety severity during dressing change in burn patients,” Burns, 2020.
View at: Google Scholar
L. Valizadeh, A. Seyyedrasooli, V. Zamanazadeh, and K. Nasiri, “Comparing the effects of reflexology and footbath on sleep quality in the elderly: a controlled clinical trial,” Iranian Red Crescent Medical Journal, vol. 17, no. 11, Article ID e20111, 2015.
View at: Publisher Site | Google Scholar
E. Bakir, S. S. Baglama, and S. Gursoy, “The effects of reflexology on pain and sleep deprivation in patients with rheumatoid arthritis: a randomized controlled trial,” Complementary Therapies in Clinical Practice, vol. 31, pp. 315–319, 2018.
View at: Publisher Site | Google Scholar
K. S. Unal and R. Balci Akpinar, “The effect of foot reflexology and back massage on hemodialysis patients’ fatigue and sleep quality,” Complementary Therapies in Clinical Practice, vol. 24, pp. 139–144, 2016.
View at: Publisher Site | Google Scholar
F. Malekshahi, F. Aryamanesh, and S. Fallahi, “The effects of massage therapy on sleep quality of patients with end-stage renal disease undergoing hemodialysis,” Sleep and Hypnosis—International Journal, vol. 2, pp. 91–95, 2017.
View at: Publisher Site | Google Scholar
A. Khaledifar, M. Nasiri, B. Khaledifar, A. Khaledifar, and A. Mokhtari, “The effect of reflexotherapy and massage therapy on vital signs and stress before coronary angiography: an open-label clinical trial,” ARYA Atherosclerosis, vol. 13, no. 2, pp. 50–55, 2017.
View at: Google Scholar
K. Koras and N. Karabulut, “The effect of foot massage on postoperative pain and anxiety levels in laparoscopic cholecystectomy surgery: a randomized controlled experimental study,” Journal of PeriAnesthesia Nursing, vol. 34, no. 3, pp. 551–558, 2019.
View at: Publisher Site | Google Scholar
E. Eguchi, N. Funakubo, K. Tomooka, T. Ohira, K. Ogino, and T. Tanigawa, “The effects of aroma foot massage on blood pressure and anxiety in Japanese community-dwelling men and women: a crossover randomized controlled trial,” PLoS One, vol. 11, no. 3, Article ID e0151712, 2016.
View at: Publisher Site | Google Scholar
N. Pasyar, M. Rambod, and F. R. Kahkhaee, “The effect of foot massage on pain intensity and anxiety in patients having undergone a tibial shaft fracture surgery: a randomized clinical trial,” Journal of Orthopaedic Trauma, vol. 32, no. 12, pp. e482–e486, 2018.
View at: Publisher Site | Google Scholar
k. Oshvandi, S. Abdi, A. Karampourian, A. Moghimbaghi, and S. Homayonfar, “The effect of foot massage on quality of sleep in ischemic heart disease patients hospitalized in CCU,” Iranian Journal of Critical Care Nursing, vol. 7, no. 2, pp. 66–73, 2014.
View at: Google Scholar
T. Bahrami, N. Rejeh, M. Heravi Karimooi, S. D. Tadrisi, and M. Vaismoradi, “The effect of foot reflexology on hospital anxiety and depression in female older adults: a randomized controlled trial,” International Journal of Therapeutic Massage & Bodywork: Research, Education, & Practice, vol. 12, no. 3, pp. 16–21, 2019.
View at: Publisher Site | Google Scholar
M. Rambod, N. Pasyar, and M. Shamsadini, “The effect of foot reflexology on fatigue, pain, and sleep quality in lymphoma patients: a clinical trial,” European Journal of Oncology Nursing, vol. 43, p. 101678, 2019.
View at: Publisher Site | Google Scholar
Y. Abbaszadeh, A. Allahbakhshian, A. Seyyedrasooli, P. Sarbakhsh, S. Goljarian, and N. Safaei, “Effects of foot reflexology on anxiety and physiological parameters in patients undergoing coronary artery bypass graft surgery: a clinical trial,” Complementary Therapies in Clinical Practice, vol. 31, pp. 220–228, 2018.
View at: Publisher Site | Google Scholar
S. Saatsaz, R. Rezaei, A. Alipour, and Z. Beheshti, “Massage as adjuvant therapy in the management of post-cesarean pain and anxiety: a randomized clinical trial,” Complementary Therapies in Clinical Practice, vol. 24, pp. 92–98, 2016.
View at: Publisher Site | Google Scholar
G. O. Noh and K. S. Park, “Effects of aroma self-foot reflexology on peripheral neuropathy, peripheral skin temperature, anxiety, and depression in gynaecologic cancer patients undergoing chemotherapy: a randomised controlled trial,” European Journal of Oncology Nursing, vol. 42, pp. 82–89, 2019.
View at: Publisher Site | Google Scholar
M. Soheili, F. Nazari, V. Shaygannejad, and M. Valiani, “A comparison the effects of reflexology and relaxation on the psychological symptoms in women with multiple sclerosis,” Journal of Education and Health Promotion, vol. 6, p. 11, 2017.
View at: Publisher Site | Google Scholar
H. Shahsavari, “The effects of foot reflexology on anxiety and physiological parameters among candidates for bronchoscopy: a randomized controlled trial,” European Journal of Integrative Medicine, vol. 12, pp. 177–181, 2017.
View at: Publisher Site | Google Scholar
F. Ramezanibadr, K. Amini, K. Hossaingholipor, and S. Faghihzadeh, “The impacts of foot reflexology on anxiety among male candidates for coronary angiography: a three-group single-blind randomized clinical trial,” Complementary Therapies in Clinical Practice, vol. 32, pp. 200–204, 2018.
View at: Publisher Site | Google Scholar
R. Ozturk, U. Sevil, A. Sargin, and M. S. Yucebilgin, “The effects of reflexology on anxiety and pain in patients after abdominal hysterectomy: a randomised controlled trial,” Complementary Therapies in Medicine, vol. 36, pp. 107–112, 2018.
View at: Publisher Site | Google Scholar
M. Bagheri Nesami, S. A. Shorofi, N. Zargar, M. Sohrabi, A. Gholipour Baradari, and A. Khalilian, “The effects of foot reflexology massage on anxiety in patients following coronary artery bypass graft surgery: a randomized controlled trial,” Complementary Therapies in Clinical Practice, vol. 20, no. 1, pp. 42–47, 2014.
View at: Publisher Site | Google Scholar
M. Molavi Vardanjani, N. Masoudi Alavi, N. S. Razavi, M. Aghajani, E. Azizi Fini, and S. M. Vaghefi, “A randomized-controlled trial examining the effects of reflexology on anxiety of patients undergoing coronary angiography,” Nursing and Midwifery Studies, vol. 2, no. 3, pp. 3–9, 2013.
View at: Publisher Site | Google Scholar
I. Levy, S. Attias, T. Stern Lavee et al., “The effectiveness of foot reflexology in reducing anxiety and duration of labor in primiparas: an open-label randomized controlled trial,” Complementary Therapies in Clinical Practice, vol. 38, Article ID 101085, 2020.
View at: Publisher Site | Google Scholar
I. Toygar, O. U. Yesilbalkan, Y. G. Malseven, and E. Sonmez, “Effect of reflexology on anxiety and sleep of informal cancer caregiver: randomized controlled trial,” Complementary Therapies in Clinical Practice, vol. 39, Article ID 101143, 2020.
View at: Publisher Site | Google Scholar
C. Y. Li, S. C. Chen, C. Y. Li, M. L. Gau, and C. M. Huang, “Randomised controlled trial of the effectiveness of using foot reflexology to improve quality of sleep amongst Taiwanese postpartum women,” Midwifery, vol. 27, no. 2, pp. 181–186, 2011.
View at: Publisher Site | Google Scholar
A. Samarehfekri, M. Dehghan, M. Arab, and M. R. Ebadzadeh, “Effect of foot reflexology on pain, fatigue, and quality of sleep after kidney transplantation surgery: a parallel randomized controlled trial,” Evidence-Based Complementary and Alternative Medicine, vol. 2020, Article ID 5095071, 9 pages, 2020.
View at: Publisher Site | Google Scholar
H. J. Song, H. Son, H. J. Seo, H. Lee, S. M. Choi, and S. Lee, “Effect of self-administered foot reflexology for symptom management in healthy persons: a systematic review and meta-analysis,” Complementary Therapies in Medicine, vol. 23, no. 1, pp. 79–89, 2015.
View at: Publisher Site | Google Scholar
W. F. Yeung, K. F. Chung, M. M. Poon et al., “Acupressure, reflexology, and auricular acupressure for insomnia: a systematic review of randomized controlled trials,” Sleep Medicine, vol. 13, no. 8, pp. 971–984, 2012.
View at: Publisher Site | Google Scholar
J. Lee, M. Han, Y. Chung, J. Kim, and J. Choi, “Effects of foot reflexology on fatigue, sleep and pain: a systematic review and meta-analysis,” Journal of Korean Academy of Nursing, vol. 41, no. 6, pp. 821–833, 2011.
View at: Publisher Site | Google Scholar
M. Hasanpour, M. M. Mohammadi, and H. Shareinia, “Effects of reflexology on premenstrual syndrome: a systematic review and meta-analysis,” BioPsychoSocial Medicine, vol. 13, p. 25, 2019.
View at: Publisher Site | Google Scholar
R. Chandrababu, E. L. Rathinasamy, C. Suresh, and J. Ramesh, “Effectiveness of reflexology on anxiety of patients undergoing cardiovascular interventional procedures: a systematic review and meta-analysis of randomized controlled trials,” Journal of Advanced Nursing, vol. 75, no. 1, pp. 43–53, 2019.
View at: Publisher Site | Google Scholar
K. F. Schulz, I. Chalmers, R. J. Hayes, and D. G. Altman, “Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials,” JAMA, vol. 273, no. 5, pp. 408–412, 1995.
View at: Publisher Site | Google Scholar
M. J. Verhoef, A. L. Casebeer, and R. J. Hilsden, “Assessing efficacy of complementary medicine: adding qualitative research methods to the gold standard,” The Journal of Alternative and Complementary Medicine, vol. 8, no. 3, pp. 275–281, 2002.
View at: Publisher Site | Google Scholar
A. Hrobjartsson, F. Emanuelsson, A. S. Skou Thomsen, J. Hilden, and S. Brorson, “Bias due to lack of patient blinding in clinical trials: a systematic review of trials randomizing patients to blind and nonblind sub-studies,” International Journal of Epidemiology, vol. 43, no. 4, pp. 1272–1283, 2014.
View at: Publisher Site | Google Scholar
K. F. Schulz, D. G. Altman, and D. Moher, “Consort 2010 statement: updated guidelines for reporting parallel group randomised trials,” Journal of Pharmacology and Pharmacotherapeutics, vol. 1, no. 2, pp. 100–107, 2010.
View at: Google Scholar

Copyright

Copyright © 2020 Wei-Li Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

8096

Downloads

1876

Citations