The Effects of Acupuncture Treatment on Sleep Quality and on Emotional Measures among Individuals Living with Schizophrenia: A Pilot Study

Reshef, Alon; Bloch, Boaz; Vadas, Limor; Ravid, Shai; Kremer, Ilana; Haimov, Iris

doi:https://doi.org/10.1155/2013/327820

Sleep Disorders

On this page

Abstract Introduction Results Discussion Conflicts of Interests Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2013 | Article ID 327820 | https://doi.org/10.1155/2013/327820

The Effects of Acupuncture Treatment on Sleep Quality and on Emotional Measures among Individuals Living with Schizophrenia: A Pilot Study

Alon Reshef,^1,2Boaz Bloch,^1,2Limor Vadas,^1,3Shai Ravid,¹Ilana Kremer,^2,4and Iris Haimov³

Academic Editor: Michel M. Billiard

Received23 Mar 2013

Revised27 Jun 2013

Accepted15 Jul 2013

Published05 Sept 2013

Abstract

Purpose. To examine the effects of acupuncture on sleep quality and on emotional measures among patients with schizophrenia. Methods. Twenty patients with schizophrenia participated in the study. The study comprised a seven-day running-in no-treatment period, followed by an eight-week experimental period. During the experimental period, participants were treated with acupuncture twice a week. During the first week (no-treatment period) and the last week of the experimental period, participants filled out a broad spectrum of questionnaires and their sleep was continuously monitored by wrist actigraph. Results. A paired-sample t-test was conducted comparing objective and subjective sleep parameters manifested by participants before and after sequential acupuncture treatment. A significant effect of acupuncture treatment was observed for seven objective sleep variables: sleep onset latency, sleep percentage, mean activity level, wake time after sleep onset, mean number of wake episodes, mean wake episode and longest wake episode. However, no significant effects of acupuncture treatment were found for subjective sleep measures. Likewise, the results indicate that acupuncture treatment improved psychopathology levels and emotional measures, that is, depression level and anxiety level. Conclusions. Overall, the findings of this pilot study suggest that acupuncture has beneficial effects as a treatment for insomnia and psychopathology symptoms among patients with schizophrenia.

1. Introduction

Schizophrenia is a mental disorder involving disturbances in basic mental functions, such as emotions, cognition, perception, and other aspects of behavior [1–3]. The clinical picture of schizophrenia is characterized by a mixture of two main categories of core symptoms: positive symptoms (i.e., delusions and hallucinations) and negative symptoms (i.e., apathy, flat affect, and lack of functioning) [4–6]. Its lifetime prevalence is about 1%, with equal distribution between men and women [4]. Schizophrenia is known to be one of the most debilitating and distressful mental disorders, and during its course the disease often deteriorates and becomes chronic [7–9]. Schizophrenia is responsible for tremendous emotional and economic burdens on patients, their families, and society as a whole [8, 10].

Further, it may be valuable to consider schizophrenia as a multidimensional disorder that includes several different domains, among them clinical, neurocognitive, occupational, familial, and societal, and perhaps most important subjective well-being and positive feelings [11]. Besides the core symptoms mentioned above, other clinical expressions of schizophrenia include depressive features, anxiety features and sleep disturbances, of which insomnia is most prevalent [12–14]. The treatment of schizophrenia is complex and should be tailored to the patient, taking into consideration biopsychosocial components. Yet standard treatments, especially biological treatments, are only partially effective and have possible serious side effects.

Insomnia is the most common sleep disorder in psychiatry [15, 16]. Polysomnographic studies have shown that patients with schizophrenia exhibit increased sleep latency manifested by difficulties initiating or maintaining sleep, reduced sleep efficiency and total sleep time, reduced REM latency and REM density, and disturbed non-REM sleep architecture, specifically a decrease in SWS, especially in stage 4 [12, 17–21]. Among patients with schizophrenia, insomnia may precede relapse or appear during exacerbated schizophrenic episodes; it may even complicate schizophrenia to the degree that patients can exhibit suicidal behavior [22, 23].

Many studies have provided evidence showing that insomnia is not simply a typical symptom of depression or of other psychiatric disorders but may actually be a predictor (or an independent risk factor) for the development of such conditions [24, 25]. Further research has indicated that insomnia can be an important indicator in the diagnosis of mental disorder and can also play a role in the deterioration of existing mental disorders [25, 26]. Moreover, Kantrowitz et al. proposed in their study that sleep deficits reflect a core element of schizophrenia [20].

Among patients with schizophrenia, sleep disturbances and, specifically, changes in sleep architecture and sleep quality have an enormous impact on quality of life, level of functioning, and cognitive functioning [20]. Hence, preserving the integrity of sleep among such patients is an important health priority. The most prevalent treatment for insomnia in patients with schizophrenia involves pharmacotherapy. Medication has many disadvantages, among them side effects that add emotional, social, and economic burdens to the existing burden of the disease. For instance, one of the most common treatments for insomnia is the use of benzodiazepines, a heterogeneous class of anxiolytic drugs distinguished by their half-lives. At high doses, benzodiazepines result in across-the-board side effects, notably memory impairment, drowsiness, and increased likelihood of accidents [27]. Another common drug treatment is the use of imidazopyridines, whose effects have been found to resemble those of short-acting benzodiazepines [28–30] but with less influence on sleep architecture, cognitive behaviors, and withdrawal symptoms. In addition, antidepressants, antihistamines, and antipsychotics [31] have been mentioned as treatments for insomnia. Many of these have also been determined to have serious side effects, particularly during prolonged use [32]. Additionally, all drug treatments are relatively contraindicated in pregnancy, sleep apnea, liver or kidney dysfunction, prior history of substance abuse, or certain jobs requiring atypical shifts [27–32].

The disadvantages of drug treatment for insomnia in patients with schizophrenia underline the importance of seeking alternative nonpharmacological treatments, among them complementary medicine techniques such as shiatsu, reflexology, and acupuncture. Moreover, despite recent achievements in psychopharmacology, the pharmacological treatment for schizophrenia is far from satisfactory. Hence, additional treatment modalities are most welcome. Complementary therapies are widely used among psychiatric patients, including patients with schizophrenia. In the western world and in Israel, the most popular modality used for many somatic and mental disorders is acupuncture. Cumulative data suggest that complementary treatment strategies, including acupuncture, can be applied and carefully examined in schizophrenia [33–36].

Acupuncture is one of the oldest healing practices in the world. It is considered to be a safe and effective treatment modality which, according to Traditional Chinese Medicine (TCM), harmonizes the body’s energies [37]. Acupuncture incorporates the use of ultrafine needles (0.15–0.30 mm diameter) inserted into specific points on the skin (acupoints). TCM teaches that the body’s energy, or qi (pronounced chee), flows along a series of points called meridians. Each internal organ has a corresponding meridian, and the application of pressure (acupressure, shiatsu), heat (moxibustion), or needles (acupuncture) to the relevant acupoints is believed to have an impact upon the associated internal organs and thus to harmonize the body’s qi [38]. The exact mechanism by which acupuncture induces physiological changes, relieves pain, and alleviates illness is still unclear. Research has shown that treatment with acupuncture results in nonspecific (placebo response) as well as specific effects such as local and systemic effects, among them an increase in the release of pituitary beta-endorphins and ACTH [38]. This release of endorphins may partly explain the analgesic effects of this treatment, whereas increased ACTH secretion—which leads to elevated serum cortisol levels—may account for its anti-inflammatory effects. Acupuncture can also cause accelerated synthesis and release of serotonin and noradrenaline into the central nervous system, thus activating descending antinociceptive pathways and deactivating multiple limbic areas that promote pain association [38].

Previous studies have demonstrated that acupuncture has a positive influence on a number of diseases and disorders, among them depression, chronic pain, and sleep disorders [39–41]. Nevertheless, tests of the use and effectiveness of acupuncture for mental disorders and sleep disturbances have yielded heterogeneous and inconclusive results [40, 42]. One explanation for these results may be the paucity of studies conducted so far, while another may be the lack of objective outcome measures. Objective sleep assessment may therefore be a preferable outcome measure, in addition to the usual clinical assessment tools. Another explanation may be the difficulty in testing Eastern treatments techniques using impeccable Western methodology.

The correlation between sleep difficulties and schizophrenia along with the data showing the beneficial effects of acupuncture for insomnia suggests that acupuncture may have a positive effect for patients with schizophrenia. Moreover, objective sleep measurement can be an excellent outcome measure and may help answer some validity issues concerning the effectiveness of TCM therapies in schizophrenia.

Accordingly, the current pilot study examines the effects of the acupuncture technique as a treatment for insomnia and as a possible treatment of core symptoms and emotional measures among patients with schizophrenia.

2. Method

The clinical experiment conformed to the principles outlined by the Declaration of Helsinki, and the complete study protocol was approved by the Helsinki Committee of the Haemek Medical Center (number 0015-08-EMC) and by the Institutional Ethics Committee of the Yezreel Academic College of Emek Yezreel (number 0028-YVC). After the study was completely described to all participants, their written informed consent was obtained.

2.1. Participants

Twenty individuals living with schizophrenia or schizoaffective disorder participated in the study (mean age 43.15, SD 9.42; 10 males and 10 females). All the patients were diagnosed as being on the schizophrenia spectrum (i.e., schizophrenia and schizoaffective disorder) (ICD-10 criteria) [43] and were treated with antipsychotic medications. In addition, some of them were treated with combinations of antidepressants and mood stabilizers along with anxiolytic medications, a common practice for the treatment of this clinical population [43].

Inclusion criteria included ICD-10 diagnosis of schizophrenia spectrum, clinical stability with no medication change during one month prior to study beginning.

Participants were ineligible for inclusion in the current study if they demonstrated symptomatic aggravation, suicidality (suicidal ideation or acts) during one month prior to study beginning, substance abuse, or physical or neurological unstable conditions [43].

All participants were recruited from the outpatient clinics of the Department of Psychiatry at Haemek Medical Center. Patients were recruited by a convenience sample since this was a naturalistic pilot design. Patients were consecutive and were not picked at certain days. All participants were living independently in the community or in rehabilitation settings (hostels). All of them had been stable in following their medication regimens for at least one month before the study began. All participants completed the study period; that is, the dropout rate was zero.

2.2. Procedure

The study began with a seven-day running-in, treatment-as-usual period, followed by an eight-week experimental period. During the experimental period, participants were treated with acupuncture twice a week, for a total sequential acupuncture treatment comprising 16 sessions. During the first week of the study (treatment-as-usual period) and the last week of the experimental period, participants’ sleep was continuously monitored with a wrist actigraph, and participants completed a broad spectrum of questionnaires.

2.3. Measurements

General information was provided by a demographic questionnaire suitable for the study population. Evaluations included psychiatric clinical assessment, emotional condition assessment, sleep assessment, and Chinese medicine assessment.

2.3.1. Sleep Measurements

Sleep Questionnaires. All participants completed three questionnaires that subjectively evaluated their sleep patterns: (i) a qualitative questionnaire—the Mini Sleep Questionnaire (MSQ) [44, 45]; (ii) a quantitative informative questionnaire—the Technion Sleep Questionnaire [46]; (iii) a qualitative questionnaire—the Pittsburgh Sleep Quality Index Hebrew Translation (PSQI-H) [47].

Wrist Actigraph Recording. For the purposes of objectively evaluating sleep, each participant’s sleep was continuously monitored over a one-week period by a miniature actigraph worn on the wrist (Mini Motionlogger, Ambulatory Monitoring, Inc., Ardsley, NY, USA). The wrist actigraph facilitates monitoring sleep under natural circumstances with minimal distortions. The actigraph measures wrist activity utilizing a piezoelectric element and translates wrist movements into an electrical signal that is digitized and memorized. Activity is recorded at 60-second intervals [48, 49]. The recordings were analyzed by an automatic algorithm (W2 scoring algorithm) provided by the manufacturer to determine time in bed (total number of minutes from bedtime to wake time), sleep onset latency (time taken to fall asleep from bedtime), sleep percentage (percentage of total sleep time out of total time in bed), mean activity level (mean activity score measured in counts/min), wake time after sleep onset (total number of wake minutes after sleep onset), mean number of wake episodes, mean wake episode (mean number of minutes participant is awake during waking episodes after initially falling asleep), and longest wake episode (number of minutes participant is awake during the longest waking episode after initially falling asleep).

2.3.2. Clinical and Emotional Assessment

Participants were interviewed by a psychiatrist and completed two questionnaires aimed at measuring their clinical morbidity. (1)Brief Psychiatric Rating Scale (BPRS) [50, 51]. (2)Positive and Negative Syndrome Scale (PANSS) [51, 52] for schizophrenia and schizoaffective patients only.

Participants’ level of depression was assessed through two subjective questionnaires. (1)Beck Depression Inventory (BDI) [53, 54] is a 21-item self-report questionnaire. The 21 items correspond to symptoms such as mood, pessimism, and suicidal thoughts. The BDI is an internally consistent and valid measurement [55]. (2)Calgary Depression Scale for schizophrenia (CDSS) is a 9-item test that measures the severity of depression. The CDSS is used to assess depressive symptoms in people with schizophrenia, independent of their positive, negative, and general symptoms [56–58]. The questionnaire rates the severity of symptoms observed in depression, such as low mood, insomnia, agitation, anxiety and weight loss.

Anxiety level was assessed by two questionnaires.(1)State-Trait Anxiety Inventory (STAI) [59–61] is a 40-item self-report measure comprising two 20-item scales. The first scale measures state anxiety, defined as a transitory emotional state or condition, and the second measures trait, character, and logical anxiety [60, 61]. (2)Hamilton Anxiety Rating Scale (HAS) is a 14-item test that measures the severity of anxiety symptoms in children and adults. It provides measures of overall anxiety, psychic anxiety (mental agitation and psychological distress), and somatic anxiety (physical complaints related to anxiety) [62, 63].

Hedonic state was assessed by the Snaith-Hamilton Pleasure Scale (SHAPS). The SHAPS questionnaire includes 14 items that indicate levels of hedonic states [64, 65].

The Quality of Life Enjoyment and Satisfaction Questionnaire (Q-LES-Q) [66, 67] was used to measure participants’ general satisfaction with their life.

2.3.3. Chinese Medicine Assessment

All participants were interviewed by an acupuncture therapist at the beginning of each session (i.e., during the entire 16-session sequence) and answered a diagnostic Chinese medicine questionnaire to assess present diagnosis of physical and mental conditions from the perspective of TCM. This questionnaire assesses physical and mental morbidities, and primary and secondary complaints. In addition, at the beginning of each session, participants’ pulse and tongue measurements were taken using Chinese medicine techniques.

2.4. Acupuncture Treatment

The treatment was acupuncture (needle acupuncture) using standard Chinese needles sized 0.15 mm 0.18 mm, 0.22 mm 0.30 mm, and 0.25 mm 0.40 mm. The use of each size needle and the acupoint corresponding to it were determined by the guidelines set out in the Manual of Acupuncture [68]. Each treatment lasted 30 minutes. The acupoints selected by the practitioners were chosen for their compatibility with the practitioners’ diagnosis of each patient. The treatment regimen and selected acupoints were determined by traditional Chinese medicine diagnosis of syndromes marked by complex sets of signs and symptoms. These syndromes do not fit Western diagnoses such as depression or schizophrenia. For example, the Western diagnosis of depression can be referred to as “liver qi stagnation” or “blood deficiency” or “heart fire” in traditional Chinese medicine. Certified acupuncturists gave the acupuncture treatments, and each patient had his own acupuncturist for all the sessions of this study. The treatment method and acupoints were chosen according to the patient’s diagnosis in an attempt to address each and every patient’s individual condition “as a whole” rather than aiming only at the patient’s sleeping disorder by using a set of “protocol points.”

2.5. Statistical Analysis

A paired sample t-test was conducted comparing psychopathology score, emotional measures, and objective and subjective sleep parameters manifested by participants before and after sequential acupuncture treatment.

3. Results

3.1. Objective and Subjective Sleep Measures

Actigraphic sleep measures included eight measures of sleep quality: time in bed, sleep onset latency, sleep percentage, mean activity level, wake time after sleep onset, mean number of wake episodes, mean wake episode, and longest wake episode. A paired sample t-test was conducted comparing objective sleep parameters manifested by participants before and after sequential acupuncture treatment. A significant effect of acupuncture treatment was observed for seven sleep variables (Table 1).

A significant difference was found in sleep latency (, ), indicating shorter sleep latency following acupuncture treatment (M 14.32, SD 12.81; M 26.63, SD 26.71, resp.) (Figure 1(a)). In addition, a significant difference was found in sleep percentage (, ), indicating higher sleep percentage following acupuncture treatment (M 89.86, SD 7.14) compared with baseline measures (M 84.20, SD 10.76) (Figure 1(b)). Likewise, a significant reduction was found in mean activity level (, ). Following acupuncture treatment, participants were less active during sleep compared to baseline measures (M 13.26, SD 7.63; M 20.04, SD 9.43, resp.) (Figure 1(c)).

(a)

(b)

(c)

(d)

A significant difference was also found in total wake minutes (Figure 1(d)) (, ), indicating fewer total wake minutes during sleep following acupuncture treatment (M 46.58, SD 32.64) compared to baseline measures (M 67.43, SD 45.86). Similarly, significant differences were found in mean wake episodes, long wake episodes, and longest wake episode (, ; , ; , , resp.), revealing shorter mean wake episodes (M 5.42, SD 2.31), shorter long wake episodes (M 2.85, SD 1.54), and shorter longest wake episode (M 18.16, SD 11.55) following acupuncture treatment compared to baseline measures (M 7.21, SD 4.81; M 3.76, SD 1.62; M 25.71, SD 19.20, resp.). However, no significant effect of acupuncture treatment was found for total time in bed (n.s.).

A paired sample t-test was conducted comparing subjective sleep parameters manifested by participants before and after sequential acupuncture treatment. No significant effects of acupuncture treatment were found for subjective sleep measures (n.s.) (Table 1).

3.2. Objective and Subjective Emotional and Clinical Measures

A paired sample t-test was conducted comparing psychopathology score manifested by participants before and after sequential acupuncture treatment (Table 2).

Objective psychopathology levels were measured by the Brief Psychiatric Rating Scale (BPRS) and by the Positive and Negative Syndrome Scale (PANNS). A significant difference was found in psychopathology levels assessed by the Brief Psychiatric Rating Scale (BPRS), indicating that acupuncture improved the general psychopathology score (, ), with a lower general psychopathology score following acupuncture treatment (M 2.14, SD 0.74) compared with the baseline score (M =2.49, SD 0.81) (Figure 2(a)).

(a)

(b)

(c)

(d)

Similarly, the results indicate that acupuncture improved the overall psychopathology score assessed by the Positive and Negative Syndrome Scale (PANNS) (, ), with a lower total psychopathology score following acupuncture treatment (M 2.65, SD 0.94) compared with the baseline measure (M 2.96, SD 0.98).

Likewise, significant differences were found for positive, negative, and general symptoms assessed by the Positive and Negative Syndrome Scale (PANNS) (, ; , ; , , resp.), revealing lower positive, negative, and general symptoms following acupuncture treatment (M 2.04, SD 0.88; M 3.47, SD 1.20; M 2.43, SD 0.93, resp.) compared with baseline measures (M 2.44, SD 1.01; M 3.62, SD 1.20; M 2.83, SD 0.95, resp.) (Figures 2(b), 2(c), and 2(d)).

A paired sample t-test was conducted comparing emotional measures manifested by participants before and after sequential acupuncture treatment (Table 2).

A marginal significant difference was found in depression level as measured by the Beck Depression Inventory (BDI) questionnaire (, ), showing a reduced depression level following acupuncture treatment (M 12.01, SD 11.61) compared with the baseline depression level (M 14.66, SD 11.89). Moreover, a significant difference was found in depression level as measured by the Calgary Depression Scale for schizophrenia (CDSS) questionnaire (, ), revealing a lower depression level following acupuncture treatment (M 4.21, SD 4.90) compared to the baseline depression level (M 7.16, SD 6.43) (Figure 3(a)).

(a)

(b)

In addition, a significant difference was found in anxiety level as measured by the State-Trait Anxiety Inventory (STAI) and by the Hamilton Anxiety Rating Scale (HAS) questionnaires (, ; , , resp.), revealing a lower anxiety level following acupuncture treatment (M 2.12, SD 0.48; M 0.73, SD 0.49) compared with the baseline anxiety level (M 2.27, SD 0.52; M 1.21, SD 0.68) (Figure 3(b)).

A paired sample t-test was conducted comparing quality of life levels manifested by participants before and after sequential acupuncture treatment. The results revealed a marginal significant difference in quality of life level measured by the Quality of Life Enjoyment and Satisfaction Questionnaire (Q-LES-Q) (, ), showing a higher level of quality of life following acupuncture treatment (M 3.70, SD 0.55) compared with the baseline quality of life level (M 3.60, SD 0.58).

However, no significant effects of acupuncture treatment were found for depression level measured by the Beck Depression Inventory (BDI) or for hedonic level measured by the Snaith-Hamilton Pleasure Scale (SHAPS) (n.s.).

3.3. Traditional Chinese Medicine Assessments

The results of the traditional Chinese medicine assessments of patients from this study have been published previously [69].

4. Discussion

In the current pilot study we examined the efficacy of acupuncture treatment for patients with schizophrenia living in the community. Outcome measures included three different domains—sleep measures, clinical and emotional measures, and traditional Chinese medicine assessments. The results following acupuncture treatment indicate a significant improvement in objective sleep measures collected by actigraph device, among them sleep onset latency, sleep percentage, mean activity level, wake time after sleep onset, mean number of wake episodes, mean wake episode, and longest wake episode. The treatment made patients fall asleep faster. They slept better, with less wake time during sleep and reduced activity level during sleep. As a result their sleep was more efficient. Moreover, the results of the current study revealed that, following acupuncture treatment, sleep percentage no longer met the criterion for insomnia (85%) [70].

Interestingly, however, patients did not report any significant subjective improvement in their sleep. These findings raise the possibility of an optional discrepancy between subjective reported sleep measures and objective recorded measures. Many psychiatric disorders are evaluated both by objective and by subjective assessment tools to provide a general and multiangled perspective of the disorder examined. Yet, consistently arising discrepancies between different tools may suggest that these tools actually assess different phenomena. So the question is as follows: do subjective and objective sleep measures assess two distinct phenomena? In fact, several studies have shown that participant reports of their own sleep are only partly correlated to their objective sleep measures [46, 71–74]. The meaning of this difference between subjective sleep report and objective findings is far from being understood in terms of the biological factors involved, the clinical consequences, the treatment modality, and other factors as well. This subjective-objective discrepancy has been found repeatedly among different populations, such as posttrauma patients and elderly patients. Thus, findings revealing this discrepancy in patients with schizophrenia are in line with these studies. However, another explanation for this discrepancy of findings between objective and subjective assessments is the period of assessment of each measure. The objective measurements were taken over a brief period (one week at the end of the acupuncture treatment), while the patients may tend to subjectively assess their overall experience during the course of therapy, which they think may be ineffective. The subjective assessment results may also be heavily influenced by patients’ own interpretation of their symptoms and experience as well as the wordings of the questionnaires.

Most importantly, these findings reinforce the influence of acupuncture on sleep measures, since the effect was found for the objective measures, implying that while the beneficial effect of acupuncture on sleep among patients with schizophrenia may exist, it may not be reportable. This makes the reliability of self-report with respect to sleep a questionable issue. These findings may be very important, since sleep difficulties are very common among patients with schizophrenia [19] and involve distress, malfunctioning, and impairment of quality of life, all directly related to sleep difficulties. Moreover, sleep difficulties and other domains of the psychopathology of schizophrenia, whether positive symptoms or symptoms such as anxiety and depression, have mutual and reciprocal relationships. Thus, sleep difficulties may play a crucial role in treatment resistance, partial remission, or relapse in schizophrenia.

Additionally, the results revealed an improvement in clinical and emotional assessments following acupuncture treatment. The core symptoms of schizophrenia, both positive and negative, as assessed by the Brief Psychiatric Rating Scale (BPRS) and by the Positive and Negative Syndrome Scale (PANSS), exhibited improvement compared to baseline following acupuncture treatments. Both the BPRS and the PANSS are commonly used scales among patients with schizophrenia for clinical diagnosis, for severity assessment, and for monitoring changes in the patient. Significant improvement on these scales shows a high correlation with clinical improvement, both objective and subjective.

This potential effect may be very important, especially in view of the unsatisfactory benefits of antipsychotic medications and the enormous burden of schizophrenia. This finding is concurrent with other studies that showed the beneficial effect of acupuncture on the core psychopathology of schizophrenia [36]. However, those studies had limited methodologies [36]. Likewise, the overall results of those studies are equivocal and insufficient [35].

Another clinical domain assessed was the domain of depression and anxiety. Depression and anxiety are very common in chronic schizophrenia and are connected with poor prognosis, greater distress, and higher rates of suicide [75–77]. It seems that acupuncture may not suffice as a sole treatment but rather can be used, as in this study, as an “add-on” for treating psychopathological domains other than the core domain of schizophrenia. Our study results revealed a significant beneficial effect of acupuncture on depression and anxiety levels, as assessed by the Calgary Depression Scale for schizophrenia (CDSS), by the State-Trait Anxiety Inventory (STAI), and by the Hamilton Anxiety Rating Scale (HAS). Because the symptoms of depression may overlap the negative symptoms of schizophrenia, we used the Calgary Depression Scale for schizophrenia (CDSS), which is used especially for assessing depression in the treatment of patients with schizophrenia. To summarize, the clinical outcome measures of the current study showed an overall improvement in depression, anxiety, and the core symptoms of schizophrenia.

In this study we chose to use acupuncture as an “add-on” treatment, and all of the patients continued their medication treatment as usual. The reason for not using acupuncture as a sole treatment was the unsatisfactory efficacy of acupuncture alone for schizophrenia in studies published so far. Moreover, schizophrenia is a complex disorder with multiple areas of distress and dysfunction, among them intrapsychic, interpersonal, and occupational, with long-term residual symptoms and rehabilitation difficulties. On the other hand, conventional treatment for schizophrenia, even at its best when combining pharmacotherapy, psychotherapy, and rehabilitation, achieves unsatisfactory results and only partial remission. All this suggests that supplemental treatments are of the utmost importance. Acupuncture as a supplementary treatment seems to be a promising option.

The study was carried out in the community with patients with schizophrenia living in hostels in “real life” situations with as few exclusion criteria as possible and without any limitations on the usual (pharmacotherapy, psychotherapy, and rehabilitation) treatment. There were no dropouts at any stage of the study. This zero dropout rate is unusual among general clinical studies and may signify high patient satisfaction with acupuncture treatment and low anxious or paranoid references, which would have been expected among patients with schizophrenia.

Altogether, this pilot study may suggest a good setting for evaluating an “add-on” treatment, and the results may have implications for real treatment choices. This is in contrast to rigorously designed studies, in which conclusions concerning “real life and real patients" are hard to obtain, or at least problematic.

This pilot study has several methodological limitations. Although the study used a within-subject design, it included a pre- and posttreatment evaluation but not a comparison with a control group, thus overlooking some other explanation for the effect. Therefore, the current study was vulnerable to placebo bias, either by participants or by therapists. Likewise, in this study, many statistical tests were performed, so there was a risk of committing type I errors.

Remarkably, we found a consistent and interesting change in many qualities that were not systematically assessed, such as changes in patients’ voices, general appearance, posturing, pace and movement, and vitality. Since all of these and many more qualities are familiar to TCM therapists, and since TCM treatment aims at relieving a broad spectrum of symptoms and distress, new assessment tools should be developed for similar future studies. Furthermore, since all these qualities seem to be connected to different aspects of well-being and quality of life, it may be equally important to develop new assessment tools for conventional pharmacotherapeutic studies.

In summary, to the best of our knowledge this is the first study to evaluate the efficacy of acupuncture on sleep in patients with schizophrenia using actigraph sleep measurement as an objective efficacy measure. Our results suggest that, for patients with schizophrenia, acupuncture treatment may have a possible beneficial effect on clinical core schizophrenic symptoms and on depressive and anxiety symptoms. Moreover, for patients with schizophrenia the results suggest a possible beneficial effect of acupuncture treatment on objective sleep but not on the patients’ subjective experience in the short term while the patients are undergoing eight weeks of therapy. These findings need to be validated in future studies; that is, large randomized controlled trials are required to assess the efficacy of acupuncture treatment for insomnia among patients with schizophrenia.

The results of the current study demonstrated the potential short-term benefits of acupuncture. Future studies should examine whether these benefits will be maintained after cessation of therapy or whether acupuncture must be continued forever to maintain the benefits. Therefore, future studies are needed to validate the benefits of long-term acupuncture treatment. Since the results of the current study revealed that no patient experienced any adverse effects throughout the course of therapy, there is definitely room to check the feasibility of long-term acupuncture treatment among patients with schizophrenia.

Conflicts of Interests

We declare that this was not an industry-supported study. This study was not supported by a grant or by funders. No conflict of interests exists in our research. None of the authors or our institutions has any financial or other relationship that might have inappropriately influenced our writing.

Authors’ Contribution

Alon Reshef and Boaz Bloch contributed equally to this research.

Acknowledgments

The authors acknowledge the generous support of the participants and the generous assistance of several research assistants during the data collection process: Bendrihem Ronen, Levi Miri, Rabinovich Beeri, and Dvir Inbal.

References

R. W. Heinrichs and K. K. Zakzanis, “Neurocognitive deficit in schizophrenia: a quantitative review of the evidence,” Neuropsychology, vol. 12, no. 3, pp. 426–445, 1998.
View at: Publisher Site | Google Scholar
A. I. Green, M. S. Salomon, M. J. Brenner, and K. Rawlins, “Treatment of schizophrenia and comorbid substance use disorder,” CNS and Neurological Disorders—Drug Targets, vol. 1, no. 2, pp. 129–139, 2002.
View at: Google Scholar
P. F. Buckley, B. J. Miller, D. S. Lehrer, and D. J. Castle, “Psychiatric comorbidities and schizophrenia,” Schizophrenia Bulletin, vol. 35, no. 2, pp. 383–402, 2009.
View at: Publisher Site | Google Scholar
American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders, American Psychiatric Press, Washington, DC, USA, 4th edition, 1994.
J. S. Brekke, J. D. Long, N. Nesbitt, and E. Sobel, “The impact of service characteristics on functional outcomes from community support programs for persons with schizophrenia: a growth curve analysis,” Journal of Consulting and Clinical Psychology, vol. 65, no. 3, pp. 464–475, 1997.
View at: Publisher Site | Google Scholar
R. Hunter and S. Barry, “Negative symptoms and psychosocial functioning in schizophrenia: neglected but important targets for treatment,” European Psychiatry, vol. 27, no. 6, pp. 432–436, 2012.
View at: Publisher Site | Google Scholar
E. Y. H. Chen, C. L. Kwok, J. W. Y. Au, R. Y. L. Chen, and B. S. T. Lau, “Progressive deterioration of soft neurological signs in chronic schizophrenic patients,” Acta Psychiatrica Scandinavica, vol. 102, no. 5, pp. 342–349, 2000.
View at: Publisher Site | Google Scholar
A. Oni-Orisan, L. V. Kristiansen, V. Haroutunian, J. H. Meador-Woodruff, and R. E. McCullumsmith, “Altered vesicular glutamate transporter expression in the anterior cingulate cortex in schizophrenia,” Biological Psychiatry, vol. 63, no. 8, pp. 766–775, 2008.
View at: Publisher Site | Google Scholar
G. Venkatasubramanian and M. S. Keshavan, “Early intervention in psychosis: perspectives on Asian studies,” Asian Journal of Psychiatry, vol. 5, no. 1, pp. 1–2, 2012.
View at: Publisher Site | Google Scholar
K. T. Mueser, D. P. Valentiner, and J. Agresta, “Coping with negative symptoms of schizophrenia: patient and family perspectives,” Schizophrenia Bulletin, vol. 23, no. 2, pp. 329–339, 1997.
View at: Google Scholar
J. P. Lindenmayer, R. Bernstein-Hyman, and S. Grochowski, “Five-factor model of schizophrenia,” Journal of Nervous and Mental Disease, vol. 182, no. 11, pp. 631–638, 1994.
View at: Google Scholar
J. M. Monti and D. Monti, “Sleep in schizophrenia patients and the effects of antipsychotic drugs,” Sleep Medicine Reviews, vol. 8, no. 2, pp. 133–148, 2004.
View at: Publisher Site | Google Scholar
S. Zisook, M. Nyer, J. Kasckow, S. Golshan, D. Lehman, and L. Montross, “Depressive symptom patterns in patients with chronic schizophrenia and subsyndromal depression,” Schizophrenia Research, vol. 86, no. 1-3, pp. 226–233, 2006.
View at: Publisher Site | Google Scholar
K. Wulff, D. Dijk, B. Middleton, R. G. Foster, and E. M. Joyce, “Sleep and circadian rhythm disruption in schizophrenia,” The British Journal of Psychiatry, vol. 200, no. 4, pp. 308–316, 2012.
View at: Publisher Site | Google Scholar
D. Riemann, “Insomnia and comorbid psychiatric disorders,” Sleep Medicine, vol. 8, supplement 4, pp. S15–S20, 2007.
View at: Publisher Site | Google Scholar
W. Szelenberger and C. Soldatos, “Sleep disorders in psychiatric practice,” World Psychiatry, vol. 4, no. 3, pp. 186–190, 2005.
View at: Google Scholar
J. M. Kane and Z. A. Sharif, “Atypical antipsychotics: sedation versus efficacy,” Journal of Clinical Psychiatry, vol. 69, supplement 1, pp. 18–31, 2008.
View at: Google Scholar
J. Poulin, A. M. Daoust, G. Forest, E. Stip, and R. Godbout, “Sleep architecture and its clinical correlates in first episode and neuroleptic-naive patients with schizophrenia,” Schizophrenia Research, vol. 62, no. 1-2, pp. 147–153, 2003.
View at: Publisher Site | Google Scholar
S. Cohrs, “Sleep disturbances in patients with schizophrenia: impact and effect of antipsychotics,” CNS Drugs, vol. 22, no. 11, pp. 939–962, 2008.
View at: Publisher Site | Google Scholar
J. Kantrowitz, L. Citrome, and D. Javitt, “GABAB receptors, schizophrenia and sleep dysfunction: a review of the relationship and its potential clinical and therapeutic implications,” CNS Drugs, vol. 23, no. 8, pp. 681–691, 2009.
View at: Publisher Site | Google Scholar
J. A. Costa e Silva, “Sleep disorders in psychiatry,” Metabolism: Clinical and Experimental, vol. 55, supplement 2, pp. S40–S44, 2006.
View at: Publisher Site | Google Scholar
American Sleep Disorders Association, International Classification of Sleep Disorders, Revised: Diagnostic and Coding Manual, American Sleep Disorders Association, Rochester, Minn, USA, 1997.
D. P. van Kammen, W. B. van Kammen, J. L. Peters et al., “CSF MHPG sleep and psychosis in schizophrenia,” Clinical Neuropharmacology, vol. 9, no. 4, pp. 575–577, 1986.
View at: Google Scholar
E. O. Johnson, T. Roth, and N. Breslau, “The association of insomnia with anxiety disorders and depression: exploration of the direction of risk,” Journal of Psychiatric Research, vol. 40, no. 8, pp. 700–708, 2006.
View at: Publisher Site | Google Scholar
M. J. Peterson, M. E. Rumble, and R. M. Benca, “Insomnia and psychiatric disorders,” Psychiatric Annals, vol. 38, no. 9, pp. 597–605, 2008.
View at: Publisher Site | Google Scholar
E. Collier, G. Skitt, and H. Cutts, “A study on the experience of insomnia in a psychiatric inpatient population,” Journal of Psychiatric and Mental Health Nursing, vol. 10, no. 6, pp. 697–704, 2003.
View at: Publisher Site | Google Scholar
W. B. Mendelson, “Combining pharmacologic and nonpharmacologic therapies for insomnia,” Journal of Clinical Psychiatry, vol. 68, no. 5, pp. 19–23, 2007.
View at: Google Scholar
J. D. Hoehns and P. J. Perry, “Zolpidem: a nonbenzodiazepine hypnotic for treatment of insomnia,” Clinical Pharmacy, vol. 12, no. 11, pp. 814–828, 1993.
View at: Google Scholar
M. B. Scharf, T. Roth, G. W. Vogel, and J. K. Walsh, “A multicenter, placebo-controlled study evaluating Zolpidem in the treatment of chronic insomnia,” Journal of Clinical Psychiatry, vol. 55, no. 5, pp. 192–199, 1994.
View at: Google Scholar
S. H. Shaw, H. Curson, and J. P. Coquelin, “A double-blind, comparative study of zolpidem and placebo in the treatment of insomnia in elderly psychiatric in-patients,” Journal of International Medical Research, vol. 20, no. 2, pp. 150–161, 1992.
View at: Google Scholar
M. J. Sateia and P. D. Nowell, “Insomnia,” The Lancet, vol. 364, no. 9449, pp. 1959–1973, 2004.
View at: Publisher Site | Google Scholar
W. V. McCall, “Pharmacologic treatment of insomnia,” in Sleep Medicine, T. L. Lee-Ching, M. J. Satia, and M. A. Carskadon, Eds., pp. 169–176, Hanley and Blfus, Philadelphia, Pa, USA, 2002.
View at: Google Scholar
J. Rathbone, L. Zhang, M. Zhang et al., “Chinese herbal medicine for schizophrenia: cochrane systematic review of randomised trials,” The British Journal of Psychiatry, vol. 190, pp. 379–384, 2007.
View at: Publisher Site | Google Scholar
J. T. Shuval, N. Mizrachi, and E. Smetannikov, “Entering the well-guarded fortress: alternative practitioners in hospital settings,” Social Science and Medicine, vol. 55, no. 10, pp. 1745–1755, 2002.
View at: Publisher Site | Google Scholar
J. Rathbone and J. Xia, “Acupuncture for schizophrenia,” Cochrane Database of Systematic Reviews, no. 4, Article ID CD005475, 2005.
View at: Google Scholar
M. S. Lee, B. C. Shin, P. Ronan, and E. Ernst, “Acupuncture for schizophrenia: a systematic review and meta-analysis,” International Journal of Clinical Practice, vol. 63, no. 11, pp. 1622–1633, 2009.
View at: Publisher Site | Google Scholar
H. MacPherson, K. Thomas, S. Walters, and M. Fitter, “The York acupuncture safety study: prospective survey of 34 000 treatments by traditional acupuncturists,” The British Medical Journal, vol. 323, no. 7311, pp. 486–487, 2001.
View at: Google Scholar
C. M. H. Goertz, R. Niemtzow, S. M. Burns, M. J. Fritts, C. C. Crawford, and W. B. Jonas, “Auricular acupuncture in the treatment of acute pain syndromes: a pilot study,” Military Medicine, vol. 171, no. 10, pp. 1010–1014, 2006.
View at: Google Scholar
R. C. Kessler, J. Soukup, R. B. Davis et al., “The use of complementary and alternative therapies to treat anxiety and depression in the United States,” The American Journal of Psychiatry, vol. 158, no. 2, pp. 289–294, 2001.
View at: Publisher Site | Google Scholar
D. K. Cheuk, W. F. Yeung, K. F. Chung, and V. Wong, “Acupuncture for insomnia,” Cochrane Database of Systematic Reviews, no. 3, Article ID CD005472, 2007.
View at: Google Scholar
W. F. Yeung, K. F. Chung, M. M. Poon et al., “Acupressure, reflexology, and auricular acupressure for insomnia: a systematic review of randomized controlled trials,” Sleep Medicine, vol. 13, no. 8, pp. 971–984, 2012.
View at: Publisher Site | Google Scholar
M. D. Kutch, “Cost-effectiveness analysis of complementary and alternative medicine in treating mental health disorders,” Dissertation Abstracts International A, vol. 71, no. 11, p. 4102, 2011.
View at: Google Scholar
World Health Organisation, International Statistical Classification of Diseases and Related Health Problems, 10th Revision (ICD-10), WHO, Geneva, Switzerland, 1992.
J. Zomer, R. Peled, A. H. E. Rubin, and P. Lavie, “Mini Sleep Questionnaire (MSQ) for screening large populations for EDS complaints,” in Sleep 1984, W. P. Koella, E. Ruther, and H. Schulz, Eds., pp. 467–469, Gustav Fischer, New York, NY, USA, 1985.
View at: Google Scholar
O. Tzischinsky, A. Cohen, E. Doveh et al., “Screening for sleep disordered breathing among applicants for a professional driver's license,” Journal of Occupational and Environmental Medicine, vol. 54, no. 10, pp. 1275–1280, 2012.
View at: Publisher Site | Google Scholar
I. Haimov, N. Breznitz, and S. Shiloh, “Sleep in healthy elderly: sources of discrepancy between self-report and recorded sleep,” in Clinical and Neurophysiological Aspects of Sleep, V. M. Kumar and H. N. Mallick, Eds., pp. 145–148, Medimond, International Proceedings, 2006.
View at: Google Scholar
T. Shochat, O. Tzischinsky, A. Oksenberg, and R. Peled, “Validation of the Pittsburgh sleep quality index hebrew translation (PSQI-H) in a sleep clinic sample,” Israel Medical Association Journal, vol. 9, no. 12, pp. 853–856, 2007.
View at: Google Scholar
J. O. Brooks III, L. Friedman, D. L. Bliwise, and J. A. Yesavage, “Use of the wrist actigraph to study insomnia in older adults,” Sleep, vol. 16, no. 2, pp. 151–155, 1993.
View at: Google Scholar
C. Mccall and W. V. Mccall, “Comparison of actigraphy with polysomnography and sleep logs in depressed insomniacs,” Journal of Sleep Research, vol. 21, no. 1, pp. 122–127, 2012.
View at: Publisher Site | Google Scholar
J. E. Overall and D. E. Gorham, “The brief psychiatric rating scale,” Psychological Reports, vol. 10, no. 3, pp. 799–812, 1962.
View at: Google Scholar
M. Sherwood, A. E. Thornton, and W. G. Honer, “A quantitative review of the profile and time course of symptom change in schizophrenia treated with clozapine,” Journal of Psychopharmacology, vol. 26, no. 9, pp. 1175–1184, 2012.
View at: Google Scholar
S. R. Kay, L. A. Opler, and J. P. Lindenmayer, “Reliability and validity of the positive and negative syndrome scale for schizophrenics,” Psychiatry Research, vol. 23, no. 1, pp. 99–110, 1988.
View at: Google Scholar
A. T. Beck and R. A. Steer, Beck Depression Inventory Manual, The Psychological Corporation, San Antonio, Tex, USA, 1987.
Y. J. Lee, S. J. Cho, I. H. Cho, J. H. Jang, and S. J. Kim, “The relationship between psychotic-like experiences and sleep disturbances in adolescents,” Sleep Medicine, vol. 13, no. 8, pp. 1021–1027, 2012.
View at: Google Scholar
A. T. Beck, R. A. Steer, and M. G. Garbin, “Psychometric properties of the beck depression inventory: twenty-five years of evaluation,” Clinical Psychology Review, vol. 8, no. 1, pp. 77–100, 1988.
View at: Google Scholar
M. J. Müller, H. Brening, C. Gensch, J. Klinga, B. Kienzle, and K. M. Müller, “The calgary depression rating scale for schizophrenia in a healthy control group: psychometric properties and reference values,” Journal of Affective Disorders, vol. 88, no. 1, pp. 69–74, 2005.
View at: Publisher Site | Google Scholar
R. Schennach, M. Obermeier, F. Seemüller et al., “Evaluating depressive symptoms in schizophrenia: a psychometric comparison of the calgary depression scale for schizophrenia and the Hamilton depression rating scale,” Psychopathology, vol. 45, no. 5, pp. 276–285, 2012.
View at: Publisher Site | Google Scholar
O. Schwartz-Stav, A. Apter, and G. Zalsman, “Depression, suicidal behavior and insight in adolescents with schizophrenia,” European Child and Adolescent Psychiatry, vol. 15, no. 6, pp. 352–359, 2006.
View at: Publisher Site | Google Scholar
A. Okun, R. E. K. Stein, L. J. Bauman, and E. J. Silver, “Content validity of the psychiatric symptom index, CES-depression scale, and state-trait anxiety inventory from the perspective of DSM-IV,” Psychological Reports, vol. 79, no. 3, pp. 1059–1069, 1996.
View at: Google Scholar
C. D. Spielberger, R. L. Gorusch, and R. E. Lushene, Manual for the State-Trait Inventory (Self-Evaluation Questionnaire), Consulting Psychologists Press, Palo Alto, Calif, USA, 1970.
R. Meades and S. Ayers, “Anxiety measures validated in perinatal populations: a systematic review,” Journal of Affective Disorders, vol. 133, no. 1-2, pp. 1–15, 2011.
View at: Publisher Site | Google Scholar
W. Maier, R. Buller, M. Philipp, and I. Heuser, “The Hamilton anxiety scale: reliability, validity and sensitivity to change in anxiety and depressive disorders,” Journal of Affective Disorders, vol. 14, no. 1, pp. 61–68, 1988.
View at: Publisher Site | Google Scholar
M. Bellani, J. P. Hatch, M. A. Nicoletti et al., “Does anxiety increase impulsivity in patients with bipolar disorder or major depressive disorder?” Journal of Psychiatric Research, vol. 46, no. 5, pp. 616–621, 2012.
View at: Publisher Site | Google Scholar
R. P. Snaith, M. Hamilton, S. Morley, A. Humayan, D. Hargreaves, and P. Trigwell, “A scale for the assessment of hedonic tone. The Snaith-Hamilton pleasure scale,” The British Journal of Psychiatry, vol. 167, no. 1, pp. 99–103, 1995.
View at: Google Scholar
J. Thomas, M. Al Ali, A. Al Hashmi, and A. Rodriguez, “Convergent validity and internal consistency of an Arabic Snaith Hamilton pleasure acale,” International Perspectives in Psychology: Research, Practice, Consultation, vol. 1, no. 1, pp. 46–51, 2012.
View at: Google Scholar
J. Endicott, J. Nee, W. Harrison, and R. Blumenthal, “Quality of life enjoyment and satisfaction questionnaire: a new measure,” Psychopharmacology Bulletin, vol. 29, no. 2, pp. 321–326, 1993.
View at: Google Scholar
A. Luquiens, M. Reynaud, B. Falissard, and H. J. Aubin, “Quality of life among alcohol-dependent patients: How satisfactory are the available instruments? A systematic review,” Drug and Alcohol Dependence, vol. 125, no. 3, pp. 192–201, 2012.
View at: Publisher Site | Google Scholar
P. Deadman and M. Al-Khafaji, A Manual of Acupuncture, Journal of Chinese Medicine Publications, England, UK, 1998.
B. Bloch, S. Ravid, L. Vadas et al., “The acupuncture treatment of schizophrenia: a review with case studies,” Journal of Chinese Medicine, no. 93, pp. 57–63, 2010.
View at: Google Scholar
I. V. Zhdanova, R. J. Wurtman, M. M. Regan, J. A. Taylor, J. P. Shi, and O. U. Leclair, “Melatonin treatment for age-related insomnia,” Journal of Clinical Endocrinology and Metabolism, vol. 86, no. 10, pp. 4727–4730, 2001.
View at: Publisher Site | Google Scholar
L. Zhang and Z. Zhao, “Objective and subjective measures for sleep disorders,” Neuroscience Bulletin, vol. 23, no. 4, pp. 236–240, 2007.
View at: Publisher Site | Google Scholar
I. Kobayashi, J. M. Boarts, and D. L. Delahanty, “Polysomnographically measured sleep abnormalities in PTSD: a meta-analytic review,” Psychophysiology, vol. 44, no. 4, pp. 660–669, 2007.
View at: Publisher Site | Google Scholar
E. Klein, D. Koren, I. Arnon, and P. Lavie, “Sleep complaints are not corroborated by objective sleep measures in post-traumatic stress disorder: a 1-year prospective study in survivors of motor vehicle crashes,” Journal of Sleep Research, vol. 12, no. 1, pp. 35–41, 2003.
View at: Publisher Site | Google Scholar
M. Matousek, K. Cervena, L. Zavesicka, and M. Brunovsky, “Subjective and objective evaluation of alertness and sleep quality in depressed patients: correlation between the patients' statements and polygraphic findings,” BMC Psychiatry, vol. 4, article 14, 2004.
View at: Publisher Site | Google Scholar
M. Pompili, X. F. Amador, P. Girardi et al., “Suicide risk in schizophrenia: learning from the past to change the future,” Annals of General Psychiatry, vol. 6, article 10, 2007.
View at: Publisher Site | Google Scholar
R. A. Emsley, P. P. Oosthuizen, A. F. Joubert, M. C. Roberts, and D. J. Stein, “Depressive and anxiety symptoms in patients with schizophrenia and schizophreniform disorder,” Journal of Clinical Psychiatry, vol. 60, no. 11, pp. 747–751, 1999.
View at: Google Scholar
R. J. Bragaa, M. V. Mendlowicza, R. P. Marrocosd, and I. L. Figueiraa, “Anxiety disorders in outpatients with schizophrenia: prevalence and impact on the subjective quality of life,” Journal of Psychiatric Research, vol. 39, no. 4, pp. 409–414, 2005.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2013 Alon Reshef et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

5113

Downloads

2128

Citations