Abstract

In evidence-based medicine, randomized controlled trials (RCTs) are the preferred method for evaluating the efficacy of interventions. In regard to acupuncture RCTs, the most difficult issues are the design of the control group and implementation of the principle of “double-blinding.” We compared the advantages and limitations associated with different control group designs in acupuncture RCTs, to assist researchers in this field.

1. Introduction

1.1. The WHO Promotes the Use and Research of Acupuncture

Acupuncture is a convenient, effective, and simple form of traditional Chinese medicine that has few side effects [1]. Thus, it is often the first therapy that patients consider for a wide range of complaints where medicine is lacking and is the most widely used complementary and alternative medicine worldwide. In 1979, the World Health Organization (WHO) issued its first report on traditional medicine and described 43 categories of symptoms treatable by acupuncture; in 1996, the list was expanded to 64 [2]. This fact alone shows the value of acupuncture worldwide. In 1995, the WHO “Guidelines for Clinical Research on Acupuncture” [3] stipulated three criteria for good acupuncture studies: validity, reliability, and statistical significance ( value). Thus, at every stage of research, from basic studies to clinical trials, these criteria are paramount in any attempt to explain the function and effect of acupuncture.

1.2. Acupuncture RCTs Are Needed

Evidence-based medicine (EBM) [4] has become the gold standard among researchers, ever since the term was coined by Guyatt et al. in his paper published in JAMA in 1992 [5]. Randomized clinical trials (RCTs) belong to the Ib [6] level of EBM and therefore provide reliable criteria for study validity. Factors influencing the validity of RCTs include [3] patient selection, study size, site(s) of investigation, blinding techniques, randomization, design of the control group, crossover studies (usually inappropriate for acupuncture), and the strategic approach. Well-designed, properly conducted RCTs also include statistical analysis by a biostatistician to ensure that the results are statistically valid.

1.3. The Importance of a Control Group in Acupuncture RCTs

The ongoing debate about the therapeutic effects of acupuncture for some diseases [712] means that RCTs are needed to evaluate the efficacy of acupuncture. Such trials must include an appropriate control group [13]. A well-designed control group not only increases reliability of the study but also improves its blinding, which further affects the study results [14].

One researcher [15] has questioned the consistently positive clinical trials of acupuncture from countries in East Asia. His systematic review of controlled trials noted that six studies had insufficient blinding. Inadequate concealment from the control group and lack of randomization yielded a higher ratio of positive results in these studies. Furthermore, any mistakes in selection or having a poorly designed control group may lead to misinterpretation of results or misleading statements [16].

The purpose of this study was to systematically review the construction of control groups in RCT acupuncture studies published over the last few decades.

2. Methods

A literature search was performed using the PubMed English language database, using the search keywords “acupuncture” and “placebo needle.” We included studies that met the following criteria: randomized control trials (RCTs) that adopted a double-blind, single-blind, or nonblind design. We chose studies that we considered to be representative for each category of control group design. We focus our analysis on the design of control groups in acupuncture studies, instead of evaluating the efficacy of acupuncture in each study.

3. Results

3.1. The Types, Advantages, and Limitations of Control Groups in Acupuncture RCTs

A survey of the literature reveals that 11 different designs exist for control groups in acupuncture RCTs, as shown in Table 1. Among these 11 designs, those classified under 1–5 have no needle intervention, those under 6–8 vary from the treatment group according to the location and depth of needle insertion, those under 9-10 use assistant tools on the skin surface, while the last design comprises multiple methods using paired subjects/controls. Advantages and limitations associated with each type are listed in Table 1.

4. Discussion

4.1. The Ideal Control Group

The purpose of the control group is to determine the effect of the intervention by properly eliminating any placebo effect produced by the test group. Therefore, RCT study designs must include at least 1 control group. Importantly, the control group must experience the same placebo effect as the test group, and ideally participants and researchers are blinded as to whether participants receive treatment or placebo.

An ideal acupuncture control group must include three conditions. First, the design should be accepted by the study subjects, who must be blinded as to their assigned treatment group. Second, the curative effects should be minor and not give rise to special therapeutic effects that influence the results. Third, all other conditions for controls, excluding the intervention, should be identical to those used for the test group.

4.2. Design Strategy

Four different strategies for designing control groups have been used alone or in combination in recent acupuncture RCTs: (1) absence of acupuncture needle insertion, (2) different location of inserted acupuncture needles, (3) different depth of insertion, and (4) the use of assistant tools. In regard to the absence of acupuncture needle insertion, the control group employed an imitative puncture action and no acupuncture, performed at specific acupoints, nonspecific acupoints, or sham acupoints. In regard to different locations for inserted acupuncture needles, specific acupoints consisted of the acupoints applied in the test group according to the meridian method of acupuncture, while sham acupoints comprised the points drifting off the specific acupoints or meridian above 0.5 B-cun and not on the meridian or known acupoints. However, the optimal distance for drifting off the specific acupoints or meridian remains controversial. Nonspecific acupoints are acupoints with nontherapeutic effects or minor effects that have been observed in previous research. In regard to different depth of insertion, needle insertion depths are categorized as superficial, minimal, or deep acupuncture. Superficial acupuncture does not pierce the epidermis. In minimal acupuncture, the needle penetrates to a depth of less than 4 mm and does not cause “de-chi.” Deep acupuncture involves needle passage through the hypodermis to a depth of more than 5 mm, usually 10–20 mm, and often causes “de-chi.” In reference to the use of assistant tools, placebo needles [1720] such as the Streitberger’s needle, Park Sham Device, or Takakura’s needle use a blunt tip and are tapped onto the skin. It is important to note that, although these four strategies were adopted, the control group in acupuncture RCTs is less of an ideal comparator than when it is used in drug RCTs.

4.3. Laser Acupuncture and Transcutaneous Electrical Nerve Stimulation (TENS)

Laser acupuncture and TENS usually serve as nonacupuncture contrasts, meaning that they are not involved in needle insertion. Laser acupuncture has been clinically applied since the 1970s [21]. Laser acupuncture is defined as the simulation of traditional acupuncture points with low-intensity, nonthermal laser irradiation. The therapeutic effects are related to not only wavelength, irradiance, and beam profile, but also skin properties such as thickness, age, and pigmentation [21]. Laser acupuncture may be beneficial for conditions ranging from pain relief, hiccups to enuresis, and postoperative nausea and vomiting [22, 23]. These possible therapeutic effects may mean that using laser acupuncture as an intervention in the control group may cause underestimation of acupuncture effects.

TENS is a noninvasive analgesic technique that is usually used to relieve nociceptive, neuropathic, and musculoskeletal pain [24]. Evidence from animal studies has shown that TENS reduces ongoing nociceptive cell activity and sensitization in the central nervous system when applied to somatic receptive fields. It is hypothesized that low-intensity TENS relieves pain by a segmental mechanism, while higher intensity TENS activates extrasegmental descending pain inhibitory pathways [25].

Because of these possible therapeutic effects, using TENS as the control group intervention may cause underestimation of acupuncture effects. Moreover, the procedure of TENS differs from acupuncture. Therefore, blinding is impossible. It is noted that TENS should not be applied on the anterior and posterior areas of the chest because TENS may compromise pulmonary ventilation due to the stimulation of the intercostal muscles [25]. TENS should not be placed over areas where there has been recent haemorrhage because the currents are able to cause further haemorrhage.

4.4. Needle Pricking May Induce Nonspecific Physiological Reactions

Needle pricking may induce nonspecific physiological reactions and diffuse noxious inhibitory controls (DNICs) [26]. When a nociceptive stimulus is applied to any part of the body that is distinct from the excitatory receptive fields, discharges of neurons in the dorsal horn of the spinal cord are strongly inhibited. Sham needles penetration into sites other than acupoints or nonspecific needles into nontherapeutic acupoints n may act as nociceptive stimuli. These stimuli then activate the A delta and/or peripheral C-fibers, triggering DNIC [27]. Hence, in pain research, acupuncture may decrease pain sensation among subjects in the control groups using sham and nonspecific contrast designs and thereby reduce any between-group differences. Therefore, we suggest that acupuncture analgesia RCTs adopt minimal acupuncture contrast, superficial acupuncture contrast, or a placebo needle contrast design for the control group.

4.5. Minimal Acupuncture and Superficial Acupuncture

Minimal acupuncture requires that insertion points are not acupoints and needle penetration is to a depth of less than 4 mm, while superficial acupuncture requires that dull needles or other tools (e.g., needle tube and toothpicks) are tapped onto acupoints; dull needles do not prick the skin. It was assumed that both interventions have no therapeutic effects. However, recent studies did not agree with this assumption. Lightly touching the skin stimulates mechanoreceptors coupled to slow conducting unmyelinated C afferents that causes activity in the insular region, but not in the somatosensory cortex [28, 29]. This afferent nerve activity may affect brain function resulting in a “limbic touch response,” which causes emotional and hormonal reactions. It is likely that, in many studies, when minimal acupuncture and superficial acupuncture are used as control interventions, they are able to alleviate the pain condition. However, compared to nonspecific and sham acupuncture involving real needle insertion, minimal acupuncture and superficial acupuncture are considered to have less influence upon levels of pain.

4.6. Nonspecific and Sham Acupuncture

Nonspecific acupuncture involves acupuncture performed at acupoints that are considered to produce only minor or no effects. However, care must be taken as to choice of nonspecific acupoints: inappropriate selection will render the study invalid. Not only does it remain controversial as to the optimal distance for drifting off specific acupoints or meridian when using sham acupuncture, but also, if two meridians are sited closely together, the sham acupoints may be located on an unintended meridian. For long-term study, both nonspecific and sham acupuncture are considered to be more appropriate as control interventions because they involve real needle insertion.

4.7. Placebo Needling

Placebo needling is considered to be a credible technique for use in subjects with little or no experience of acupuncture [1720]. However, studies have found that placebo needling had a greater placebo effect on subjects than did placebo pills [30, 31]. The more knowledge and experience among study participants have as to acupuncture the deeper the controversy. Moreover, the therapeutic procedure may produce a psychological placebo effect, instead of real physiological phenomena that are associated with true acupuncture. Selection of acupuncture points and the visual impact of needling also influence the applicability of placebo needling [32]. More importantly, those devices (the placebo needle) do not overcome the problem of double-blinding [33]. However, the blinding effect is increased when placebo needles are used together with needle tubes [3439]. While Takakura’s placebo needle blinds the acupuncturist to a greater degree compared with the Park Sham Device (PSD) and Streitberger’s needles, the blinding is less effective for participants, because the needle sensation is less than that produced by the PSD and Streitberger’s needles.

5. Conclusions

We list 11 different designs and four strategies associated with control group design in acupuncture RCTs. In clinical practice experience, efficacy is closely related to the manipulation of acupuncture performance, including the lifting and thrusting of needles or needle rotation. For example, in acupuncture analgesia, stronger stimulation (rotating needles with higher frequency and a thicker needle) will have greater efficacy than a weaker stimulation (rotating needles with lower frequency and with a thinner needle). Acupuncture manipulation is not easy to describe very clearly, so most acupuncture RCTs are performed with electroacupuncture. We suggest that acupuncture RCTs may be successfully conducted by hand manipulation if the method is properly described, including details such as the reinforcing and reducing method and acupuncture dosage. In this way, acupuncture research will be more closely related to clinical practice.

Hence, the choice of control in an RCT depends on the type of research and the therapeutic effects of acupuncture being examined. The research design should take into consideration the placebo effect, a blinded design, subject selection, measurements chosen, and any contrast between the treatment and placebo groups. Such a design will correctly reflect the result without underestimating the effect of acupuncture.

Authors’ Contribution

J.-G. Lin and C.-H. Chen contributed equally to this work as cofirst authors.

Acknowledgments

The authors are grateful to Ms. Iona MacDonald and Ms. Ya-Ting Wu for their help in producing the final paper. This work was supported by Grants NSC-100-2320-B-039-029-MY2 and NSC-100-2320-B-039-018 from the National Science Council, Taipei, Taiwan, and in part by the Taiwan Department of Health Clinical Trial and Research Center of Excellence (DOH101-TD-B-111-004).