Evaluation of Reporting Quality in Randomised Controlled Trials of Acupuncture for Acute Herpes Zoster by the CONSORT Statement and STRICTA Guidelines

Qian, Guifeng; Zeng, Jingchun; Lu, Liming; Pei, Wenya; Liu, Kun; Luo, Zhenke; She, Yalin; Zhang, Pande; Lin, Guohua

doi:https://doi.org/10.1155/2020/4308380

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusions Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 4308380 | https://doi.org/10.1155/2020/4308380

Evaluation of Reporting Quality in Randomised Controlled Trials of Acupuncture for Acute Herpes Zoster by the CONSORT Statement and STRICTA Guidelines

Guifeng Qian,^1,2Jingchun Zeng,³Liming Lu,⁴Wenya Pei,⁵Kun Liu,⁶Zhenke Luo,⁶Yalin She,⁶Pande Zhang,²and Guohua Lin³

Academic Editor: Maruti Ram Gudavalli

Received20 Aug 2019

Accepted16 Jan 2020

Published18 Feb 2020

Abstract

Objective. To explore the methods for improving the reporting quality of randomised controlled trials (RCTs) on acupuncture through evaluating the reporting quality in RCTs of acupuncture for acute herpes zoster by the CONSORT statement and STRICTA guidelines. Methods. English and Chinese databases were searched from database creation until October 2018 and updated to July 2019. The basic characteristics and methodological quality of the literatures included were evaluated based on the CONSORT statement and the STRICTA guidelines. Descriptive statistical analysis was used in this study. The agreement between the two researchers of all items was calculated by Cohen’s kappa statistics. Results. A total of 40 RCTs were included. Based on the CONSORT statement, items “Background,” “Randomised” in the title or abstract,” “Statistical methods,” and “Outcomes and estimation” were good reporting, with positive rates >80%. However, the quality of reporting in items “Sample size,” “Allocation concealment,” “Implementation,” “Blinding,” “Flow chart,” “Intent-to-treat analysis,” “Ancillary analyses,” and “Clinical Trials Register” was very poor, with positive rates <10%. Based on the STRICTA guidelines, good reporting existed in items “Acupuncture rational,” “Points used,” “Needle stimulation,” “Needle retention time,” “Course of treatment,” “Control intervention,” and “Treatment frequency,” with positive ratings >80%. The reporting quality of items “Numbers of needles inserted,” “Depth of insertion,” “Responses elicited,” and “Practitioner background” was lower, with positive rates <50%. The agreement of most items was judged as moderate, substantial, or good.Conclusion. The reporting quality of RCTs in acupuncture for acute HZ is generally inadequate. It is necessary that researchers and journal editors learn and raise the adoption of the CONSORT statement and STRICTA guidelines to enhance the reporting quality of the RCTs in acupuncture.

1. Introduction

Herpes zoster (HZ) is caused by activation of varicella-zoster virus resulting in sensory ganglia infection [1]. The major symptoms of acute HZ are the severe pain, characteristic rash, and distinctive distribution, which reduce quality of life [2]. HZ can occur in all age groups especially in elderly. The incidence rate of HZ rises sharply from the age of 60 and reaches 11 cases per 1000 at the age of 90, roughly half of those who reach 85 years old will develop HZ [3]. The standard treatment for HZ is antiviral therapy, despite the progress of the vaccine advanced. Research has shown that the effect of HZ vaccine lasted only 8 years [4], so adults vaccinated before the age of 60 years might not be protected at the highest risk of HZ. The efficacy of the vaccine still needs further research and improvement [5]. More and more physicians and patients have accepted acupuncture as a complement therapy for a series of diseases especially pain in western countries. A cross-sectional study investigated that the pain was the top acupuncture indications and was nearly half of the clinical problem acupuncturists encountered in the US clinics [6]. Acupuncture was reported for the treatment of HZ [7–10], which showed that it relieves pain of HZ, shortens the healing of the rash, and reduces the occurrence of postherpetic neuralgia (PHN). But no studies have evaluated the reporting quality of these papers.

The “Consolidated Standards of Reporting Trials” (CONSORT) guidelines, updated in 2001 and 2010, provided checklists for the author to write papers for publication [11, 12]. It is widely used to evaluate the reporting quality of clinical trials today. The “Standards for Reporting Interventions in Controlled Trials of Acupuncture” (STRICTA) guidelines, extending the CONSORT guidelines, is to improve the reporting quality of clinical trials for acupuncture [13, 14]. A series of studies showed they help readers obtain information about research design, intervention implementation, data analysis, and so on [15–18]. They have positively impacted on reporting quality of the trials. Based on the above guidelines, this study was conducted to clarify the reporting quality of acupuncture for acute HZ by CONSORT statement and STRICTA guidelines.

2. Methods

2.1. Search Strategy

The databases Ovid Embase, Ovid Medline, Cochrane Library, WanFang database, Chongqing Weipu (VIP), and China National Knowledge Infrastructure (CNKI) were searched from creation until October 2018 and updated it to July 2019. The following search terms were used in Chinese and English: (Acupuncture OR Acupuncture therapy OR Electro-acupuncture OR Auricular acupuncture OR Scalp acupuncture OR Fire needle OR Warming needle OR Needle OR Acupuncture point OR Meridian OR Acupoint OR Jingluo) AND (Herpes zoster OR Shingles OR Varicella-zoster virus). All articles were published either in Chinese or English. The details of the search strategy can be found in Supplementary File 1.

2.2. Inclusion and Exclusion Criteria

2.2.1. Types of Studies

We included any clinical reports assessing the efficacy of acupuncture in the treatment of acute HZ and mentioning “Randomised Controlled Trials” in the title, abstract, or text, regardless of blinding, implementation, or allocation concealment were used or not in the study. Nonrandomized papers, review, abstract, and case report were included. Any studies with no available data or outcomes for extraction have been excluded.

2.2.2. Types of Participants

Patients of any gender, age, or ethnicity with HZ in the acute phase were eligible. Herpes zoster is diagnosed clinically by the pain, characteristic rash, and distinctive distribution [19]. The acute phase of HZ usually occurs during the 30 days after the onset of the characteristic rash [20]. Patients of any types of HZ with the exception of visceral HZ, meningeal HZ, and PHN were qualified.

2.2.3. Types of Interventions

Different forms of acupuncture techniques or needle were included consisting of manual acupuncture, electroacupuncture, fire or warm needle, scalp acupuncture, and auricular acupuncture, except laser acupuncture and acupressure. The intervention of the experimental group was acupuncture alone or acupuncture combined with medication same as the control group. The control group used placebo, no treatment, antivirals, neurotrophic drugs, corticosteroids, and analgesics, while acupuncture, traditional Chinese medicine, proprietary Chinese medicine, moxibustion, cupping, or physical therapy did not contained.

2.3. Selection of Reports

Firstly, two researchers (GQ and JZ) reviewed the title and abstract of citations retrieved and read the full report through NoteExpress separately. Any article that does not meet incorporate criteria or match exclusions standards moved into the specified folder with different labels in NoteExpress. For example, nonrandomized controlled trials, case report, animal experiments, comments, and reviews are removed in the specified folder. The entire team discusses any uncertain literature and makes the final decision.

2.4. Data Extraction

Two researchers (WP and KL) used the EpiData software to selected information from the final documents after receiving training of research and statistical methods about the CONSORT and STRICTA checklists. The general information includes the title of the paper, the author, the year of publication, the name of the journal, the type of journal, and the language of the publication. Any information unmentioned was encoded as “not reported.” Two researchers analyzed the full text of 40 articles and performed data extraction.

2.5. Assessment of Reporting Quality

We assessed the reporting quality of RCTs in acupuncture for acute HZ according to the CONSORT statement and STRICTA guidelines. Items of them can be found in Tables 1 and 2. Every article was reviewed by two investigators (GQ and JZ). If report 0 indicates that the item is not explicitly stated, it is marked as 1. The agreement between the two researchers been evaluated through calculating Cohen’s kappa. Agreement was judged as good if κ was >0.8, substantial if 0.6 < κ ≤ 0.8, moderate if 0.4 < κ ≤ 0.6, fair if 0.2 < κ ≤ 0.4, and poor if κ was ≤0.2. Any disagreements or difficulties were solved through conversation in the process. 95% CI and Cohen’s kappa of each variable were performed by the Statistical Package for the Social Sciences (SPSS) version 20.0.

3. Results

After searching, 34 Medline, 60 Embase, 1309 Cochrane Library, 13 WanFang, 129 VIP, and 1731 CNKI, totally 3276 recordings were retrieved (Figure 1). Among them, 1403 were English, and 1873 were Chinese. In accordance with the inclusion of the literature, excluding standards, and screening requirements, 40 RCT papers screened at last in Supplementary file 2.

3.1. Characteristics of Included Trials

3.1.1. Year of Publication

In total, 40 RCTs were mainly published in the last 10 years including 1998 to 2019 (Figure 2). The interventions of them were manual acupuncture (19, 47.50%), electroacupuncture (11, 27.50%), scalp acupuncture (1, 2.50%) and fire needle (9, 22.50%), without ear acupuncture, sham acupuncture, or another intervention.

3.1.2. Journals and Languages

The 40 trials were published in 34 different journals. 11 (27.50%) papers were published in general medical journals, 18 (45.00%) papers in traditional or alternative medicine journals regarding journal category, 10 (25.00%) in specialist medical journals, and 1 (2.50%) paper was master’s thesis. 2 (5.00%) were published in Journal of New Chinese Medicine, 1 (2.50%) in Acupuncture Research, and 1 (2.50%) in the Shanghai Journal of Acupuncture Moxibustion. Only 1 paper (2.50%) was published in the Complementary Alternative Medicine in English, and the remaining 39 (97.22%) papers are all published in Chinese.

3.1.3. Funding Sources

Only 8 studies (20.00%) reported their sources of funding. 3(7.50%) received funding from national, 3 (7.50%) from university or hospitals, and 2 (5.00%) from regional, respectively. There is no report which received funding from pharmaceutical companies or research agencies in our sample.

3.2. Completeness of Reporting for the CONSORT Items

The data of reporting quality are listed in Table 1 based on the CONSORT statement. Good reporting were items “Background,” “Randomised” in the title or “abstract,” “Statistical methods,” “Outcomes and estimation,” and “Interpretation,” with positive rates >80%. However, the reporting quality in items “Sample size,” “Allocation concealment,” “Implementation,” “Blinding,” “Flow chart,” “Intent-to-treat analysis,” “Ancillary analyses,” “limitation,” and “Clinical Trials Register” was very poor with positive rates <10%.

3.3. Completeness of Reporting for the STRICTA Items

The reporting quality ratings for the needling details are listed in Table 2. Based on the STRICTA guidelines, good reporting existed for the items “Acupuncture rational,” “Points used,” “Needle stimulation,” “Needle retention time,” “Course of treatment,” and “Treatment frequency,” with positive ratings >80%. However, the reporting quality of items “Numbers of needles inserted,” “Depth of insertion,” and “Responses elicited” was lower, with positive rates <50%, and “Practitioner background” was poor, with positive rates <10%.

The agreement between two reviewers of all items was observed in this study, and the agreement of mostly items was judged as moderate, substantial or good, except items “Implementation,” “Responses elicited,” and “Needle type” was assessed fair.

4. Discussion

This study has showed that the reporting quality of RCTs in acupuncture for HZ was dissatisfied. We need to pay attention as a lot of papers did not strictly comply with CONSORT statement and STRICTA guidelines in this study. Low-quality clinical research influences other researchers to evaluate the study. Accurate and standardised reporting not only reduces the bias of systematic reviews but also contributes to medical decision-making. Acupuncturists can easily grasp effective operational procedures with high-quality reporting.

In the 40 reports, most of them use “random,” “random group,” and other words simply to describe randomisation, and only 13 studies (32.50%) report the method used to generate the random allocation sequence. Adequate randomisation is an effective measure to control the selective offsets and assure the authenticity of the results [21]. The researchers should use the scientific random sequence generation methods and describe it in detail to ensure the feasibility and repeatability of the study.

No literature referred allocation concealment, intent-to-treat analysis, blinding of participants or care providers;only 1 paper (2.50%) showed outcome assessors blinded after assignment to interventions. Research confirmed that allocation concealment, blinding, and intent-to-treat analysis are important protective measures to prevent implementation, measurement bias, and overestimate the effect especially in the evaluation of subjective outcome indicators such as pain, itching, and mood [22–24]. Therefore, these aspects need to be improved in later research.

The sample size estimation can avoid false negative results between intervention and control groups. There were only 2 reports (5.00%) referred to the sample size estimates, and samples of 12 RCTs (30.00%) were more than 100. The lack of correct sample size estimation will lead to the lower test performance of RCT and affect the authenticity and reliability of the research results.

We select STRICTA guidelines to assess the quality of the “intervention” in report, as it has more detailed and specific reporting criteria for acupuncture. According to the STRICTA guidelines, the reporting quality of items “Numbers of needles inserted,” “Depth of insertion,” “Responses elicited,” and “Practitioner background” was lower. A study indicates that the number of needles inserted and course of treatment were associated with outcomes in the treatment of pain [25]. Another study concluded that needling at correct acupoint locations was especially important to the effect of acupuncture for chronic pain [26]. However, there was little evidence to confirm the characteristics of acupuncture or acupuncturists have a wide variation of effects on pain at present, which required large sample sizes trials to evaluate. Therefore, it is significant to report all items of STRICTA guidelines.

Otherwise, there are several limitations in this study. Firstly, we did not search literature published in Japanese or Korean, and we only included trials published in English and Chinese. Secondly, we did not extract all items from the CONSORT 2010 statement and the STRICTA guidelines. Lastly, the literature finally included in this study is mainly in Chinese, and only one paper is in English.

5. Conclusions

The study indicates that the quality of reporting in RCTS on acupuncture for HZ was significantly lower and needs substantial improvement. In addition, most editors and researchers in Chinese are not familiar with the CONSORT statement and its extensions [16]. So, we recommend that the authors reporting and designing RCTs to abide by them and journal editors learn and raise the adoption of them to enhance the reporting quality of the RCTs in acupuncture.

Data Availability

The data used to support the findings of this study are included within the article and supplementary information.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Guohua Lin and Pande Zhang conceptualized and designed the study. Yalin She and Zhenke Luo acquired the data. Wenya Pei and Kun Liu extracted the data. Liming Lu and Wenya Pei performed statistical analysis. Guifeng Qian and Jingchun Zeng carried out assessment of the reporting quality. Guifeng Qian and Jingchun Zeng wrote the manuscript. Guohua Lin and Pande Zhang revised the manuscript. All authors critically reviewed and commented on the manuscript. Guifeng Qian and Jingchun Zeng contributed equally to this work and are co-first authors.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (no. 81574061), the Science and Technology Department of Guangdong Province (no. 2017A020213019), and the First Affiliated Hospital of Guangzhou University of Traditional Chinese Medicine (no. 2019QN23).

Supplementary Materials

The main features of the 40 included studies and their references in this paper. (Supplementary Materials)

References

D. Cvjetkovic, J. Jovanovic, I. Hrnjakovic-Cvjetkovic, S. Brkic, and M. Bogdanovic, “Reactivation of herpes zoster infection by varicella-zoster virus,” Medicinski pregled, vol. 52, no. 3–5, pp. 125–128, 1999.
View at: Google Scholar
Y. Hama, K. Shiraki, Y. Yoshida et al., “Antibody to varicella-zoster virus immediate-early protein 62 augments allodynia in zoster via brain-derived neurotrophic factor,” Journal of Virology, vol. 84, no. 3, pp. 1616–1624, 2010.
View at: Publisher Site | Google Scholar
R. P. Insinga, R. F. Itzler, J. M. Pellissier, P. Saddier, and A. A. Nikas, “The incidence of herpes zoster in a United States administrative database,” Journal of General Internal Medicine, vol. 20, no. 8, pp. 748–753, 2005.
View at: Publisher Site | Google Scholar
V. A. Morrison, G. R. Johnson, K. E. Schmader et al., “Long-term persistence of zoster vaccine efficacy,” Clinical Infectious Diseases, vol. 60, no. 6, pp. 900–909, 2015.
View at: Publisher Site | Google Scholar
T. Bharucha, D. Ming, and J. Breuer, “A critical appraisal of 'Shingrix', a novel herpes zoster subunit vaccine (HZ/Su or GSK1437173A) for varicella zoster virus,” Human Vaccines & Immunotherapeutics, vol. 13, no. 8, pp. 1789–1797, 2017.
View at: Publisher Site | Google Scholar
H. Wang, G. Yang, S. Wang, X. Zheng, W. Zhang, and Y. Li, “The most commonly treated acupuncture indications in the United States: a cross-sectional study,” The American Journal of Chinese Medicine, vol. 46, no. 7, pp. 1387–1419, 2018.
View at: Publisher Site | Google Scholar
Z.-S. Liu, W.-N. Peng, B.-Y. Liu et al., “Clinical practice guideline of acupuncture for herpes zoster,” Chinese Journal of Integrative Medicine, vol. 19, no. 1, pp. 58–67, 2013.
View at: Publisher Site | Google Scholar
T. Ursini, M. Tontodonati, L. Manzoli et al., “Acupuncture for the treatment of severe acute pain in herpes zoster: results of a nested, open-label, randomized trial in the VZV Pain Study,” BMC Complementary and Alternative Medicine, vol. 11, no. 1, p. 46, 2011.
View at: Publisher Site | Google Scholar
M. E. Coyle, H. Liang, K. Wang et al., “Acupuncture plus moxibustion for herpes zoster: a systematic review and meta-analysis of randomized controlled trials,” Dermatologic Therapy, vol. 30, no. 4, p. e12468, 2017.
View at: Publisher Site | Google Scholar
H. Tian and L. Wei, “[Filiform fire needling plus cotton moxibustion for 126 cases of herpes zoster],” Zhongguo Zhen Jiu, vol. 35, no. 10, pp. 1031-1032, 2015.
View at: Google Scholar
C. Begg, M. Cho, S. Eastwood et al., “Improving the quality of reporting of randomized controlled trials. The CONSORT statement,” JAMA: The Journal of the American Medical Association, vol. 276, no. 8, pp. 637–639, 1996.
View at: Publisher Site | Google Scholar
K. F. Schulz, D. G. Altman, and D. Moher, “CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials,” BMJ, vol. 340, no. 1, p. c332, 2010.
View at: Publisher Site | Google Scholar
H. MacPherson, A. White, M. Cummings, K. Jobst, K. Rose, and R. Niemtzow, “Standards for reporting interventions in controlled trials of acupuncture: the STRICTA recommendations,” Complementary Therapies in Medicine, vol. 9, no. 4, pp. 246–249, 2001.
View at: Publisher Site | Google Scholar
H. MacPherson, D. G. Altman, R. Hammerschlag et al., “Revised STandards for reporting interventions in clinical trials of acupuncture (STRICTA): extending the CONSORT statement,” Journal of Evidence-Based Medicine, vol. 3, no. 3, pp. 140–155, 2010.
View at: Publisher Site | Google Scholar
L. Turner, L. Shamseer, D. G. Altman, K. F. Schulz, and D. Moher, “Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? a Cochrane review,” Systematic Reviews, vol. 1, no. 1, p. 60, 2012.
View at: Publisher Site | Google Scholar
B. Ma, Z.-M. Chen, J.-K. Xu et al., “Do the CONSORT and STRICTA checklists improve the reporting quality of acupuncture and moxibustion randomized controlled trials published in Chinese journals? A systematic review and analysis of trends,” PLoS One, vol. 11, no. 1, Article ID e0147244, 2016.
View at: Publisher Site | Google Scholar
K. H. Kim, J. W. Kang, M. S. Lee, and J.-D. Lee, “Assessment of the quality of reporting in randomised controlled trials of acupuncture in the Korean literature using the CONSORT statement and STRICTA guidelines,” BMJ Open, vol. 4, no. 7, Article ID e005068, 2014.
View at: Publisher Site | Google Scholar
S. Svenkerud and H. MacPherson, “The impact of STRICTA and CONSORT on reporting of randomised control trials of acupuncture: a systematic methodological evaluation,” Acupuncture in Medicine, vol. 36, no. 6, pp. 349–357, 2018.
View at: Publisher Site | Google Scholar
R. N. Werner, A. F. Nikkels, B. Marinović et al., “European consensus-based (S2k) guideline on the management of herpes zoster-guided by the European Dermatology Forum (EDF) in cooperation with the European Academy of Dermatology and Venereology (EADV), Part 1: Diagnosis,” Journal of the European Academy of Dermatology and Venereology, vol. 31, no. 1, pp. 9–19, 2017.
View at: Publisher Site | Google Scholar
R. Dworkin and R. Portenoy, “Proposed classification of herpes zoster pain,” The Lancet, vol. 343, no. 8913, p. 1648, 1994.
View at: Publisher Site | Google Scholar
V. W. Berger and J. D. Bears, “When can a clinical trial be called ’randomized'?” Vaccine, vol. 21, no. 5-6, pp. 468–472, 2003.
View at: Publisher Site | Google Scholar
K. F. Schulz, I. Chalmers, R. J. Hayes, and D. G. Altman, “Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials,” JAMA, vol. 273, no. 5, pp. 408–412, 1995.
View at: Publisher Site | Google Scholar
L. Wood, M. Egger, L. L. Gluud et al., “Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study,” BMJ, vol. 336, no. 7644, pp. 601–605, 2008.
View at: Publisher Site | Google Scholar
J. Savovic, H. Jones, D. Altman et al., “Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies,” Health Technology Assessment, vol. 16, no. 35, pp. 1–82, 2012.
View at: Publisher Site | Google Scholar
H. MacPherson, A. C. Maschino, G. Lewith et al., “Characteristics of acupuncture treatment associated with outcome: an individual patient meta-analysis of 17,922 patients with chronic pain in randomised controlled trials,” PLoS One, vol. 8, no. 10, Article ID e77438, 2013.
View at: Publisher Site | Google Scholar
A. J. Vickers, E. A. Vertosick, G. Lewith et al., “Acupuncture for chronic pain: update of an individual patient data meta-analysis,” The Journal of Pain, vol. 19, no. 5, pp. 455–474, 2018.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Guifeng Qian et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

687

Downloads

985

Citations