Abstract

Background. Acupuncture is widely used in the clinical treatment of essential hypertension (EH). This overview is aimed at summarizing current systematic reviews of acupuncture for EH and assessing the methodological bias and quality of evidence. Methods. Two researchers searched and extracted 7 databases for systematic reviews (SRs)/meta-analyses (MAs) and independently assessed the methodological quality, risk of bias, reporting quality, and quality of evidence of randomized controlled trials (RCTs) included in the SRs/MAs. Tools used included the measurement tool to assess systematic reviews 2 (AMSTAR-2), the risk of bias in systematic (ROBIS) scale, the checklist of preferred reporting items for systematic reviews and meta-analyses (PRISMA), and the grading of recommendations assessment, development, and evaluation (GRADE) system. Results. This overview included 14 SRs/MAs that use quantitative calculations to comprehensively assess the various effects of acupuncture in essential hypertension interventions. The methodological quality, reporting quality, risk of bias, and quality of evidence for outcome measures of SRs/MAs were all unsatisfactory. According to the results of the AMSTAR-2 assessment, all SRs/MAs were of low or very low quality. According to the results of the ROBIS evaluation, a few SRs/MAs were assessed as low risk of bias. According to the results of the PRISMA checklist assessment, SRs/MAs that were not fully reported on the checklist accounted for the majority. According to the GRADE system, 86 outcomes were assessed under different interventions in SRs/MAs, and 2 were rated as moderate-quality evidence, 23 as low-quality evidence, and 61 as very low-quality evidence. Limitations of the included SRs/MAs included the lack of necessary items, such as not being registered in the protocol, not providing a list of excluded studies, and not analyzing and addressing the risk of bias. Conclusion. Currently, acupuncture may be an effective and safe treatment for EH, but the quality of evidence is low, and caution should be exercised when applying this evidence in clinical practice.

1. Introduction

Essential hypertension (EH) is a common clinical disease caused by multiple factors such as heredity and environment. The main clinical manifestation is elevated arterial pressure in the systemic circulation, which can cause serious damage to multiple organs such as blood vessels, the heart, brain, kidneys, and eyes [1]. There is a strong, independent linear association between blood pressure and cardiovascular disease risk. Hypertension is an independent risk factor for cardiovascular disease [2], and the concurrent cardiovascular and cerebrovascular diseases not only cause disability and high mortality but also consume medical and social resources, causing a heavy burden on families, society, and the health system [3]. With the increase of life and work pressure, the incidence of hypertension is increasing year by year, and the affected population is getting younger and younger. Against this background, the cardiovascular disease has become a heavy burden in my country, and effective control of hypertension is the top priority to relieve the burden of cardiovascular and cerebrovascular diseases [4]. Usually, the conventional treatment of EH is mainly western medicine, characterized by the initial use of a single antihypertensive drug, followed by dose titration and sequential addition of other drugs to achieve antihypertensive goals [5]. However, problems such as adverse reactions caused by long-term medication, drug tolerance, and high medical expenses have been increasingly concerned by patients. Therefore, it is imminent to find a treatment method that can effectively lower blood pressure, reduce adverse reactions, and effectively control complications [6].

Therefore, more and more scholars are exploring safer EH treatment methods. At present, some scholars have applied acupuncture with traditional Chinese medicine (TCM) to the treatment of EH. Many clinical studies [721] have shown that acupuncture can effectively control blood pressure; acupuncture may regulate the central nervous system [79] and the renin-angiotensin-aldosterone system (RAAS) [1012], balance the imbalanced immune system [1315], improve vascular structure [1618], and reduce oxidative stress [1921]. Therefore, it is believed that acupuncture may be a safer and more effective antihypertensive therapy.

In recent years, evidence-based medicine has been deeply integrated with TCM clinical research, especially acupuncture clinical research. From the perspective of evidence-based clinical practice, systematic reviews (SRs) should be the best evidence to guide clinical practice. Through preliminary searches, the team found that there have been multiple SRs showing that acupuncture therapy has a certain effect on EH, but the methodological quality of these SRs is unclear, and the quality of the evidence provided is uncertain. Therefore, our study aims to critically evaluate the methodological quality of SRs/MAs in the treatment of EH with acupuncture through a comprehensive overview to provide clinical ideas and evidence support.

2. Materials and Methods

The methodology of this overview follows the Cochrane Handbook, and the report of this overview is in line with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) 2020 checklist [22]. This overview has been registered with the PROSPERO website (registration number: PROSPERO CRD42022361514).

2.1. Inclusion and Exclusion Criteria

The inclusion criteria are as follows: (1) SRs/MAs based on randomized clinical trials(RCTs), the language is limited to Chinese and English; (2) a definite diagnosis of EH, regardless of type, gender, age, and course of disease; (3) interventions in the treatment group included one of the three methods of simple acupuncture, electroacupuncture, and warm acupuncture or one of the abovementioned three methods combined with the treatment recommended by the guidelines (including lifestyle regulation and conventional antihypertensive drugs (CAD)), while the control group received a guideline-recommended treatment or a placebo/sham acupuncture; (4) the main outcome indicators were the effective rate of blood pressure reduction, the improvement of systolic blood pressure (SBP) and diastolic blood pressure (DBP), the change of blood pressure before and after treatment, and adverse reactions.

The exclusion criteria are as follows: (1) duplicate publications, animal studies, research protocols, narrative reviews, reviews, and network meta-analysis; (2) works of literature with incomplete data or unidentifiable original text; (3) the subjects of the study were EH combined with other illnesses.

2.2. Search Strategy

A systematic search was conducted through PubMed, Cochrane Library, Embase, Web of Science, the Chinese National Knowledge Infrastructure (CNKI), Chinese Biological Medicine Database (CBM), and Wanfang Database; the search period is from the inception of the database to September 30, 2022, and hand-searched and traced references were adopted to supplement relevant literature. The search used a combination of subject words and free words. Key search terms were derived from MeSH and included search terms such as: “Acupuncture,” “Essential hypertension,” “Systematic review,” OR “meta-analysis”. The search strategies used in PubMed are shown in Table 1. The adjustment was made to suit the specific needs of each database when necessary. In addition, we searched conference proceedings and dissertations to identify relevant gray literature.

2.3. Literature Screening and Data Extraction

Two researchers (MX-F and XQ-W) independently screened and extracted the literature and cross-checked them. The disagreement (if any) was discussed and negotiated or subjected to the decision of a third author (GH-D). The extracted literature information included authors, publication year, nationality, sample size, intervention measures, quality assessment tools, and main conclusions.

2.4. Quality Assessment

Two researchers (MX-F and XQ-W) independently assessed the methodological and evidence quality of the included SRs/MAs; any discrepancies were resolved by consensus or adjudication by a third author (GH-D).

2.4.1. Methodological Quality Assessment

In 2007, clinical epidemiology and evidence-based medicine experts from research institutions in Netherlands and Canada developed and published a measurement tool to assess systematic reviews (AMSTAR). In the following 10 years, AMSTAR became an internationally recognized and most widely used evaluation tool. Subsequently, a large number of relevant documents using AMSTAR tools appeared. Research shows that the use of AMSTAR has played a positive role in standardizing the production and reporting of SRs/MAs and promoting the generation and dissemination of high-level evidence. A measurement tool to assess systematic reviews 2 (AMSTAR-2) [23] is a quality evaluation tool of SRs/MAs methodology newly developed on the basis of the first version of AMSTAR, with good consistency and practicality among evaluators.

AMSTAR-2 contains 16 items that can be answered with a “yes,” “partially yes,” or “no.” According to the evaluation criteria, it can be rated as “high,” “moderate,” “low,” and “very low,” and 7 out of 16 items in the tool (2, 4, 7, 9, 11, 13, and 15) are critical items.

2.4.2. Risk of Bias Assessment

The risk of bias in systematic review (ROBIS) [24], which aims at the bias risk of system evaluation, is used not only to evaluate the bias risk in the process of producing and interpreting the results of multiple SRs/MAs such as intervention, diagnosis, etiology, and prognosis but also to evaluate the correlation between the SRs/MAs problems and the practical problems to be solved by users.

ROBIS is useful for assessing the extent of bias in four domains: (1) eligibility criteria for each study; (2) the identification and selection of studies; (3) data collection and study appraisal; and (4) overall synthesis and major findings. Within each domain, specific questions were used to determine the risk of bias, which was rated as “low,” “high,” or “unclear.”

2.4.3. Report Quality Assessment

SR/MA is an important evidence to guide clinical practice. The clarity of its report affects the realization of its clinical value. Standard reports can reduce the bias between actual research results and published results and increase the transparency of articles. The PRISMA report guide is designed to help authors improve the quality of their reports, obtain key information, and improve readability and credibility.

The quality of each SR/MA report for the included SRs/MAs was assessed by the PRISMA 2020 [22] checklist, and each of the 27 items included in PRISMA 2020 was scored as “yes,” “partially yes,” or “no.”

2.4.4. Evidence Quality Assessment

In order to be useful to decision-makers, clinicians, and patients, the SRs/MAs must provide not only the effect estimates of each result but also the information needed to judge the correctness of these effect estimates. The grading of recommendation assessment, development, and evaluation (GRADE) [25] provides a structure for SRs/MAs and clinical practice guidelines to ensure that it addresses all key issues of outcome evidence quality evaluation related to a specific issue in a consistent and systematic manner.

The quality of evidence for each SR/MA outcome was evaluated by the GRADE system. Since the initial quality of evidence for RCTs is high, the quality of evidence for the outcomes of the study was evaluated based on downgrading factors such as limitations, inconsistencies, indirectness, imprecision, and publication bias of the study. According to the downgrading level, they were rated as “high,” “moderate,” “low,” and “very low.”

3. Results

3.1. Literature Search and Screening Results

A total of 273 works of related literature were retrieved, and 14 works of literature [2639] were finally included after the layer-by-layer screening. The specific screening process is shown in Figure 1.

3.2. The Basic Characteristics of the Included Literature

Among the 14 SRs/MAs included, 5 [3539] SRs/MAs were in English, 9 [2634] SRs/MAs were in Chinese, 13 SRs/MAs were conducted in China, and 1 [34] SR/MA was carried out in South Korea, the publication year was 2009-2022, and the number of RCT studies ranged from 4 to 53. In terms of quality assessment of included RCTs, 8 SRs/MAs [2830, 32, 34, 3739] were assessed by the Cochrane risk of bias tool, and 5 SRs/MAs [26, 27, 31, 33, 36] were assessed by the Jadad scale, and 1 SR/MA [35] used the Oxford scale. The intervention measures in the treatment group were one of the three methods of simple acupuncture, electroacupuncture, and warm acupuncture or one of the above-mentioned methods combined with the relevant treatment recommended by the guidelines (including lifestyle regulation and CAD), while the control group received relevant treatments recommended by the guidelines or placebo/sham acupuncture. See Table 2 for specific information.

3.3. Results on SRs/MAs Quality Assessment
3.3.1. Results of the Methodological Quality

The quality of the included SRs/MAs was assessed by AMSTAR-2, and the results showed that 12 SRs/MAs [2637] were of very low quality because none of the included SRs/MAs met the criteria of item 2 (none of the included SRs/MAs has a registered protocol); 2 SRs/MAs [38, 39] were of low quality, and none of the 14 SRs/MAs met the criteria of item 7 (none of the SRs/MAs provided an exclusion list) and item 3 (no explanation for selecting the type of systematic review included in the study design). The methodological quality limitation also included the following items: item 1 (1 SR/MA author did not fully describe the PICO elements in the SR), item 8 (authors of 2 SRs/MAs did not fully describe essential characteristics of included studies), item 10 (2 SRs/MAs did not report funding RCTs/SRs/MAs), item 12 (authors of 12 SRs/MAs did not investigate the presence of risk of bias on the total effect), item 13 (authors of 4 SRs/MAs did not discuss the effect of risk of bias on the total effect of included studies), item 14 (authors of 8 SRs/MAs did not investigate sources of heterogeneity in results and/or did not discuss their effect on study results), item 15 (authors of 7 SRs/MAs did not test for publication bias and/or discussed its effect on results), item 16 (authors of 2 SRs/MAs did not describe funding sources and/or statements conflict of interest). The results are summarized in Table 3.

3.3.2. Results of the Risk of Bias Assessment

Regarding the results of the ROBIS assessment, both phase 1 and domain 1 of phase 2 rated SRs/MAs as having a low risk of bias. In the phase 2, 4 SRs/MAs in domain 2 were rated as low risk of bias, 8 SRs/MAs in domain 3 were rated as low risk of bias, 1 SR/MA in domain 4 was rated as low risk of bias, and all SRs/MAs were rated as high risk of bias in phase 3. The ROBIS scale evaluation results are shown in Table 4.

However, there were also some reporting flaws in other projects. The reports for item 5 (methods: protocol and registration), item 8 (methods: search), item 15 (risk of bias across studies), and item 24 (funding) were incomplete (“Yes or Partial Yes” with a response rate less than 50%). The results of the PRISMA checklist assessment are shown in Table 5.

3.3.3. Results of the Quality of the Evidence

Meta-analysis was performed on the outcome indicators in the study, and the GRADE system was used to evaluate the quality of 86 outcome indicators under different intervention indicators one by one. Of these, 2 were of moderate quality, 23 were of low quality, and 61 were of very low quality. Limitation downgrading due to the risk of bias was more common in included studies (), followed by imprecision (), publication bias (), inconsistency (), and indirectness (). See Table 6 for details.

3.3.4. Summary of Results

The outcome measures extracted from the included studies are listed in Table 6.

(1) The Effective Rate in Lowering Blood Pressure. 6 SRs/MAs [26, 27, 3032, 38] reported the effective rate of blood pressure reduction. 2 SRs/MAs [26, 27] reported that acupuncture alone was more effective than CAD in the treatment of EH; 4 SRs/MAs [3032, 38] reported that acupuncture combined with CAD was more effective than CAD alone in the treatment of EH.

(2) The Efficacy of Improving SBP and DBP. 11 SRs/MAs [27, 2934, 3639] reported the efficacy of acupuncture in improving SBP and DBP. 9 SRs/MAs [27, 29, 3133, 3639] reported that acupuncture alone was more effective in treating EH than CAD or placebo/sham acupuncture or no treatment. 10 SRs/MAs [2934, 3639] reported that acupuncture combined with lifestyle regulation or CAD was more effective than lifestyle regulation or CAD or placebo/sham acupuncture in the treatment of EH

(3) The Effect of Reducing the Magnitude of SBP and DBP. 3 SRs/MAs [28, 35, 37] reported the magnitude of blood pressure reduction of SBP and DBP. 3 SRs/MAs [28, 35, 37] reported that acupuncture alone was more effective than CAD or placebo/sham acupuncture in the treatment of EH, and the efficacy of acupuncture combined with CAD in the treatment of EH was better than that of CAD alone or placebo/sham acupuncture combined with CAD

(4) The Effective Rate of Comprehensive Treatment. 3 [3234] SRs/MAs reported the effective rate of comprehensive treatment. 2 SRs/MAs [32, 33] reported that the efficacy of acupuncture alone in the treatment of EH was better than that of CAD, and acupuncture combined with CAD or behavioral adjustment was better than CAD alone in the treatment of EH. 1 SR/MA [34] reported that acupuncture combined with TCM decoction Tianma Gouteng decoction (TMGTD) was more effective than CAD or TMGTD in the treatment of EH.

(5) The Effective Rate of Improving Symptoms. 2 SRs/MAs [26, 32] reported an effective rate of symptom improvement. 2SRs/MAs [26, 32] reported that the efficacy of acupuncture alone in the treatment of EH was better than that of CAD, and the efficacy of acupuncture combined with CAD in the treatment of EH was better than that of CAD alone

(6) Adverse Reactions. 8 SRs/MAs [28, 31, 32, 3539] reported adverse reactions. The main adverse reactions included occasional acupuncture site bleeding, dizziness, headache, cough, nausea, and pain, which recovered spontaneously after rest and did not require treatment. Since most studies failed to report adverse reactions in a standard way, quantitative analysis was not performed.

4. Discussion

At present, the main treatment strategy for EH is to give CAD on the basis of lifestyle control combined with the risk assessment of hypertension. However, due to the problems such as drug tolerance and side effects, clinicians are paying increasing attention to the treatment of hypertension by TCM, especially acupuncture. At present, there has been some clinical evidence for acupuncture treatment of hypertension. We systematically searched the existing systematic reviews and meta-analyses and comprehensively analyzed the existing evidence. The main findings of the study are as follows.

This study is the first overview of systematic reviews of acupuncture for essential hypertension based on RCTs published between 2009 and 2022. Growing evidence suggests that acupuncture can be used as an adjunctive treatment for EH and reduce dependence on CAD. Overall, available evidence suggests that acupuncture alone or a combination of acupuncture and medicine is more effective than placebo (sham acupuncture) or conventional antihypertensive regimens in the treatment of EH. In terms of safety, acupuncture has no serious adverse reactions.

4.1. The Methodology Is Not Standardized

The results of the AMSTAR-2 evaluation showed that the methodological quality of the included works of literature was rated as very low or low, mainly due to the following problems:

(1) Missing Preliminary Design Protocol: The researcher should specify the preliminary design protocol in the SRs/MAs. Most of the SRs/MAs included in this article were not registered, which may have increased the risk of bias in the preparation of the systematic reviews.

(2) Incomplete Literature Search: The involved researchers searched at least two databases, but most of them did not conduct supplementary search and gray literature search

(3) Failure to Provide a List of Excluded Literature: It may affect the authenticity of the results. During the systematic review process, it is an integral part of high-quality SR/MA to provide a list of potentially relevant studies that did not meet the inclusion criteria and explain the reasons for the exclusion

(4) Risk of Bias Analysis Assessment Flaws: When RCTs of varying qualities are included, the authors should assess their impact on the study results through subgroup analysis, regression analysis, sensitivity analysis, etc. Some of the included systematic reviews have insufficient or no description of the risk of bias assessment, and the lack of assessment of publication bias may undermine the authenticity of the conclusions. Furthermore, if SRs/MAs do not report funding resources of the included RCTs, this may increase clinical trial bias, as findings from industry-funded studies may be biased in favor of the funders.

In the GRADE system rating, acupuncture has certain efficacy in the treatment of EH, but the quality of evidence is low. The reason lies in that the methodological quality of the 14 included SRs/MAs has certain defects and the methodological quality of the original studies included in each SR/MA is not high, which affects the strength of the demonstration of the outcome indicators. It also shows that the original research design of the current acupuncture therapy for EH has certain defects, lacking scientific and standardized methodological guidance; the sample size of the research is relatively small, which ultimately affects the potency of the systematic review. According to the graded evidence quality assessment, 2 of the 86 effect sizes were of moderate quality, 23 were of low quality, and 61 were of very low quality. Risk of bias was the most common downgrading factor, followed by imprecision, publication bias, inconsistency, and indirectness. The risk of bias is mainly reflected in the fact that most of the original RCTs on acupuncture for EH did not clearly describe random sequence generation, allocation concealment, or blinding. Through further analysis, the outcome measures included in the SRs/MAs were found to be at risk of publication bias. It is worth noting that although almost all SRs/MAs indicated that acupuncture is an effective treatment, the conclusions of SRs/MAs may differ from real-world results and require further confirmation in the future due to low methodological quality studies.

4.2. Implications for Future Research

To reduce biases in such aspects as selectivity, implementation, and measurement, further large-sample, multicenter, long-term clinical RCTs based on evidence-based medicine standards are needed in the original research, and attention should be paid to the correct and reasonable implementation of randomization, allocation scheme concealment and blinding, etc. In addition, to further improve the quality of the evidence, authors should pay attention to the registration of the study protocol to ensure the rigor of its procedures before conducting SRs/MAs studies. During literature retrieval and screening, the information of literature exclusion and the complete retrieval strategy of all databases should be listed and elaborated to ensure that the process can be reproduced by others. In the quantitative calculation of effect sizes, care should be taken to exclude the results of individual studies on a case-by-case basis to ensure the stability of the results. In addition, a comprehensive assessment of publication bias will also improve the accuracy of meta-analysis results.

4.3. Strengths and Limitations

This is the first overview that makes use of the above assessment tools to assess SRs/MAs regarding acupuncture for EH. On one hand, the evaluation results strengthen the quality of the current relevant SRs/MAs evidence; on the other, the evaluation process of AMSTAR-2, ROBIS, PRISMA, and GRADE grading revealed obvious limitations of SRs/MAs and RCTs, which may help guide future high-quality clinical research. However, we must also acknowledge the limitations of this overview. Due to language limitations, this study only included systematic reviews published in both Chinese and English and did not include Korean and Japanese databases with the same background in traditional Chinese medicine research. Besides, the retrieval process has actually omitted manual retrieval, resulting in selection bias to a certain extent. In addition, two researchers conducted literature screening and quality assessment, and the process was subjective, the quantity of SRs/MAs included was small, and the overall quality was not high.

5. Conclusion

At present, acupuncture has a certain curative effect in the treatment of EH, but the quality of the evidence is low. The evidence should be used with caution in clinical practice, where the actual situation should be fully considered and the application should be combined with the patient’s value preference and economic factors.

Abbreviations

EH:Essential hypertension
CAD:Conventional antihypertensive drugs
TMGTD:Tianma Gouteng decoction
SBP:Systolic blood pressure
DBP:Diastolic blood pressure
SRs:Systematic reviews
MAs:Meta-analyses
RCTs:Randomized controlled trials
AMSTAR-2:A measurement tool to assess systematic reviews 2
ROBIS:Risk of bias in systematic reviews
PRISMA:Preferred reporting items for systematic reviews and meta-analyses
GRADE:Grading of recommendations assessment, development, and evaluation
TCM:Traditional Chinese medicine
CNKI:Chinese national knowledge infrastructure
CBM:Chinese biological medicine database.

Data Availability

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

Disclosure

The preprint version is available at Research Square (doi:10.21203/rs.3.rs-2183175/v1) (14 November 2022).

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this article.

Authors’ Contributions

MXF, XQW, and GHD participated in the research design. MXF, XQW, and GHD conducted a literature search and screened data extraction. MXF, XQW, and RML analyzed the data, did a statistical analysis, and wrote the manuscript. MXF, RML, and GHD participated in the correction of the manuscript. All authors reviewed the manuscript. All authors read and approved the final version of the manuscript.

Acknowledgments

This study was funded/supported by the National Natural Science Foundation of China (nos. 82174172 and 81774047) and the National Key R&D Program Project (no. 2019YFC1710401).