Review Article | Open Access
Zipan Lyu, Zhongyu Huang, Fengbin Liu, Zhengkun Hou, "A Methodological and Reporting Quality Assessment of Systematic Reviews/Meta-Analyses about Chinese Medical Treatment for Gastroesophageal Reflux Disease", Gastroenterology Research and Practice, vol. 2020, Article ID 3868057, 19 pages, 2020. https://doi.org/10.1155/2020/3868057
A Methodological and Reporting Quality Assessment of Systematic Reviews/Meta-Analyses about Chinese Medical Treatment for Gastroesophageal Reflux Disease
Objective. To access the methodological and reporting quality of systematic reviews (SRs)/meta-analyses (MAs) about Chinese medical treatment for gastroesophageal reflux disease (GERD). Methods. The PubMed, Wanfang Data, China National Knowledge Infrastructure (CNKI), Chinese Science and Technology Periodical Database (VIP), Chinese Biomedical (CBM), Web of Science, and Cochrane Library databases were searched from inception to June 2020. Two researchers independently screened the literature considering the eligibility criteria. Overview Quality Assessment Questionnaire (OQAQ), Assessment of Multiple Systematic Reviews 2 (AMSTAR 2), and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used to assess the methodological and reporting quality of the included reports. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) system was used to evaluate the level of evidence in each report. Results. Thirty-three SRs/MAs met the inclusion criteria. The OQAQ results showed that defects in the methodological quality of 17/32 reports were major, with scores of 3 points. Analyzing a single item as the object, search strategies (item 2), and risk of bias in individual studies (item 4) was considered poor. The AMSTAR 2 results showed that 25.4% of the items were not reported, and 7.8% of the items were only partially reported. The overall assessment of AMSTAR 2 showed the majority of systematic reviews and meta-analyses were of low/very low (31/33, 93.9%) methodological quality, with a lack of protocol registration and excluded study list. The PRISMA results showed that 19.9% of items were not reported, and 15.2% of items were only partially reported, due to a lack of protocol registration and study selection methods. The methodological and reporting quality of the included studies was generally poor. Evidence evaluation with GRADE showed that most (31/33) of the included studies had low or very low levels of evidence. Conclusion. The methodological and reporting quality of SRs/MAs about Chinese medical treatment for GERD is generally poor. The main problems included incomplete search strategies, risk of bias in individual studies, the lack of protocol registration and excluded study list, and incorrect study selection methods.
Gastroesophageal reflux disease (GERD) is a global chronic disease that affects 10% to 20% of Europeans and 2.5% to 7.1% of Asians [1–3]. However, mainstream therapy approaches including acid suppression therapy, prokinetics, and antireflux surgery were reported to be with little efficacy in relieving reflux symptoms . To improve individual quality of life, patients with GERD seek alternative medicines for reducing the frequency and severity of reflux symptoms such as heartburn and belching . As empirical alternative approaches, it was reported that traditional Chinese medicine (TCM) therapies such as acupuncture and herb treatment are safe and efficient in the treatment of gastroesophageal reflux disease. However, adequate high-quality evidence from normatively designed clinical trials is still in lack of further promotion of these approaches and their basic theory .
Summarizing empirical evidence that fits prespecified eligibility criteria with the application of statistical methods and systematic review/meta-analysis (SR/MA) provides multilevel evidence as reference for clinical decision-making. More remarkably, the conclusion from these works could be of varying quality which significantly depends on the material and process of the researches. Therefore, it is important to make a proper evaluation of existing resources of SR/MA for the achievement of reliable evidence among ambiguous even contradictory conclusions. And the promotion of the research about the evaluation of the quality of SR/MA is necessary for further application of TCM approaches as a treatment for complex diseases such as GERD [7, 8].
In the past decades, methodologies and instruments had been designed and developed as assisting tools for the evaluation of reliability and credibility of the SR/MA among which the Overview Quality Assessment Questionnaire (OQAQ), A Measurement Tool to Assess Systematic Reviews (AMSTAR), The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, and The Grading of Recommendations Assessment, Development and Evaluation (GRADE) were reported to be widely used for evaluation of the quality of researches and conclusion they are drawn.
The OQAQ (containing 10 items) was developed by Oxman and Guyatt in 1991 to evaluate the quality of SR/MA methodologies . The AMSTAR containing 11 items was jointly developed by clinical epidemiologists at the Medical Research Centre of the University of Vrije Universiteit, the Netherlands, and the University of Ottawa, Canada, in 2007. The tool was updated as the AMSTAR 2 (including 16 items) in 2017 for evaluating SR/MA methodological quality [10, 11]. The PRISMA guideline (containing 27 items) was developed based on the Quality of Reporting of Meta-Analyses (QUOROM) statement, which was developed by an international team represented by David Moher, and this was revised in 2009 to guide and evaluate the writing of systematic reviews [12, 13]. The GRADE is an evidence rating system created by the GRADE Working Group. It was officially launched in 2004 and is used to evaluate the quality of evidence and the level of recommendation . To provide reliable evidence for TCM treatment about GERD in clinical practice, this study made use of the OQAQ, AMSTAR 2 scale, and PRISMA guidelines for accessing the methodological and reporting quality of the SRs/MAs about Chinese medical treatment for GERD with the hope of further reminding clinicians to be more cautious about the quality of SRs/MAs on GERD.
2. Materials and Methods
2.1. Search Strategy
Two trained researchers independently searched eight databases, including the PubMed, Wanfang Data, China National Knowledge Infrastructure (CNKI), Chinese Science and Technology Periodical Database (VIP), Chinese Biomedical (CBM), Web of Science, and Cochrane Library databases were searched from inception to June 2020. The following keywords and combined free words were used in the search: “gastric esophageal reflux disease,” “Chinese medical therapy,” “systematic review,” and “meta-analysis.” The grammar was adjusted according to different databases. The reference list of each included paper was screened to find potentially relevant articles that were not initially identified by the search. If there were multiple updates for a study, only the latest version would be included.
2.2. Inclusion Criteria
One study would be included if the following conditions were met: (1) the study was self-labeled or designed as a systematic review, meta-analysis, or systematic review and meta-analysis; (2) the studies included participants who were diagnosed with GERD (reflux oesophagitis (RE) or nonerosive reflux disease (NERD) or Barrett’s esophagus (BE)); (3) the topic was set as the treatment of gastroesophageal reflux disease with Chinese medicine; (4) these articles were full texts that have been published.
2.3. Exclusion Criteria
Publications were excluded according to the following criteria: (1) studies were not SRs/MAs; (2) studies did not concern a clinical question regarding human beings; (3) studies had missing or unclear data for final analysis.
2.4. Data Extraction
Two trained researchers independently extracted data from the included SRs/MAs with preestablished forms. To ensure the validity of the data extraction form, 10% of the literature samples were randomly pretested and appropriate modifications would be made to the forms based on the preassessment results. The following basic characteristics of the included SRs/MAs were extracted: (1) the first author, (2) the study country, (3) the year of publication, (4) the language of publication, (5) the numbers of authors, (6) the type of study, (7) the numbers of participants, (8) the numbers of included RCTs, (9) the invention, (10) comparisons, (11) bias risk assessment tool results, (12) funding sources, and (13) Cochrane review.
2.5. Assessment of Methodological and Reporting Quality
The OQAQ and the AMSTAR 2 scale were used to evaluate the methodological quality, and the PRISMA guidelines were used to access the quality of reporting for the included SRs/MAs. According to the matching level between the content of the report and item of those three scales, the score of each item was 0, 0.5, or 1, and the weight of each field was equal. When it was clear that the conditions were met, the item would be judged as “complete reporting (score 1),” and when it was clear that the conditions were not met, the item would be judged as “no reporting (score 0).” When the item was related but not fully described, the item would be judged as “partial reporting (score 0.5).” The OQAQ questionnaire results were set as follows when evaluating the methodological quality of a single SR/MA: , , , and . For each item of the three scales, the reporting rate was calculated as the sum of the score of each article and presented as a percentage to analyze problems with the SR/MA methodologies and reporting quality. Besides, the included SRs/MAs would be grouped into three preset subgroups, including language, funding, and Cochrane review, to explore potential factors that may affect the quality of SR/MA methodology and reporting. Each SR/MA was independently evaluated by two authors, and differences were resolved through discussion.
2.6. Assessment of Quality of the Evidence
GRADE was used to assess the SR/MA level of evidence. The quality of the evidence was classified into four levels: high, moderate, low, and very low. The GRADE system assessment results were combined with the methodological and reporting quality assessment results to produce GERD drug treatment recommendations.
3.1. Search Results
The search protocol identified 825 studies with potential relevance. After screening titles and abstracts, 72 studies were eligible for full-text review, and 39 studies were excluded according to the exclusion criteria. Finally, 33 reports [15–46], including 22 network meta-analyses (NMA)/MAs, 6 SRs, and 5 NMAs/MAs and SRs, underwent quality assessment. Information on the search protocol is shown in Figure 1.
3.2. General Characteristics
There were 28 reports [15–24, 26–32, 34, 35, 38–45] in Chinese and 5 reports [25, 33, 36, 37, 46] in English. 18 studies reported the sources of funding; but none of them were Cochrane reviews. The 33 studies included 124 RCTs and 15686 GERD patients and compared the efficacies of multiple Chinese medical interventions. All 33 studies have used the risk of bias assessment tool; only 1 study  used a tool but did not describe it, and the other 32 studies used the Jadad scale, Cochrane handbook, or both of them as the risk of the bias assessment tool. The details of all the included reports are shown in Table 1.
Notes: TCM (traditional Chinese medicine) included herbal formula, acupuncture, and moxibustion; modern medicine included PPIs (proton pump inhibitors), H2RAs (H2 receptor antagonists), and antibiotics.
3.3. Methodological Quality
The results of the OQAQ and AMSTAR 2 scale for evaluating methodological quality are shown in Tables 2 and 3. The evaluation results of the OQAQ showed that the defects in the methodological quality of 16 reports were negligible, with scores of 7 points, and 17 reports had major defects, with scores of 3 points. Analyzing a single item as the object, search strategies (item 2), and risk of bias in individual studies (item 4) was considered poor according to the OQAQ, with a no reporting rate of 36.8% and a partial reporting rate of 25%. The remaining items (1, 3, 5-9), such as information sources (item1), study selection (item3), and synthesis of results (item 5), in the OQAQ, had a complete reporting rate of 100%. According to the AMSTAR 2 results, the patient, intervention, comparison, outcome (PICO) criteria (item 1), explanation of study design (item 3), included studies (item 8), combined data (item 11), and satisfactory explanation (item 14) had been completely reported with the rate of 100%; protocol registration (item 2), the listing of excluded studies (item 7), and funding (item 10) had been incompletely reported with rates of 0%, 31.3%, and 31.3%, respectively. A single study was used as the object for analysis; the AMSTAR 2 scale showed that on average, each study had a complete reporting rate of 66.8%, a partial reporting rate of 7.8%, and a no reporting rate of 25.4%.
Notes: ; ; ; score ( deficiencies; defects; defects; defects).
Notes: ; ; of study design; ; selection in duplicate; extraction in duplicate; studies; studies; of bias; ; data; impact of RoB; for RoB; ; ; ; Q2, 4, 7, 9, 11, 13, and 15 are the critical domains; ; ; , ; ; ; .
3.4. Reporting Quality
The results of the PRISMA quality evaluation are shown in Table 4. The average score for the 33 studies was 19.5 out of 27 points, suggesting that the quality of the included studies was low. A single study was used as the object for analysis; the highest score was 25 points , the lowest score was 15 points , and there was a large gap in quality between studies. The no reporting rate for PRISMA results was 19.9%, and the partial reporting rate was 15.2%. In the single-item analysis, the reporting rates for the topic (item 1), the rationale (item 3), and the synthesis of results (item 21) were 100% (33/33). Structured summary (item 2), eligibility criteria (item 6), information sources (item7), summary measures (item 13), study selection (item 17), and synthesis of results (item 21) were completely or partially reported. None of the studies reported that protocol registration (item 5), study selection (item 9), data items (item 11), and additional (item 16) were poorly reported.
Notes: ; ; .
3.5. Evidence Quality
The results of the evidence quality assessment are shown in Table 5. There was no high-quality level of study. Most of the included studies had either a low or very low-quality level, with only two studies [35, 46] having a moderate level of evidence.
3.6. Subgroup Analysis
Since there were no Cochrane reviews, subgroup analyses were conducted only for topics about language and funding. The results of the two subgroup analyses according to language and funding are shown in Table 6. Methodological quality assessments with the OQAQ and AMSTAR 2 scale suggested that the results of the funding subgroups were similar. According to the PRISMA results, 28 reports [15–24, 26–32, 34, 35, 38–45] in Chinese had an average quality score of 19.2, and 5 reports [25, 33, 36, 37, 46] in English had an average quality score of 24. The 16 studies [17, 20, 22, 24, 26–29, 31, 33, 35, 37, 40–45] that received funding had an average quality score of 19.6, and the nonfunded research had an average quality score of 20.2. The two studies with moderate evidence levels were nonfunded studies according to the evaluation results of GRADE.
This study showed that the progress of SR/MA research regarding Chinese medical treatment of GERD was not good. The methodological and reporting quality of the related studies was low. The results of the OQAQ showed that the defects in the methodological quality of 16 reports were negligible, with scores of 7 points, and 17 reports had major defects, with scores of 3 points. The results of the AMSTAR 2 scale showed that the unreported rate was 25.4% and the partial reporting rate was 7.8%, totaling 66.8%. The no reporting rate for PRISMA results was 19.9%, and the partial reporting rate was 15.2%. The above defects reduced the credibility of relevant conclusions to some extent.
4.1. Characteristics of Research Scope and Results
Since the inclusion of SRs/MAs in this study did not consider the use of the Cochrane criteria, it is not comparable to the quality differences reported by those who applied Cochrane and non-Cochrane methodologies. However, some MAs [47–49] reported excellent methodological quality according to the Cochrane criteria, indicating that rigorous expert-led methods training and expert collaboration guidance are conducive to the production of high-quality MAs.
The results reported by all of the studies were positive which may be related to the fact that positive results are more often published than negative results. By applying systemic analysis, Young et al.  found that “if a study reports a negative result, then publication is quite difficult”. Zhu et al.  reported in an article that “negative findings of MAs can be independent factors for improved methodologies (a 0.6-point increase in the AMSTAR score).” Therefore, it is important when a study produces a negative result, it should be reported honestly and not disregarded or modified.
4.2. Subgroup Analysis
Funded research was inferior to nonfunded research in both reporting and methodological quality, and it was also found that funded research tended to be published in Chinese (14/16). It is a common phenomenon in China that well-known research institutions or researchers are more likely to receive funding in relevant fields. Likewise, journals tend to favor research from well-known institutions or individuals to improve their reputation instead of evaluating research based on quality. This is in line with Reingewertz and Lutmar  who noted that academic in-group bias is general. This discovery reminds researchers about the necessity of making an objective evaluation of each study. When performing an SR/MA, it is important to search as comprehensively as possible, be cautious about language and country restrictions, and include good research to improve the overall quality of the study.
4.3. Methodological Quality
With the OQAQ applied for evaluating the quality of the included research methods, the main reasons leading to the decrease in scores were the literature search strategies (item 2) and the risk of individual study bias (item 4). SR/MA is a secondary analysis, and a large number of studies have shown that incomplete search strategies will generate selection bias and affect the quality of studies. Though the search strategy about researches was considered on the three scales, there are differences among their requirements. For the OQAQ, it is required that researchers should include both electronic searches and manual searches while only electronic searches were required in the PRISMA guidelines and AMSTAR 2 scale. However, with the development of interworking technology and the application of databases, there have been more approaches for researchers to obtain potentially relevant research, such as the preprint websites http://arxiv.org/ and https://www.biorxiv.org/, which allow researchers to obtain grey literature which is a kind of important and valuable information recourse. The China Journal Full-text Database (CJFD) includes 6,100 core journals and important journals in various disciplines. Since 1994, the data integrity of the 6,100 periodicals has reached 98%. Therefore, it should be realized that the use of an electronic search alone would not affect the credibility of the final results. In this study , the methodological quality assessment score was reduced from 7 to 3 points due to the lack of manual searching. Manual searching is very important, but whether it is necessary or not is debated at present since the OQAQ was developed in 1991 and it seems to be slightly out of date. Moreover, it does not involve the evaluation of publication bias and conflicts of interest even though publication bias is an extremely important indicator of the methodological quality of systemic evaluation. By performing a systematic review, Pussegoda et al.  showed that the OQAQ has been used significantly less by researchers than the PRISMA guidelines or the AMSTAR scale. This article would recommend the application of the AMSTAR scale for the evaluation of the methodological quality of SRs/MAs. For researchers who want to produce SRs/MAs, a comprehensive search strategy with a combination of search databases, professional websites, professional internal conference proceedings, libraries, clinical trial registration platforms, and official registration websites of relevant institutions would be recommended.
According to the design of AMSTAR 2, items 2, 4, 7, 9, 11, 13, and 15 were critical for methodological quality evaluation. However, none of the studies provided protocol registration information (item 2) or a listing of excluded studies (item 7). The reason why the selected articles failed to provide preliminarily excluded studies maid is that the excluded list is merely required in the current guidance for research reporting and publishing out of the scope of research. Especially for domestic periodicals in China, due to the limitations of the layout and word counts, editors cannot list relatively lengthy exclusion documents in the manuscript. Therefore, the author generally believes that the magazine editors or peer reviewers will ask the author to exclude the list of documents during the manuscript review stage and conduct a detailed assessment before the paper is published. As to the fifth item in PRISMA guidelines, it is required for the report about protocol registration of the research. Lesley et al.  regarded systematic reviews as a form of observational research in which a protocol registered before the start of the study would help to ensure its scientific validity and feasibility. Registration can effectively control bias that may occur in all aspects of research and prevent researchers from arbitrarily changing the research protocol. Booth et al.  developed the perspective that a registered plan can effectively reduce the duplication of SRs/MAs and reduce scientific research resource waste. In 2011, Tricco et al. , an international expert in evidence-based medicine, jointly called for the registration of all meta-analyses and systematic reviews worldwide. This would enable highly scientific, rigorous, and transparent production processes and increase the publication rate of scientific articles. As to registered websites, the Cochrane Collaboration and PROSPERO would be recommended for research registration. The difference between the two registration systems is that the PROSPERO platform accepts studies with a broad scope with a relatively simple and easy process for registration and auditing while that of the Cochrane Collaboration is more complicated and restrict.
4.4. Reporting Quality
As shown in the result of the PRISMA evaluation, more than 80% of items were not completely reported. As to study selection of the articles, there were 87.6% (29/33) of enrolled articles that did not completely report it in the method section while only 24.2% (8/33) of enrolled articles did not completely report it in the result section. For reporting the study selection method, item 9 requires that the report includes the selection process for the study, and item 17 requires that the results of each step in the screening process be reported. There were obvious differences in the reporting rates for items 9 and 17, in which some scholars believe are related to expensive publication fees. However, by comparing the report lengths of the highest (J. Li et al. ) and lowest scoring (S. Li et al. ), the number of words was reduced by rationally using typesetting, cleverly combining tables, and adding less-important content to the appendix, while still ensuring the rigor and integrity of the report.
4.5. GRADE Evidence Assessment
In the GRADE assessment, most of the evidences included in the study were low-level or very low-level evidence. The main reason for the degradation in the level of evidence was that included studies had a high risk of bias. This indicates that the quality of RCTs related to drug treatment of GERD is poor, making it difficult to provide support for evidence-based medicine. Multicenter, large-sample RCTs are urgently needed. Researchers should focus on high-quality, relevant clinical research in the future. There were two studies (JY.K. Dai et al. , S. Li et al. ) with intermediate levels of evidence; their PRISMA scores were 24.5 and 25, respectively. Supported by the strength of the same evidence, Li et al.’s study  had the best reporting quality and was closest to fulfilling the requirements of the Cochrane Collaboration. High-quality SRs/MAs have level I evidence for evidence-based medicine. It is well known that the Cochrane Collaboration’s SR/MA criteria have been widely used in guidelines because of their rigorous and scientific development. They are known to the academic community as the gold standard for evidence-based results. Because of the absence of relevant Cochrane reviews and because two studies had the same level of evidence according to GRADE, we creatively introduced PRISMA evaluation results and recommended the conclusions of Li et al.  to clinical decision-makers. However, given the possible biases, a further systematic review is needed.
There are several limitations to the design of the research. First of all, since self-labeled other than the standardized definition of system review was set as the inclusion criterion for literature selection, there may be a predetermined low score in the quality of the report. Secondly, due to the unquantified item setting of the AMSTAR scale and PRISMA scale and different understandings from evaluators, subjective bias was introduced resulting in differences in the final scoring results. Thirdly, the scope of analysis as limited to the SRs/MAs of TCM in treating GERD. Those studies around the therapies such as PPI and other mainstream treatments were not included; therefore, the extrapolation of the conclusions was limited.
The methodological and reporting quality of SRs/MAs about Chinese medical treatment for GERD is generally poor. The main problems included incomplete search strategies, risk of bias in individual studies, the lack of protocol registration and excluded studies list, and incorrect study selection methods.
All related data would be available on request to the corresponding author (firstname.lastname@example.org).
Zipan Lyu and Zhongyu Huang are co-first author.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this article.
Zipan Lyu and Zhongyu Huang contributed toward the concept, data analysis, and manuscript writing and manuscript review; Zipan Lyu, Zhongyu Huang, and Zhengkun Hou contributed toward data collection, funding, and manuscript review; Fengbin Liu and Zhengkun Hou contributed toward concept and manuscript review. Zipan Lyu and Zhongyu Huang contributed equally to this work.
This study was supported by the Natural Science Foundation of China (No. 81774450).
- B. Gold and P. Sherman, “A global, evidence-based consensus on the definition of pediatric gastroesophageal reflux disease (GERD),” American Journal of Gastroenterology, vol. 103, p. S36, 2008.
- H. B. El-Serag, S. Sweet, C. C. Winchester, and J. Dent, “Update on the epidemiology of gastro-oesophageal reflux disease: a systematic review,” Gut, vol. 63, no. 6, pp. 871–880, 2014.
- K.-L. Goh, “Gastroesophageal reflux disease in Asia: a historical perspective and present challenges,” Journal of Gastroenterology and Hepatology, vol. 26, pp. 2–10, 2011.
- D. Zou, J. He, X. Ma et al., “Epidemiology of symptom-defined gastroesophageal reflux disease and reflux esophagitis: the systematic investigation of gastrointestinal diseases in China (SILC),” Scandinavian Journal of Gastroenterology, vol. 46, no. 2, pp. 133–141, 2011.
- E. Ness-Jensen, A. Lindam, J. Lagergren, and K. Hveem, “Changes in prevalence, incidence and spontaneous loss of gastro-oesophageal reflux symptoms: a prospective population-based cohort study, the HUNT study,” Gut, vol. 61, no. 10, pp. 1390–1397, 2012.
- D. J. Cook, C. D. Mulrow, and R. B. Haynes, “Systematic reviews: synthesis of best evidence for clinical decisions,” Annals of Internal Medicine, vol. 126, no. 5, pp. 376–380, 1997.
- E. Ernst and M. H. Pittler, “Assessment of therapeutic safety in systematic reviews: literature review,” BMJ, vol. 323, no. 7312, p. 546, 2001.
- I. Chalmers and P. Glasziou, “Avoidable waste in the production and reporting of research evidence,” The Lancet, vol. 374, no. 9683, pp. 86–89, 2009.
- A. D. Oxman and G. H. Guyatt, “Validation of an index of the quality of review articles,” Journal of Clinical Epidemiology, vol. 44, no. 11, pp. 1271–1278, 1991.
- B. J. Shea, J. M. Grimshaw, G. A. Wells et al., “Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews,” BMC Medical Research Methodology, vol. 7, no. 1, p. 10, 2007.
- B. J. Shea, B. C. Reeves, G. Wells et al., “AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both,” BMJ, vol. 358, article j4008, 2017.
- D. Moher, D. J. Cook, S. Eastwood, I. Olkin, D. Rennie, and D. F. Stroup, “Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement,” The Lancet, vol. 354, no. 9193, pp. 1896–1900, 1999.
- D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and Prisma Group, “Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,” Open Medicine, vol. 3, no. 3, pp. 123–130, 2009.
- G. Guyatt, A. Oxman, G. Vist et al., “GRADE: an emerging consensus on rating quality of evidence and strength of recommendations,” BMJ, vol. 336, no. 7650, pp. 924–926, 2008.
- J. S. Song, J. Xiong, X. Z. Lu, and H. G. Shang, “Systematic review of Xiao Xian Xiong decoction and its addition and reduction prescription in the treatment of gastroesophageal reflux disease,” Journal of Liaoning Journal of Traditional Chinese Medicine, vol. 34, no. 5, pp. 653–655, 2008.
- L. Yang, Systematic review of oral Chinese medicine in the treatment of gastroesophageal reflux disease, Nanjing University of Chinese Medicine, 2011.
- W. Zhao, M. Y. Shao, M. Wei, J. Chen, and J. L. Qiu, “Systematic review of liver soothing and stomach therapy for reflux esophagitis,” Journal of Liaoning Journal of Traditional Chinese Medicine, vol. 38, no. 3, pp. 398–401, 2011.
- S. Chen and X. Tian, “Meta-analysis of Ban Xia Hou Po decoction for gastroesophageal reflux disease,” Chinese Journal of Clinical Research, vol. 27, no. 9, pp. 1080–1082, 2014.
- C. H. Sun, D. Chen, and B. Wang, “Meta-analysis of clinical efficacy of Tong Jiang He Wei decoction in the treatment of gastroesophageal reflux disease,” Chinese People's Liberation Army Medical Journal, vol. 26, no. 5, pp. 54–57, 2014.
- M. Zhang, Meta-analysis of traditional Chinese medicine in the treatment of non-erosive gastroesophageal reflux disease, Beijing University of Chinese Medicine, 2014.
- Y. Q. Wang, Systematic review of traditional Chinese medicine in the treatment of gastroesophageal reflux cough, Chengdu University of Chinese Medicine, 2014.
- Y. J. Li, Y. Wang, and W. Wei, “Systematic review and meta-analysis of a randomized controlled trial of Xin Kai Ku Yang therapy for gastroesophageal reflux disease,” World Journal of Integrated Traditional Chinese and Western Medicine, vol. 10, no. 11, pp. 1490–1495, 2015.
- Y. Q. Pei, “Meta-analysis of traditional Chinese medicine in the treatment of non-erosive gastroesophageal reflux disease,” Chinese Health Standards Management, vol. 6, no. 8, pp. 73–76, 2015.
- Z. L. Guo, Z. Su, F. Wang, and X. M. Luo, “Meta-analysis of the efficacy of Ban Xia Xie Xin decoction in the treatment of reflux esophagitis,” Chinese Journal of Experimental Formulae, vol. 21, no. 24, pp. 219–224, 2015.
- W. Ling, Y. Huang, J. H. Xu et al., “Consistent efficacy of WenDan decoction for the treatment of digestive reflux disorders,” American Journal of Chinese Medicine, vol. 43, no. 5, pp. 893–913, 2015.
- M. Zheng and Y. Tang, “Meta-analysis of gastroesophageal reflux disease treated mainly with Chaihu Shugan powder,” Tianjin Traditional Chinese Medicine, vol. 33, no. 8, pp. 456–461, 2016.
- M. Zheng and Y. Tang, “Meta-analysis of gastroesophageal reflux disease treated mainly with Bamxiaxiexin decoction,” World Journal of Integrated Traditional Chinese and Western Medicine, vol. 5, no. 11, pp. 610–614, 2016.
- Y. H. Ge, P. Huang, B. Lyu et al., “Meta-analysis on the effect of TCM syndrome differentiation in the treatment of reflux esophagitis,” Chinese Journal of Integrated Chinese and Western Medicine Digestion, vol. 24, no. 5, pp. 355–358, 2016.
- J. J. Zhu, Y. Li, S. Liu et al., “Meta-analysis of external treatment of gastroesophageal reflux disease with traditional Chinese medicine,” World Journal of Integrated Traditional Chinese and Western Medicine, vol. 12, no. 12, pp. 1629–1648, 2017.
- H. K. Ghung, Meta-analysis on the clinical efficacy of acupuncture on gastroesophageal reflux and observation on the efficacy of She Yan acupuncture combined with traditional Chinese medicine, Guangzhou University of Chinese Medicine, 2017.
- J. Chen, H. Wei, and S. Xie, “Meta-analysis of Banxia Xiexin decoction in the treatment of gastroesophageal reflux disease,” Asia-Pacific Traditional Medicine, vol. 13, no. 3, pp. 53–56, 2017.
- K. H. Chen, X. Qiu, and Z. Jia, “Meta-analysis of the long-term efficacy of Chinese Materia Medica in the treatment of reflux esophagitis,” Sichuan journal of traditional Chinese Medicine, vol. 35, no. 4, pp. 219–222, 2017.
- Y. Dai, Y. Zhang, D. Li, J. Ye, W. Chen, and L. Hu, “Efficacy and safety of modified Banxia Xiexin decoction (Pinellia decoction for draining the heart) for gastroesophageal reflux disease in adults: a systematic review and meta-analysis,” Evidence-Based Complementary and Alternative Medicine, vol. 2017, Article ID 9591319, 17 pages, 2017.
- G. Y. Li, X. Wu, J. Liao, and M. Li, “Systematic review and meta-analysis of acupuncture combined with traditional Chinese medicine for gastroesophageal reflux disease,” Tianjin Journal of Traditional Chinese Medicine, vol. 35, no. 10, pp. 756–761, 2018.
- J. Xie, G. Chen, Q. Lu, and S. Xie, “Meta-analysis of external TCM therapy for gastroesophageal reflux disease,” Liaoning Journal of Traditional Chinese Medicine, vol. 45, no. 9, pp. 1793–1796, 2018.
- J. Xiao, Y. Yang, Y. Zhu et al., “Efficacy and safety of traditional Chinese medicine on nonerosive reflux disease: a meta-analysis of randomized controlled trials,” Evidence-Based Complementary and Alternative Medicine, vol. 2018, Article ID 1505394, 13 pages, 2018.
- J. Zhu, Y. Guo, S. Liu et al., “Acupuncture for the treatment of gastro-oesophageal reflux disease: a systematic review and meta-analysis,” Acupuncture in Medicine, vol. 35, no. 5, pp. 316–323, 2017.
- L. Q. Li, S. Xie, M. Chen, J. F. Li, K. X. Gong, and J. J. Tan, “Articulated Meta-analysis of the clinical efficacy of 7 traditional Chinese medicine treatments for gastroesophageal reflux disease,” Chongqing Medicine, vol. 48, no. 24, pp. 4206–4218, 2018.
- S. Xie, L. Li, B. H. Zhong, M. B. Chen, J. F. Li, and J. J. Tan, “Reticulated meta-analysis of 7 Chinese herbal medicines for treating gastroesophageal reflux disease with liver and stomach disharmony,” Liaoning Journal of Traditional Chinese Medicine, vol. 46, no. 9, pp. 1793–1798, 2019.
- X. Fu, Y. Cao, J. Huang et al., “A meta-analysis on the treatment of gastroesophageal reflux disease with liver-soothing and stomach-harmonizing method,” Chinese Journal of Traditional Chinese Medicine, vol. 37, no. 9, pp. 2201–2205, 2019.
- J. F. Li, S. Xie, J. Li et al., “Meta-analysis of pointer therapy for gastroesophageal reflux disease,” Liaoning Journal of Traditional Chinese Medicine, vol. 46, no. 4, pp. 819–824, 2019.
- Q. Z. Song, W. Dai, M. Chen, and S. Xie, “Meta-analysis of acupuncture and acupuncture combined with simple drugs in the treatment of gastroesophageal reflux disease,” Liaoning Journal of Traditional Chinese Medicine, vol. 46, no. 12, pp. 2495–2500, 2019.
- X. H. Wu, G. Li, Z. Qiu, J. M. Liao, H. Guo, and X. T. Chai, “A systematic review and meta-analysis of the effectiveness of acupuncture treatment of gastroesophageal reflux disease,” Liaoning Journal of Traditional Chinese Medicine, vol. 46, no. 2, pp. 241–247, 2019.
- Q. Z. Song, S. Xie, and Q. Li, “Reticular meta-analysis of comparison of the efficacy of proton pump inhibitors in the treatment of reflux esophagitis with 4 kinds of meridional formulas,” Shi Zhen Chinese Medicine, vol. 31, no. 1, pp. 249–252, 2020.
- J. Li, S. Xie, G. Chen et al., “Meta-analysis of Bu Zhong Sheng Yang therapy for reflux esophagitis,” Western Chinese Medicine, vol. 33, no. 1, pp. 69–72, 2020.
- S. Li, M. Huang, G. Wu et al., “Efficacy of Chinese herbal formula Sini Zuojin decoction in treating gastroesophageal reflux disease: clinical evidence and potential mechanisms,” Frontiers in Pharmacology, vol. 11, p. 76, 2020.
- S. Adie, D. Ma, I. A. Harris, J. M. Naylor, and J. C. Craig, “Quality of conduct and reporting of meta-analyses of surgical interventions,” Annals of Surgery, vol. 261, no. 4, pp. 685–694, 2015.
- M. J. Page, L. Shamseer, D. G. Altman et al., “Epidemiology and reporting characteristics of systematic reviews of biomedical research: a cross-sectional study,” PLoS Medicine, vol. 13, no. 5, article e1002028, 2016.
- S. Mihara and S. Higuchi, “Cross-sectional and longitudinal epidemiological studies of Internet gaming disorder: a systematic review of the literature,” Psychiatry and Clinical Neurosciences, vol. 71, no. 7, pp. 425–444, 2017.
- N. S. Young, J. P. A. Ioannidis, and O. al-Ubaydli, “Why current publication practices may distort science,” PLoS Medicine, vol. 5, no. 10, article e201, 2008.
- Y. Zhu, L. Fan, H. Zhang et al., “Is the best evidence good enough: quality assessment and factor analysis of meta-analyses on depression,” PLoS One, vol. 11, no. 6, article e0157808, 2016.
- Y. Reingewertz and C. Lutmar, “Academic in-group bias: an empirical examination of the link between author and journal affiliation,” Journal of Informetrics, vol. 12, no. 1, pp. 74–86, 2018.
- K. Pussegoda, L. Turner, C. Garritty et al., “Systematic review adherence to methodological or reporting quality,” Systematic Reviews, vol. 6, no. 1, p. 131, 2017.
- L. Stewart, D. Moher, and P. Shekelle, “Why prospective registration of systematic reviews makes sense,” Systematic Reviews, vol. 1, no. 1, p. 7, 2012.
- A. Booth, M. Clarke, G. Dooley et al., “The nuts and bolts of PROSPERO: an international prospective register of systematic reviews,” Systematic Reviews, vol. 1, no. 1, p. 2, 2012.
- A. C. Tricco, S. E. Straus, and D. Moher, “How can we improve the interpretation of systematic reviews?” BMC Medicine, vol. 9, no. 1, p. 31, 2011.
Copyright © 2020 Zipan Lyu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.