GAP: From Sound Design to Practical Implementation in Clinical Trials for Traditional Chinese MedicineView this Special Issue
Review Article | Open Access
Clinical Research of Traditional Chinese Medicine Needs to Develop Its Own System of Core Outcome Sets
Currently, quality issues concerning clinical research of traditional Chinese medicine (TCM) have come into the spotlight. It has been recognized that poorly-devised research methodology largely restricted the development of clinical research in TCM. The choice of appropriate outcome measurements is key to the success of clinical research; however, the current procedure for outcomes selection in clinical research of TCM is problematic due to the underdevelopment of clinical methodology. Under this circumstance, we propose the introduction to the concept of Core Outcome Set (COS) and discuss the feasibility of developing a COS system that caters for clinical studies in TCM, in the hope that the outcome evaluation system could be up to international standards.
Clinical effectiveness is not only important for traditional Chinese medicine (TCM), but for all medical systems. Clinical research in TCM has been developed relatively later. Largely due to the many existing methodological defects of TCM trials, the efficacy of TCM remains controversial [1, 2]. All these issues have created a bottleneck in the development of TCM. There is a growing recognition that more attention has been paid to enhance the quality in clinical research of TCM [3, 4]. Especially in this decade, a new discipline, clinical evaluation of TCM, has formed into being and its development has been supported by the Chinese Major Science and Technology Projects. Owing to concerted efforts from a panel of experts with multidisciplinary background, the quality of clinical research of TCM has been improved, in terms of the construction of clinical research platform and the introduction of process management. There have been several achievements, for instance, the construction and implementation of the central randomization system, the application of the clinical data management system, the introduction of ethical review and trial registration, the promotion of the Consolidated Standards of Reporting Trials (CONSORT) statement, and the standardization of the data processing and analysis techniques.
2. Problems with Outcome Measures in Clinical Trials of TCM
Consensus on regarding what constitute a good design has been reached by most scholars, except some characteristics of TCM which have unique difficulties, including placebo making, sham control of acupuncture, tailoring treatment principle, and diagnostic system. Outcome measure is one of the key factors. For example, a systematic review of 35 trials investigating the efficacy of TCM for chronic obstructive pulmonary diseases (COPD) reported a total of 22 different outcomes . Another systematic review  including 17 randomized controlled trials (RCTs) with compound salvia dropping pills for unstable angina pectoris reported 11 outcome measures. Among all included studies, 11 studies (65%) reported angina improvement, 10 reported electrocardiogram improvement, and only one study reported the incidence of major cardiovascular events. 15 trials (88%) had a treatment duration of 4 weeks, too short to identify clinically significant improvement on angina. A systematic review  of primary studies on a combination of TCM treatment regimens for improving the movement function of poststroke patients included 34 RCTs with 11 different outcome measures, all being intermediate outcomes. 29 (85%) RCTs reported total effective rate; however, the original data and the standard against which to judge efficacy were not found in the primary study. In 23 RCTs (85%), the treatment period lasted less than 30 days. Moreover, only one study reported adverse events.
Problems concerning the choice and reporting of outcome measures for clinical trials of TCM were summarized as follows [5, 8–10]. (1) Outcome measured and reported in clinical trials of the same condition varied greatly, and there was apparent selective reporting bias. (2) Soft outcome measures are often employed such as percentage of patients perceiving benefit. (3) Subjective outcome measures were in a dominant position while objective outcome measures were less frequently adopted. (4) Lack of agreed and standardized evaluation criteria for TCM-related outcomes (e.g., tongue and pulses). (5) Surrogate endpoints bearing limited importance to practitioners and patients, such as biochemical indicators, were widely adopted, whereas important endpoint outcomes were less frequently reported. (6) Insufficient attention has been paid to the reporting of adverse event and adverse drug reaction associated with the use of herbal medicines.
3. Origin and Development of a Core Outcome Set (COS)
Concerning the same health care issue, the prospective of the patients, clinicians, researchers, and policymakers may vary greatly. Lack of consideration of this issue will lead to study results with less practical value. Therefore, selecting appropriate outcome(s) is crucial in the design of clinical trials. In addition, the results of systematic reviews and meta-analysis are an important source of evidence for health-related decision making, and the credibility of these results are based on the validity and quality of primary studies. If there are defections in the design and reporting of individual trials, systematic reviews and meta-analysis will not generate reliable evidence. For instance, the results of several studies cannot be compared and combined as a result of heterogeneity across studies, thus leaving valuable information wasted and the quality of evidence less rigorous .
The minimum outcome set which should be measured in a clinical trial for a specific disease, namely, a core outcome set (COS) , is an effective way to solve the above issues. It can simplify the design of clinical trials, reduce the risk of selecting inappropriate outcomes and minimize outcome reporting bias . More importantly, the use of COSs can reduce the heterogeneity of the reported outcomes between studies, so that the results of different trials can be compared and combined .
As early as the late 1870s, the World Health Organization (WHO) has put forward the notion of adopting standardized outcomes and has compiled a handbook . Since 1992, the OMERACT (Outcome Measures for Rheumatology Clinical Trials) collaboration has been committed to advocate and develop the COSs for clinical trials in rheumatology  and has made significant contributions . Since 2002, the IMMPACT (Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials) group has started working on COSs in trials with treatment for pain . To date, more than 50 organizations or groups devoted to COS have been founded, involving several conditions and diseases such as eczema  and wound .
The projects for establishing and promoting COSs is gradually underway in different areas; however, the work has not gained worldwide popularity. Internationally acknowledged COSs has been sparse and a general guideline for COSs development is lacking . Hence, clinical methodologists have launched the COMET (Core Outcome Measures in Effectiveness Trials) Initiative .
As an international academic organization, the initiatives gathered experts from different areas who are interested in promoting the development of COSs. Its management group is composed of four well-known experts in methodological research, including professor Doug Altman from the Oxford University, Professor Mike Clarke (the former director of the UK Cochrane Center) from the Queen’s University in Belfast, Professor Paula Williamson from the University of Liverpool, and Professor Jane Blazeby from the University of Bristol . The first COMET meeting was held in Liverpool in 2010 with a total of 110 participants including clinical researchers, systematic reviewers, clinicians, editors, health care consumers, trial funders, policy makers, and trials registries and regulators. The experts reached a consensus that it was necessary and urgent to promote COMET, and the relevant work should be conducted immediately. In July 2011, the COMET group held the second meeting, emphasizing the importance of developing COSs and the coordination and integration of information from various areas of health care, as well as the need to promote the development and application of COSs . The third meeting will focus on how to select, evaluate, and use measurement of core outcomes to further promote the progress of relevant work .
4. Why COSs in Clinical Trials of TCM Are Established?
The issues surrounding outcome measures in clinical trials of TCM have been discussed widely. However, the focus was on the method of categorization and the choice of expressions for the outcomes. What has also been emphasized is that the chosen outcomes should represent the characteristics of TCM, for example, outcome measurements relevant to the TCM syndrome and other soft endpoints . The above ideas on constructing COSs in the field of TCM have not aroused sufficient attention. During the recent decade, clinical studies with TCM have mushroomed and the quality has also improved. However, the majority of these studies have been rejected for publication on leading international medical journals, and their findings also received few citations and little recognition. The lack of a uniform standard for selecting and reporting outcomes may be one of the factors devaluing the clinical research of TCM. As a result, promoting methodological research on COSs and establishing COSs based on the unique features of TCM are good solutions. It can also improve the quality of clinical research of TCM and the practicability of study results.
Furthermore, the development of clinical methodology for TCM in China kept following international trends, rather than taking initiatives. For instance, the reporting standards of herbal interventions were established by a group of Canadian experts , and the reporting standards in clinical trials of acupuncture were set by a panel of western scholars . Neither of them involved a TCM specialist. It is time to take initiatives in establishing COSs catering for TCM clinical research in order to facilitate the work of scientific and rational evaluation of clinical efficacy of TCM.
At the time when the development of COSs in clinical research has just been started internationally, TCM scholars shall seize the opportunity and devise key techniques and methods for establishing COSs for TCM clinical research. In this way our research methodology may meet international standards. And we believe the uniqueness of TCM can add to the variety and vitality and also expand the breadth and depth of international COS research.
5. The Feasibility of Establishing COS in Clinical Trials of TCM
The COMET initiative team, the OMERACT working group, and the WHO have conducted extensive research on the development and application of COSs and have accumulated valuable experiences. The practical knowledge of and experiences with organization and management of the COMET initiative team will be of particular value for the development of COSs in clinical research of TCM. The currently existing methodological guidelines can provide guidance on our work. With advances in clinical epidemiology and evidence-based medicine, the development of research methodology and its application in clinical studies of TCM have made encouraging progress. Several multidisciplinary research teams have been formed, including scholars specialized in TCM, clinical epidemiology, evidence-based medicine, clinical pharmacology, statistics, and bioinformatics. This provides the professional research team necessary for establishing COSs in clinical trials of TCM.
The detailed work will be done based on guidance on developing the COMET initiative. Firstly, several diseases on which TCM therapies have unique effects should be identified such as chronic noncommunicable diseases. Secondly, systematic reviews especially high-quality Cochrane reviews for these diseases will be selected to determine outcomes related to specific disease. Thirdly, information from patients and TCM clinicians will be collected by using consensus methods such as the Delphi technique. Finally, outcome measures from systematic reviews and the consensus will be integrated.
The development of COSs in the field of TCM research will help improve the design and conducting of TCM trials to international standards, thereby lending credibility to the results.
Conflict of Interests
The authors declared that there was no conflict of interests regarding the publication of this paper.
The authors were supported by the Natural Science Foundation of China Project (NSFC-81273935).
- J. H. Zhang, H. C. Shang, and G. H. Dai, “Key points of protocol design on clinical therapeutic research of traditional Chinese medicine,” Chinese Journal of Integrated Traditional and Western Medicine, vol. 27, no. 2, pp. 171–173, 2007.
- M. Y. Di and J. L. Tang, “Adaption and application of the four phase trials to traditional Chinese medicines,” Evidence-Based Complementary and Alternative Medicine, vol. 2013, Article ID 128030, 10 pages, 2013.
- H. C. Shang and B. L. Zhang, “To improve the overall level of traditional Chinese medicine research by goverment leading and multiple participation,” Chinese Journal of Evidence-Based Medicine, vol. 10, no. 6, pp. 640–641, 2010.
- H. C. Shang, B. L. Zhang, and Y. Y. Wang, “Clinical research of traditional Chinese medicine needs ‘a breakthrough’,” Tianjin Journal of Traditional Chinese Medicine, vol. 30, no. 1, pp. 4–5, 2013.
- M. H. Wang, J. S. Li, X. Q. Yu et al., “A systematic review of outcomes of randomized controlled trials about stable-stage of chronic obstructive pulmonary disease,” Chinese Journal of Gerontology, vol. 31, no. 11, pp. 1943–1948, 2011.
- J. H. Zhang, H. C. Shang, X. M. Gao et al., “Compound salvia droplet pill, a traditional Chinese medicine, for the treatment of unstable angina pectoris: a systematic review,” Medical Science Monitor, vol. 14, no. 1, pp. RA1–RA7, 2008.
- Z. Junhua, F. Menniti-Ippolito, G. Xiumei et al., “Complex traditional Chinese medicine for poststroke motor dysfunction: a systematic review,” Stroke, vol. 40, no. 8, pp. 2797–2804, 2009.
- E. Ernst, “Methodological aspects of traditional Chinese medicine (TCM),” Annals of the Academy of Medicine Singapore, vol. 35, no. 11, pp. 773–774, 2006.
- R. Q. Chen, C. M. Wong, and T. H. Lam, “Construction of a traditional Chinese medicine syndrome-specific outcome measure: the Kidney Deficiency Syndrome Questionnaire (KDSQ),” BMC Complementary and Alternative Medicine, vol. 12, article 73, 9 pages, 2012.
- T. X. Wu, H. C. Shang, Z. X. Bian et al., “Recommendations for reporting adverse drug reactions and adverse events of traditional Chinese medicine,” Chinese Journal of Evidence-Based Medicine, vol. 10, no. 2, pp. 215–219, 2010.
- D. Tovey, The Impact of Cochrane Reviews, The Cochrane Library, 2010, http://www.thecochranelibrary.com/details/editorial/756937/The-Impact-of-Cochrane-Reviews.html.
- M. Clarke, “Standardising outcomes for clinical trials and systematic reviews,” Trials, vol. 8, article 39, 2007.
- P. R. Williamson, D. G. Altman, J. M. Blazeby, M. Clark, and E. Gargon, “The COMET (core outcome measures in effectiveness trials) initiative,” Trials, vol. 12, supplement 1, article A70, 2011.
- P. R. Williamson, D. G. Altman, J. M. Blazeby et al., “Developing core outcome sets for clinical trials: issues to consider,” Trials, vol. 13, article 132, 2012.
- World Health Organization, WHO Handbook for Reporting Results of Cancer Treatment, WHO Publication, World Health Organization, Geneva, Switzerland, 1979.
- P. Tugwell and M. Boers, “OMERACT conference on outcome measures in rheumatoid clinical trials: introduction,” Journal of Rheumatology, vol. 20, no. 3, pp. 528–530, 1993.
- P. Tugwell, M. Boers, P. Brooks, L. Simon, V. Strand, and L. Idzerda, “OMERACT: an international initiative to improve outcome measurement in rheumatology,” Trials, vol. 8, article 38, 2007.
- R. H. Dworkin, D. C. Turk, J. T. Farrar et al., “Core outcome measures for chronic pain clinical trials: IMMPACT recommendations,” Pain, vol. 113, no. 1-2, pp. 9–19, 2005.
- J. Schmitt and H. Williams, “Harmonising outcome measures for eczema (HOME). Report from the first international consensus meeting (HOME 1), 24 July 2010, Munich, Germany,” The British Journal of Dermatology, vol. 163, no. 6, pp. 1166–1168, 2010.
- F. Gottrup, J. Apelqvist, and P. Price, “Outcomes in controlled and comparative studies on nonhealing wounds: recommendations to improve the quality of evidence in wound management,” Journal of Wound Care, vol. 19, no. 6, pp. 239–268, 2010.
- I. P. Sinha, R. L. Smyth, and P. R. Williamson, “Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies,” PLoS Medicine, vol. 8, no. 1, Article ID e1000393, 2011.
- S. L. Lai, “Key points about clinical effectiveness assessment of traditional Chinese medicine,” Journal of Guangzhou University of Traditional Chinese Medicine, vol. 19, no. 4, pp. 245–250, 2002.
- J. J. Gagnier, H. Boon, P. Rochon, D. Moher, J. Barnes, and C. Bombardier, “Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement,” Annals of Internal Medicine, vol. 144, no. 5, pp. 364–367, 2006.
- H. MacPherson, D. G. Altman, R. Hammerschlag et al., “Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement,” PLOS Medicine, vol. 7, no. 6, Article ID e1000261, 2010.
Copyright © 2013 Li Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.