- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Evidence-Based Complementary and Alternative Medicine
Volume 2011 (2011), Article ID 636134, 10 pages
Systematic Review of Integrative Health Care Research: Randomized Control Trials, Clinical Controlled Trials, and Meta-Analysis
1Military Medical Research and Integrative Medicine, Samueli Institute, 2101 East Coast Hwy, Corona Del Mar, CA 92625, USA
2Department of Planning, Policy and Design, School of Social Ecology, University of California Irvine, Irvine, CA 92697-7075, USA
3University of California Los Angeles, Los Angeles, CA 90095-1569, USA
4RAND Corp., 1776 Main Street, Santa Monica, CA 90401-3208, USA
5Southern California University of Health Sciences, Whittier, CA 90604, USA
6Samueli Institute, 1737 King Street, Alexandria, VA 22314, USA
7VA Long Beach Healthcare System, Long Beach, CA 90803, USA
8Center for Health Policy Research, University of California, Irvine, CA 92697, USA
Received 19 May 2010; Accepted 18 June 2010
Copyright © 2011 Raheleh Khorsan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
A systematic review was conducted to assess the level of evidence for integrative health care research. We searched PubMed, Allied and Complementary Medicine (AMED), BIOSIS Previews, EMBASE, the entire Cochrane Library, MANTIS, Social SciSearch, SciSearch Cited Ref Sci, PsychInfo, CINAHL, and NCCAM grantee publications listings, from database inception to May 2009, as well as searches of the “gray literature.” Available studies published in English language were included. Three independent reviewers rated each article and assessed the methodological quality of studies using the Scottish Intercollegiate Guidelines Network (SIGN 50). Our search yielded 11,891 total citations but 6 clinical studies, including 4 randomized, met our inclusion criteria. There are no available systematic reviews/meta-analyses published that met our inclusion criteria. The methodological quality of the included studies was assessed independently using quality checklists of the SIGN 50. Only a small number of RCTs and CCTs with a limited number of patients and lack of adequate control groups assessing integrative health care research are available. These studies provide limited evidence of effective integrative health care on some modalities. However, integrative health care regimen appears to be generally safe.
In the United States, “institutional integrative health care (aka integrative medicine) is being developed in a highly individualistic manner (page 3)” . Much of this literature refers to integrating CAM into institutional health systems and involves bringing CAM providers into conventional health centers . However, there is another approach to integrative health care emerging within the CAM community itself, the insurance industry and with what is termed by one writer as the “CAM entrepreneurs” [2, 3].
There are various definitions and a diversity of terminology of integrative health care . Maizes et al. define the term “integrative medicine” as “medicine that reemphasizes the relationship between patient and physician, and integrates the best of complementary and alternative medicine with the best of conventional medicine” . Boon et al.’s  study on the working definition for integrative health care defines “integrative health care” as the combination of an interdisciplinary, nonhierarchical blending of both CAM and conventional medicine that employs a collaborative team approach guided by consensus building, mutual respect, and a shared vision of health through a partnership of patient and practitioners to treat the whole person by synergistically combining therapies and services in a manner that exceeds the collective effect of the individual practice . Interestingly, at the prestigious IOM conference on integrative health care no formal definition emerged .
Therefore, the definition of integrative health care can range from simply incorporating CAM into conventional medicine to the notion that integrative health care constitutes a new form of medical practice. Stumpf, Shapiro, and Hardy refer to the malleable definitions of integrative health care as “one first step towards understanding the phenomenon.” However, a definition is more likely to emerge from key issues that are shaping the future of integrative medicine. That is, bilateral integrative medicine more resembles assimilation of CAM by biomedicine than true acculturation .
It seems that regardless of the definitions, health care practitioners and policy makers have increasingly recognized that patients are using integrative health care to improve their wellness and treat illness . Thus, for this paper, a guiding principle to the definition of integrative health care research is the study of the incorporation of CAM with biomedicine as a collaborative and integral part of the health care system. That is, the integration of conventional (allopathic) medicine and CAM, involving shared management of the patient, shared patient care, shared practice guidelines, and shared common values and goals to treat the well-being of the whole person.
There is preliminary theoretical and empirical data to support that integrative health care is not equivalent to CAM [9, 10]. However, the diversity of definitions, the ranges in levels of integration, and the degree of integration between CAM and biomedicine poses challenges to the practice, research, education, and policy/guideline decision and development in this evolving field.
We posit that incorporation of CAM into conventional medicine without a joint management does not constitute integrative health care. In fact, the use of CAM as an adjunctive treatment to conventional care without a unifying paradigm or joint management may lead to worse outcomes because the selected CAM modality may adversely interact with conventional modality, and vice versa. In essence, integrative health care combines the best products and practices of CAM and conventional health care to optimize the body's natural healing processes [5, 11].
The purpose of this paper is to review and summarize literature on Randomized controlled trial (RCT) and Controlled clinical trial (CCT), and systematic reviews on integrative health care as defined above and to make recommendations for future research on this topic.
We conducted a systematic literature review using a web-based, secure, systematic review management program called TrialStat SRS 4.0 (©Copyright 2003–2009 Mobius Analytics Inc, Ottawa, Ontario). TrialStat automates article progression and management, eliminates data transcription and reduces data collation work at the end of a review. This approach differs from conventional systematic literature review because it allows researchers to deliver results faster with improved accuracy and quality, providing a complete audit trail of all changes made in the systematic review. We searched the following databases from 1965 to Sept 2007: Pubmed, Allied and Complementary Medicine (AMED), BIOSIS Previews, EMBASE, the entire Cochrane Library, MANTIS, Social SciSearch, SciSearch Cited Ref Sci, PsychInfo, CINAHL, and NCCAM grantee publications listings. For the initial search, gray literature was searched using ProQuest Dissertations and Theses, and Google Scholar From our search strategy the keywords are identified in Table 3.
An updated secondary search was conducted in May 2009 during manuscript development to insure that all articles meeting the inclusion/exclusion criteria using the original search terms were included. In addition, hand searches and reference tracking were also performed, and the citation list was assessed for comprehensiveness by content experts.
2.1. Inclusion and Exclusion Criteria
Our initial search terms were Integrat* and Medicine; Integrat* and Health* (for healthcare); multidisciplinary care; complementary or alternative and conventional medicine or health care; and delivery of health care and integrat*.
Three investigators (RK, IC, and AH) independently screened titles and abstracts for relevance based on the inclusion criteria for this paper. Any disagreements about including a study were resolved through discussion and consensus. To avoid any misinterpretation, we excluded articles in languages other than English.
This paper reports only on the RCT’s, CCTs, and meta-analysis that passed our second level review screening. However, we have collected articles on practice models, models of integration, program evaluation, observational studies, cost-effectiveness, healthcare utilization, and so forth, which will be reported at a future date. The initial search retrieved all the above articles which were coded into their respective categories of study design. These were included in the bibliography but excluded from formal evaluation in this paper (see Figure 1).
Articles were included in this paper if they met the following criteria: () involved human subjects; () clinical study designs, including clinical controlled trials (including RCTs) and systematic reviews or meta-analysis involved with integrative health care research; and () integrative health care treatment as defined by the authors of this paper (including at least one modality from CAM and one modality from conventional medicine and they are combined using an integrative healthcare paradigm). We limited studies to those published in the English language. We also excluded studies with one of the following criteria: () did not present original data or an analysis of original data (i.e., commentaries, editorials, or expert opinion pieces); () were published in other media or in incomplete formats (i.e., abstracts, conference proceedings, posters, or web postings); () exclusively CAM without integration with conventional medicine; () use of CAM as adjunctive therapy to conventional medicine without incorporating an integrative health care paradigm in the design of the study; () studies that tested herbs and supplements; and () not applicable to Western health care setting. Also, articles on integrated care pathways, integrated review, integrated managed health system (i.e., electronic patient records, integrated delivery systems/networks or health care delivery), clinical integration, integrated case management, integrated analysis, exclusively CAM without conventional medicine integration, exclusively conventional medicine without CAM integration, scholarship of integration, integration into a curriculum for education, integrating theory of conventional medicine, integrated approach to concepts or integrating a single conventional medicine therapy to another, not applicable to western health care setting, and legalities or regulation of integration were excluded as “not relevant”.
This paper did not involve human or nonhuman experimentation and was exempt from Institutional Review Board (IRB) approval.
2.2. Methodological Assessment Process and Quality Rating
The methodological quality of the included studies was assessed independently by the reviewers (RK, IC, and AH). Each article was evaluated by type of study design and quality.
Also, there were independent assessments of the quality of the studies selected, and data extraction comprised descriptive information of the study population, the types of interventions, and the relevant outcome measurements and differences in ratings were resolved by reconciliation, discussion, and consensus. The outcome measures in each article were extracted and a determination was made regarding the direction of evidence for each study as strong, mixed, weak, or inconclusive (see Table 4). Controlled clinical trials (CCTs) (i.e., nonrandomized, pilot, single group, and other small studies) were qualitatively discussed in this paper regarding outcomes measures and study dropouts but not formally scored for bias such as randomization and blinding (see Table 4).
Total effect size was not calculated due to the heterogeneity of the trials identified during the review phase. All assessments were based on information provided in the published manuscripts that met the inclusion criteria.
2.3. Adverse Events Methodology and Reporting
Safety evaluation and adverse events reporting in all the RCTs were conducted using a 100 point safety assessment scale (SAS-CT) . This scale has six major domains and the sub-domains have different weights according to their degree of importance and rate of occurrence. Safety evaluation and adverse events reporting in all the clinical studies was assessed by two investigators (RK and IC) and checked for consistency (see Table 2 for scoring information).
If all information required is presented in the text, tables, or figures, full points are given. If anything had to be extrapolated or added or half information is missing, half points are given. However, whether or not a conclusion can be drawn depends on the amount of information available  (see Table 4 for SAS-CT scores).
3. Study Selection
Our initial search yielded 11,591 citations from database inception to Sept 2007. An additional secondary search was conducted to capture studies published from September 2007–May 2009. This secondary search yielded 300 citations (see Figure 1).
4. Results on Quality Assessment and Trial Homogeneity
Heterogeneity across studies (i.e., outcomes, population, and the small number of studies per therapy) precluded formal meta-analysis. Therefore, it was only possible to conduct a descriptive analysis of the studies’ design (study validity and bias) and outcomes reported.
Of the 20 studies included in the qualitative synthesis, a total of 6 articles met the inclusion criteria of this paper. Of these 6 trials, there were 4 RCTs for which data were extracted in a standardized manner, and three independent investigators assessed the methodologically quality of RCTs using the (SIGN) checklist (see Table 1). Table 4 describes the main study characteristics and summarizes the findings of the 4 RCTs and 2 CCTs. The studies reviewed in this paper could not be combined for a total effect size because of the 4 RCTs, three () were conducted by the same research group on the same population and heterogeneity across studies. Using the SIGN 50, three of the 4 RCTs (75%) were rated as high quality “++”. One or (25%) of the RCTs was rated as neutral “+”, and no RCT was rated as low quality “−”. Individual SIGN item scores are available on Table 5.
5. Descriptive Results: Effects of Interventions
5.1. Clinical Trials on Multidimensional Integrative Health Care Interventions ()
Six articles [16–21] that were clinical trials of multidimensional integrative health care interventions were obtained. These 6 studies included four RCTs on integrative health care therapies to improve cardiovascular risk and/or disease symptoms [16–19], and two CCTs evaluating integrative health care therapies to improve quality of life/life satisfaction in women with breast cancer [20, 21]. Three of these RCTs were multiple reports published from the same research team on similar topics and populations—the efficacy of Noetic therapies before percutaneous intervention for unstable coronary syndromes [16–18].
The Monitoring and Actualization of Noetic therapy (MANTRA) clinical trials [16–18] examined the feasibility and efficacy of applying 4 Noetic therapies—stress relaxation, imagery, touch therapy, and prayer—to patients in the setting of acute coronary interventions compared to usual care. The results of two MANTRA trials, by Krucoff et al. [16, 17] were not statistically significant for any treatment outcomes comparisons. However, there was a reduction (25%–30%) in absolute incidence of major adverse cardiovascular events (i.e., mortality, myocardial infarction, congestive heart failure, and urgent or repeat revascularization) or adverse clinical events in patients treated with any Noetic therapies compared to usual care (control). Also, in the pilot study of the 4 individual Noetic therapies, off-site prayer was associated with the lowest absolute mortality in-hospital and at 6 months . The parallel randomization to 4 different Noetic therapies across 5 study arms limited the assessment of possible synergy between therapies.
When the same research team examined the beneficial effects of Noetic therapies on mood assessed by Visual Analogue Scale (VAS) before percutaneous coronary intervention for unstable coronary syndromes they found that of the eight VAS scales on mood only one, [the VAS for worry], yielded significant effects () in the stress management, imagery, and touch therapy groups compared to with usual therapy .
The final RCT on an integrative health care to improve cardiovascular risk was based on multidimensional intervention principles . Using a relationship-centered, mind-body approach (including mindfulness meditation, relaxation training, stress management, motivational techniques, and health education and coaching) in supporting behavior change, the study reported significant improvements in the 10-year cardiovascular risk as measured by the Framingham risk score (FRS) compared to usual care .
5.2. Two CCTs on the Choice of Care for Breast Cancer
Two nonrandomized studies, by Carlsson et al. [20, 21], compared quality-of-life of women with breast cancer who were treated with anthroposophic therapy (ABCW) after surgery for breast cancer, an individually composed therapies consisting of natural products, Iscador, diets, art therapy, eurhythmic therapy, therapeutic massage, hydrotherapy, compared to usual care.
Carlsson et al.  conducted their first study to investigate the acceptability and feasibility of an anthroposophic therapy (ABCW) after surgery for breast cancer cared to usual care. They measured the differences in perceived quality-of-life/life satisfaction and coping strategies between the women receiving ABCW on entering the CCT compared to usual care alone. There were three primary outcome instruments used in this study: () the European organization for research and treatment of cancer quality-of-life questionnaire core 30 (EORTC QLQ-C30), () the life satisfaction questionnaire (LSQ), and () the differences in coping measured by the mental adjustment to cancer scale. The results found that women who choose ABCW reported lower quality-of-life and a greater psychosocial distress compared to the women receiving usual care on all measures on entering the study (). The dropout rate was about 13% for the ABCW group and 7% for the usual care group. The authors examined the possibility that perhaps the women in the ABCW group, who choose their individualistic care, might have been more independent personalities in choosing in their decision of care compared to the usual care group. A follow-up study reported that the women in ABCW group showed more passive and anxious coping on admission, but this decreased over time . This could be one explanation for the ABCW higher dropout rate.
A second study from the same team (2004) , found that women with breast cancer who participated in a 6-month CCT and 1 year follow-up reported a significant () increase quality-of-life/life satisfaction (EORTC QLQ-C30 and LSQ) after ABCW treatment compared to the usual care alone. A follow-up study on the same population of women found that after 5 years, there were improvements in overall quality of life and in emotional and social functioning compared to admission for the women who choose ABCW. For these women, improvements took place between admission and 1 year, but not further on .
Table 4 summarizes the methodological details and results of these clinical trials of multidimensional integrative health care interventions.
6. Result Summary
Our initial search yielded 11,591 citations of which six (4 RCTs and 2 CCTs) [16–21] were trials of integrative health care interventions. We found that cardiovascular health and women’s health were the two most common topics in integrative health care research. The total average age of adult subjects for the trial articles reviewed in this paper was 51.16 years. The most recent article in this paper was published in 2006, the oldest article was published in 2001. There were no studies on integrative pediatric care.
Four RCTs were scored on internal validity and methodological bias using the SIGN checklist. Three of the 4 RCTs (75%) were rated as high quality “++”. One or (25%) of the RCTs was rated as neutral “+”, and no RCT was rated as low quality “−”. Half (50%) of the total clinical trials included in this paper were unable to report effectiveness of their intervention (i.e., no outcome measures as positive) despite sufficient power to do so.
Most of these studies reported limitations such as the lack of credible controls for a placebo effect, inadequate assessment of long-term treatment benefits, and insufficient sample size, it would be difficult to generalize these findings. Two studies failed to report information on adverse events as required to be presented in the manuscript text, tables, or figures, and therefore scored 0 on the SAS-CT (see Tables 4 and 5).
Two major conclusions can be drawn from this paper. The first is that there is an increasing, and somewhat extensive, body of literature with key terms Integrat* and Medicine; Integrat* and Health* (for healthcare); multidisciplinary care; complementary or alternative and conventional medicine or health care; and delivery of health care and integrat*. This search found over 10,000 articles. However, a second conclusion is that there are very few clinical controlled trials testing the efficacy of integrative health care. The large number of articles that were not relevant to our paper included studies on combining conventional services and alternative modalities without the incorporation of a collaborative and integral partnership of an integrated health care system. That is, the integration of conventional (allopathic) medicine and CAM, involving shared management of the patient, shared patient care, shared practice guidelines, and shared common values and goals to treat the well-being of the whole person. We found that the lack of a taxonomy makes searching this field very difficult.
This might reflect that this research topic is an emerging field. Like any emerging field integrative health care faces the problem of how to define and operationalize itself. That is, transforming the concepts into empirical and measurableentities. According to Maizes and Caspi, Integrative Health Care “requires a shift from the “fixing" paradigm that has been central to biomedicine (page 148)”. More importantly, it “shifts the paradigm from sickness to health, keeps the patient in the central focus of care, and multiplies the number of strategies available to the patient. It is a new kind of medicine that shifts the experience for both patient and provider (page 148)” .
Some have described Integrative Health Care as a transformative process [9, 25]. Mulkins’s and Verhoef’s study to identify factors for those patients who seek Integrative Health Care found 4 dimensions of transformation: () having access to a range of appropriate therapies to support individual journeys, () care that focuses on one’s overall well being, () control over disease management, and () developing healing relationships with care providers . Bell et al. also define Integrative Health Care as a transformative system represented by a higher-order system of systems of care that emphasizes wellness and healing of the entire person (bio-psycho-socio-spiritual dimensions) as primary goals, drawing on best both conventional and CAM approaches in the context of a supportive and effective physician-patient relationship . While other proposed a continuum for team-oriented health care practice starting from the nonintegrative to fully integrative approach .
Therefore, to date no consensus has emerged about what constitutes Integrative Health Care. While there have been attempts to create outcome measures for Integrative Health Care (i.e., one-item visual analogue Arizona Integrative Outcomes Scale (AIOS), which assesses self-rated global sense of spiritual, social, mental, emotional, and physical well-being over the past 24 hours and the past month)  and there has been discussion on the importance of patient's perspective on integrative health care outcomes (i.e., physical well-being, change in physiological indicators, improved emotional well-being, personal transformation, feeling connected, global state of well-being, and cure)  none about what the important outcome variables are that must be measured. A growing body of literature documents the patient-based outcome assessment (PBOA) instruments that have been used to determine outcomes in CAM research to help practitioners and researchers make informed evidence-based decisions [28, 29]. However, we were unable to indentify similar literature for Integrative Health Care. Thus, the claimed inherent holistic nature of Integrative Health Care in which the social, psychological, spiritual, physical, and behavioral components oriented towards support and the stimulation of healing and the achievement of wholeness (i.e., the whole system) present special challenges with respect to design of clinical studies and especially with respect to the calculation of a total effect size. For this paper, we only reviewed clinical studies that involved a blending of both CAM and conventional therapy that provides a seamless continuum of decision-making and patient-centered care and support. However, heterogeneity across studies made it impossible to assess a total effect size.
The lack of trials might reflect the fact that for the most part the studies are of already existing programs in which it is not possible to set up controlled trials. Researchers here are for the most part studying programs that are already up and running so that the best that can be done is observational studies . The most common situation for program evaluation is for existing programs so that we are comparing (often retrospectively) outcomes before and after implementation of the program .
Lastly, the lack for trial might also reflect that controlled trials may be an inappropriate research model here and that what are required are methods for whole systems research. “Thus, unlike biomedical research that typically examines parts of health care and parts of the individual, one at a time, but not the complete system, integrative outcomes research advocates the study of the whole. The whole system includes the patient-provider relationship, multiple conventional and CAM treatments, and the philosophical context of care as the intervention. The systemic outcomes encompass the simultaneous, interactive changes within the whole person (page 133)” .
Integrative Health care clearly involves, even allowing for differences in definition, the bringing together of differing complex systems of care . By their very nature, they are not systems that lend themselves very readily to the type of research design required for controlled trials.
In spite of the nascent state of integrative health care research on clinical trials, clinicians may be able to use this literature review as a guideline for incorporating specific types of integrative health practices that are strongly evidence-based. There is still insufficient evidence to draw definite conclusions about the efficacy of integrative health care treatments; however, they appear to be generally safe. Available data suggest that some integrative health care therapies may warrant further study.
8. Limitations/Challenges Encountered in Reviewing the Field of Integrative Health Care
It was our goal to identify only published studies having to do with integrative health care. During the initial examination of key term and primary studies in this paper it was discovered that there was no clear terminology or definition for integrative health care. This lack of clarity made it difficult to generate search terms for the paper. For example, IM can turn up under integrated versus integrative medicine, integrated health systems versus holistic health systems. It might also appear under such things as traditional Chinese medicine and western medicine. To make sure we captured all these, the search terms by necessity had to be very broad. The downside of this strategy was that the search generated 11,891 total citations. Much additional work was required, therefore, to insure that the studies were truly focused on integrative health care. This has resulted in a level of review that is not usual when reviewing citations for inclusion. Further limitations included: () only studies in the English language were reviewed () both peer reviewed and nonpeer reviewed studies were reviewed. Nonpeer reviewed journals are generally considered of being lower quality.
The two major limitations however are that we focused on clinical studies and only those that can be termed integrative health care as defined here. As noted earlier, this excluded most of the field. However, it is important to show that in the case of the strongest designs (i.e., RCTs and CCTs) and were it really is integrative, the field at the moment is very small.
There is still insufficient evidence from trials to strongly support the higher efficacy of integrative medicine regimen compared with usual care. However, integrative health care regimen appears to be generally safe. Additional high quality RCTs and CCTs are therefore needed to build a stronger evidence-based body of knowledge. This is the same recommendation that has been made for CAM .
Funding Sources and Conflicts of Interest
No conflict of interest exists for any of the authors of this study. This paper is supported by the US Army Medical Research and Materiel Command under Award no. W81XWH-07-2-0076 through the Samueli Institute. The views, opinions, and/or findings contained in this paper are those of the author(s) and should not be construed as an official Department of the Army position, policy, or decision unless so designated by other documentation.
The authors would like to thank Dr. Wayne Jonas of the Samueli Institute for his excellent review and linguistic editing of the manuscript.
- I. D. Coulter, M. A. Ellison, L. Hilton, H. J. Rhodes, and G. W. Ryan, Hospital-Based Integrative Medicine: A Case Study of the Barriers and Factors Facilitating the Creation of a Center, RAND, Santa Monica, Calif, USA, 2008.
- J. Weeks, “Major trends in the integration of complementary and alternative medicine,” in Integrating Complementary Medicine into Health Systems, N. Faass, Ed., pp. 4–11, Aspen, Gaithersburg, Md, USA, 2001.
- J. W. Hanks, “Chiropractric inclusion in complementary and alternative medicine clinics: analysis of current trends,” Topics in Clinical Chiropractic, vol. 8, no. 2, pp. 20–50, 2001.
- H. Boon, M. Verhoef, D. O'Hara, B. Findlay, and N. Majid, “Integrative healthcare: arriving at a working definition,” Alternative Therapies in Health and Medicine, vol. 10, no. 5, pp. 48–56, 2004.
- V. Maizes, C. Schneider, I. Bell, and A. Weil, “Integrative medical education: development and implementation of a comprehensive curriculum at the University of Arizona,” Academic Medicine, vol. 77, no. 9, pp. 851–860, 2002.
- D. Ullman, “A review of a historical summit on integrative medicine,” Evidence-Based Complementary and Alternative Medicine, 2009 Aug 31, [Epub ahead of print].
- S. H. Stumpf, S. J. Shapiro, and M. L. Hardy, “Divining integrative medicine,” Evidence-Based Complementary and Alternative Medicine, vol. 5, no. 4, pp. 409–413, 2008.
- M. McHughes and B. N. Timmermann, “A review of the use of CAM therapy and the sources of accurate and reliable information,” Journal of Managed Care Pharmacy, vol. 11, no. 8, pp. 695–703, 2005.
- I. R. Bell, O. Caspi, G. E. R. Schwartz et al., “Integrative medicine and systemic outcomes research: issues in the emergence of a new model for primary health care,” Archives of Internal Medicine, vol. 162, no. 2, pp. 133–140, 2002.
- M. J. Verhoef, A. Mulkins, and H. Boon, “Integrative health care: how can we determine whether patients benefit?” Journal of Alternative and Complementary Medicine, vol. 11, no. 1, pp. S.57–S.65, 2005.
- T. W. Gaudet and R. Snyderman, “Integrative medicine and the search for the best practice of medicine,” Academic Medicine, vol. 77, no. 9, pp. 861–863, 2002.
- Network SIG, A Guideline Developers' Handbook, SIGN, Edinburgh, Scotland, 2001.
- A. Letheby, “Grading for evidence-based guidelines: a simple system for a complex task? New Zealand Guidelines Group,” 2001–2006.
- B. B. Singh, S. P. Vinjamury, and V. J. Singh, “Clinical research design: limited systematic review of five diagnostic categories,” in Scientific Basis for Ayurvedic Therapies, L. C. Mishra, Ed., pp. 31–41, CRC Press, New York, NY, USA, 2004.
- B. B. Singh, R. Khorsan, S. P. Vinjamury, C. Der-Martirosian, A. Kizhakkeveettil, and T. M. Anderson, “Herbal treatments of asthma: a systematic review,” Journal of Asthma, vol. 44, no. 9, pp. 685–698, 2007.
- M. W. Krucoff, S. W. Crater, C. L. Green et al., “Integrative noetic therapies as adjuncts to percutaneous intervention during unstable coronary syndromes: Monitoring and Actualization of Noetic Training (MANTRA) feasibility pilot,” American Heart Journal, vol. 142, no. 5, pp. 760–769, 2001.
- M. W. Krucoff, S. W. Crater, D. Gallup et al., “Music, imagery, touch, and prayer as adjuncts to interventional cardiac care: the Monitoring and Actualisation of Noetic Trainings (MANTRA) II randomised study,” Lancet, vol. 366, no. 9481, pp. 211–217, 2005.
- J. E. Seskevich, S. W. Crater, J. D. Lane, and M. W. Krucoff, “Beneficial effects of noetic therapies on mood before percutaneous intervention for unstable coronary syndromes,” Nursing Research, vol. 53, no. 2, pp. 116–121, 2004.
- D. Edelman, E. Z. Oddone, R. S. Liebowitz et al., “A multidimensional integrative medicine intervention to improve cardiovascular risk,” Journal of General Internal Medicine, vol. 21, no. 7, pp. 728–734, 2006.
- M. Carlsson, M. Arman, M. Backman, and E. Hamrin, “Perceived quality of life and coping for Swedish women with breast cancer who choose complementary medicine,” Cancer Nursing, vol. 24, no. 5, pp. 395–401, 2001.
- M. Carlsson, M. Arman, M. Backman, U. Flatters, T. Hatschek, and E. Hamrin, “Evaluation of quality of life/life satisfaction in women with breast cancer in complementary and conventional care,” Acta Oncologica, vol. 43, no. 1, pp. 27–34, 2004.
- M. Carlsson, M. Arman, M. Backman, and E. Hamrin, “Coping in women with breast cancer in complementary and conventional care over 5 years measured by the mental adjustment to cancer scale,” Journal of Alternative and Complementary Medicine, vol. 11, no. 3, pp. 441–447, 2005.
- M. Carlsson, M. Arman, M. Backman, U. Flatters, T. Hatschek, and E. Hamrin, “A five-year follow-up of quality of life in women with breast cancer in anthroposophic and conventional care,” Evidence-Based Complementary and Alternative Medicine, vol. 3, no. 4, pp. 523–531, 2006.
- V. Maizes and O. Caspi, “The principles and challenges of integrative medicine: more than a combination of traditional and alternative therapies,” Western Journal of Medicine, vol. 171, no. 3, pp. 148–149, 1999.
- A. L. Mulkins and M. J. Verhoef, “Supporting the transformative process: experiences of cancer patients receiving integrative care,” Integrative Cancer Therapies, vol. 3, no. 3, pp. 230–237, 2004.
- H. Boon, M. Verhoef, D. O'Hara, and B. Findlay, “From parallel practice to integrative health care: a conceptual framework,” BMC Health Services Research, vol. 4, article 1, 2004.
- I. R. Bell, V. Cunningham, O. Caspi, P. Meek, and L. Ferro, “Development and validation of a new global well-being outcomes rating scale for integrative medicine research,” BMC Complementary and Alternative Medicine, vol. 4, article 1, 2004.
- R. Khorsan, A. York, I. D. Coulter, R. Wurzman, J. A. G. Walter, and R. R. Coeytaux, “Patient-based outcome assessment instruments in acupuncture research,” Journal of Alternative and Complementary Medicine, vol. 16, no. 1, pp. 27–35, 2010.
- R. Khorsan, I. D. Coulter, C. Hawk, and C. G. Choate, “Measures in chiropractic research: choosing patient-based outcome assessments,” Journal of Manipulative and Physiological Therapeutics, vol. 31, no. 5, pp. 355–375, 2008.
- V. Maizes, H. Silverman, P. Lebensohn et al., “The integrative family medicine program: an innovation in residency education,” Academic Medicine, vol. 81, no. 6, pp. 583–589, 2006.
- S. Vohra, K. Feldman, B. Johnston, K. Waters, and H. Boon, “Integrating complementary and alternative medicine into academic medical centers: experience and perceptions of nine leading centers in North America,” BMC Health Services Research, vol. 5, article 78, 2005.
- W. B. Jonas, W. Beckner, and I. Coulter, “Proposal for an integrated evaluation model for the study of whole systems health care in cancer,” Integrative Cancer Therapies, vol. 5, no. 4, pp. 315–319, 2006.
- E. H. Logue, “'The science of CAIM: whats next for complementary, alternative and integrative medical research?',” Evidence-Based Complementary and Alternative Medicine, vol. 7, no. 1, pp. 145–147, 2010.