Development of Key Performance Indicators for Capturing Impact of Pharmaceutical Care in Palestinian Integrative Healthcare Facilities: A Delphi Consensus Study

Shawahna, Ramzi

doi:https://doi.org/10.1155/2020/7527543

Evidence-Based Complementary and Alternative Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusions Data Availability Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 7527543 | https://doi.org/10.1155/2020/7527543

Development of Key Performance Indicators for Capturing Impact of Pharmaceutical Care in Palestinian Integrative Healthcare Facilities: A Delphi Consensus Study

Ramzi Shawahna^1,2

Academic Editor: Andreas Sandner-Kiesling

Received19 Mar 2020

Revised27 May 2020

Accepted10 Jun 2020

Published25 Jun 2020

Abstract

Background. The current study was performed to develop a consensus-based core inventory of key performance indicators (KPIs) to be used in capturing the impact of pharmaceutical care in healthcare facilities that employ integrative medicine paradigm in Palestine. Methods. A panel of healthcare professionals and risk/quality assurance managers was composed employing a judgmental sampling technique. The study tool was a questionnaire. Views and opinions of the panelists on the roles of pharmacists in caring for patients admitted to or visiting healthcare facilities that employ integrative medicine were collected using 11 statements. An initial inventory of activities and services that potentially can be used as KPIs was compiled from the literature and interviews with key contact experts in the domain. Three iterative Delphi rounds were conducted among the panelists (n = 50) to achieve formal consensus on the KPIs that should be used. The consensus-based KPIs were ordered by the scores of the panelists. Results. A total of 8 consensus-based KPIs were developed. The KPIs related to the number of problems related to medications and complementary and alternative medicine (CAM) that were resolved by pharmacists and CAM practitioners ( < 0.0001), number of patients for whom reconciliations were documented ( < 0.0001), number of patients receiving direct, comprehensive, and/or collaborative care ( < 0.0001), and number of patients for whom pharmacists and CAM practitioners were involved in implementing a therapeutic plan ( < 0.05) were rated significantly higher than the KPI (#8) related to the participation in multi-healthcare provider discussions/deliberations. Conclusions. Consensus-based KPIs that can be used in capturing the impact of evidence-based CAM and pharmaceutical care of patients in healthcare facilities that employ integrative medicine paradigm were developed. Future studies are still needed to investigate if implementing these KPIs might promote evidence-based CAM and pharmaceutical care in healthcare facilities that employ the integrative medicine paradigm.

1. Introduction

Improving approaches to healthcare delivery has been given a high priority across healthcare delivery systems around the globe. As a result, approaches to care are becoming increasingly person-centered and holistic in nature [1]. The concept of integrative medicine has emerged as a collaborative approach to healthcare that brings together conventional Western medicine and complementary and alternative medicine (CAM) in a coordinated way [2, 3]. Healthcare facilities employing integrative medicine cater to the needs of different patients by formulating personalized care plans that take into consideration the health needs of the body, mind, spirituality, and belonging to the community [4–6].

Studies have shown that patients are not always satisfied with the outcomes of their conventional Western medicines. Therefore, different modalities of CAM are increasingly being used by hospitalized patients as well as outpatients [7–13]. The different modalities of CAM are either used as complementary or as alternatives to conventional Western medicines [14, 15]. Although efforts are surmounting to introduce the concept of “evidence-based” to the discipline, integrative medicine approaches were shown to improve the care of patients with cancer [16], stroke [17], cardiovascular [18], inflammatory [19], and many other disease conditions [20, 21]. Studies have shown that integrative medicine reduced mortality and morbidity as well as improved patients’ reported quality of life and healthcare costs. It has been argued that, in integrative medicine paradigms, healthcare providers understand the strengths and weaknesses of both conventional medicine and CAM and can blend the best parts of both approaches [2].

In modern healthcare systems, delivery of care is provided by many healthcare providers including physicians, pharmacists, nurses, and CAM practitioners. Recently, the competencies of the pharmacist as a member of the healthcare delivery team have been recognized. As a result, the roles and responsibilities of pharmacists are expanding continuously. These expanding roles and responsibilities were advocated and promoted by professional groups in different nations like the UK, USA, Australia, and Canada [22–24]. Pharmacists are experts in pharmacotherapy who are supposed to provide pharmaceutical care. Ensuring that the patients are making the best out of their therapies is one of the main roles of pharmacists. Additionally, pharmacists can provide many services that might include designing and implementing therapeutic plans, ordering laboratory tests, screening for, identifying, explaining, and resolving adverse medication reactions, interactions, ineffective therapies, and counseling/educating patients how to benefit the most out of their therapies [25–27].

In contemporary healthcare systems, there has been a shift from delivering a larger volume of care services to delivering larger quality of care services [28]. Recently, ensuring consistency of service delivery and assessing the quality of services provided has drawn considerable attention [28–31]. As a consequence, quality measures have been developed to measure and benchmark the performance of the different providers of care services across the continuum of healthcare delivery [28, 32]. To serve this purpose, key performance indicators (KPIs) are often developed for capturing the performance of healthcare providers and the provision of services. These KPIs are supposed to monitor if healthcare services were provided with consistency and efficiency. KPIs can be defined as discrete events that when they occur can result in positive outcomes for patients [28, 29, 31]. As efforts are surmounting to enhance healthcare delivery in healthcare facilities employing integrative medicine, measuring performance becomes imperative.

KPIs are increasingly used by policymakers to make decisions related to justifying the allocation of resources, improvement of quality of care, promotion of accountability, improvement of patient safety, and helping patients make informed decisions while receiving healthcare services [29]. In a recent study, 8 consensual KPIs that can be used in capturing the impact of pharmacists while providing care for patients with epilepsy in primary healthcare settings were developed [28]. In another study, Fernandes et al. developed another 8 KPIs to capture the performance of clinical pharmacists while caring for patients in hospitalized patient settings [31]. In a recent scoping review, 42 pharmaceutical activities and services were identified as potential KPIs that could be used to benchmark pharmaceutical care in integrative medicine [33]. These potential KPIs were related to activities like taking the history, reconciliation, resolving drug-related discrepancies, providing direct and collaborative care, development of care plans, improving performance, and continuing education. In another study, 9 CAM practitioners, 8 pharmacists, 2 physicians, 2 nurses, and 1 risk/quality assurance manager were interviewed in semistructured interviews to explore their perspectives on activities and services that might be used as quality indicators of pharmaceutical care in integrative medicine [34]. Thematic analysis of the interviews led to 6 major themes that were related to providing collaborative care, services at admission, during the stay, at the transition of care, and at discharge, resolving drug-related discrepancies, collaboration with other healthcare professionals, professional development, and performing services efficiently.

The literature did not narrate extensively on which activities and services that should be used as KPIs to capture the impact of pharmacists in integrative healthcare facilities. In the absence of consensus on which activities and services that should be captured while gauging the impact of pharmacists, decision-makers are left wondering on which activities and services to measure. Therefore, this study was conducted to develop and achieve consensus on what activities and services to use as KPIs to capture and measure the impact of pharmacists in integrative healthcare facilities.

2. Methods

This study was part of a larger study that was conducted to develop a consensus-based core inventory of KPIs to be used in capturing the impact of pharmaceutical care in healthcare facilities that employ integrative medicine paradigm [33, 34]. The present study is being reported in compliance with the Conducting and REporting of Delphi Studies (CREDES) guidelines [35]. Compliance with the CREDES is shown in Supplementary Table S1. The different stages of the study are shown in Figure 1.

2.1. Study Context

Patients in Palestine receive healthcare services from three main providers: (1) governmental sector, (2) private sector, and (3) international and nongovernmental organizations like the United Nations Relief and Works Agency for Palestine Refugees (UNRWA) [36]. In addition to conventional Western medicine, many Palestinians turn to the different modalities of CAM [7, 8, 10–13, 28]. These CAM modalities are either used to complement or as alternatives to conventional Wester medicines. Pharmacy schools in Palestine train pharmacists in two different academic programs: Bachelor of Science (B.Sc.) in pharmacy and Doctor of Pharmacy (Pharm.D). In addition to industry and community pharmacy practice, the pharmacy graduates are trained to assume all roles in healthcare facilities including primary, secondary, and tertiary healthcare facilities. Pharmacists are the main providers of CAM [8, 11]. As recent studies have reported a worldwide increase in using CAM modalities among hospitalized patients [14, 15], like their peers elsewhere, pharmacists in Palestine are expected to deliver a variety of pharmaceutical care services to patients using such modalities, particularly, those admitted to healthcare facilities that employ integrative medicine paradigm.

2.2. Study Design

This study was conducted in an observational design in which the Delphi technique was used as a formal consensus approach.

Activities performed and services provided by pharmacists while caring for patients admitted to or visiting healthcare facilities that employ integrative medicine that potentially can be used as KPIs were collected from the literature into an initial inventory [33]. The list of activities and services collected from the literature was supplemented by additional activities and services that were provided by 9 CAM practitioners, 8 pharmacists, 2 physicians, 2 nurses, and 1 risk/quality assurance manager who were interviewed using in-depth semistructured qualitative interviews [34].

2.3. Study Tool

The tool used in this study was a questionnaire. The questionnaire contained 3 parts. Part 1 was designed to collect sociodemographic and practice characteristics of the participants. In this part, the participants needed to provide their gender, age, profession, academic degrees, and employer. Part 2 was designed to expose the views and opinions of the participants on the roles of pharmacists in caring for patients admitted to or visiting healthcare facilities that employ integrative medicine. This part contained 11 statements on the roles that pharmacists could play in healthcare facilities that employ an integrative medicine paradigm to patient care. The participants had to express their opinions and views by selecting either disagree, neutral, or agree on each statement. Part 3 was designed to include the activities and services that were collected in the initial inventory.

2.3.1. Review and Piloting the Questionnaire

The questionnaire was pilot tested with 3 CAM practitioners and 3 pharmacists for readability and comprehension (Figure 1). Based on the feedback provided by the CAM practitioners and pharmacists, wordings of some items in the questionnaire were revised for readability and clarity.

2.3.2. Delphi Panel

For this study, a panel of healthcare professionals (CAM practitioners, pharmacists, physicians, nurses, and risk/quality assurance managers) was composed employing a judgmental sampling technique (Figure 1). The potential panelists were identified, invited, and recruited using personal contacts in the field. In the Delphi technique, selecting the panel members is one of the most sensitive steps [37]. Previous knowledge of the topic being investigated is a prerequisite for qualifying as a potential panel member. The panel members in this study were identified, invited, and recruited on the basis of their practical experience in the domain. The panel members were diversified by gender, age group, academic degree, profession, employer, and length of experience in the domain. The study design and objectives were explained to the potential panel members upon invitation. Before participation, all potential panel members had to provide their informed consent. In this study, the inclusion criteria were as follows: (1) having an academic degree in one of the healthcare professions with relation to integrative medicine, (2) being employed as a CAM practitioner, pharmacist, physician, nurse, or risk/quality assurance manager, (3) having practical experience in the domain for more than 5 years, and (4) willing to provide an informed consent. Potential panelists who were most likely would meet the inclusion criteria were initially invited. A total of 58 potential panel members were initially invited to this study. We intentionally invited physicians, nurses, and risk/quality assurance managers to the panel to ensure the inclusion of other members of the healthcare provision team. The number of the panel members used in this study was informed by previous studies in which the Delphi technique was used in healthcare [9, 11, 12, 28, 35, 36, 38–49]. However, there is no formal consensus on the size of panel members in the Delphi technique and panel members in previous studies ranged from 10 to 1,000 [50].

2.3.3. The First Delphi Round

Questionnaires were delivered to all panel members who provided consent to participate in the study using Google Forms (Figure 1). To preserve the privacy of the panelists, the link to the questionnaire was sent to each panelist in an individualized e-mail. In the first Delphi round, the panel members provided their sociodemographic and experience characteristics, expressed their views and opinions on the 11 statements on the roles of pharmacists in providing healthcare to patients admitted to or visiting healthcare facilities that employ integrative medicine, and rated each activity and service in the initial inventory using a Likert-scale of 1–3, where scoring 1 indicated that the panel member was of the opinion that the activity or service was not useful and should not be used as a potential KPI, scoring 2 indicated that the panel member was indecisive if the service or activity was useful or not, and scoring 3 indicated that the panel member was of the opinion that the activity or service was useful and should be used as a potential KPI [28, 36].

In this round, the panel members suggested combining relevant activities together in an elaborated statement rather than using all activities and services discretely.

(1) Data Analysis in the First Delphi Round. Scores of the panel members were collected in an Excel Spreadsheet (Microsoft Inc.). Percentages of the panel members who rated the activity or service as useful were computed for each activity and service separately. It was decided a priori that activities and services rated useful by ≥60% of the panel members will be included and carried forward in the subsequent iterative Delphi rounds [51].

2.3.4. The Second Delphi Round

Activities and services that were rated as useful by 60% or more of the panel members in the first Delphi round were included and carried forward to the second iterative Delphi round. Relevant activities and services were combined as was suggested by the panel members in the first Delphi round. In the second iterative Delphi round, the panel members had to use a Likert-scale of 1–9, where scoring 1 indicated complete disagreement and scoring 9 indicated complete agreement. In the Delphi technique, many indices have been previously used to express disagreement/agreement on input items [52]. In the second Delphi round, a Likert-scale of 1–9 was used to provide the panelists with a wider range to express the extent of their disagreement/agreement. Furthermore, the scale of 1–9 was the most commonly used indices in expressing the extent of disagreement/agreement by the panelists in the Delphi technique. Again, the panel members were encouraged to include written qualitative comments as justification or qualification to their scores on each activity or service.

(1) Statistical Analysis of the Scores and Definition of Consensus Used in the Second Delphi Round. The basic descriptive statistics like quartile 1 (Q1), quartile 2 (median), quartile 3, and interquartile range (IQR) were calculated for each activity or service separately. As the panel members provided qualitative comments also, these comments were analyzed for contents by the main investigator. The main investigator also interpreted the comments and summarized them. Interpretations and summaries were sent back to the panel members for comments, feedback, additions, deletions, or corrections.

In this study, the definition of consensus was set a priori and was informed by previous studies that employed the Delphi technique [9, 11, 12, 28, 36, 45–49, 51]. Results were analyzed as follows: (1) a decision was made to disregard and remove the activity or service from the final core list of KPIs when the median was in the range of 1–3 and the IQR was ≤2, (2) a decision was made to include the activity or service in the final core list of KPIs when the median was in the range of 7–9 and the IQR was ≤2, and (3) a decision could not be made whether to include or remove an activity of service from the final core list of KPIs when the median was in the range of 4–6 and/or the IQR was >2 and the decision remained equivocal. A decision was made a priori to carry forward and subject all equivocal activities and services in the second iterative Delphi round to a third Delphi round.

2.3.5. The Third Delphi Round

Activities and services that remained equivocal in the second Delphi round were included and carried forward to the third Delphi round (Figure 1). For each equivocal activity and service, the panel members were provided with a reminder of their own scores, median scores of other panel members, and a summary of the qualitative comments made on each activity or service. The panel members were asked if they wished to maintain or reconsider their scores in view of the comments and scores of other panel members. The data were collected in the period of June to October 2019.

(1) Analysis of Scores in the Third Delphi Round. Scores of the panel members were analyzed using the same descriptive statistics that were used in the second Delphi round. Based on the qualitative comments provided by the panel members, it was clear that consensus was unlikely in a fourth Delphi round. Therefore, we decided not to conduct a fourth Delphi round, and the items were not included in the final core list.

(2) Statistical Analysis of Ratings of the KPIs on Which Consensus Was Achieved. Scores of the panel members on each KPI on which consensus was achieved were entered into GraphPad Prism for Windows (v.6.0). Dunn’s multiple comparisons tests were used to compare the scores on each consensus-based KPI. Findings were considered statistically significant as follows: when was <0.05, when was <0.01, when was <0.001, and when was <0.0001.

2.4. Ethical Approval

This study received approval from the Institutional Review Board (IRB) of An-Najah National University. The panel members knew that the Delphi technique was semianonymous which meant that their identities were known to the investigator but not the rest of the panel members. All panel members provided informed consent before they could take part in the study.

3. Results

3.1. Panel Members

Of the 58 initially invited potential participants, 50 panelists participated in the subsequent iterative Delphi rounds (response rate = 86.2% of those initially invited). The response rate was 100% in the three iterative Delphi rounds. Of the panelists, 44% were female in gender and 78% were 40 years and older. More than half (60%) of the recruited panelists were intentionally either CAM practitioners or pharmacists. Other healthcare professionals like physicians and nurses who had different academic degrees were also represented in the panel. Half (50%) of the panelists were employed by hospitals. The majority (64%) of the panelists had practice experience of 10 and more years. Details of the sociodemographic and practice characteristics of the panelists are shown in Table 1.

3.2. Views and Opinions of the Panel Members on the Roles of Pharmacists in Caring for Patients Admitted to or Visiting Healthcare Facilities That Employ Integrative Medicine

When the panel members were requested to express their views and opinions on the roles that pharmacists could play in caring for patients admitted to or visiting healthcare facilities that employ integrative medicine, 94% agreed that they could play a crucial role, 86% agreed that their interventions could significantly improve care services, 90% agreed that their interventions could significantly reduce problems related to medications and CAM used by the patients, 94% agreed that they should play an active role in designing care plans, 92% agreed that they should review, evaluate, and when necessary should recommend changes to care plans, 58% agreed that currently pharmacists were underemployed in providing care, 92% agreed that their interventions might improve knowledge of patients with regard to medications and CAM, 94% agreed that they should educate patients about their diseases, medications, and CAM use, 90% agreed that they should promote adherence to medications and CAM use, 90% agreed that their interventions could promote adherence of patients to medications and CAM, and 74% agreed that their interventions could promote the quality of life of the patients. Details of the responses of the panel members are shown in Table 2.

3.3. Iterative Delphi Technique Rounds

3.3.1. The First Delphi Round

In the first Delphi round, 73 activities and services were rated as useful by 60% and more of the panel members. These activities and services are shown in Table 3. Activities that were rated as useful by less than 60% of the panel members are shown in Supplementary Table S2.

The panel members also provided qualitative comments indicating that the inventory was in their opinion extensively huge and they suggested that relevant activities and services could be combined together. For example, a pharmacist stated: “Many of these items are related services. Allergies to drugs and CAM, drug and CAM interactions, inappropriate doses are all drug or CAM-related problems and all could be resolved by pharmacists. I think it would be better to combine them together.” Informed by similar qualitative comments of the panel members, relevant activities and services were combined into 11 items that were presented to the panel members in the second Delphi round.

3.3.2. The Second Iterative Delphi Round

Relevant activities and services rated as useful by ≥60% of the panel members were combined together into 11 items and were presented to the panel members for rating and comments in the second Delphi round. The a priori set definition of consensus used in this study indicated that the median score had to fall within the range 7–9 and the IQR had to be ≤2 for each item to be included in the final core list of the consensus-based KPIs. As either the median fell in the range 4–6 or the IQR was larger than 2 as shown in Tables 4 and 5, items not meeting the consensus criteria were subjected to a third iterative Delphi round.

3.3.3. The Third Delphi Round and the Consensus-Based KPIs

When the 11 items were presented to the panel members for scores and comments in the third Delphi round, consensus as per the definition set a priori was achieved on 8 (72.7%) of the 11 presented items. The consensus-based KPIs are listed in Table 4 ordered by the percentage of the panel members who rated the KPI 7–9. The 8 consensus-based KPIs were from the thematic areas of care, reconciliation, counseling/education, competence/performance/satisfaction, and multi-healthcare provider patient care.

When the scores of the panel members were compared using Dunn’s multiple comparisons tests, KPIs related to the number of problems related to medications and CAM that were resolved by pharmacists and CAM practitioners ( < 0.0001), the number of patients who received documented reconciliation ( < 0.0001), the number of patients who received direct, comprehensive, and/or collaborative care ( < 0.0001), and the number of patients for whom pharmacists and CAM practitioners were involved in planning/preparing/implementing/executing/completing a therapeutic plan ( < 0.05) were rated significantly higher than the KPI (number 8) related to participation in multi-healthcare provider discussions/deliberations. The details of the multiple comparisons are shown in Supplementary Table S3.

3.3.4. Activities and Services That Potentially Might Be Used as Key Performance Indicators on Which Consensus Was Not Achieved

In this study, the consensus was not achieved as per the a priori set definition on 3 (27.3%) items out of the 11 items presented to the panel members in the third Delphi round. Details of these items are shown in Table 5. The decision either to use these activities and services as KPIs is left to the decision and policymakers in individual healthcare facilities that employ the integrative medicine paradigm. The 3 items belonged to the thematic areas of care and professional development.

4. Discussion

Pharmacists are increasingly assuming roles and responsibilities in caring for patients in healthcare establishments that employ integrative medicine. Therefore, there is a pressing need to capture and measure their impact in providing healthcare services to patients who are admitted to or visiting these healthcare facilities. Traditionally, the largest volumes of healthcare services in hospitalized patient settings were provided by nurses and physicians. Therefore, traditionally, KPIs were developed to focus on activities that were performed by nurses and physicians. To effectively capture and measure the impact of pharmacists, the KPIs need to be tailored to the activities and services often provided by pharmacists [28, 30].

4.1. Summary and Significance of the Main Findings

In this study, consensus-based KPIs were developed for the first time to capture the impact of pharmacists in caring for patients admitted to or visiting healthcare facilities that employ integrative medicine. Prior to this study, the literature provided little guidance on what activities and services could be used as KPIs to capture and measure the impact of pharmacists in caring for patients admitted to or visiting healthcare facilities that employ integrative medicine. This study provides for the first time 8 consensus-based KPIs in five thematic areas that can be used in capturing the impact of pharmacists.

Facing severe fund cuts, top management in healthcare are always pressurized to make difficult decision to allocate scarce resources, maintain and/or extend services, and optimize healthcare delivery to patients [29, 53]. As a result, there is a surmounting need to continuously inform decision-makers, taxpayers, and funding bodies to justify allocating economic resources, secure funds, and demonstrate value in activities and services within a business plan. Therefore, the consensus-based KPIs presented in this study could be invaluable to decision-makers and stakeholders within the healthcare sector. The KPIs provided in this study could be helpful in supporting improvements in terms of quality care provided to patients admitted to or visiting healthcare facilities that employ integrative medicine. Additionally, these KPIs might promote advancing evidence-based pharmaceutical care and evidence-based CAM practice. KPIs can also be useful in delineating expectations of the top management, healthcare providers, patients, and society at large. They might also help prioritize activities and services provided by pharmacists, assist in describing the standards and quality of pharmaceutical care, and permit benchmarking of pharmaceutical care and CAM-based practice. KPIs might also promote professional accountability and transparency as well as contributions of pharmacists in improving patient reported outcomes [28, 29, 31]. It is also noteworthy mentioning that pharmacists providing care to patients admitted to or visiting healthcare facilities that employ integrative medicine can use these consensus-based KPIs to self-reflect and identify avenues for improvements in daily practice [28, 29]. Using these consensus-based KPIs to measure the impact of pharmacists and sharing the findings might be helpful in informing decision-makers to prioritize tasks, improve workflows, and avoid redundancies. Additionally, decision-makers might use these KPIs to make sure that pharmacists provide patients with the best quality of care within a given budget. Data generated from the use of these consensus-based KPIs might be presented in the meetings of quality evaluation committees, top management, fund donors, and boards of trustees.

4.2. Appraisal of the Method Used in This Study

Since its inception, the Delphi technique has evolved as one of the most powerful and commonly employed formal consensus approaches in developing concepts and definitions and achieving consensus on issues that lack formal consensus in healthcare. Traditionally, formal consensus techniques have been employed as alternative methods to anecdotal and subjective approaches. Advantages of the Delphi technique are numerous and include overcoming geographical barriers and constrains in reaching for panelists who possess previous knowledge of the topic being studied, eliminating financial costs needed to transport panelists and convene face to face meetings, ability to maintain the anonymity of the panel members, and ability to prevent domination of the discussion by prominent and extrovert panel members who can impose generalized bandwagon effect on the discussion [28, 43, 44].

In this study, the panel members who rated the items in the Delphi rounds again were of both genders, from different professions, had different academic degrees, were employed in different sectors, and had a comparatively long experience in the domain. The majority of the panel members were pharmacists. Other healthcare professions were also included to impart diversity to the panel and ensure the representation of other healthcare providers. This diversity might have added validity and strength to our method used in this study and to the suitability of using the developed KPIs as gold standards for developing KPIs to capture and measure the impact of pharmacists in providing care to patients admitted to or visiting healthcare facilities that employ integrative medicine do not exist. In the absence of a gold standard, formal consensus techniques provide suitable alternative methods to anecdotal and other subjective approaches [9, 11, 12, 28, 36, 45–49, 54]. It is noteworthy mentioning that professionals are more likely to use consensus-based KPIs compared to KPIs either improvised or developed using anecdotal or subjective approaches. Therefore, consensus-based methods have been promoted as approaches to reduce bias, promote transparency, and increase strength and validity to judgmental approaches while developing concepts like KPIs [28, 54].

4.3. Perspectives of the Panelists on the Role of Pharmacists in Integrative Healthcare Facilities

In this study, the vast majority of the panel members were of the opinion that pharmacists should play a greater role in providing care for patients admitted to or visiting healthcare facilities that employ integrative medicine. The findings of this study were consistent with those reported elsewhere and expanding the roles of pharmacists that were advocated by professional organizations in different countries around the world [14, 55–58]. As multi-healthcare provider paradigms have been promoted in modern healthcare systems, other healthcare providers like physicians expressed the desire to learn about integrative medicine and the use of CAM modalities [14, 15, 59, 60].

4.4. Key Performance Indicators

In this study, the consensus was achieved to consider identifying and resolving medication and CAM-related problems as a KPI to capture the impact of pharmacists in providing care to patients admitted to or visiting healthcare facilities that employ integrative medicine. The findings of this study were consistent with a previous study in which consensus was achieved to consider activities like screening for, identifying, and addressing problems related to antiepileptic drugs as a KPI to capture the impact of pharmacists in caring for patients with epilepsy visiting epilepsy clinics [28]. In an integrative medicine paradigm, pharmacists are healthcare providers with recognized expertise in pharmaco- and CAM-based therapies. Therefore, pharmacists and CAM practitioners are expected to screen for, identify, and address problems related to using medications and different CAM modalities while caring for patients. Previous studies have shown that the inclusion of pharmacists in the health provision teams reduced medication-related problems in patients admitted to hospitals, after discharge from hospitals, and in primary healthcare practice [61–65]. It was not a surprise that this KPI was rated higher than other KPIs by the panel members who participated in this study. The consensus was also achieved to services related to medication and/or CAM reconciliation as KPI to capture the impact of pharmacists in integrative medicine. The findings of this study were consistent with those previously reported on the role of pharmacists in providing care to patients [28, 29, 31]. In daily practice, pharmacists are expected to conduct medication and CAM reconciliations, take the best possible medication and CAM histories, perform reviews, and address problems and discrepancies. Medication reconciliation is now a well-recognized area in pharmaceutical care and pharmacists are increasingly expected to conduct medication reconciliations and resolve problems and discrepancies [28, 66, 67]. Additionally, pharmacists are supposed to be actively involved and use their expertise in designing care plans tailored to the individual needs of the patients [66, 67]. This might efficiently be done by collaborating with other healthcare professionals in a multi-healthcare provider model of care [28, 31]. Educating patients on their diseases, medications, and CAM modalities might need to be conducted at different stages while the patient is admitted to or visiting the healthcare facility: at admission, during their stay, and at discharge. Pharmacists are recognized experts in medications and CAM modalities. Therefore, they are in a key position to educate patients about their diseases, medications, and CAM use [68]. In modern healthcare delivery, patients are increasingly informed about their diseases and therapeutic options available to them. In clinical practice, decisions are often made jointly between healthcare providers and patients. In order to empower patients to actively be involved in making decisions, patients should be well informed about their diseases and the therapeutic options available to them. Complaints about activities and services are being used as quality indicators by different providers. In this study, the consensus was achieved to consider the number of complaints received on services delivered by pharmacists as a KPI. The findings of this study were consistent with previous studies in which complaints were used as an indicator of dissatisfaction with a service by the service user [69]. Again, the number of errors committed by pharmacists was considered a KPI in this study. The number of errors committed by pharmacists could be used to benchmark and improve the activities and services provided by pharmacists. Minimizing errors might promote safe care delivery in healthcare facilities that employ integrative medicine. The findings of this study were contradictory to those previously reported in which consensus was not achieved to consider the number of errors made by pharmacists per a predetermined time period as a KPI to measure the impact of pharmacists in caring for patients with epilepsy [28]. Active participation and contributions of pharmacists in discussions with other healthcare providers and answering their inquiries were also considered as a KPI. Previous studies have shown that ineffective communication between healthcare providers was considered an important barrier that hindered multi-healthcare provider approaches to healthcare provision [70, 71].

Although continuing educations is crucial to professional development, in this study, the consensus was not achieved to consider the number of continuing education/training sessions either attended or delivered by pharmacists as a KPI. Again, the consensus was not achieved to consider therapeutic medication or CAM monitoring and assessment of high-risk medication or CAM orders as KPIs. These activities and services remained equivocal and the decision to capture and use them in measuring the impact of pharmacists in integrative medicine is left to the decision-makers. It has been argued that KPIs should be important, relevant to patient care, and easily measurable [69]. Therefore, consensus-based KPIs could vary with regard to specialty, settings, and patient populations [28].

4.5. Implications on Future Practice

In Palestine, all government hospitals in the West Bank were recently connected by an electronic health information system (HIS) that was purchased by the Ministry of Health from Avicenna Health Information Medical Systems [36]. Similarly, the UNRWA developed an in-house built electronic health record system that is being implemented in more than 100 of its health centers in Jordan, Syria, Lebanon, the West Bank, and Gaza Strip [72]. The system was developed to facilitate services relevant to common illnesses, maternal and child health, noncommunicable diseases, laboratory, and pharmacy. Electronic systems are powerful tools that may permit collecting and measuring activities performed and services delivered by healthcare providers. The consensus-based KPIs developed in this study might be helpful in providing qualitative and qualitative measures of the impact of pharmacists in providing key services consistently and efficiently. Additionally, the use of these consensus KPIs might help exposing gaps that need to be addressed, attraction of funds, justifying the allocation of scarce resources, and promotion of improvements in healthcare delivery in healthcare facilities employing integrative medicine paradigms.

4.6. Limitations of the Study

Notwithstanding, KPIs could be associated with a number of limitations. For instance, KPIs might fail to capture the activity that they were designed to measure [73]. In this case, KPIs might underestimate the impact of healthcare providers across the continuum of healthcare delivery. KPIs could also be associated with perverse incentives and gaming the system. There could be obstacles in implementing monitoring systems that collect information on these KPIs. They could also negatively impact the morale of healthcare providers. KPIs are often dichotomous and do not necessarily provide insight into the quality of the services provided. Simply computing the KPI could impart bias and could carry an inherent risk to the quality of care provided to patients.

The findings of this study should be interpreted after carefully taking into account the following points. First, patients or their caregivers were not included in the Delphi panel members. However, the inclusion of patients or their caregivers should have permitted exposing their perspectives and expectations from their caring pharmacists. Second, community pharmacists were also not included in the Delphi panel members. In Palestine, the majority of the registered pharmacists are practicing as community pharmacists [13, 45, 47]. However, the inclusion of community pharmacists should have permitted exposing their views and opinions. Third, the Delphi technique was used as the consensus achieving technique in this study. The use of such an approach is a limitation. However, formal consensus techniques are more robust methods when the only alternatives include subjective and/or anecdotal approaches [28]. Fourth, the size of the Delphi panel was comparatively limited. However, there is no consensus on a size for the Delphi panels and previous studies have used panels with 10 to 1,000 participants [50]. The size of the panel used in this study was within the range of the panels we used before. Fifth, a purposive sampling method was used while recruiting the panelists in the Delphi technique. Nonprobability sampling techniques have long been criticized as biased. However, due to the nature and objectives of this study, the use of probability sampling approaches was not feasible. Again, having prior knowledge of the topic being investigated is a prerequisite for a participant to qualify for inclusion in a Delphi panel. Finally, all panelists were from Palestine which might limit the generalizability of the findings of this study.

5. Conclusions

In this study, consensus-based KPIs that can be used in capturing the impact of evidence-based CAM and pharmaceutical care of patients admitted to or visiting healthcare facilities that employ integrative medicine paradigm were developed. Future studies are still needed to investigate if implementing these consensus-based KPIs might promote evidence-based CAM and pharmaceutical care in healthcare facilities that employ an integrative medicine paradigm to healthcare.

Data Availability

Data supporting the results reported in a published article can be found in the Results section and as supplementary materials with this manuscript.

Conflicts of Interest

The author declares no conflicts of interest.

Acknowledgments

The author would like to thank the panelists who took part in the study. An-Najah National University is thanked for granting permission to conduct this study.

Supplementary Materials

Supplementary Table S1: adherence to Conducting and Reporting of Delphi Studies (CREDES) guidelines. Supplementary Table S2: activities rated by <60% of the panel members in the first Delphi round as potential key performance indicators (KPIs). Supplementary Table S3: multiple comparisons of ratings made by the panel members on each consensus-based key performance indicator in the third Delphi round. (Supplementary Materials)

References

L. Nazarko and J. Thorne, “Providing holistic care to prevent hospital admission,” Journal of Prescribing Practice, vol. 2, no. 2, pp. 84–90, 2020.
View at: Publisher Site | Google Scholar
W. Zhang, S. E. Pritzker, and K. K. Hui, “Factors affecting definitions of and approaches to integrative medicine: a mixed methods study examining China’s integrative medicine development,” Evidence-Based Complementary and Alternative Medicine, vol. 2015, Article ID 458765, 12 pages, 2015.
View at: Publisher Site | Google Scholar
S. Y. Moon, K. M. Shin, J. Y. Shin, O. J. Kwon, and J. H. Lee, “Integrative medicine for postoperative patients,” A Survey of Korean Medicine Doctors, vol. 2017, Article ID 4650343, 8 pages, 2017.
View at: Publisher Site | Google Scholar
R. Gannotta, S. Malik, A. Y. Chan, K. Urgun, F. Hsu, and S. Vadera, “Integrative medicine as a vital component of patient care,” Cureus, vol. 10, no. 8, p. e3098, 2018.
View at: Publisher Site | Google Scholar
V. Maizes, D. Rakel, and C. Niemiec, “Integrative medicine and patient-centered care,” Explore, vol. 5, no. 5, pp. 277–289, 2009.
View at: Publisher Site | Google Scholar
K. Armstrong, T. Lanni, M. M. Anderson, and G. E. Patricolo, “Integrative medicine and the oncology patient: options and benefits,” Supportive Care in Cancer, vol. 26, no. 7, pp. 2267–2273, 2018.
View at: Publisher Site | Google Scholar
N. A. Jaradat, R. Shawahna, A. M. Eid, R. Al-Ramahi, M. K. Asma, and A. N. Zaid, “Herbal remedies use by breast cancer patients in the West Bank of Palestine,” Journal of Ethnopharmacology, vol. 178, pp. 1–8, 2016.
View at: Publisher Site | Google Scholar
R. Shawahna, “Combining and using the utrecht method and the analytic hierarchy process to facilitate professional and ethical deliberation and decision making in complementary and alternative medicine: a case study among a panel of stakeholders,” Evidence-Based Complementary and Alternative Medicine, vol. 2018, Article ID 2315938, 10 pages, 2018.
View at: Publisher Site | Google Scholar
R. Shawahna and M. Al-Atrash, “What do primary healthcare providers and complementary and alternative medicine practitioners in Palestine need to know about exercise for cancer patients and survivors: a consensual study using the Delphi technique,” Evidence-Based Complementary and Alternative Medicine, vol. 2019, Article ID 7695818, 14 pages, 2019.
View at: Publisher Site | Google Scholar
R. Shawahna and N. A. Jaradat, “Ethnopharmacological survey of medicinal plants used by patients with psoriasis in the West Bank of Palestine,” BMC Complementary and Alternative Medicine, vol. 17, no. 1, p. 4, 2017.
View at: Publisher Site | Google Scholar
R. Shawahna, S. Qiblawi, and H. Ghanayem, “Which benefits and harms of using fenugreek as a galactogogue need to Be discussed during clinical consultations? A Delphi study among breastfeeding women, gynecologists, pediatricians, family physicians, lactation consultants, and pharmacists,” Evidence-Based Complementary and Alternative Medicine, vol. 2018, Article ID 2418673, 13 pages, 2018.
View at: Publisher Site | Google Scholar
R. Shawahna and A. Taha, “Which potential harms and benefits of using ginger in the management of nausea and vomiting of pregnancy should be addressed? a consensual study among pregnant women and gynecologists,” BMC Complementary and Alternative Medicine, vol. 17, no. 1, p. 204, 2017.
View at: Publisher Site | Google Scholar
N. Y. Shraim, R. Shawahna, M. A. Sorady et al., “Community pharmacists’ knowledge, practices and beliefs about complementary and alternative medicine in Palestine: a cross-sectional study,” BMC Complementary and Alternative Medicine, vol. 17, no. 1, p. 429, 2017.
View at: Publisher Site | Google Scholar
I. Roth, L. Highfield, P. Cuccaro, R. Wells, S. Misra, and J. Engebretson, “Employing evidence in evaluating complementary therapies: findings from an ethnography of integrative pain management at a large urban pediatric hospital,” The Journal of Alternative and Complementary Medicine, vol. 25, no. S1, pp. S95–S105, 2019.
View at: Publisher Site | Google Scholar
E. S. Highfield, M. Longacre, Y.-H. Chuang, and J. F. Burgess, “Does acupuncture treatment affect utilization of other hospital services at an urban safety-net hospital?” The Journal of Alternative and Complementary Medicine, vol. 22, no. 4, pp. 323–327, 2016.
View at: Publisher Site | Google Scholar
M. Niesley, K. Doran, N. Huynh, and M. Winters, “A model for coordinated delivery of individualized complementary and integrative medicine care for cancer survivors,” Journal of Clinical Oncology, vol. 34, no. 3_suppl, 3_suppl, 2016.
View at: Publisher Site | Google Scholar
M. Park, J. Hunter, and S. Kwon, “Evaluating integrative medicine acute stroke inpatient care in South Korea,” Health Policy, vol. 122, no. 4, pp. 373–379, 2018.
View at: Publisher Site | Google Scholar
M. Aggarwal, B. Aggarwal, and J. Rao, “Integrative medicine for cardiovascular disease and prevention,” Medical Clinics of North America, vol. 101, no. 5, pp. 895–923, 2017.
View at: Publisher Site | Google Scholar
H.-l. Gong, W.-f. Tang, Y.-y. Ren et al., “Summary of integrative medicine for severe acute pancreatitis: 26-year clinical experiences and a report of 1561 cases,” Chinese Journal of Integrative Medicine, vol. 17, no. 5, pp. 381–385, 2011.
View at: Publisher Site | Google Scholar
T. Varteresian and H. Lavretsky, “The use of complementary alternative and integrative medicine (CAIM) for treatment and prevention of late-life depression and cardiovascular disease,” in Cardiovascular Diseases and Depression: Treatment and Prevention in Psychocardiology, B. T. Baune and P. J. Tully, Eds., pp. 467–491, Springer International Publishing, Cham, Switzerland, 2016.
View at: Publisher Site | Google Scholar
A. A. Asadi-Pooya, M. Homayoun, and S. Sharifi, “Complementary and integrative medicine in epilepsy: what patients and physicians perceive,” Epilepsy & Behavior, vol. 101, Article ID 106545, 2019.
View at: Publisher Site | Google Scholar
K. M. S. Bastianelli, L. Nelson, and L. Palombi, “Perceptions of pharmacists' role in the health care team through student-pharmacist led point-of-care screenings and its future application in health care,” Currents in Pharmacy Teaching and Learning, vol. 9, no. 2, pp. 195–200, 2017.
View at: Publisher Site | Google Scholar
R. A. Blouin and M. L. Adams, “The role of the pharmacist in health care,” North Carolina Medical Journal, vol. 78, no. 3, pp. 165–167, 2017.
View at: Publisher Site | Google Scholar
N. J. Gray, J. Burton, R. Campbell, and J. E. McDonagh, “Expanding the role of the pharmacist,” in Health Care Transition: Building a Program for Adolescents and Young Adults with Chronic Illness and Disability, A. C. Hergenroeder and C. M. Wiemann, Eds., pp. 279–292, Springer International Publishing, Cham, Switzerland, 2018.
View at: Google Scholar
J. Jackson, S. Caliph, W. K. Chui, and L. Ocampo, “Using a collaborative decision-making approach to identify, prioritise and respond to issues influencing Good Pharmacy Practice across countries of the Western Pacific Region,” International Journal of Pharmacy Practice, vol. 28, no. 3, pp. 282–289, 2020.
View at: Publisher Site | Google Scholar
R. Nash, L. Chalmers, I. Stupans, and N. Brown, “Developing lifelong learning skills: using a traffic light report to promote competency standards and self-assessment among pharmacy undergraduates,” in Ensuring Quality in Professional Education Volume I: Human Client Fields Pedagogy and Knowledge Structures, K. Trimmer, T. Newman, and F. F. Padró, Eds., pp. 209–240, Springer International Publishing, Cham, Switzerland, 2019.
View at: Publisher Site | Google Scholar
J. J. Waddell, L. M. Nissen, and A. R. Hale, “Advanced pharmacy practice in Australia and leadership: mapping the APPF against an evidence-based leadership framework,” Journal of Pharmacy Practice and Research, vol. 47, no. 4, pp. 263–268, 2017.
View at: Publisher Site | Google Scholar
R. Shawahna, “Development of key performance indicators to capture in measuring the impact of pharmacists in caring for patients with epilepsy in primary healthcare: a Delphi consensual study,” Epilepsy & Behavior, vol. 98, no. Pt A, pp. 129–138, 2019.
View at: Publisher Site | Google Scholar
E. Lo, D. Rainkie, W. M. Semchuk et al., “Measurement of clinical pharmacy key performance indicators to focus and improve your hospital pharmacy practice,” The Canadian Journal of Hospital Pharmacy, vol. 69, no. 2, pp. 149–155, 2016.
View at: Publisher Site | Google Scholar
D. A. Caplin, J. K. Rao, F. Filloux, J. F. Bale, and C. Van Orman, “Development of performance indicators for the primary care management of pediatric epilepsy: expert consensus recommendations based on the available evidence,” Epilepsia, vol. 47, no. 12, pp. 2011–2019, 2006.
View at: Publisher Site | Google Scholar
O. Fernandes, S. K. Gorman, R. S. Slavik et al., “Development of clinical pharmacy key performance indicators for hospital pharmacists using a modified Delphi approach,” Annals of Pharmacotherapy, vol. 49, no. 6, pp. 656–669, 2015.
View at: Publisher Site | Google Scholar
A. D. Patel, C. Baca, G. Franklin et al., “Quality improvement in neurology,” Epilepsy Quality Measurement Set, vol. 91, no. 18, pp. 829–836, 2018.
View at: Google Scholar
R. Shawahna, “Quality indicators of pharmaceutical care for integrative healthcare: a scoping review of indicators developed using the Delphi technique,” Evidence-Based Complementary and Alternative Medicine, vol. 2020, Article ID 9131850, 20 pages, 2020.
View at: Publisher Site | Google Scholar
R. Shawahna, “Quality indicators of pharmaceutical care in Palestinian integrative healthcare facilities: findings of a qualitative study among stakeholders,” Evidence-Based Complementary and Alternative Medicine, vol. 2020, Article ID 4520769, 13 pages, 2020.
View at: Publisher Site | Google Scholar
S. Jünger, S. A. Payne, J. Brine, L. Radbruch, and S. G. Brearley, “Guidance on Conducting and reporting delphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review,” Palliative Medicine, vol. 31, no. 8, pp. 684–706, 2017.
View at: Publisher Site | Google Scholar
R. Shawahna, “Merits, features, and desiderata to be considered when developing electronic health records with embedded clinical decision support systems in Palestinian hospitals: a consensus study,” BMC Complementary and Alternative Medicine, vol. 19, no. 1, p. 216, 2019.
View at: Publisher Site | Google Scholar
C. Okoli and S. D. Pawlowski, “The Delphi method as a research tool: an example, design considerations and applications,” Information & Management, vol. 42, no. 1, pp. 15–29, 2004.
View at: Publisher Site | Google Scholar
R. Boulkedid, H. Abdoul, M. Loustau, O. Sibony, and C. Alberti, “Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review,” PLoS One, vol. 6, no. 6, Article ID e20476, 2011.
View at: Publisher Site | Google Scholar
B. Dean, N. Barber, and M. Schachter, “What is a prescribing error?” Quality in Health Care, vol. 9, no. 4, pp. 232–237, 2000.
View at: Publisher Site | Google Scholar
C. Duffield, “The Delphi technique: a comparison of results obtained using two expert panels,” International Journal of Nursing Studies, vol. 30, no. 3, pp. 227–237, 1993.
View at: Publisher Site | Google Scholar
M. A. Ghaleb, N. Barber, B. Dean Franklin, and I. C. Wong, “What constitutes a prescribing error in paediatrics?” Quality and Safety in Health Care, vol. 14, no. 5, pp. 352–357, 2005.
View at: Publisher Site | Google Scholar
F. Hasson, S. Keeney, and H. McKenna, “Research guidelines for the Delphi survey technique,” Journal of Advanced Nursing, vol. 32, no. 4, pp. 1008–1015, 2000.
View at: Publisher Site | Google Scholar
H. P. McKenna, “The Delphi technique: a worthwhile research approach for nursing?” Journal of Advanced Nursing, vol. 19, no. 6, pp. 1221–1225, 1994.
View at: Publisher Site | Google Scholar
A. Page, K. Potter, R. Clifford, A. McLachlan, and C. Etherton-Beer, “Prescribing for Australians living with dementia: study protocol using the Delphi technique,” BMJ Open, vol. 5, no. 8, Article ID e008048, 2015.
View at: Publisher Site | Google Scholar
R. Shawahna, “Which information on women's issues in epilepsy does a community pharmacist need to know? A Delphi consensus study,” Epilepsy & Behavior, vol. 77, pp. 79–89, 2017.
View at: Publisher Site | Google Scholar
R. Shawahna, A. Abbas, and A. Ghanem, “Medication transcription errors in hospitalized patient settings: a consensual study in the Palestinian nursing practice,” BMC Health Services Research, vol. 19, no. 1, p. 644, 2019.
View at: Publisher Site | Google Scholar
R. Shawahna, A. Haddad, B. Khawaja, R. Raie, S. Zaneen, and T. Edais, “Medication dispensing errors in Palestinian community pharmacy practice: a formal consensus using the Delphi technique,” International Journal of Clinical Pharmacy, vol. 38, no. 5, pp. 1112–1123, 2016.
View at: Publisher Site | Google Scholar
R. Shawahna, D. Masri, R. Al-Gharabeh, R. Deek, L. Al-Thayba, and M. Halaweh, “Medication administration errors from a nursing viewpoint: a formal consensus of definition and scenarios using a Delphi technique,” Journal of Clinical Nursing, vol. 25, no. 3-4, pp. 412–423, 2016.
View at: Publisher Site | Google Scholar
R. Shawahna, M. Odeh, and M. Jawabreh, “Factors promoting clinical inertia in caring for patients with dyslipidemia: a consensual study among clinicians who provide healthcare to patients with dyslipidemia,” Journal of the National Medical Association, vol. 111, no. 1, pp. 18–27, 2019.
View at: Publisher Site | Google Scholar
R. B. Akins, H. Tolson, and B. R. Cole, “Stability of response characteristics of a Delphi panel: application of bootstrap data expansion,” BMC Medical Research Methodology, vol. 5, p. 37, 2005.
View at: Publisher Site | Google Scholar
D. De Meyer, J. Kottner, H. Beele et al., “Delphi procedure in core outcome set development: rating scale and consensus criteria determined outcome selection,” Journal of Clinical Epidemiology, vol. 111, pp. 23–31, 2019.
View at: Publisher Site | Google Scholar
S. Birko, E. S. Dove, and V. Özdemir, “Evaluation of nine consensus indices in Delphi foresight research and their dependency on Delphi survey characteristics: a simulation study and debate on Delphi design and interpretation,” PLoS One, vol. 10, no. 8, Article ID e0135162, 2015.
View at: Publisher Site | Google Scholar
C. Brown, “Improving quality of care for epilepsy patients using a pharmacist review service,” Progress in Neurology and Psychiatry, vol. 16, no. 5, pp. 12–16, 2012.
View at: Publisher Site | Google Scholar
N. D. Ferguson, A. M. Davis, A. S. Slutsky, and T. E. Stewart, “Development of a clinical definition for acute respiratory distress syndrome using the Delphi technique,” Journal of Critical Care, vol. 20, no. 2, pp. 147–154, 2005.
View at: Publisher Site | Google Scholar
D. Jorgenson, D. Dalton, B. Farrell, R. T. Tsuyuki, and L. Dolovich, “Guidelines for pharmacists integrating into primary care teams,” Canadian Pharmacists Journal/Revue des Pharmaciens du Canada, vol. 146, no. 6, pp. 342–352, 2013.
View at: Publisher Site | Google Scholar
E. J. Lim, J. L. Vardy, B. S. Oh, and H. M. Dhillon, “A scoping review on models of integrative medicine: what is known from the existing literature?” The Journal of Alternative and Complementary Medicine, vol. 23, no. 1, pp. 8–17, 2016.
View at: Google Scholar
X.-Y. Hu, A. Lorenc, K. Kemper, J.-P. Liu, J. Adams, and N. Robinson, “Defining integrative medicine in narrative and systematic reviews: a suggested checklist for reporting,” European Journal of Integrative Medicine, vol. 7, no. 1, pp. 76–84, 2015.
View at: Publisher Site | Google Scholar
D. M. Eisenberg, T. J. Kaptchuk, D. E. Post et al., “Establishing an integrative medicine program within an academic health center: essential considerations,” Academic medicine: Journal of the Association of American Medical Colleges, vol. 91, no. 9, pp. 1223–1230, 2016.
View at: Publisher Site | Google Scholar
M. Eckert, C. Amarell, D. Anheyer, H. Cramer, and G. Dobos, “Integrative pediatrics: successful implementation of integrative medicine in a German hospital setting—concept and realization,” Children, vol. 5, no. 9, 2018.
View at: Publisher Site | Google Scholar
P. Lebensohn, B. Kligler, A. J. Brooks et al., “Integrative medicine in residency: feasibility and effectiveness of an online program,” Family Medicine, vol. 49, no. 7, pp. 514–521, 2017.
View at: Google Scholar
N. Abunahlah, A. Elawaisi, F. M. Velibeyoglu, and M. Sancar, “Drug related problems identified by clinical pharmacist at the internal medicine ward in Turkey,” International Journal of Clinical Pharmacy, vol. 40, no. 2, pp. 360–367, 2018.
View at: Publisher Site | Google Scholar
H. Benson, C. Lucas, W. Kmet, S. I. Benrimoj, and K. Williams, “Pharmacists in general practice: a focus on drug-related problems,” International Journal of Clinical Pharmacy, vol. 40, no. 3, pp. 566–572, 2018.
View at: Publisher Site | Google Scholar
M. A. S. Ali, E. M. H. Khedr, F. A. H. Ahmed, and N. N. E. Mohamed, “Clinical pharmacist interventions in managing drug-related problems in hospitalized patients with neurological diseases,” International Journal of Clinical Pharmacy, vol. 40, no. 5, pp. 1257–1264, 2018.
View at: Publisher Site | Google Scholar
A. C. M. Hazen, A. A. de Bont, L. Boelman et al., “The degree of integration of non-dispensing pharmacists in primary care practice and the impact on health outcomes: a systematic review,” Research in Social and Administrative Pharmacy, vol. 14, no. 3, pp. 228–240, 2018.
View at: Publisher Site | Google Scholar
S. M. Westberg, S. K. Derr, E. D. Weinhandl et al., “Drug therapy problems identified by pharmacists through comprehensive medication management following hospital discharge,” Journal of Pharmacy Technology, vol. 33, no. 3, pp. 96–107, 2017.
View at: Publisher Site | Google Scholar
A. B. Blondal, S. K. Sporrong, and A. B. Almarsdottir, “Introducing pharmaceutical care to primary care in Iceland-an action research study,” Pharmacy, vol. 5, no. 2, 2017.
View at: Publisher Site | Google Scholar
O. M. Al-Quteimat and A. M. Amer, “Evidence-based pharmaceutical care: the next chapter in pharmacy practice,” Saudi Pharmaceutical Journal, vol. 24, no. 4, pp. 447–451, 2016.
View at: Publisher Site | Google Scholar
U. Eshiet, J. Okonta, and C. Ukwe, “The efficacy of a pharmacist implemented educational treatment programme for people with epilepsy: a report of a randomised controlled trial,” Seizure, vol. 69, pp. 147–153, 2019.
View at: Publisher Site | Google Scholar
G. F. Lloyd, S. Singh, P. Barclay, S. Goh, and B. Bajorek, “Hospital pharmacists' perspectives on the role of key performance indicators in Australian pharmacy practice,” Journal of Pharmacy Practice and Research, vol. 47, no. 2, pp. 87–95, 2017.
View at: Publisher Site | Google Scholar
S. Rixon, S. Braaf, A. Williams, D. Liew, and E. Manias, “Pharmacists' interprofessional communication about medications in specialty hospital settings,” Health Communication, vol. 30, no. 11, pp. 1065–1075, 2015.
View at: Publisher Site | Google Scholar
B. L. Sicat, C. Huynh, R. Willett, S. Polich, and S. Mayer, “Interprofessional education in a primary care teaching clinic: findings from a study involving pharmacy and medical students,” Journal of Interprofessional Care, vol. 28, no. 1, pp. 71–73, 2014.
View at: Publisher Site | Google Scholar
G. Ballout, N. Al-Shorbaji, N. Abu-Kishk, Y. Turki, W. Zeidan, and A. Seita, “UNRWA’s innovative e-Health for 5 million Palestine refugees in the Near East,” BMJ Innovations, vol. 4, no. 3, pp. 128–134, 2018.
View at: Publisher Site | Google Scholar
H. Pasman and W. Rogers, “How can we use the information provided by process safety performance indicators? Possibilities and limitations,” Journal of Loss Prevention in the Process Industries, vol. 30, pp. 197–206, 2014.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Ramzi Shawahna. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3578

Downloads

1018

Citations