Nursing Research and Practice

Nursing Research and Practice / 2013 / Article

Research Article | Open Access

Volume 2013 |Article ID 171872 |

Dawn Stacey, Gail Macartney, Meg Carley, Margaret B. Harrison, The Pan-Canadian Oncology Symptom Triage and Remote Support Group (COSTaRS), "Development and Evaluation of Evidence-Informed Clinical Nursing Protocols for Remote Assessment, Triage and Support of Cancer Treatment-Induced Symptoms", Nursing Research and Practice, vol. 2013, Article ID 171872, 11 pages, 2013.

Development and Evaluation of Evidence-Informed Clinical Nursing Protocols for Remote Assessment, Triage and Support of Cancer Treatment-Induced Symptoms

Academic Editor: Linda Moneyham
Received06 Sep 2012
Revised29 Nov 2012
Accepted03 Dec 2012
Published18 Feb 2013


The study objective was to develop and evaluate a template for evidence-informed symptom protocols for use by nurses over the telephone for the assessment, triage, and management of patients experiencing cancer treatment-related symptoms. Guided by the CAN-IMPLEMENT© methodology, symptom protocols were developed by, conducting a systematic review of the literature to identify clinical practice guidelines and systematic reviews, appraising their quality, reaching consensus on the protocol template, and evaluating the two symptom protocols for acceptability and usability. After excluding one guideline due to poor overall quality, the symptom protocols were developed using 12 clinical practice guidelines (8 for diarrhea and 4 for fever). AGREE Instrument (Appraisal of Guidelines for Research and Evaluation) rigour domain subscale ratings ranged from 8% to 86% (median 60.1 diarrhea; 40.5 fever). Included guidelines were used to inform the protocols along with the Edmonton Symptom Assessment System questionnaire to assess symptom severity. Acceptability and usability testing of the symptom populated template with 12 practicing oncology nurses revealed high readability ( ), just the right amount of information ( ), appropriate terms ( ), fit with clinical work flow ( ), and being self-evident for how to complete ( ). Five nurses made suggestions and 11 rated patient self-management strategies the highest for usefulness. This new template for symptom protocols can be populated with symptom-specific evidence that nurses can use when assessing, triaging, documenting, and guiding patients to manage their-cancer treatment-related symptoms.

1. Introduction

Adults undergoing cancer treatments often experience distress from treatment-related symptoms [1, 2]. Helping patients manage these symptoms can relieve some distress but more importantly better symptom management may lead to safer care for some symptoms that can progress to be life threatening [3]. Given that most chemotherapy and radiation therapy is provided through ambulatory programs, and patients experience treatment-related symptoms at home, telephone is the easiest way to access oncology health professionals [4, 5]. Thus, an important service for patients is telephone access to healthcare professionals for self-care guidance and triaging symptoms to the appropriate level of care. According to recent surveys, 88% of ambulatory oncology programs in Ontario reported that nurses respond to incoming calls from patients for symptom management and 54% of oncology nurses in Canada provide remote symptom support by telephone or email [6, 7].

Current research is limited to nurse initiated telephone calls to specific oncology patient populations as a follow-up posttreatment to address informational and psychosocial needs, or to monitor for recurrent disease. These types of outgoing telephone-based nursing services have been shown to be feasible and effective for meeting the information needs of patients with specific types of cancer [816]. Furthermore, telephone follow-up calls have been positively received and are deemed acceptable by patients and nurses [8, 9, 11, 1719]. Telephone-based interventions reported in these studies are focused on cancer disease specific questions to ask in the follow-up calls without details on management of the oncology treatment related symptoms.

Key elements necessary for quality telephone-based nursing services that minimize risk of litigation include access to protocols to guide the assessment and advice provided, documentation of calls, quality assurance monitoring, and training [20, 21]. However, access to and the ways symptom protocols are used vary across oncology programs and nurses [6, 7]. Most programs in Canada that reported using protocols indicated they were using those available through Cancer Care Ontario since 2004. Often these protocols were not being integrated into clinical practice. Another potential source of synthesized evidence to guide symptom management is clinical practice guidelines [22, 23]. However, cancer symptom focused clinical practice guidelines are not formatted for use by telephone and the publicly available telephone symptom management protocols did not provide references to these sources of evidence [6, 7]. This highlights a gap between the evidence to support symptom management and the tools to facilitate use of evidence in clinical practice. Clinical practice protocols as knowledge translation tools can reduce the gap between scientific evidence and current practice by presenting the best available evidence and using a format that is sensitive to how nurses think and what nurses do [22, 24].

The overall aim of this study was to develop and evaluate a template for evidence-informed symptom protocols for use by nurses over the telephone for the assessment, triage, and management of patients experiencing cancer-treatment-related symptoms. For the purposes of this study, a protocol is defined as an agreed upon standardized approach to guide nursing practice. It is based on the best available scientific evidence and formatted for ease of use to fit with usual clinical routines or practices for a specific patient situation.

2. Materials and Methods

Methods were guided by the CAN-IMPLEMENT© methodology [25]. This framework was chosen because of its focus on adapting current guidelines. CAN-IMPLEMENT© is an adaptation and implementation planning resource designed to facilitate guideline adaptation and knowledge activation. The three-part resource (Guide, Library Science Supplement, and Toolkit) provides practical guidance for those interested in using already developed guidelines, adapting those recommendations for local use, and preparing for implementation. The procedures that guided our study were to (a) establish the research questions; (b) conduct a systematic review of the literature to identify clinical practice guidelines and systematic reviews for cancer-treatment-related symptom management; (c) appraise methodological quality of identified guidelines and systematic reviews; (d) iteratively develop a template for clinical nursing symptom specific protocols for use on the telephone with nurses and researchers; and (e) evaluate the protocol template for acceptability and usability. To provide an exemplar, we chose to focus on two different symptoms commonly associated with cancer treatments: diarrhea and neutropenia with fever. This project was a part of the larger Canadian Guideline Adaptation Study and ethics approval was received from the Queen’s University Research Ethics Board, Kingston, Ontario, Canada (REB number NURS-211-07).

2.1. Research Questions to Inform Protocols

To determine the evidence required to inform the development of clinical nursing protocols for the assessment, triage, and management of cancer patients experiencing treatment-related symptoms, we first identified five key questions (1) How are symptoms defined? (2) What criteria are used to assess the symptom? (3) How can a patient be risk stratified (e.g., high risk versus low risk of negative outcome) based on the symptom assessment findings? (4) How should patients’ symptoms be managed (e.g., education in self-care and referral for consultation of other health professionals)? (5) What followup is required for ongoing symptom monitoring?

2.2. Search Strategy

The search strategy was designed in collaboration with a health sciences librarian (AR-W). Inclusion and exclusion criteria were defined using the PIPOH (Population, Intervention, Professionals/Patients, Outcomes, Health Care Setting) framework [26]. Based on a series of exploratory searches conducted in 2007 in Ovid interface to identify guidelines and systematic reviews in the databases Medline, Embase, CINAHL, and Psychinfo, the PIPOH criteria were refined (see Table 1). For example, searching for guidelines explicitly about telehealth practice was too limiting therefore the inclusion criteria were expanded to include any guideline about symptom management related to cancer care. The final search of each electronic database was conducted in July 2008 and was limited to the previous 5 years, from 2003 to 2008 (see Table 2). Using the key terms developed for the electronic searches, grey literature searches were conducted on websites known or suspected to have practice guidelines related to cancer care and known guideline clearinghouse websites. As citations were identified in the various searches, they were placed into a RefWorks database and duplicates were removed. To ensure currency of selected guidelines, the primary author of each guideline was contacted and asked the following: (a) has there been any more recent version and/or plans to update the guideline? and (b) are you aware of any new evidence that might affect the guideline recommendations?


PopulationAdults with cancer on chemotherapy, hormone therapy, and/or radiation therapySurgery alone
Intervention(s)Any cancer-treatment-related symptom intervention to assess, rate severity, or manage
Professionals targetedNurses and other health professionals working in oncology services
OutcomesAppropriate referrals for medical consultation, safe management of symptoms, patients guided in self-care
Healthcare settingTelephone or email to patients at home receiving services through ambulatory oncology program
MethodologyClinical practice guideline or systematic review
LanguageEnglish or FrenchOther languages
Publication dates2002 or laterPrior to 2002

Database Limits Strategy neutropeniaStrategy for diarrhea

Ovid MEDLINE(R) (1996 to July week 1 2008) 2003–2008
(1) exp. neoplasms/(811201)
(2) Neutropenia/(6657)
(3) Febrile neutropenia.ab,ti. (2107)
(4) 1 and 2 or 3 (4892)
(5) Limit 4 to humans and year = “2003–2008” and english or french and guideline or practice guideline (6)
(1) exp. neoplasms/(811201)
(2) exp. diarrhea/(11983)
(3) Diarrhea$.ab,ti. (18069)
(4) Diarrhoea$.ab,ti. (7932)
(5) 1 and 2 or 3 or 4 (4866)
(6) Limit 4 to humans and year = “2003–2008” and english or french and guideline or practice guideline (5)

EMBASE (1996 to 2008 week 28) 2003–2008
(1) exp. neoplasm/(877949)
(2) Febrile neutropenia/(6834)
(3) Febrile neutropenia.ab,ti. (2188)
(4) 1 and 2 or 3 (6474)
(5) exp * practice guideline/(9361)
(6) 4 and 5 (14)
(7) limit 6 to human and year = “2003–2008” and english or french (12)
(1) exp. neoplasm/(876520)
(2) exp. diarrhea/(57553)
(3) Diarrhea$.ab,ti. (17055)
(4) Diarrhoea$.ab,ti. (7543)
(5) 1 and 2 or 3 or 4 (18526)
(6) exp * practice guideline/(9335)
(7) 5 and 6 (18)
(8) Limit 7 to human and year = “2003–2008” and english or french (17)

CINAHL—cumulative index to nursing and allied health literature
(1982 to July week 1 2008)
(1) exp. neoplasms/(89596)
(2) Neutropenia/(816)
(3) Febrile neutropenia.ab,ti. (206)
(4) 1 and (2 or 3) (399)
(5) Limit 4 to year = “2003–2008” and english or french and practice
guidelines (7)
(1) exp. neoplasms/(89596)
(2) Diarrhea/(2449)
(3) Diarrhea$.ab,ti. (2165)
(4) Diarrhoea$.ab,ti. (705)
(5) 1 and 2 or 3 or 4 (475)
(6) Limit 5 to year = “2003–2008” and english or french and practice
guidelines (0)

(2000 to July week 1 2008)
(1) exp. neoplasms/(10572)
(2) Febrile neutropenia.ab,ti. (4)
(3) 1 and 2 (0)
(1) exp. neoplasms/(10572)
(2) Diarrhea/(147)
(3) Diarrhea$.mp. (674)
(4) Diarrhoea$.mp. (137)
(5) 2 or 3 or 4 (768)
(6) 1 and 5 (34)
(7) treatment guidelines/(1947)
(8) 6 and 7 (0)

2.3. Screening

Citations were screened for eligibility by two independent reviewers using a three-stage process: titles only, title plus abstract, and full-text screening. Levels one and two were completed by GM and DS to judge the citation as include, exclude, or unsure. All citations rated as include or unsure by at least one reviewer were advanced to the next level. Full text documents were screened for eligibility (GM, DS) and discrepancies were resolved by consensus with the health sciences librarian.

2.4. Appraisal of Methodological Quality

Each included guideline was appraised by four independent raters using the AGREE Instrument (Appraisal of Guidelines for Research and Evaluation) (DS, GM, MC, DC, KC, BS, DB, ML, AB). The AGREE Instrument has proven reliability and validity for assessing the quality of clinical practice guidelines [27]. AGREE ratings were entered into a spreadsheet. AGREE scores were calculated for each of the five AGREE domains and the overall recommendation, then standardized out of 100. AMSTAR was used to appraise the quality of the systematic reviews by two independent raters [28]. AMSTAR scores had a total possible score of 22 given that there were 11 questions and two appraisers. AMSTAR ratings were entered into a spreadsheet and scores tabulated.

2.5. Data Extraction

Following appraisal of identified guidelines and systematic reviews for quality, data was extracted independently by two team members and included: title, publication year, currency survey results, quality appraisal scores, overall recommendation, strengths, limitations, related algorithms/tools, and evidence to answer research questions with level of evidence. A recommendations matrix was populated with the extracted data to allow for comparison across citations [9].

2.6. Iterative Protocol Development

We convened a pan-Canadian panel of 24 stakeholders with a range of expertise in oncology nursing, knowledge translation, CAN-IMPLEMENT© methodology, library sciences, health services research, and electronic systems tools from eight Canadian provinces. Participants were involved in (a) reviewing findings from the systematic literature search, screen, and quality appraisal; (b) reaching consensus on symptom-specific recommendations to include in the protocol; (c) providing iterative feedback as the protocols were developed (via email and in face-to-face meetings). In pairs, participants engaged in role play with the protocols in order to further evaluate their usability and were asked to provide oral feedback during the meeting. A meeting evaluation feedback questionnaire given to participants consisted of eight multiple choice and two open end response type questions pertaining to evaluation of the meeting (i.e., objective met, information presented, and enough time) and evaluation of the protocols. Specifically, participants were asked whether the protocols provided an accurate reflection of the current scientific knowledge and whether they were willing to use them in practice.

2.7. Methods to Evaluate the Symptom Protocol

Preliminary acceptability and usability testing of the protocols was conducted with oncology nurses from across Canada using a brief survey tool. The tool asked nurses to rate the protocol(s) based on their perceived ease of use, amount of information provided, use of appropriate terms, likelihood to fit with clinical work flow, helpfulness of the various elements provided (e.g., assessment criteria, severity rating and self-care strategies), and provided space for general comments. The questions were taken from previous surveys used for implementing knowledge tools in clinical practice [29, 30]. The survey consisted of eight questions including seven multiple choice and one likert scale plus three open ended responses for information to be added or removed, general comments, and suggestions for improvement. The survey was self-reported. Both quantitative and qualitative findings were entered into a spreadsheet and reported descriptively.

3. Results

3.1. Systematic Review

A total of 412 citations were identified for two cancer-treatment-related symptoms of diarrhea and fever with neutropenia (see Figure 1). After removing duplicates and narrowing the search parameters to guidelines and systematic reviews, we identified 93 citations. Grey literature searches identified six guidelines from cancer or cancer-related organizations. Of 93 citations, 74 were excluded based on title review, 10 were removed after full-text review (e.g., irrelevant, primary study, editorial), and 13 were included. Examples of why citations were identified as irrelevant include beyond the scope of nursing practice (i.e., prescribing medication), about prevention as opposed to assessment, triage and management, or did not pertain to the target population (i.e., endoscopy patients, chronic diarrhea). The 13 citations included 8 focused on diarrhea (6 guidelines and 2 systematic reviews), 4 febrile neutropenia (4 guidelines only), and 1 guideline including both symptoms.

Diarrhea guidelines were found in peer-reviewed publications ( ) [3133], British Columbia Cancer Agency ( ) [34, 35], the Oncology Nursing Society ( ) [36], and Cancer Care Ontario ( ) [37] (Table 3). Both systematic reviews of diarrhea management were from the Cochrane Library (selenium for alleviating treatment side effects) [38]; and Chinese medical herbs for chemotherapy side effects in colorectal cancer patients [39]. The febrile neutropenia guidelines were found in national organizations ( ) [40, 41], peer-reviewed publications ( ) [42, 43], and Cancer Care Ontario ( ) [37] (Table 4).

Author (Year)CountryDefines symptomCriteria to assess symptomRisk stratificationSelf-care to manage symptomFollowup for ongoing monitoringOther recommendations in guidelineRigour score (raters would recommend)

Major et al. (2004) [31]CanadaLimitedNCI-CTC grade
0 to 4
OTC medicationsReassess within 24 hoursUse of prescribed medication86 (4/4)
Rubenstein et al./Keefe et al. (2004/2007) [32, 44]USA; AustraliaLimitedNCI-CTC grade
0 to 4
OTC medicationsUse of prescribed medication82 (4/4)
Benson et al. (2004) [33]USA Uncomplicated versus complicatedDietary and OTC medicationsReassess within 24 hoursUse of prescribed medications73 (4/4)
ONS-PEP (2008) [36]USA Similar to complicated aboveDietary and OTC medicationsUse of prescribed medications48 (4/4)
BC Cancer Agency (2004) [34]CanadaLimitedNCI-CTC grade 0 to 4Dietary and OTC medicationsReassess within 24 hoursUse of prescribed medications17 (2/4)
BC Cancer Agency (2008) [35]Canada Nonurgent, urgent, emergentDietary and OTC medicationsReassess within 24 hoursUse of prescribed medications 14 (2/4)
Cancer Care Ontario (2004) [37]Canada Nonurgent, urgent, emergentDietary8 (2/4)

: present in the guideline; —: none; OTC: over the counter; NCI-CTC: National Cancer Institute Common Terminology Criteria.

Author (year)CountryDefines symptomCriteria to assess symptomRisk stratificationSelf-care to manage symptomFollowup for ongoing monitoringOther recommendations in guidelineRigour score
(raters would recommend)

Hughes et al. (2002) [41]USA ≥38.3°C or ≥38°C for 1 hour and <500 cell/mm3 or <1000 cell/mm3 and expected to dropSee scoring index on Table 4 of Hughes et al. (2002) [41]Scoring index on Table 4 of the paper for MASCC risk indexUse of prescribed medications62 (4/4)
NCCN (2008) [40]USARefers to Hughes
et al. [41]
Temperature, neutrophil countMASCC risk indexUse of prescribed medications48 (2/4)
Mendes et al. (2007) [43]BrazilRefers to Hughes
et al. [41]
Temperature, neutrophil count, sepsesInfectious diseases working group, German Society of Haematology and OncologyReassess in 12 to 24 hours if neutropenia onlyUse of prescribed medications33 (4/4)
Cancer Care Ontario (2004) [37]Canada≥38°CMany items (temperature, chills, other symptoms, etc.)Nonurgent, urgent, emergentMonitor temperature; minimize infection riskTake temperature every 2–4 hours23 (2/4)
Gaillet (2007) [42]FranceExcluded due to low quality score; no data extracted14 (0/4)

—: none; NCCN: National Comprehensive Cancer Network; MASCC: Multinational Association for Supportive Care in Cancer.

In February 2009, the currency survey checking for updated evidence about diarrhea was completed by all the seven guideline developers and both systematic review authors. Only one guideline [32] had been updated and the new guideline was added [44]. The currency survey for fever with neutropenia was completed in February 2009 by one of the three guideline authors and no guidelines had been updated.

3.2. Quality of Evidence

For clinical practice guidelines relevant to diarrhea ( ), AGREE domains were rated higher for clarity of presentation (median 77; range 65 to 94), guideline purpose (68; 31 to 83), and rigour of development (60; 8 to 86) (see Figure 2). There were lower ratings for editorial independence (38; 4 to 92), stakeholder involvement (31; 10 to 65), and applicability (25; 8 to 36). Four of the guidelines which were recommended by all four raters to inform the development of the protocols also had the highest rigour scores. The remaining guidelines with lower rigour scores were each recommended by two of four raters. Raters indicated that these documents of lower methodological quality may still be useful for informing the presentation of the protocols as opposed to contribution of evidence. The two systematic reviews both scored highly in terms of methodological quality (AMSTAR ratings of 19/22 (86.4%)) but reviewers agreed neither should to be used to inform the development of the protocols given their content did not answer any of the research questions.

For clinical practice guidelines relevant to fever with neutropenia ( ), one guideline was not recommended by any raters and was removed from the analysis. For the remaining clinical practice guidelines relevant to fever with neutropenia ( ), AGREE domains were rated higher for scope and purpose (median 84.7; range 61 to 92) and clarity of presentation (78.1; 54 to 90) (see Figure 3). There were lower ratings for stakeholder involvement (40.6; 10 to 48), rigour of development (40.5; 23 to 62), applicability (22.2; 17 to 61), and editorial independence (16.7; 8 to 79). All four raters recommended two of the guidelines while the other two guidelines were recommended by two of four raters.

3.3. Iterative Protocol Development

In March 2009, a group of 14 experts from the research team (AR-W, BS, CT, CK, DC, DS, EG, GM, KC, MH, MC, MS, RS, JV) and two local oncology nurses (MR, JR) convened in Ottawa, Ontario, and reached consensus on the recommendations for symptom-specific protocols based on the current evidence and the protocol format after a review of existing symptom protocols identified in oncology, palliative care, and primary care. The protocol template has five recommendations for the nurse to (a) assess symptom severity, (b) triage patient for symptom management based on highest severity; (c) review medications being used for the symptom, (d) review self-management strategies (presented using motivational interviewing techniques [45]), and (e) summarize and document the plan agreed upon with the patient. For each recommendation, there are questions and prompts for the nurse to explore the symptom experience with the patient (  example protocol). The resulting protocol was focused specifically on the symptom and could be combined with general assessment information collected on all patients. The meeting evaluation feedback questionnaire completed by 11 of 16 participants revealed that all participants thought the final symptom protocols would be an accurate reflection of the current scientific knowledge and for those whom it was relevant ( ) they would be willing to test the protocols in clinical practice. After trying the protocols in role play exercises, they were revised using plain language to facilitate communication between nurses using the protocol(s) and patients. It was apparent that the protocols required training in their use particularly given that few rated the protocols as self-evidence to use. A set of principles were finalized for creating the symptom protocol template (see Table 5).

(1) Evidence-based using evidence from appraised clinical practice guidelines
(2) Template should meet the criteria for being a guideline (AGREE II-rigour)
 (i) Systematic methods used to search for evidence
 (ii) Clear criteria for selecting the evidence (e.g. quality appraised guidelines)
 (iii) Methods for formulating the recommendations are described
 (iv) Health-related benefits, side effects and risks have been considered
 (v) Explicit link between recommendations and the supporting evidence
 (vi) Reviewed by experts prior to publication
(3) Usable in practice beyond resource on the shelf
(4) Be able to be integrated into the electronic health record and clinical practice (e.g., uses Edmonton Symptom Assessment System question that is frequently used to screen for symptoms)
(5) Plain language to enhance patients’ health literacy
(6) If assessment criteria and triage for severity is vague or absent from guidelines, use the National Cancer Institute Common Terminology Criteria for Adverse Events.
(7) Ensure consistency across guidelines (e.g., if blood in vomit listed as severe in the diarrhea guidelines, then it should also be severe on the bleeding guideline)

3.4. Evaluation of the Symptom Protocol for Acceptability and Usablity

Preliminary feedback to establish the protocol’s acceptability and usability was obtained from 12 oncology nurses. Nurses rated the amount of information as just right (10 nurses), too much (1), or no answer (1). When asked if terms were appropriate, 10 agreed, 1 disagreed, and 1 gaveno answer. All 12 nurses indicated the font type, size, and icons made readability good. When asked if using the protocol would be self-evident, 5 agreed, 7 disagreed with areas requiring more guidance being the assessment ( ), documentation ( ), and triage ( ). Nurses were divided on rating the amount of space for entering data (6 enough, 4 not enough, and 2 no answer). When asked if the protocol would fit with clinical work flow, 8 agreed, 1 disagreed, and 3 did not answer the question. Nurses rated the patient self-management strategies the highest for usefulness of information followed by review of medications, triage of severity, and documenting. Suggestions to improve the protocols that were subsequently acted upon were explaining levels of evidence (changed level of evidence to type of evidence), interpreting assessment, adding more information (e.g., if symptom worsens in triage section; in self-care, discuss medications with physician or pharmacist), and using more plain language (e.g., provide medication trade and generic names; change decreased performance status to interfering with activities of daily living). Suggestions to improve the protocols that were not specifically acted upon were the need for protocols that incorporate more than one symptom and adding space to document emotional support. An open space was added for additional comments and could be used to document related emotional issues. General feedback included clear, user-friendly, comprehensive assessment, very thorough yet concise, offers direction without needing to seek more information, and excellent self-care strategies. Nurses liked the tick boxes that could save time from excessive charting, the ease of tool completion while talking, and clear differentiation between mild, moderate, and severe symptoms. Others appreciated the way the protocols linked the evidence for use in practice. Unresolved issues were the need to provide training on how to use the protocols in clinical practice, having electronic applications, and the potential for local adaptation given the different types of resources available across the various ambulatory oncology programs in Canada (e.g., hours of service and ability to link to physicians).

4. Discussion

The CAN-IMPLEMENT© methodology [25] provided a solid framework and systematic approach for the development of a template for cancer-treatment-related symptom protocols for use by nurses over the telephone. This framework was chosen because of its focus on adapting current guidelines. As stated in CAN-IMPLEMENT©, one group may select one specific, relevant, and high quality guideline for adaptation to their local context; another may identify relevant segments of several high quality guidelines to customize the information to meet their needs. It was impossible to choose a single guideline and therefore our protocol was based on the latter. Interestingly, the systematic reviews were inadequate for informing the protocols due to their narrow scope. Factors which strengthened this project were the systematic and rigorous methods used to search and screen available guidelines, the ability to see consistencies across guidelines via a recommendations matrix, being able to use information from multiple guidelines starting with those with the highest quality appraisal ratings, a transparent and reproducible process for the evidence used to inform the protocol, and a thorough approach to document the symptom experience.

Although clinical practice guidelines are described as knowledge translation tools [46], they are not readily useable in clinical nursing practice for oncology symptom management. In fact, they are often not integrated into clinical practice for any clinical setting or discipline. We were then challenged to determine a way for translating evidence into a new type of knowledge tool that was sensitive to how nurses think and what type of care they provide in clinical practice. While developing the new protocol template, our intention was to address the necessary elements to meet the criteria specified by the Rigour of Development domain of the AGREE Instrument. Specifically, this relates to being transparent about the process used to search, screen, and synthesize the evidence and the methods used to inform the recommendations [47]. The end result is a user friendly protocol that translates evidence from clinical practice guidelines for use in clinical practice.

Feedback from various stakeholders during the iterative development of the protocols clearly indicate, the need for training. Our findings are consistent with nursing professional practice teletriage guidelines that require training in teletriage [20, 21] and with findings from systematic reviews of effective interventions for implementing evidence into clinical practice [48]. A review of 81 randomized trials found that educational meetings improve patient care by 6.0% (range ±1.8% to 15.3%) with higher effects observed when health professionals attended the training and more interactive learning activities were used [48]. The only other intervention that showed higher improvements in patient care was having a local opinion leader (12% improvement; range 6.0 to 14.5%). One qualitative study of nurses’ experiences providing telephone followup after treatment highlighted the need to further develop nurses’ skills, including communication skills to be able to provide this type of intervention [17]. Therefore, training in how to use these new protocols will be important to ensure they are being used the way they were intended and to help users understand those sections that were identified as being less intuitive.

To develop the protocol template, we specifically chose to narrow the target audience to oncology nurses providing telephone-based services for patient initiated calls and avoided aiming to develop a protocol that would be relevant to all oncology service providers. However, the protocol is likely relevant for nurses providing face-to-face patient care as well, and in particular for nurses visiting patients in their homes. Further research is needed to evaluate their acceptability, usability, and relevance to nursing practice across different oncology settings (i.e., hospital, clinic, and home care), and not limiting to telephone-based services. Two main limitations were the variable methodological quality of included guidelines and the minimal amount of information that could be used from any one higher quality guideline.There were variable quality ratings for the included guidelines and including guidelines of lower quality may result in the protocols recommending less evidence-based actions. Although we included findings from lower quality guidelines, we did so to indicate consistency across guidelines, with a goal of being transparent about how the information was used (e.g., referencing guidelines within the protocol and providing their rigour ratings based on the AGREE assessment in the reference list). For example, if a specific recommendation was present in a lower quality guideline and higher quality guideline, both documents were cited in order to show consistency across the source documents. Finally, lower quality guidelines were considered useful primarily for formatting and presentation of information within the protocol. Another potential limitation was only including guidelines rather than searching for individual studies. The main reason for doing so was to use a synthesis of evidence that has the potential of increasing the stability of the findings [49]. About half of the included guidelines (those with higher rigour scores) were based on a synthesis of primary articles to inform their recommendations. Given these findings had already been synthesized into a quality guideline it would have been redundant to consult these primary studies to inform the development of the protocol.

5. Conclusions

Guided by the CAN-IMPLEMENT© methodology, we developed and evaluated a template for creating clinical nursing symptom protocols to use with patients experiencing symptoms while receiving cancer treatments. This new protocol template which puts evidence into an actionable format is a considerable advancement to the CAN-IMPLEMENT© for point-of-care use of evidence. New protocols created in this initiative provide an evidence-informed and user friendly approach for nurses to systematically assess, triage, document, and if appropriate guide patients in managing their symptoms at home. Furthermore, these types of clinical protocols are consistent with Accreditation Canada’s requirements for enhancing safe practices within organizations [35]. However, training on how to use the protocols is important to ensure they are used properly and safely. The process of translating evidence from guidelines into practice-ready symptom protocols is relevant for other cancer symptoms and could be considered for other patient populations. Subsequent application and evaluation of the process by other groups will be important to advance greater uptake of evidence into practice. More specifically, there is a need to consider protocols that apply a symptom cluster approach inclusive of emotional symptoms that could facilitate symptom management beyond a single symptom approach. Finally, there is a need to evaluate their impact on nursing, patient, and organizational outcomes.


This project, a part of a larger Canadian Guideline Adaptation study, was funded by the Canadian Partnership Against Cancer Corporation 2008–2011. The authors would like to acknowledge the contributions of many oncology nurses who helped them critically consider the presentation of evidence and usability of the protocols. They appreciate the help of Melany Leonard and Astride Bazile at McGill University Health Centre who assisted with the AGREE appraisal of included guidelines and Mychele Rheaume and Joanne Ready from the Ottawa Hospital for participation in the discussions at the face-to-face meeting. The Pan-Canadian Oncology Symptom Triage and Remote Support (COSTaRS) Group who assisted in the development and approval of the manuscript includes Dawn Stacey, Debra Bakker, Meg Carley, Kim Chapman, Dauna Crooks, Greta Cummings, Esther Green, Margaret Harrison, Doris Howell, Craig Kuziemsky, Gail Macartney, Katie Nichol, Brenda Sabo, Myriam Skrutkowski, Ann Syme, Carolyn Tayler, Tracy Truant, Val Angus, Janice McVeety, Amanda Ross-White, and Joan van den Hoek.


  1. D. H. Henry, H. N. Viswanathan, E. P. Elkin, S. Traina, S. Wade, and D. Cella, “Symptoms and treatment burden associated with cancer treatment: results from a cross-sectional national survey in the US,” Supportive Care in Cancer, vol. 16, no. 7, pp. 791–801, 2008. View at: Publisher Site | Google Scholar
  2. L. Barbera, H. Seow, D. Howell et al., “Symptom burden and performance status in a population-based cohort of ambulatory cancer patients,” Cancer, vol. 116, no. 24, pp. 5767–5776, 2010. View at: Publisher Site | Google Scholar
  3. D. Behl, A. W. Hendrickson, and T. J. Moynihan, “Oncologic emergencies,” Critical Care Clinics, vol. 26, no. 1, pp. 181–205, 2010. View at: Publisher Site | Google Scholar
  4. R. Wilson and J. Hubert, “Resurfacing the care in nursing by telephone: lessons from ambulatory oncology,” Nursing Outlook, vol. 50, no. 4, pp. 160–164, 2002. View at: Publisher Site | Google Scholar
  5. J. Reid and S. Porter, “Utility, caller, and patient profile of a novel chemotherapy telephone helpline service within a regional cancer centre in Northern Ireland,” Cancer Nursing, vol. 34, no. 3, pp. E27–E32, 2011. View at: Publisher Site | Google Scholar
  6. G. Macartney, D. Stacey, M. Carley, and M. B. Harrison, “Priorities, barriers and facilitators for remote telephone support of cancer symptoms: a survey of Canadian oncology nurses,” Canadian Oncology Nursing Journal, vol. 22, no. 4, pp. 135–247, 2012. View at: Google Scholar
  7. D. Stacey, D. Bakker, E. Green, M. Zanchetta, and M. Conlon, “Ambulatory oncology nursing telephone services: a provincial survey,” Canadian Oncology Nursing Journal, vol. 17, pp. 1–5, 2007. View at: Google Scholar
  8. K. Beaver, D. Tysver-Robinson, M. Campbell et al., “Comparing hospital and telephone follow-up after treatment for breast cancer: randomised equivalence trial,” BMJ, vol. 338, Article ID a3147, 2009. View at: Publisher Site | Google Scholar
  9. K. Beaver, M. Campbell, S. Williamson et al., “An exploratory randomized controlled trial comparing telephone and hospital follow-up after treatment for colorectal cancer,” Colorectal Disease, vol. 14, pp. 1201–1209, 2012. View at: Google Scholar
  10. K. Beaver, S. Latif, S. Williamson et al., “An exploratory study of the follow-up care needs of patients treated for colorectal cancer,” Journal of Clinical Nursing, vol. 19, pp. 3291–3300, 2010. View at: Google Scholar
  11. K. Beaver, M. Twomey, G. Witham, S. Foy, and K. A. Luker, “Meeting the information needs of women with breast cancer: piloting a nurse-led intervention,” European Journal of Oncology Nursing, vol. 10, no. 5, pp. 378–390, 2006. View at: Publisher Site | Google Scholar
  12. G. Knowles, L. Sherwood, M. G. Dunlop et al., “Developing and piloting a nurse-led model of follow-up in the multidisciplinary management of colorectal cancer,” European Journal of Oncology Nursing, vol. 11, no. 3, pp. 212–223, 2007. View at: Publisher Site | Google Scholar
  13. S. Moore, J. Corner, J. Haviland et al., “Nurse led follow up and conventional medical follow up in management of patients with lung cancer: randomised trial,” British Medical Journal, vol. 325, no. 7373, pp. 1145–1147, 2002. View at: Google Scholar
  14. M. Wells, P. T. Donnan, L. Sharp, C. Ackland, J. Fletcher, and J. A. Dewar, “A study to evaluate nurse-led on-treatment review for patients undergoing radiotherapy for head and neck cancer,” Journal of Clinical Nursing, vol. 17, no. 11, pp. 1428–1439, 2008. View at: Publisher Site | Google Scholar
  15. K. Cox and E. Wilson, “Follow-up for people with cancer: nurse-led services and telephone interventions,” Journal of Advanced Nursing, vol. 43, no. 1, pp. 51–61, 2003. View at: Publisher Site | Google Scholar
  16. M. Leahy, M. Krishnasamy, A. Herschtal, M. Bressel, T. Dryden, K. H. Tai et al., “Satisfaction with nurse-led telephone follow up for low to intermediate risk prostate cancer patients treated with radical radiotherapy. A comparative study,” European Journal of Oncology Nursing. In press. View at: Google Scholar
  17. K. Beaver, S. Williamson, and K. Chalmers, “Telephone follow-up after treatment for breast cancer: views and experiences of patients and specialist breast care nurses,” Journal of Clinical Nursing, vol. 19, no. 19-20, pp. 2916–2924, 2010. View at: Publisher Site | Google Scholar
  18. K. Beaver, C. Wilson, D. Procter et al., “Colorectal cancer follow-up: patient satisfaction and amenability to telephone after care,” European Journal of Oncology Nursing, vol. 15, pp. 23–30, 2011. View at: Google Scholar
  19. M. L. Kimman, M. M. F. Bloebaum, C. D. Dirksen, R. M. A. Houben, P. Lambin, and L. J. Boersma, “Patient satisfaction with nurse-led telephone follow-up after curative treatment for breast cancer,” BMC Cancer, vol. 10, article 174, 2010. View at: Publisher Site | Google Scholar
  20. Canadian Nurses Association, Telehealth: The Role of the Nurse, Canadian Nurses Association, Ottawa, Canada, 2007.
  21. College of Nurses of Ontario, TelePractice: A Practice Guideline, College of Nurses of Ontario, Toronto, Ontario, 2009.
  22. M. Brouwers, D. Stacey, and A. O'Connor, “Knowledge creation: synthesis, tools and products,” CMAJ, vol. 182, no. 2, pp. E68–E72, 2010. View at: Publisher Site | Google Scholar
  23. A. R. Gagliardi, M. C. Brouwers, V. A. Palda, L. Lemieux-Charles, and J. M. Grimshaw, “How can we improve guideline use? A conceptual framework of implementability,” Implementation Science, vol. 6, no. 1, article 26, 2011. View at: Publisher Site | Google Scholar
  24. I. D. Graham, J. Logan, M. B. Harrison et al., “Lost in knowledge translation: time for a map?” Journal of Continuing Education in the Health Professions, vol. 26, no. 1, pp. 13–24, 2006. View at: Publisher Site | Google Scholar
  25. M. B. Harrison, J. van den Hoek, and for the Canadian Guideline Adaptation Study Group, CAN-IMPLEMENT(C): A Guideline Adaptation and Implementation Planning Resource, Queen's University School of Nursing and Canadian Parternship Against Cancer, Ontario, Canada, 2012.
  26. B. Fervers, J. S. Burgers, M. C. Haugh et al., “Adaptation of clinical guidelines: literature review and proposition for a framework and procedure,” International Journal for Quality in Health Care, vol. 18, no. 3, pp. 167–176, 2006. View at: Publisher Site | Google Scholar
  27. The AGREE Collaboration, Appraisal of Guidelines for Research & Evaluation (AGREE) Instrument, 2011,
  28. B. J. Shea, L. M. Bouter, J. Peterson et al., “External validation of a measurement tool to assess systematic reviews (AMSTAR),” PLoS ONE, vol. 2, no. 12, Article ID e1350, 2007. View at: Publisher Site | Google Scholar
  29. M. J. Barry, F. J. Fowler, A. G. Mulley, J. V. Henderson, and J. E. Wennberg, “Patient reactions to a program designed to facilitate patient participation in treatment decisions for benign prostatic hyperplasia,” Medical Care, vol. 33, no. 8, pp. 771–782, 1995. View at: Google Scholar
  30. D. Stacey, S. K. Chambers, M. J. Jacobsen, and J. Dunn, “Overcoming barriers to cancer-helpline professionals providing decision support for callers: an implementation study,” Oncology Nursing Forum, vol. 35, no. 6, pp. 961–969, 2008. View at: Publisher Site | Google Scholar
  31. P. Major, A. Figueredo, V. Tandan, V. Bramwell, M. Charette, T. Oliver et al., “The role of octreotide in the management of patients with cancer. Practice guideline report #12-7. Cancer Care Ontario,” 2004, View at: Google Scholar
  32. E. B. Rubenstein, D. E. Peterson, M. Schubert et al., “Clinical practice guidelines for the prevention and treatment of cancer therapy-induced oral and gastrointestinal mucositis,” Cancer, vol. 100, no. 9, pp. 2026–2046, 2004. View at: Google Scholar
  33. A. B. Benson, J. A. Ajani, R. B. Catalano et al., “Recommended guidelines for the treatment of cancer treatment-induced diarrhea,” Journal of Clinical Oncology, vol. 22, no. 14, pp. 2918–2926, 2004. View at: Publisher Site | Google Scholar
  34. BC Cancer Agency. BCCA Guidelines for Management of Chemotherapy-Induced Diarrhea, 2004,
  35. V. Buduhan, R. Cashman, E. Cooper, K. Levy, and A. Syme, Professional practice nursing standards—symptom management guidelines: cancer related diarrhea, BC Cancer Agency, 2010,
  36. Oncology Nursing Society: putting evidence into practice: what interventions are effective in preventing and treating diarrhea in adults with cancer receiving chemotherapy or radiation therapy? 2008.
  37. Cancer Care Ontario Nursing Professional Advisory Committee: telephone nursing practice and symptom management guidelines, 2004,
  38. G. Dennert and M. Horneber, “Selenium for alleviating the side effects of chemotherapy, radiotherapy and surgery in cancer patients,” Cochrane Database of Systematic Reviews, vol. 3, Article ID CD005037, 2006. View at: Google Scholar
  39. W. Taixiang, A. J. Munro, and L. Guanjian, “Chinese medical herbs for chemotherapy side effects in colorectal cancer patients,” Cochrane Database of Systematic Reviews, no. 1, Article ID CD004540, 2005. View at: Google Scholar
  40. National Comprehensive Cancer Network: prevention and treatment of cancer-related infections, 2008.
  41. W. T. Hughes, D. Armstrong, G. P. Bodey et al., “2002 Guidelines for the use of antimicrobial agents in neutropenic patients with cancer,” Clinical Infectious Diseases, vol. 34, no. 6, pp. 730–751, 2002. View at: Publisher Site | Google Scholar
  42. H. Gaillet, Neutropénie Fébrile Post Chimiothérapie—Ambulatoire, 2007.
  43. A. V. A. Mendes, R. Sapolnik, and N. Mendonça, “New guidelines for the clinical management of febrile neutropenia and sepsis in pediatric oncology patients,” Jornal de Pediatria, vol. 83, no. 2, pp. S54–S63, 2007. View at: Publisher Site | Google Scholar
  44. D. M. Keefe, M. M. Schubert, L. S. Elting et al., “Updated clinical practice guidelines for the prevention and treatment of mucositis,” Cancer, vol. 109, no. 5, pp. 820–831, 2007. View at: Publisher Site | Google Scholar
  45. W. R. Miller and T. B. Moyers, “Eight stages in learning motivational interviewing,” Journal of Teaching in the Addictions, vol. 5, no. 1, pp. 3–17, 2007. View at: Publisher Site | Google Scholar
  46. M. Brouwers, D. Stacey, and A. O'Connor, “Knowledge translation tools: use of clinical practice guidelines and patient decision aids,” in The Science and Practice of Knowledge Translation, S. Straus, I. Graham, and J. Tetroe, Eds., 2008. View at: Google Scholar
  47. M. C. Brouwers, M. E. Kho, G. P. Browman et al., “Development of the AGREE II, part 2: assessment of validity of items and tools to support application,” CMAJ, vol. 182, no. 10, pp. E472–E478, 2010. View at: Publisher Site | Google Scholar
  48. J. M. Grimshaw, M. P. Eccles, J. N. Lavis, S. J. Hill, and J. E. Squires, “Knowledge translation of research findings,” Implementation Science, vol. 7, pp. 1–29, 2012. View at: Google Scholar
  49. G. H. Guyatt, A. D. Oxman, R. Kunz et al., “GRADE: going from evidence to recommendations,” BMJ, vol. 336, no. 7652, pp. 1049–1051, 2008. View at: Google Scholar

Copyright © 2013 Dawn Stacey et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

More related articles

 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly as possible. We will be providing unlimited waivers of publication charges for accepted research articles as well as case reports and case series related to COVID-19. Review articles are excluded from this waiver policy. Sign up here as a reviewer to help fast-track new submissions.