Nursing Research and Practice

Nursing Research and Practice / 2013 / Article
Special Issue

Dissemination and Implementation Research: Intersection between Nursing Science and Health Care Delivery

View this Special Issue

Research Article | Open Access

Volume 2013 |Article ID 909606 | 15 pages | https://doi.org/10.1155/2013/909606

Dissemination and Implementation Research Funded by the US National Institutes of Health, 2005–2012

Academic Editor: Deborah Vincent
Received29 Nov 2012
Accepted22 Jan 2013
Published27 Mar 2013

Abstract

Dissemination and implementation (D&I) research is a growing area of science focused on overcoming the science-practice gap by targeting the distribution of information and adoption of interventions to public health and clinical practice settings. This study examined D&I research projects funded under specific program announcements by the US National Institutes of Health (NIH) from 2005 to 2012. The authors described the projects’ D&I strategies, funding by NIH Institute, focus, characteristics of the principal investigators (PIs) and their organizations, and other aspects of study design and setting. Results showed 46 R01s, 6 R03s, and 24 R21s funded totaling $79.2 million. The top funders were the National Cancer Institute and the National Institute of Mental Health, together providing 61% of funding. The majority of PIs were affiliated with Schools of Medicine or large, nonprofit research organizations and think tanks. Only 4% of projects were to PIs with appointments at Schools of Nursing, with 7% of the funding. The most commonly funded projects across all of the studies focused on cancer control and screening, substance abuse prevention and treatment, and mental health services. Typically implemented in community and organizational settings, D&I research provides an excellent opportunity for team science, including nurse scientists and interdisciplinary collaborators.

1. Introduction

The existence of a gap between science and practice is universally recognized. Clinical research findings and clinical practice guidelines that have promise to improve health move very slowly from the research setting into clinical practice, and many of these interventions never reach those who could benefit. It is estimated that it takes an average of 17 years to translate 14% of original research into benefit for patients and an average of 9 years for interventions recommended as evidence-based practices to be fully adopted [1, 2].

Dissemination and implementation (D&I) research is a growing area of science focused on overcoming this science-practice gap. Research on dissemination addresses the targeted distribution or spread of information and interventions to specific public health and clinical practice settings. Implementation science is the study of methods to promote the integration of evidence and change practice patterns and health care policy within real-world public health and clinical service settings [3]. Using the language from models depicting the continuum of translational science from bench to practice and health impact, D&I research is often depicted as “T3” and “T4” science [4, 5].

Although the research enterprise has generated a rich supply of evidence-based interventions, programs, and services, knowledge about how to best disseminate and implement these evidence-based practices has not kept pace. Evidence is needed for how these interventions can be “scaled up,” what contextual factors and conditions are pivotal to successful adoption, and how to give added attention to issues of external validity, fidelity, and sustainability. D&I nurse researchers and practitioners are important players in advancing the goals of this science to improve patient and system outcomes [68].

Evidence does suggest that passive approaches to dissemination, such as the publication of consensus statements in professional journals, mass mailings, and untargeted presentations to heterogeneous groups, are ineffective strategies to achieve significant uptake and practice change [9, 10]. Targeted and active dissemination strategies, such as hands-on technical assistance, replication guides, point-of-decision prompts, and training workshops with hands-on experience, are more promising [11]. Implementation strategies have been described as either “top down” or “bottom up” and include a range of approaches, such as stakeholder relationship building and communication, continuous quality management, audit and feedback, service delivery practices and training, and local consensus building [12]. These D&I strategies are often directed at multiple levels and in different combinations of levels, including patient, provider, organizational, and policy. Features of organizations (e.g., hospitals, clinics, workplaces, and schools), such as organizational leadership and climate, managerial relations, and absorptive capacity, are increasingly seen as key intervention targets to facilitate D&I efforts [13].

Although D&I research in health is a relatively young science, advances in both the rigor and ambitiousness of studies over the past decade reflect robust growth in the field [14]. Many conceptual frameworks for guiding D&I research, such as the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) model [15], have been developed and are being tested. Common themes in these frameworks include a heavy emphasis on context, fidelity adaptation and quality of implementation, multilevel targets, and engagement of the target population in partnership research [16]. Research is also focused on developing and validating sound measures important for D&I research, such as measures for key organizational-level constructs [13]. In addition, comparative effectiveness studies of competing active D&I strategies are beginning to appear in the literature, including evaluation of cost [17]. Study designs best suited to answer questions in D&I research are also developing, including a focus on mixed-methods designs and system science approaches [18].

Federal funding for D&I research has traditionally been very small, particularly in relation to the funding available for discovery research. Although the portfolio of D&I research at the National Institutes of Health (NIH) is growing, funding for this science remains extremely small compared with the $30 billion each year that the NIH spends on basic and efficacy research [19]. In 2005, a trans-NIH committee (including the National Institute of Nursing Research [NINR]) issued the first of a set of multi-institute program announcements to stimulate research in this area. These program announcements have been continuously reissued over the past 8 years and include the Research Project Grant (R01) and Small Grant (R03 and R21) mechanisms. The purpose of this funding opportunity is to support innovative approaches to identifying, understanding, and overcoming barriers to the adaptation, adoption, and integration of evidence-based interventions and guidelines that previous research has shown to be efficacious and effective, but where uptake to date has been limited or significantly delayed [20].

A total of 76 D&I research projects have been funded by the NIH through these multi-institute program announcements from 2005 to 2012. Research findings from some of these NIH-funded projects have been presented at the NIH Annual Conference on the Science of Dissemination and Implementation and published in the literature. However, no summary of these funded projects examining the body of work in this research portfolio is available.

The purpose of this study was to examine the D&I research projects funded through these program announcements from 2005 to 2012 in terms of describing what has been funded by which NIH Institutes, the dollars invested, characteristics of the principal investigators (PIs) and their organizations, and an assessment of the focus of these projects, the D&I strategies employed, and other aspects of study design and setting. Although the studies funded through these Program Announcements Reviewed (PARs) do not include all the possible D&I-related research projects funded by NIH over this period, this study was confined to these projects because they represent outcomes of a sustained, multi-institute initiative to stimulate development of D&I science. This paper presents a description of these funded projects and suggests opportunities for nurse scientists in D&I research.

2. Methods

To accomplish the aims of this study, the abstracts from all projects funded by the NIH under the multi-institute “Dissemination and Implementation Research in Health” (PAR-06-039, PAR-06-520, PAR-06-521, PAR-07-086, PAR-10-038, PAR-10-039, and PAR-10-040) were accessed through the NIH Research Portfolio Online Reporting Tools (RePORT) [21]. Projects funded under an earlier program announcement specific to mental health (PAR-02-131, “Dissemination and Implementation Research in Mental Health”) were excluded from this review. The paper process is outlined in Figure 1.

The narrative abstracts for all 76 projects were independently examined by two reviewers to extract information on the following areas: funding institute, award amount, project topic, and characteristics of the PI and awardee organization. The 46 R01 projects were further independently examined by 3 reviewers for conceptual frameworks, D&I strategies, level of measurement, and study design and setting. In cases of discrepancies in recorded findings, an iterative process of abstract review was used until 100% agreement among the reviewers was reached. The small grant mechanisms (i.e., R03s and R21s) were excluded from the analysis of the R01s in this examination because the smaller projects were mainly needs assessments, small pilots, and instrument development studies and were generally not intervention research.

Summary tables and figures were constructed, using type of funding mechanism (R01, R03, R21) for initial categorization of abstracts. The quantitative results (e.g., frequencies and means) and qualitative results (e.g., project topic and D&I strategy) provided a foundation for drawing conclusions about the funded D&I research and discussing the implications for nursing research.

3. Results

3.1. Overview of the Projects

A total of 76 project abstracts were reviewed, representing 46 R01s, six R03s, and 24 R21s funded by the NIH, totaling $79.2 million during the 2005 to 2012 period (Table 1). Nine NIH Institutes and Centers funded these awards, with the National Cancer Institute (NCI) and the National Institute of Mental Health (NIMH) funding 58% of the total number of projects, which accounted for 61% of the total funding. The NINR awarded 6% of the projects: three R01s, one R03, and one R21, totaling $4.9 million. The NIH Fogarty International Center joined the program announcements in 2009 and funded several grants focused on global health. Figure 2 depicts the funding for the R01 awards, again, with the majority of the larger research project grants funded by the NCI and the NIMH.


InstituteMechanismFunds, $ (%)No. of awards (%)Average
award, $
% of total funding

R0124,408,597 (91)191,284,663
NCIR03213,000 (1) 2106,500
R212,096,157 (8)6349,360

Totals26,717,754 (100) 27 (36)34

NIMHR0119,090,897 (89)111,735,536
R212,353,747 (11)6392,291

Totals21,444,644 (100) 17 (22)27

R017,414,761 (77)41,853,690
NIDAR03177,913 (2)1177,913
R212,041,179 (21)5408,236

Totals9,633,853 (100)10 (13)12

NHLBIR019,450,356 (100) 5 (7)1,890,07112

NIAIDR012,093,169 (67)21,046,585
R211,035,998 (33)4259,000

Totals3,129,167 (100)6 (8)4

R014,431,873 (89)31,477,291
NINRR03166,404 (3)1166,404
R21391,916 (8)1391,916

Totals4,990,193 (100)5 (7)6

NIDCRR01935,330 (46)1935,330
R211,103,698 (54)2551,849

Totals2,039,028 (100)3 (4)3

NINDSR011,586,221 (100)1 (1)1,586,2212

FICR03221,775 (100)2 (3)110,8880.3

Total funding

R0169,411,204 (88)461,508,939
R03779,092 (1) 6129,849
R219,022,695 (11)24375,946

Total79,212,991 (100)76100

NCI: National Cancer Institute; NIMH: National Institute of Mental Health; NIDA: National Institute on Drug Abuse; NHLBI: National Heart, Lung, and Blood Institute; NIAID: National Institute of Allergy and Infectious Diseases; NINR: National Institute of Nursing Research; NIDCR: National Institute of Dental and Craniofacial Research; NINDS: National Institute of Neurological Disorders and Stroke; FIC: Fogarty International Center.

The majority of PIs for these funded projects were affiliated with Schools of Medicine and large, nonprofit research organizations and think tanks, such as Rand and Kaiser, and these institutions received 58% of the total funding (Table 2). Schools of Public Health accounted for about 18% and 19% of the PI affiliations and the total funding, respectively. Only about 4% of the funded projects were to PIs at Schools of Nursing, making up about 7% of the total funding. The universities and research organizations funded for these projects were more heavily clustered in the West and East coastal states and the East North Central states (Figure 3). The institutions in the West and East coastal states received about two thirds of the total funding for all of the projects.


PI affiliationR01R03R21No. of projects (%)Funds, $ (%)

School of Medicine213832 (42)29,066,546 (37)
Other research organizations (i.e., Rand, Kaiser, etc.)71412 (16)17,518,075 (22)
School of Public Health100414 (18) 14,846,637 (19)
School of Nursing3003 (4)5,869,637 (7)
School of Social Work2002 (3)4,915,825 (6)
College of Arts and Sciences2136 (8)3,308,268 (4)
Other university-based organizations0134 (5)1,385,087 (2)
College of Biomedical Engineering1001 (1)1,199,218 (2)
School of Dentistry0022 (3)1,103,698 (1)

Totals4662476 (100)79,212,991 (100)

The topic focus for the 76 projects funded over the past 8 years reflects a broad spectrum of areas, consistent with the missions of the sponsoring NIH Institutes and Centers. The projects included dissemination and implementation of evidence-based health behavior interventions and research-based guidelines, programs, and services for prevention, diagnosis, and clinical management in public health, clinical settings, and the public policy arena. As shown in Figure 4, the most commonly funded projects were cancer control and screening, substance abuse prevention and treatment, and mental health services.

Many of the projects involved scaling up interventions found to be effective in smaller trials or adapting an evidence-based intervention for implementation in a new setting. For example, one R01 project [22] studied the dissemination and implementation of an evidence-based weight-management program for veterans called MOVE! by scaling up this program to reach a broad population of veterans across the Veterans Affairs national network of medical centers and community clinics. Another R01 project [23] examined the impact of adapting and delivering an evidence-based organizational implementation strategy called Availability, Responsiveness, and Continuity (ARC), originally developed in Tennessee, on improving mental health services for youth in community-based agencies in a Midwest community.

3.2. A Focus on the R01 Projects

A more in-depth analysis of the R01 projects was conducted to better understand the intervention projects that move the science beyond the pilot phase. This analysis included an examination of the theories and frameworks, D&I strategies, levels of measurement, and study design and setting.

3.2.1. Theories and Frameworks

Among the 46 R01 projects, the range of orientation to a theory or model varied widely (Table 3). The majority of the R01-funded projects had no mention of a theoretical framework or guiding model ( ). Of the frameworks mentioned, the RE-AIM framework for evaluating interventions was most commonly utilized ( ), closely followed by Rogers’ Diffusion of Innovations model ( ) [24]. One study combined Rogers’ Diffusion of Innovations model and the RE-AIM framework ( ). Nine studies utilized frameworks that had specific relevance for their project, such as grants that proposed the use of behavioral interventions and had a related behavioral model supporting the intervention. For example, a project titled “Dissemination of a Theory-Based Bone Health Program in Online Communities” [25] utilized social cognitive theory in designing an online bone-health intervention targeting adults aged 50 years and older.


Rank (fewest to most)Theory or modelFrequency (%)

1Rogers’ Diffusion of Innovations + RE-AIM1 (2)
2Nonspecific reference to theory or model2 (4)
3Rogers’ Diffusion of Innovations (alone or in combination with another theory or model)5 (11)
4RE-AIM (alone or in combination with another theory or model)7 (15)
5Specific theoretical framework or model:9 (20)
 Cooperation Extension System 1
 Community Readiness Model 1
 Quality Assurance Model 2
 Self-Regulation Theory of Health Behavior1
 Collaborative Depression Core Model 1
 Cognitive Behavioral Theory 1
 Advanced Recovery Theory 1
 Program Change Model1
6No theory or model22 (48)

Re-Aim: Reach, Effectiveness, Adoption, Implementation, and Maintenance.
3.2.2. D&I Strategies

Of the 46 R01 projects, 29 had one D&I strategy and 15 had two D&I strategies, for a total of 59 D&I strategies used (Table 4). In two of the abstracts, the strategies were either unclear or were not stated. Examining the D&I strategies, a majority (78%) of studies utilized active dissemination approaches, whereas 10% used passive dissemination approaches, and the remaining 12% used an evaluative approach (i.e., evaluation of an existing program). Many studies utilized a combination of mixed active, passive, and/or evaluative strategies. The range of active approaches varied; for example, one study adapted patient navigation strategies to Chinese women in Chicago [26] in an intervention that modified tailored patient navigation to improve cancer screening rates in this low-income and underserved population. The dissemination approach proposed in this study incorporated patient navigators as providers of cancer control education and screening in active teaching roles within the Asian immigrant population and was categorized in our study as hands-on technical assistance and training, two active D&I strategies. An example of evaluation of dissemination was demonstrated in a study examining smoking cessation and knowledge integration with people who use tobacco control quitlines [27], in which participant social network analysis was conducted to provide insight about potential dissemination approaches in the future.


Strategy/subcategoryNo. (%)

Passive
 Publication of information, such as practice  guidelines6 (10)
Active
 Training (train the trainer, certificate training,
 and staff development workshop)
23 (39)
 Hands-on technical assistance8 (14)
 Websites and interpersonal channels (social
 networking)
5 (8)
 Replication guides3 (5)
 Phone calls4 (7)
 Social marketing2 (3)
 Point-of-decision prompts for use1 (2)
Evaluative
 Evaluation7 (12)

Total D&I strategies59 (100)

3.2.3. Levels of Measurement

These R01 projects used five levels of measurement in evaluating the intervention outcomes: policy level, patient level, provider level, organizational level, and multilevel outcome measures. Multilevel outcome measures involved different combinations of the other four levels, such as a combination of organizational and provider measures or an intervention study that measured both provider and patient outcomes. Multilevel outcome measures were the most common means of evaluation for these R01 projects (47%), whereas the most frequent individual outcome measure was at the organizational level (22%; see Figure 5).

One example of a research study using a multilevel outcomes methodology [28] involved a colorectal screening intervention replicated by a community health services agency for Asian American patients. Intervention outcomes were measured using a combination multilevel evaluation at both the organizational (i.e., the agency) and individual levels by collecting data from individual providers at the intervention community agencies.

An example of program evaluation using a single level of outcome measure [29] involved a 5-year project that examined the transportation, implementation, and sustainability of a computer-assisted cognitive-behavioral treatment (CACBT) for young children’s anxiety in elementary schools. In this multisite study, each school provided at least four counselors, social workers, school psychologists, or teachers who could implement the intervention. The outcome of the project was measured in terms of whether or not the school personnel increased the use of the CACBT program and increased identification of elementary school students with distressing anxiety through use of the Behavioral Assessment System for Children, Second Edition, Teacher Rating Scale.

3.2.4. Study Design and Setting

Many of these 46 R01 projects had multiple aims and multiple stages as part of the study intervention. The project designs included randomized controlled trials, quasiexperimental designs, case studies, survey research, community-based participatory approaches, and system science designs, such as social network analysis.

Many projects utilized mixed-methods designs, using quantitative methods to measure outcomes and qualitative methods to describe processes or expand the depth of understanding. For example, one project [30] involved three separate stages, with the first stage using two in-depth case studies of model substance abuse treatment programs serving the substance abuser group in the community. The second stage used a quantitative telephone survey approach to collect data from the directors of all 480 substance abuse treatment programs serving substance abusers in their respective communities. The final stage involved a qualitative approach using in-depth case studies of 12 of these 480 substance abuse treatment programs from the stage-two telephone interviews. As a result, the researchers planned to collect, analyze, and report both quantitative and qualitative data gathered during the three stages of the project [30].

When these R01 projects were grouped by predominant design, 43% of the studies used a quasiexperimental design, and 24% used randomized controlled trials. Together, these two designs accounted for two out of three designs among the R01 studies (Table 5). The project settings were also diverse and included rural and urban primary care and specialty care practices ( ), state government and international health settings ( ), community health agencies ( ), hospitals ( ), online social networking ( ), schools ( ), large health care systems ( ), churches ( ), and worksites ( ). See Table 6 for a list of the 76 abstracts used in the study.


Rank
(most to fewest)
Predominant study design:
46 RO1 projects
Frequency (%)

1Quasiexperimental designs20 (43)
2Randomized controlled trials11 (24)
3Systems science (e.g., social network analysis)10 (22)
4Case studies3 (7)
5Community-based participatory research1 (2)
6Unclear study design1 (2)

Other categories

Studies with more than one design14 (30)
Studies using mixed methods (quantitative and qualitative)14 (30)


Principal investigatorProject titleProject numberMechanismFunding instituteFunding amount*

Aarons, GregoryLeadership development for evidence-based practice implementation1R21MH082731-01A1R21NIMH$467,057
Aarons, Gregory et al.Interagency collaborative teams to scale up evidence-based practice1R01MH092950-01A1R01NIMH$1,370,657
Allen, Rebecca SueLegacy intervention family enactment (LIFE): an effectiveness trial1R21NR011112-01R21NINR$391,916
Auerbach, Andrew D.Improving use of perioperative beta-blockers with a multidimensional QI program1R01HL086473-01R01NHLBI$2,018,019
Berenholtz, Sean M.A multifaceted intervention to reduce ventilator-associated pneumonia in the ICU1R01HL105903-01A1R01NHLBI$972,500
Bickell, Nina A.Implementing cancer treatment measuring and reporting in office and hospital practice1R21CA132773-01A2R21NCI$419,201
Bogner, Hillary R.Implementing care for depression and diabetes1R21MH094940-01A1R21NIMH$240,000
Botvin, Gilbert J.A collaborative system approach for the diffusion of evidence-based prevention1R01DA023437-01A1R01NIDA$3,640,886
Bradbury, Angela R.Communicating genetic test results by telephone: a randomized trial1R01CA160847-01A1R01NCI$668,104
Brownson, Ross C.Cancer control dissemination research among state-level policy makers1R01CA124404-01A1R01NCI$2,466,945
Brownson, Ross C.Disseminating evidence-based interventions to control cancer1R01CA160327-01A1R01NCI$517,465
Bruce, Martha L.Homecare agency-randomized trial of web implementation strategy for depression1R01MH096441-01A1R01NIMH$386,912
Campbell, Marci K.Dissemination of a weight-management program among US veterans1R01CA124400-01R01NCI$2,813,567
Cates, Joan RobertsOptimizing HPV vaccination: parents, providers, and preteen boys1R21AI095590-01A1R21NIAID$407,000
Clarke, Jennifer Grace et al.Methods for understanding sentinel events1R21DA032739-01R21NIDA$422,848
Cobb, NathanOnline social networks for dissemination of smoking cessation interventions1R01CA155369-01A1R01NCI$775,677
Crowley, Rebecca S. et al.Implementation of automated guideline adherence feedback in Malawi1R03TW009217-01A1R03FIC$74,775
Dolcini, M. MargaretInfluences on translation of an evidence-based HIV/STI intervention into practice1R01MH085502-01R01NIMH$1,452,624
Dorsey, ShannonImproving practice in community-based settings: a randomized trial of supervision1R01MH095749-01R01NIMH$590,142
Dowdy, David WesleyA user-friendly epidemic-economic model of diagnostic tests for tuberculosis1R21AI101152-01R21NIAID$243,000
Dunn, Andrea L.Study of the naturalistic dissemination process of an evidence-based program1R01HL086448-01R01NHLBI$1,386,185
Epstein, Jeff N.Disseminating a model intervention to promote improved ADHD care in the community1R21MH082714-01R21NIMH$371,250
Feldstein, Adrianne C.Forging implementation of cancer screening reminder systems (FICSRS)1R21CA124395-01A1R21NCI$357,432
Feldstein, Adrianne C.Focusing implementation to bring effective reminders: FIBER1R01CA132709-01R01NCI$2,271,788
Foley, Kristie L.Implementation and dissemination of tobacco cessation strategies in free clinics1R21DA024631-01R21NIDA$370,064
Friedland, Gerald H. et al.Implementing point-of-care CD4 analysis to decentralize HIV care in rural Africa1R21AI102756-01R21NIAID$208,978
Glisson, Charles A.Testing an organizational implementation strategy in children's mental health1R01MH084855-01A1R01NIMH$2,448,880
Hahn, Ellen J.An intervention for promoting smoke-free policy in rural Kentucky1R01HL086450-01R01NHLBI$3,393,577
Hannon, Margaret A.Workplace health promotion1R21CA136435-01A1R21NCI$303,019
Hannon, Margaret A.Increasing implementation of evidence-based interventions at low-wage worksites1R01CA160217-01A1R01NCI$500,557
Hansen, William B.The impact of adaptation on successful implementation5R01DA024639-02R01NIDA$1,176,751
Hawkins, Robert P.Implementing CHESS ehealth breast cancer support in population-based care1R01CA149005-01A1R01NCI$1,000,078
Hawley, Kristin M.Increasing the capacity of providers to monitor fidelity to child and family CBT1R21MH090460-01A1R21NIMH$402,298
Holt, Cheryl L.Implementation of evidence-based cancer early detection in black churches1R01CA147313-01A1R01NCI$967,626
Ibrahim, Jennifer K.Translating science into policy: a survey of state tobacco control plans1R03CA128644-01A1R03NCI$150,00
Kataoka, Sheryl H.Implementation strategy for delivering a school-based mental health program1R21MH082712-01A1R21NIMH$454,805
Kendall, Philip C.Disseminating evidence-based practice to the schools: CBT for child anxiety1R01MH086438-01A2R01NIMH$996,912
Krein, Sarah et al.Implementing evidence to prevent urinary infection and enhance patient safety1R01NR010700-01R01NINR$1,715,510
Kruk, Margaret E.Improving maternal and newborn health using the HIV/AIDS program platform in Tanzania1R01AI093182-01A1R01NIAID$1,499,244
Larkey, Linda K. et al.Navigation from community to clinic to promote population CRC screening in underserved population1R01CA162393-01A1R01NCI$639,914
Leischow, Scott J.Knowledge integration in quitlines: networks that improve cessation1R01CA128638-01A1R01NCI$3,118,026
Lounsbury, David WilliamDynamics modeling as a tool for disseminating the PHS tobacco treatment guideline1R03DA022278-01A1R03NIDA$177,913
Magura, StephenCritical review of evidence-based program repositories for behavioral health treatment1R21DA032151-01R21NIDA$409,750
Mold, James W.Implementation of asthma guidelines in primary care; comparison of 4 approaches1R01HL091827-01A2R01NHLBI$1,680,075
Molfenter, Todd DavidTo test a payer/treatment agency intervention to increase use of buprenorphine1R01DA030431-01A1R01NIDA$1,199,218
Mullen, Patricia Dolan et al.Increasing reach and implementation of evidence-based programs for cancer control1R01CA163526-01R01NCI$653,871
Nahm, Eun-ShimDissemination of a theory-based bone health program in online communities1R01NR011296-01R01NINR$1,836,146
Novins, Douglas K.Evidence-based practices and substance abuse treatment for Native Americans1R01DA022239-01A1R01NIDA$1,397,906
Nutting, Paul A.Practice redesign to improve depression care-PRIDE care1R01MH069806-01A2R01NIMH$1,169,532
Ouslander, Joseph G. et al.Implementing interventions to reduce hospitalizations of nursing home residents1R01NR012936-01A1R01NINR$880,217
Pankratz, Melinda M.Comparing multiple methods of measuring fidelity of curriculum implementation1R21DA025588-01R21NIDA$427,262
Picone, GabrielSocial interactions and malaria preventive behaviors in sub-Saharan Africa1R03TW009108-01R03FIC$147,000
Powell, Adam A.Measurement of inappropriate screening tests (MIST)1R03CA166719-01A1R03NCI$63,000
Prudhomme O'Meara, WendySustainable financial incentives to improve prescription practices for malaria1R21AI095979-01A1R21NIAID$177,020
Psoter, Walter J.Increasing oral cancer screening by dentists: qualitative research on practitioner1R21DE019766-01A1R21NIDCR$687,073
Reid, Manney CarringtonImplementing a cognitive/exercise therapy for back pain in the community setting1R03NR010093-01R03NINR$166,404
Rush, William AdamsAn innovative approach to disseminate dental research1R01DE022332-01R01NIDCR$935,330
Sahler, Olle Jane Z.Online problem-solving skills training for mothers of childhood cancer patients1R01CA159013-01A1R01NCI$718,361
Shelley, Donna R. et al.Implementing tobacco use treatment guidelines in dental public health clinics1R01CA162035-01A1R01NCI$700,817
Simon, Melissa AndreaAdapting patient navigation to promote cancer screening in Chicago’s Chinatown1R01CA163830-01R01NCI$602,190
Smith, Selina A. et al.Efficacy-to-effectiveness transition of an educational program to increase colorectal cancer screening1R01CA166785-01R01NCI$449,429
Solberg, Leif I.Evaluation of a natural experiment to improve statewide depression care in MN1R01MH080692-01R01NIMH$3,219,406
Spallek, HeikoImplementing research findings and evidence-based interventions into real-world 1R21DE021494-01R21NIDCR$416,625
Squires, DanielTraining drug treatment providers to adopt evidence-based practices1R21DA021150-01A1R21NIDA$411,255
Sutfin, Erin L.Implementing evidence-based tobacco cessation strategies in campus health clinics1R21CA161664-01R21NCI$364,553
Tu, Shin-PingCancer control dissemination to Asian Americans1R01CA124397-01A1R01NCI$987,766
Tu, Shin-PingDissemination through community health centers serving diverse populations1R21CA136460-01A1R21NCI$317,884
Van Rie, Annelies T. A.Optimizing the impact of XPERT MTB/RIF on treatment outcomes of drug-resistant TB1R01AI099026-01R01NIAID$593,925
Vavilala, Monica ShantaImplementation science to increase use of evidence-based pediatric brain injury 1R01NS072308-01R01NINDS$1,586,221
Weiner, Bryan JeffreyImplementing systemic interventions to close the discovery-delivery gap1R01CA124402-01A1R01NCI$2,815,728
Weiner, Bryan JeffreyIncreasing colorectal cancer screening rates in community health centers1R21CA161657-01R21NCI$334,068
Wells, Kenneth B.Community partners in care1R01MH078853-01A1R01NIMH$5,996,233
Whitten, PamelaImplementation of a telepsychiatry program in rural oncology clinics1R21MH080699-01A2R21NIMH$418,337
Wilfley, Denise Ella et al.Implementation of evidence-based treatments for on-campus eating disorders1R01MH095748-01R01NIMH$771,666
Windsor, Richard AnthonyThe West Virginia smoking cessation or reduction in pregnancy treatment trial1R01CA124429-01A1R01
NCI$1,740,688
Wyatt, Gail E.Implementing EBAN II: an evidence-based intervention for serodiscordant couples1R01MH093230-01A1R01NIMH$687,933

This funding amount represents awards from 2005–2012. Out-year funding for projects recently awarded is not included.
NCI: National Cancer Institute; NIMH: National Institute of Mental Health; NIDA: National Institute on Drug Abuse; NHLBI: National Heart, Lung, and Blood Institute; NIAID: National Institute of Allergy and Infectious Diseases; NINR: National Institute of Nursing Research; NIDCR: National Institute of Dental and Craniofacial Research; NINDS: National Institute of Neurological Disorders and Stroke; FIC: Fogarty International Center.

4. Discussion

This review of abstracts was conducted to describe the R01, R03, and R21 projects funded under the NIH program announcements for D&I research from 2005 to 2012. Further analysis was performed for the R01 studies, which were intended to move the science beyond the pilot phase.

Review of these abstracts demonstrated a robust set of projects that reflect a growing and evolving area of science. NCI and NIMH were the major funders for the projects, which is indicative of their long history of working to advance this field. Each of these institutes has designated organizational D&I units and program officers dedicated to broadly stimulating this science. The PIs for these projects represented an array of disciplines, and the topical focus of the projects was equally diverse, illustrating the interdisciplinary nature of the D&I research community. Only a small proportion of PIs for these projects were from Schools of Nursing. Likewise, as illustrated in Figure 3, rural and western states were underrepresented among the funded projects.

When a theory or framework was present, it referred to one that is commonly applied in D&I research in the context of health, particularly the RE-AIM [15] and Diffusion of Innovations [24] models. Other commonly used models included those that supported individually focused behavioral interventions, such as cognitive behavioral theory. Consistent with the literature that demonstrates that active D&I strategies are more effective [12], most of the projects relied on active approaches, such as training and technical assistance.

Assessment of the outcomes and fidelity of the dissemination and implementation of new preventive practices, guidelines, or programs in these projects were most often measured at multiple levels, such as the individual patient, the provider, and the organization. This multimodal approach is characteristic of more recent D&I research and may reflect an evolving use of systems thinking for D&I in terms of understanding how actors and organizations influence each other within a whole [31, 32]. The predominant study designs used in these projects included quasiexperimental and randomized clinical trials. Many of the projects used mixed methods, with a third of them including both quantitative and qualitative components. Mixed methods are particularly useful in generating data from multiple levels and many stakeholders and may be particularly suited to answer the complex questions in D&I research [18, 33].

Many of these funded projects can be considered first-generation D&I research. What areas of knowledge development suggested from these studies and other experts should be promoted to move the field forward in terms of the next generation of D&I research? Developing a standard and consistent terminology for D&I research is one critical area requiring careful attention [33]. Additional theory development and testing are needed to better understand the relationships among the complex array of factors required for successful dissemination and implementation of health interventions in various settings [34]. Building a more robust set of common measures for D&I research is also a priority [13]. Glasgow and colleagues suggest that alternative study designs beyond the traditional randomized trial that emphasize the importance of external validity and that take advantage of existing social, environmental, and community data should be utilized [19]. A focus on D&I approaches with high-risk populations, including low-income, minority, and low-health literacy groups, and in low-resourced settings is also an imperative [19, 34]. Finally, new interdisciplinary collaborations with diverse partners, including key stakeholders, consumers, and clinicians, will be important to grow the science [19].

4.1. Implications for Nursing Research

D&I science moves beyond the individual as the unit of analysis to focus on groups, systems, the community, and beyond. Nursing research is conducted in all these areas, but D&I research is a way for nurses to influence health and health care on a larger scale. One example is the dissemination of evidence-based practice guidelines throughout a unit, hospital, and health care system. What are the best ways to have these guidelines widely used by nurses and other health care professionals? Which strategies are most cost-effective?

The D&I program announcements clearly present a potential funding opportunity for nurse scientists committed to translating evidence-based interventions to improve health (these program announcements were recently reissued on January 9, 2013, under PAR-13-055 (R01), PAR-13-054 (R21), and PAR-13-056 (R03)). Nursing has a rich history of work in research utilization to improve clinical care and promote practice-based inquiry. Nurse scientists are well prepared to lead and participate as members in interdisciplinary teams focused on disseminating and implementing evidence to practice. Symptom management and self-care in chronic disease and end-of-life care are just a few examples where nursing has made significant contributions to the science and should take a leadership role in translating this work to practice [35]. Many nurse researchers are skilled in both quantitative and qualitative designs often used in D&I research. A mixed-methods approach might be especially useful in testing different strategies for implementation across different populations.

There are opportunities to learn more about D&I science and receive assistance and feedback on a proposed grant application. The NIH hosts an annual conference on the science of dissemination and implementation in health, where attendees can hear state-of-the science presentations, learn about research findings in the poster session, network with D&I scientists, and attend a technical assistance workshop led by NIH Program Officers and funded by D&I researchers. Other research training opportunities, such as the annual NIH-sponsored Training Institute on Dissemination and Implementation Research in Health, are also offered periodically to the extramural community. The NIH Office of Behavioral and Social Sciences Research website includes information about these opportunities (http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/index.aspx).

Talking to the appropriate NIH Institute Program Officer identified on the PAR as the scientific contact person is also essential in planning an application submission. Considering the fit of an application with the mission of other institutes (e.g., NCI or NIMH), in addition to NINR, is also important. Grant applications for these PARs prior to 2010 were reviewed in Special Emphasis Panels, in which peer reviewers were appointed for each panel on a temporary basis. In 2010, the NIH Center for Scientific Review established a chartered study section to peer review these and other investigator-initiated applications in this science area, called the Dissemination and Implementation Research in Health Study Section (http://public.csr.nih.gov/StudySections/IntegratedReviewGroups/HDMIRG/DIRH/Pages/default.aspx). This website also provides a link to the study section’s membership roster. Whereas standing members of this study section are appointed for a specific term, other temporary reviewers are often appointed for a specific review cycle to augment the scientific expertise that may be needed, depending on the pool of applications. Another invaluable opportunity for nurse scientists who have expertise in a specific area of D&I science is to volunteer to serve as a peer reviewer for this study section by sending their curriculum vitae and letter of interest to the Scientific Review Officer assigned to this study section.

4.2. Limitations

The description and analysis in this review were based solely on the funded project abstracts published in the NIH RePORTER under the previously identified program announcements. By their nature, proposal abstracts present a limited amount of information and might not accurately represent the project once completed. Outcomes cannot be identified through review of proposal abstracts; this would require subsequent review of publications based on the funded projects. The level of analysis was limited by having access only to those abstracts publicly available through funding. Consequently, no conclusions can be made based on funded projects compared with all proposals submitted in response to this PAR. No information is publically available regarding the total number of applications submitted. Furthermore, it is not known how representative the funded projects are for any of the descriptors provided in this paper compared with submitted proposals. It is also not known whether different types of applications or specific topics were more or less likely to be funded in relation to the entire pool of applications.

As reported by others [11, 12], this abstract review was hindered by inconsistent terminology for design and strategy and even for what was meant by dissemination or implementation. Although some abstracts provided details of the proposed projects, others omitted relevant content (e.g., model used). Equally evident from this review was the lack of common measures with established validity and reliability, particularly for measuring D&I processes and outcomes. The imperative to develop these common measures as key to the successful advancement of D&I science has been widely advocated [13, 34].

Finally, it should be noted that D&I science has undergone much development since the first general program announcement was released in 2005. It is not known what impact this may have had on the number and quality of proposals submitted, especially during the latter part of the time selected for this review.

5. Conclusion

The overall goal of D&I science is to overcome the research-practice gap so that evidence-based health practices yield significant health benefits to all populations and across all health care settings [19]. The purpose of this paper was to enhance understanding of the body of work represented in the projects funded under the NIH dissemination and implementation program announcements over the past 8 years and suggest implications for nurse researchers. The projects in this portfolio demonstrated that D&I research is complex, often multiphase, and requires a collaborative, interdisciplinary approach. These projects make a highly significant contribution to the field, yet much work remains to be done, such as improving methods and measures, to move D&I science forward.

Although many nurse researchers and practitioners are engaged in D&I science, nurse scientists were underrepresented among the PIs for these projects. Nurse scientists are uniquely prepared to contribute to the advancement of D&I research in health. This NIH initiative represents an outstanding potential funding and leadership opportunity for nurse researchers committed to translational research and shortening the science-practice gap.

Conflict of Interests

The authors declare no conflict of interests.

References

  1. E. A. Balas and S. A. Boren, “Managing clinical knowledge for health care improvement,” in Yearbook of Medical Informatics 2000: Patient-Centered Systems, J. Bemmel and A. T. McCray, Eds., pp. 65–70, Schattauer, Stuttgart, Germany, 2000. View at: Google Scholar
  2. L. W. Green, J. M. Ottoson, C. García, and R. A. Hiatt, “Diffusion theory and knowledge dissemination, utilization, and integration in public health,” Annual Review of Public Health, vol. 30, pp. 151–174, 2009. View at: Publisher Site | Google Scholar
  3. National Institutes of Health, Fogarty International Center. Frequently Asked Questions About Implementation Science, 2010, http://www.fic.nih.gov/News/Events/implementation-science/Pages/faqs.aspx.
  4. J. M. Westfall, J. Mold, and L. Fagnan, “Practice-based research-“Blue Highways” on the NIH roadmap,” JAMA, vol. 297, no. 4, pp. 403–406, 2007. View at: Google Scholar
  5. M. J. Khoury, M. Gwinn, P. W. Yoon, N. Dowling, C. A. Moore, and L. Bradley, “The continuum of translation research in genomic medicine: how can we accelerate the appropriate integration of human genome discoveries into health care and disease prevention?” Genetics in Medicine, vol. 9, no. 10, pp. 665–674, 2007. View at: Publisher Site | Google Scholar
  6. N. E. Donaldson, D. N. Rutledge, and J. Ashley, “Outcomes of adoption: measuring evidence uptake by individuals and organizations,” Worldviews on Evidence-Based Nursing, vol. 1, pp. S41–S51, 2004. View at: Google Scholar
  7. J. E. Squires, T. Reay, D. Morelejo, S. M. Lefort, A. M. Hutchinson, and C. A. Estabrooks, “Designing strategies to implement research-based policies and procedures: a set of recommendations for nurse leaders based on the PARiHS framework,” Journal of Nursing Administration, vol. 42, no. 5, pp. 293–297, 2012. View at: Google Scholar
  8. M. G. Titler, “Translation science and context,” Research and Theory for Nursing Practiceno, vol. 24, no. 1, pp. 35–54, 2012. View at: Google Scholar
  9. L. A. Bero, R. Grilli, J. M. Grimshaw, E. Harvey, A. D. Oxman, and M. A. Thomson, “Getting research findings into practice. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings,” British Medical Journal, vol. 317, no. 7156, pp. 465–468, 1998. View at: Google Scholar
  10. B. A. Rabin, R. C. Brownson, J. F. Kerner, and R. E. Glasgow, “Methodologic challenges in disseminating evidence-based interventions to promote physical activity,” American Journal of Preventive Medicine, vol. 31, no. 4, supplement, pp. 24–34, 2006. View at: Publisher Site | Google Scholar
  11. B. A. Rabin, R. E. Glasgow, J. F. Kerner, M. P. Klump, and R. C. Brownson, “Dissemination and implementation research on community based cancer prevention: a systematic review,” American Journal of Preventive Medicine, vol. 38, no. 4, pp. 443–456, 2010. View at: Publisher Site | Google Scholar
  12. E. K. Proctor and R. C. Brownson, “Measurement issues in dissemination and implementation research,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 261–280, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  13. K. M. Emmons, B. Weiner, M. E. Fernandez, and S. P. Tu, “Systems antecedents for dissemination and implementation: a review and analysis of measures,” Health Education & Behavior, vol. 39, no. 1, pp. 87–105, 2012. View at: Google Scholar
  14. D. Chambers, “Foreword,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. vii–x, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  15. R. E. Glasgow, T. M. Vogt, and S. M. Boles, “Evaluating the public health impact of health promotion interventions: the RE-AIM framework,” American Journal of Public Health, vol. 89, no. 9, pp. 1322–1327, 1999. View at: Google Scholar
  16. B. Gaglio and R. E. Glasgow, “Evaluation approaches for dissemination and implementation research,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 327–356, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  17. R. E. Glasgow and J. F. Steiner, “Comparative effectiveness research to accelerate translation: recommendations for an emerging field of science,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 72–93, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  18. J. Landsverk J, C. H. Brown, P. Chamberlain et al., “Design and analysis in dissemination and implementation research,” in DissemInation and Implementation Research in Health: TranslatIng Science to Practice, R. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 225–260, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  19. R. E. Glasgow, C. Vinson, D. Chambers, M. J. Khoury, R. M. Kaplan, and C. Hunter, “National Institutes of Health approaches to implementation science; current and future directions,” American Journal of Public Health, vol. 102, no. 7, pp. 1274–1281, 2012. View at: Google Scholar
  20. National Institutes of Health. PAR-10-038: Dissemination and Implementation Research in Health, 2009, http://grants.nih.gov/grants/guide/pa-files/PAR-10-038.html.
  21. National Institutes of Health. Research Portfolio Online reporting Tools (RePORT), 2012, http://report.nih.gov/.
  22. M. K. Campbell, 1R01CA124400-01: Dissemination of a Weight Management Program Among US Veterans, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=7173197&icde=14075515&ddparam=&ddvalue=&ddsub=&cr=3&csb=default&cs=ASC.
  23. C. A. Glisson, 1R01MH084855-01A1: Testing an Organizational Implementation Strategy in Children's Mental Health, 2012, http://www.projectreporter.nih.gov/project_info_description.cfm?aid=8268517&icde=15737611&ddparam=&ddvalue=&ddsub=&cr=1&csb=default&cs=ASC.
  24. E. M. Rogers, Diffusion of Innovations, The Free Press, New York, NY, USA, 5th edition, 2003.
  25. E.-S. Nahm, 1R01NR011296-01: Dissemination of a Theory-Based Bone Health Program in Online Communities, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=7691904&icde=14073702&ddparam=&ddvalue=&ddsub=&cr=9&csb=default&cs=ASC.
  26. M. A. Simon, 1R01CA163830-01: Adapting Patient Navigation to Promote Cancer Screening in Chicago’s Chinatown, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=8223013&icde=14069793&ddparam=&ddvalue=&ddsub=&cr=23&csb=default&cs=AS.
  27. S. J. Leischow, 1R01CA128638-01A1: Knowledge Integration in Quitlines: Networks That Improve Cessation, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=7431848&icde=14069557&ddparam=&ddvalue=&ddsub=&cr=2&csb=default&cs=ASC.
  28. S.-P. Tu, 1R21CA136460-01A1: Dissemination Through Community Health Centers Serving Diverse Populations, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=7692474&icde=14072411&ddparam=&ddvalue=&ddsub=&cr=10&csb=default&cs=ASC.
  29. P. C. Kendall, 1R01MH086438-01A2: Disseminating Evidence-Based Practice to the Schools: CBT for Child Anxiety, 2012, http://projectreporter.nih.gov/project_info_description.cfm?aid=8041881&icde=14069793&ddparam=&ddvalue=&ddsub=&cr=13&csb=default&cs=ASC.
  30. D. K. Novins, 1R01DA022239-01A1: Evidence-Based Practices and Substance Abuse Treatment for Native Americans, 2008, http://projectreporter.nih.gov/project_info_description.cfm?aid=7431560&icde=14089831&ddparam=&ddvalue=&ddsub=&cr=10&csb=default&cs=ASC.
  31. B. J. Holmes, D. T. Finegood, B. L. Riley, and A. Best, “Systems thinking in dissemination and implementation research,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 175–191, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  32. G. Aarons, 1R01MH092950-01A1: Interagency Collaborative Teams to Scale-Up Evidence Based Practice, 2011, http://projectreporter.nih.gov/project_info_details.cfm?aid=8138874&icde=14069686.
  33. B. Rabin and R. C. Brownson, “Developing the terminology for dissemination and implementation research,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 23–51, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  34. R. C. Brownson, M. Dreisinger, G. A. Colditz, and E. K. Proctor, “The path forward in dissemination and implementation research,” in Dissemination and Implementation Research in Health: Translating Science to Practice, R. C. Brownson, G. A. Colditz, and E. K. Proctor, Eds., pp. 498–508, Oxford University Press, New York, NY, USA, 2012. View at: Google Scholar
  35. N. F. Woods and D. L. Magyary, “Translational research: why nursing's interdisciplinary collaboration is essential,” Research and Theory for Nursing Practice, vol. 24, no. 1, pp. 9–24, 2010. View at: Google Scholar

Copyright © 2013 Mindy Tinkle et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

5502 Views | 1696 Downloads | 27 Citations
 PDF  Download Citation  Citation
 Download other formatsMore
 Order printed copiesOrder

We are committed to sharing findings related to COVID-19 as quickly and safely as possible. Any author submitting a COVID-19 paper should notify us at help@hindawi.com to ensure their research is fast-tracked and made available on a preprint server as soon as possible. We will be providing unlimited waivers of publication charges for accepted articles related to COVID-19.