Attitudes and Beliefs towards Patients with Hazardous Alcohol Use: A Systematic Review
Objective. To describe emergency department (ED) staff attitudes and beliefs towards patients presenting with hazardous alcohol use and their clinical management. Methods. A search of MEDLINE, EMBASE, CINAHL, SCOPUS from 1990 to 2010, and reference lists from included studies was conducted. Two reviewers independently screened for inclusion and assessed study quality. One reviewer extracted the data and a second checked for completeness and accuracy. Results. Among nine studies four reported varied beliefs on whether screening was worthwhile for identifying hazardous alcohol use (physicians: 42%–88%; nurses: 50%–100%). Physicians in three studies were divided on intervention provision (32%–54% in support of intervention provision) as were nurses in two studies (39% and 64% nurses in support of intervention provision). Referral for treatment was identified in two studies as an important part of ED management (physicians: 62% and 97%; nurses: 95%). Other attitudes and beliefs identified across the studies included concern that asking about alcohol consumption would be seen as obtrusive or offensive, and a perceived lack of time and resources available for providing care and referrals. Conclusions. ED staff had varying attitudes towards ED management of patients with hazardous alcohol use. Investigations into improving clinical care for hazardous alcohol use are needed to optimize ED management for these patients.
Hazardous alcohol use is well known to increase an individual’s risk of injury due to violence or accidents [1, 2]. Acute treatment and care for alcohol-associated morbidities are often sought in hospital emergency departments (EDs), with ED patients more likely than primary care patients and the general population to report hazardous alcohol use [3–7]. In 2007, almost 3 million ED visits across the USA (2.3% of all ED visits) were primarily related to alcohol and cost the health care system $1.3 billion dollars .
The high volume of alcohol-related presentations to the ED presents an opportunity for staff to detect hazardous alcohol use, optimize care decisions, and initiate preventative interventions . Patient management approaches using the SBIRT model (Screening, Brief Intervention, Referral to Treatment) have been evaluated in the ED with mixed impact [9, 10]. The SBIRT model uses a public health approach to universal screening for substance use problems. It can rule out nonproblem substance users and identify the level of risk, and who will benefit from a brief advice. The SBIRT model can be used as a stand-alone treatment or combined with other treatment [11, 12].
A large number of studies have demonstrated short-term effects on reducing alcohol use or associated harms and cost-effectiveness for adult patients; however, several studies have also reported statistically nonsignificant effects [13–35]. The current position of the U.S. Preventive Services Task Force is that there is at least fair evidence to support the use of screening and brief intervention (BI) for those patients who screen positive for hazardous alcohol consumption . In 2006, the American College of Surgeons mandated alcohol screening and intervention for trauma patients admitted to Levels 1 and 2 trauma centers . Despite this, recent evidence suggests that ED-based SBIRT is largely absent in these settings . This absence may be due, in part, to attitudes and beliefs of ED staff [4, 39]. Translational research for ED-based SBIRT with specific attention to barriers to successful implementation including attitudes and beliefs has been recommended . The objective of this systematic review was to describe ED nurses’ and physicians’ attitudes and beliefs towards patients with hazardous alcohol use and their clinical management.
2.1. Search Strategies
Guided by input from the research team, a research librarian developed and implemented a systematic search strategy using language (English) and year (1990 to 2010) restrictions. The search was conducted in February 2010 and updated in June 2010. We used the EBSCOhost portal, encompassing the MEDLINE, EMBASE, CINAHL, and Scopus databases to conduct the search. We also searched our keywords in Google Scholar and the reference lists of retrieved studies. In our search we used the following key words and MeSH headings: “alcohol,” “attitudes OR beliefs,” “emergency department,” “Alcohol-Related Disorders,” “Attitudes of Health Personnel,” “Emergency Service or Emergency Medicine,” and “Physician-Patient Relations.”
2.2. Study Selection
Two reviewers independently screened the search results (NM, HZ). The full manuscripts of potentially relevant studies were retrieved if they were identified as relevant by at least one of the reviewers, and then independently confirmed for inclusion by two reviewers (NM, HZ). The same reviewers also independently assessed study inclusion/exclusion. Studies were included at the screening and inclusion/exclusion stages if a primary objective was to determine attitudes and beliefs of ED staff (physicians and nurses) towards patients presenting with hazardous alcohol use or their clinical management in the ED. No restrictions were placed on study design (qualitative or quantitative) or patient age. Studies were excluded if they met any of the following criteria: (1) they were conducted in any language besides English, (2) they studied a non-ED setting, (3) the study of attitudes and beliefs was not a primary objective, or (4) they examined attitudes and beliefs towards polysubstance use or the hazardous use of substances other than alcohol.
2.3. Assessment of Quality
Two reviewers (NM, HZ) assessed study quality. Disagreements were resolved with third party discussion (ASN) until mutual agreement was achieved. The quality assessment of quantitative studies depended on study design. Observational studies were assessed using questions adapted from Guyatt, Sackett, and Cook’s (1993) User Guide to Medical Literature by the Critical Appraisal Skills Program . The questions targeted the study’s focus, methods, biases, and results presentation including practicality and applicability. Qualitative studies were assessed using a tool developed for the study by the research team (available from the corresponding author upon request). The tool evaluated studies based on the following domains: validity of the study design, setting, and sampling; informed consent and appropriately addressed ethical issues; methodological reporting; efforts to establish credibility and validity; the dependability and reliability of study data.
2.4. Data Extraction and Synthesis
Data from the final set of studies were extracted using a standardized form that assessed key study characteristics (e.g., year of publication, country), characteristics of the study population and setting, and results specific to ED staff attitudes and beliefs. Data were extracted by one reviewer (NM) and checked for accuracy and completeness by a second reviewer (HZ). Discrepancies were resolved by consensus. Published data and tests of significance reported by study authors were included. In the case of unclear or unreported information in the original studies, primary authors were contacted. Meta-analyses were not conducted due to heterogeneity of study definitions and measurement. A qualitative analysis was conducted, and detailed findings are presented in evidence tables. Results are presented by design: controlled trial, observational studies, and mixed method and qualitative studies.
3.1. Description of Included Studies
Figure 1 describes the flow of studies through the selection process. The search strategies identified 352 studies as potentially relevant. After title and abstract review, 37 papers were selected for manuscript retrieval and full review, with 9 studies meeting our inclusion criteria after full-text review: seven observational studies, one qualitative, and one mixed method study [41–49]. General characteristics of the studies are summarized in Table 1. These studies, published between 1998 and 2009, were conducted in the United States (), United Kingdom (), Sweden (), Scotland (), Australia (), and China (). The majority of studies sampled physicians only (), but studies reporting information from both physicians and nurses () or nurses only () were also included in the review. Study objectives were similar between studies; they either examined ED health care professionals’ attitudes and beliefs towards adult patients with presentations for hazardous alcohol use or towards the SBIRT model.
3.2. Methodological Quality
3.2.1. Observational Studies
The seven observational studies met requirements for many of the critical components identified by the Critical Appraisal Skills Programme . Four studies were limited by a lack of power calculation [41, 43, 46, 47]. Two studies were limited by volunteer bias resultant from convenience sampling [46, 47]. Study strengths included providing a clear focus and presenting results with adequate data analyses [41, 43, 46, 47]. Four studies also had clear discussions addressing the research/clinical implications of the findings with references to other studies [41, 43, 46, 47]. Study applicability was addressed by two studies [46, 47]. Three studies were prone to methodological weaknesses such as volunteer bias resultant from convenience sampling [43, 44]. Three studies did not provide a sample size calculation [42, 44, 45]. There was no description of analytical procedures in one study . One study did not use validated measures . Across all observational studies, many had limited applicability to North American emergency care settings, as they were conducted in European and Asian settings utilizing different health care systems and models [41, 44, 45, 47].
3.2.2. Mixed Method and Qualitative Studies
Both the mixed method and qualitative studies in this paper were clear in research focus, but did not provide sufficient explanation to justify the specific qualitative methodology used [48, 49]. However, sampling strategies and data collection methodology were carried out appropriately in both studies. The studies did not describe informed consent procedures or the issue of participant anonymity. Use of multiple data sources and data triangulation enhanced the credibility and validity of one study’s findings .
3.3. Attitudes and Beliefs of ED Staff towards SBIRT
Figures 2 to 4 present the attitudes and beliefs of ED staff towards SBIRT for patients presenting with hazardous alcohol use. ED staff attitudes towards screening varied (Figure 2). Across two studies, from 42% to 88% of physicians and from 50% to 100% of nurses believed that it was worthwhile to identify hazardous alcohol use in the ED [41, 47]. One study reported that 60% of surveyed physicians and residents believed screening for hazardous alcohol use would improve treatment success . Beliefs regarding who was responsible for screening differed. Huntley et al. reported almost all of surveyed physicians believed that it was their responsibility to screen for alcohol use (98%) while Indig et al. reported only 50% of physicians and 35% of nurses believed that they were responsible for screening [45, 47]. Support for BI for hazardous alcohol use was variable amongst ED staff (Figure 3). Both the Anderson and Waller studies reported that 65% of physicians and 71–75% of nurses believed it was worthwhile to perform BI [41, 43]. Two studies reported less support (51% and 54%) by physicians in the use of BI [42, 46]. A minority of ED staff in Indig et al.’s study believed they were responsible for providing BI (32% of physicians and 39% of nurses) . Indig also reported that 62% of physicians and 95% of nurses believed it was worthwhile to make referrals for specialist treatment (also reported by Huntley et al.), although only 53% of physicians and 51% of nurses believed they were responsible for referring to a specialist (Figure 4) [45, 47].
3.4. Attitudes and Beliefs Related to the Treatability of Hazardous Alcohol Use
The majority of ED staff felt that something could be done in the ED setting to assist patients with hazardous alcohol use. Only a minority of ED staff in the Waller study believed that the ED setting could do little to assist patients with hazardous alcohol use (33% of physicians, 17% of nurses), a belief also held by a similar percentage of physicians (15%) and very few nurses (2%) in Indig’s study [41, 47]. Attitudes and beliefs related to the treatability of hazardous alcohol use were conflicting across the studies. O’Rourke et al. reported that 75% of surveyed physicians believed that alcohol use disorders were treatable, although 80% of those surveyed also believed that current treatments did not work . Graham et al. also reported similar conflicting attitudes and beliefs with 77% of surveyed physicians who agreed that alcohol use disorders were treatable, but also believed that they were difficult to treat (97%) . In contrast, almost all physicians (97%) in the Huntley study believed that treatment could be successful .
3.5. Attitudes and Beliefs regarding the Health Care Provider-Patient Relationship
Several studies identified reluctance on the part of ED health care providers to engage in treatment for hazardous alcohol use. Anderson et al. reported that 35% of surveyed physicians and 53% of nurses were hesitant to ask patients about alcohol consumption and believed formal training was required to be able to respond to patients with hazardous alcohol use (53% of physicians, 78% of nurses) . Physicians (46%) and nurses (48%) in Waller’s study reported reluctance to question or interact with such patients . Among nurses, Chung et al. reported mixed attitudes towards patients with hazardous alcohol use (, SD 13; minimum/maximum score of 27/189 indicating negative/positive attitude) . The belief that patients with hazardous alcohol use lacked motivation to change was cited by physicians (12% and 88%) and nurses (15% and 85%) in two studies [43, 47]. In a qualitative study, Nordqvist et al. found that physicians did not trust the reliability of patients’ responses and believed that asking about alcohol use could make patients feel guilty. Physicians in this study also believed that there was little chance of patients reducing their drinking as a result of their interaction with medical staff and did not believe that BI was effective . In Karlsson’s study, 11% of nurses believed BI would negatively impact the relationship with patients and that patients would object to participating . Nurses also believed that the subject of alcohol consumption was too sensitive to be discussed in a brief ED visit, with 61% of nurses believing that patients would respond negatively to questions about alcohol use. These concerns also surfaced in other studies. Indig’s study found that 24% of physicians and 39% of nurses believed questions about alcohol use were offensive while Andersen et al. reported that 56% of physicians and 90% of nurses surveyed believed that patients found questions about alcohol use offensive and intrusive [43, 47]. Nurses (72%) and physicians (61%) in Waller’s study also held similar beliefs .
This paper identified significant variation in ED physicians’ and nurses’ attitudes and beliefs towards patients with hazardous alcohol use and their management, which may help explain variations in SBIRT model use in the ED. Findings highlight the need to address key issues that underpinned the attitudes and beliefs: perceived time constraints and a lack of resources by ED, concerns that patients would respond negatively to SBIRT, communicating emerging evidence on the SBIRT model to ED staff, and identifying and responding to ED staff learning needs.
The studies in this paper identified that while ED physicians and nurses believed it is worthwhile to screen for hazardous alcohol use, provide BI, and refer for further treatment, far fewer believed they were professionally responsible for these aspects of clinical care and management. The low reports of ED-based SBIRT may be related, in part, to barriers cited across studies in this paper including a perceived lack of time to provide BI, a lack of resources for SBIRT implementation (including specialist staff and support services), and the patient’s intoxicated state. The relationship of these barriers to attitudes and beliefs, however, was not examined in the studies. The issues of who is prepared and best able to conduct SBIRT in the ED, and whether SBIRT is appropriate for this clinical setting remain debated. ED-based studies have employed different strategies for SBIRT delivery in the ED including training ED staff (physician, nurse/nurse practitioner, social worker, and emergency medical technician) and health promotion advocates to augment ED staff roles [20, 50]. Another study used designated mental health nurses to conduct post-ED, follow-up appointments . Time constraints and workload concerns voiced by physicians and nurses may be addressed by introducing specialized SBIRT care providers available for ED or post-ED care. ED-based SBIRT providers may address concerns raised by ED staff about patient reactions to SBIRT while post-ED care can address intoxication as a barrier to ED delivery.
The low reports of ED-based SBIRT as a clinical responsibility identified by this paper could also be the result of providers’ beliefs that screening would not improve treatment success (believed by 40% of physicians in one study), current treatments do not work (believed by 80% of physicians in one study), or that hazardous alcohol use/substance use disorders are difficult to treat (believed by 97% of physicians one study). According to Nordqvist et al., physicians need to be assured that performing BI is effective and worth the time . Establishing effective and timely mechanisms to communicate the growing body of evidence supporting ED-based screening and BI to ED staff may be necessary to address the negative beliefs cited in a large number of studies. Financially compensating physicians for the time it takes to perform SBIRT in the ED, providing adequate supports (personnel, easy access to treatment and referral mechanisms), as well as personalized audit and feedback may also help to improve physician adherence with current recommendations. Further, as new studies address existing methodological limitations (e.g., standardizing outcome measures, establishing effectiveness among patient subgroups such as sex and age) and clinical gaps (e.g., practical screening tools and interventions that complement the busy and hectic nature of an ED) establishing mechanisms to inform ED staff of new evidence in this field will keep staff appraised as to whether SBIRT is not only an effective model, but a feasible model for the ED .
A number of issues related to adequate training were cited in the studies. ED staff in two studies cited training as a needed facilitator for patient care and management, and a high percentage of staff in another study identified a lack of confidence in performing screening (50% of physicians and 71% of nurses), BI (71% of physicians and 73% of nurses), and referral (44% of physicians and 59% of nurses) [41, 43, 47]. Several studies have shown an increase in screening and BI delivery in primary and general care settings and in the ED following a variety of educational and training modalities [52–56]. Confidence has also improved for some staff, but not all [55, 56]. Significant changes have not been reported for attitudes and beliefs and readiness to change clinical behaviors . In-person training has been suggested as more effective than web-based resources while educational support and training are suggested to be more impactful with staff who enter training already therapeutically committed to working with patients with hazardous alcohol consumption [57, 58]. Widespread adoption of the SBIRT model in EDs will require more than a small number of studies demonstrating the effects of training programs. An extensive structured literature review conducted by Williams et al. looked at implementation programs of nine countries having geographically diverse clinical settings and research infrastructures . The paper found different implementation programs and looked at their success/failure in implementing robust SBIRT strategies . This paper, and similar papers indicate the need for change in the policies related to SBIRT in the ED and related clinical settings [20, 39]. Policies and guidelines set at the institutional level and the presence of faculty/administrators that promote and train for the usage of the SBIRT model may also warrant further attention as do studies focusing on strategies to increase the feasibility of SBIRT model use in the ED vis-à-vis cost analyses evaluating the short-term and long-term costs and benefits of SBIRT implementation .
5. Limitations of the Study
This review has several limitations. We assessed the methodological quality of studies based on published methods and did not contact corresponding authors to verify the methods used. As a result, some studies may have been adequately conducted, but the methods were poorly reported. We also did not include studies that explored attitudes and beliefs as a minor objective. As a result, two studies were screened but excluded from our review, and others may have been missed in our search strategy [55, 56]. We chose not to include studies that did not have a primary focus of attitudes and beliefs because the depth and breadth of the investigation may have differed from those studies with it as a primary objective. No pediatric studies were identified in this review. Given that underage drinking is widespread and ample evidence exists that underage hazardous alcohol use leads to adult substance use disorders and persistent dysfunction, the role of the ED in addressing hazardous alcohol use by adolescents could play a critical role in identifying those youth who could benefit from treatment and the initial management of hazardous alcohol use through BI and referral [60–71].
There were also limitations in this review that stemmed from the included studies themselves. The majority of the studies in this review were weak to moderate in quality. Studies that reduce the biases and methodological weaknesses observed in the current body of literature are needed. This includes eliminating biases from convenience or selective sampling through randomized sampling procedures or population sampling and reducing the likelihood of volunteer bias through low response rates (6 out of 9 studies had response rates <80%). Future qualitative and mixed methods studies require justification for the chosen methodology to demonstrate that they study answered the research questions and evidence needs to be provided that the researcher took steps to ensure that the conclusions reached are dependable and confirmable. It would be helpful to explore the variations in attitudes and beliefs and create an opportunity to evaluate whether they are substantial barriers to the SBIRT model in the ED.
Detection of hazardous alcohol consumption followed by BI in the ED setting has large potential benefits due to the wide population that can be captured and a growing body of empirical evidence favoring ED-based SBIRT. This review suggests that attitudes and beliefs of ED physicians and nurses may be key barriers to the widespread uptake of SBIRT for hazardous alcohol use in the ED setting.
Dr. A. S. Newton holds a New Investigator Award from the Canadian Institutes of Health Research (CIHR). Dr. T. C. Wild is a Health Scholar with Alberta Innovates-Health Solutions.
G. D'Onofrio and L. C. Degutis, “Screening and brief intervention in the emergency department,” Alcohol Research and Health, vol. 28, no. 2, pp. 63–72, 2004.View at: Google Scholar
L. M. Wier, K. Levit, E. Stranges et al., HCUP Facts and Figures: Statistics on Hospital-Based Care in the United States, Agency for Healthcare Research and Quality, 2008, http://www.hcup-us.ahrq.gov/reports.jsp.
T. F. Babor, B. G. McRee, P. A. Kassebaum, P. L. Grimaldi, K. Ahmed, and J. Bray, “Screening, Brief Intervention, and Referral to Treatment (SBIRT): toward a public health approach to the management of substance abuse,” Substance Abuse, vol. 28, no. 3, pp. 7–30, 2007.View at: Publisher Site | Google Scholar
S. Sterling, T. Valkanoff, and A. Hinman, “Integrating substance use treatment into adolescent health care,” Current Psychiatry Reports, vol. 14, pp. 453–461, 2012.View at: Google Scholar
E. Bernstein, J. Bernstein, and S. Levenson, “Project ASSERT: an ED-based intervention to increase access to primary care, preventive services, and the substance abuse treatment system,” Annals of Emergency Medicine, vol. 30, no. 2, pp. 182–189, 1997.View at: Google Scholar
F. C. Blow, K. L. Barry, M. A. Walton et al., “The efficacy of two brief intervention strategies among injured, at-risk drinkers in the emergency department: impact of tailored messaging and brief advice,” Journal of Studies on Alcohol, vol. 67, no. 4, pp. 568–578, 2006.View at: Google Scholar
R. Longabaugh, R. F. Woolard, T. D. Nirenberg et al., “Evaluating the effects of a brief motivational intervention for injured drinkers in the emergency department,” Journal of Studies on Alcohol, vol. 62, no. 6, pp. 806–816, 2001.View at: Google Scholar
S. Estee, T. Wickizer, L. He, M. F. Shah, and D. Mancuso, “Evaluation of the washington state screening, brief intervention, and referral to treatment project: cost outcomes for medicaid patients screened in hospital emergency departments,” Medical Care, vol. 48, no. 1, pp. 18–24, 2010.View at: Publisher Site | Google Scholar
J.-B. Daeppen, J. Gaume, P. Bady et al., “Brief alcohol intervention and alcohol assessment do not influence alcohol use in injured patients treated in the emergency department: a randomized controlled clinical trial,” Addiction, vol. 102, no. 8, pp. 1224–1233, 2007.View at: Publisher Site | Google Scholar
C. J. Cherpitel, J. Moskalewicz, G. Swiatkiewicz, Y. Ye, and J. Bond, “Screening, Brief Intervention, and Referral to Treatment (SBIRT) in a polish emergency department: three-month outcomes of a randomized, controlled clinical trial,” Journal of Studies on Alcohol and Drugs, vol. 70, no. 6, pp. 982–990, 2009.View at: Google Scholar
C. J. Cherpitel, R. A. Korcha, J. Moskalewicz, G. Swiatkiewicz, Y. Ye, and J. Bond, “Screening, brief intervention, and referral to treatment (SBIRT): 12-month outcomes of a randomized controlled clinical trial in a polish emergency department,” Alcoholism, vol. 34, no. 11, pp. 1922–1928, 2010.View at: Publisher Site | Google Scholar
A. Spirito, H. Sindelar-Manning, S. M. Colby et al., “Individual and family motivational interventions for alcohol-positive adolescents treated in an emergency department: results of a randomized clinical trial,” Archives of Pediatrics and Adolescent Medicine, vol. 165, no. 3, pp. 269–274, 2011.View at: Publisher Site | Google Scholar
J. Bernstein, T. Heeren, E. Edward et al., “A brief motivational interview in a pediatric emergency department, plus 10-day telephone follow-up, increases attempts to quit drinking among youth and young adults who screen positive for problematic drinking,” Academic Emergency Medicine, vol. 17, no. 8, pp. 890–902, 2010.View at: Publisher Site | Google Scholar
U.S. Preventive Services Task Force, “Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: recommendation statement,” Annals of Internal Medicine, vol. 140, no. 7, pp. 554–556, 2004.View at: Google Scholar
American College of Surgeons, Resources for Optimal Care for the Injured Patient, American College of Surgeons, Chicago, Ill, USA, 2006.
Solutions for Public Health, Critical Appraisal Skills Programme Making Sense of the Evidence: 12 Questions to Help You MAke Sense of a Cohort Study, Solutions for Public Health, 2011, http://www.sph.nhs.uk/acl_users/credentials_cookie_auth/require_login?came_from=http%3A//www.sph.nhs.uk/sph-files/casp-appraisal-tools/cohort%252012%2520questions.pdf.
S. Waller, B. Thom, S. Harris, and M. Kelly, “Perceptions of alcohol-related attendances in accident and emergency departments in England: a national survey,” Alcohol and Alcoholism, vol. 33, no. 4, pp. 354–361, 1998.View at: Google Scholar
D. M. Graham, R. F. Maio, F. C. Blow, and E. M. Hill, “Emergency physician attitudes concerning intervention for alcohol abuse/dependence delivered in the emergency department: a brief report,” Journal of Addictive Diseases, vol. 19, no. 1, pp. 45–53, 2000.View at: Google Scholar
J. Y. M. Chung, J. T. S. Chan, R. S. D. Yeung, R. C. H. Wan, and S. T. Ho, “Nurses’ attitude toward alcoholic patients in accident and emergency department in Hong Kong,” Hong Kong College of Emergency Medicine, vol. 10, no. 2, pp. 104–112, 2003.View at: Google Scholar
E. F. S. Kaner, C. A. Lock, B. R. McAvoy, N. Heather, and E. Gilvarry, “A RCT of three training and support strategies to encourage implementation of screening and brief alcohol intervention by general practitioners,” British Journal of General Practice, vol. 49, no. 446, pp. 699–703, 1999.View at: Google Scholar
E. Bernstein, J. Bernstein, J. Feldman et al., “An evidence based alcohol screening, brief intervention and referral to treatment (SBIRT) curriculum for emergency department (ED) providers improves skills and utilization,” Substance Abuse, vol. 28, no. 4, pp. 79–92, 2007.View at: Publisher Site | Google Scholar
United States Department of Health, The NSDUH Report: Quantity and Frequency of Alcohol Use Among Underage Drinkers, Substance Abuse and Mental Health Services Admistration, Office of Applied Studies, 2010, http://oas.samhsa.gov/2k8/underage/underage.cfm.
L. D. Johnston, P. M. O’Malley, J. G. Bachman, and J. E. Schulenberg, Monitoring the Future: National Survey Results on Drug Use, 1975–2004: Volume I. Secondary School Students, National Institute on Drug Abuse, Bethesda, Md, USA, 20058.
E. J. D'Amico, P. L. Ellickson, R. L. Collins, S. Martino, and D. J. Klein, “Processes linking adolescent problems to substance-use problems in late young adulthood,” Journal of Studies on Alcohol, vol. 66, no. 6, pp. 766–775, 2005.View at: Google Scholar
T. Pitkänen, “Problem drinking and psychological well-being: a five-year follow-up study from adolescence to young adulthood,” Scandinavian Journal of Psychology, vol. 40, no. 3, pp. 197–207, 1999.View at: Google Scholar