Research Article | Open Access
Planning Capacity for Mental Health and Addiction Services in the Emergency Department: A Discrete-Event Simulation Approach
Ontario has shown an increasing number of emergency department (ED) visits, particularly for mental health and addiction (MHA) complaints. Given the current opioid crises Canada is facing and the legalization of recreational cannabis in October 2018, the number of MHA visits to the ED is expected to grow even further. In face of these events, we examine capacity planning alternatives for the ED of an academic hospital in Toronto. We first quantify the volume of ED visits the hospital has received in recent years (from 2012 to 2016) and use forecasting techniques to predict future ED demand for the hospital. We then employ a discrete-event simulation model to analyze the impacts of the following scenarios: (a) increasing overall demand to the ED, (b) increasing or decreasing number of ED visits due to substance abuse, and (c) adjusting resource capacity to address the forecasted demand. Key performance indicators used in this analysis are the overall ED length of stay (LOS) and the total number of patients treated in the Psychiatric Emergency Services Unit (PESU) as a percentage of the total number of MHA visits. Our results showed that if resource capacity is not adjusted, ED LOS will deteriorate considerably given the expected growth in demand; programs that aim to reduce the number of alcohol and/or opioid visits can greatly aid in reducing ED wait times; the legalization of recreational use of cannabis will have minimal impact, and increasing the number of PESU beds can provide great aid in reducing ED pressure.
The rising number of emergency department (ED) visits in Ontario, Canada, is currently outpacing the population growth . In seven years, the number of ED visits increased by 13.4% (from 5.2 million in 2008 to 5.9 million in 2014), while in the same period, the province’s population only experienced a 6.2% growth . According to Health Quality Ontario, visits to the ED are expected to rise even further, given that the population size in Ontario is estimated to grow by 30% in the next 25 years . Additionally, there has also been an increase in ED visits related to mental health and addiction (MHA) in Ontario [2–8]. In particular, the number of MHA visits paid to the ED of Toronto Western Hospital (TWH), an academic hospital in Toronto, Ontario, increased by 55.7% in the last five years (2012–2016), compared to 14.5% for nonmental health and addiction (NMHA) visits. MHA visits account for 9.3% of all ED visits at TWH . There is also evidence that ED visits for MHA have longer length of stay (LOS) compared to NMHA visits [5, 9, 10].
In response to prolonged wait times experienced in EDs and the impact of MHA on hospital use , there are system efforts underway to explore ways to improve the experience and impact of MHA ED visits. Several hospitals in the Greater Toronto Area have created separate MHA emergency units (usually within the ED) to provide streamlined care and safer environments for patients [12–15]. Another Ontario program to reduce the number of MHA ED visits is the META : PHI (Mentoring, Education, and Clinical Tools for Addiction : Primary Care-Hospital Integration), which provides evidence-based and timely treatment for patients with alcohol and opioid-related conditions through the use of Rapid Access Addiction Medicine (RAAM) clinics [16, 17]. Under the META : PHI care pathway, upon discharge from the ED, patients with alcohol and opioid-related dependence are referred to a RAAM clinic where they are seen by an addiction specialist within one week from their discharge date , thus contributing to a reduction in the number of addiction-related visits to the ED [19, 20]. At Health Sciences North in Sudbury, when comparing the number of times patients visited the ED 90 days before and after their first RAAM appointment, a 63% reduction in the number of ED visits was observed . Similarly, in Sarnia, a 45% reduction has been reported . As of July 2018, 29 RAAM clinics in 19 cities are listed on META : PHI’s website (8 of which are located in Toronto) .
There are two major external factors to consider in the context of MHA visits to the ED, which may impact the already overburdened emergency system across Canada: (1) the current national opioid crisis  and (2) the legalization of recreational cannabis in October 2018 . A 2017 report from the Canadian Institute for Health Information shows that the number of opioid overdose-related visits to the ED increased by almost 50% in the last five years (2012–2016) . Additionally, evidence shows that legalization of the recreational use of cannabis can result in an increase of cannabis-induced visits to the ED [24–27]. In Colorado, cannabis-related ED visits increased by 19% in the first year after legalization in 2013 . However, they also decreased by 27% in the following year (though it should be noted that this 27% only considers 9 months of comparable data, from Jan to Sept 2015) .
Provided that sustainable and efficient health care is based on adequate resource capacity to ensure that patients receive the care that they need in a timely manner , appropriate alignment between ED capacity and the growing demand should be sought. To this end, mathematical techniques, such as computer simulation, have been used for capacity planning and to improve the efficiency of healthcare services [29–36]. Most of these studies use DES and test scenarios of varying staff availability, scheduling adjustments, or changes to bed availability.
Drawing from the literature studies available, we initially quantify the number of substance abuse visits to TWH, which has a designated area within the ED for MHA cases, the PESU. We then use a discrete-event simulation (DES) to model ED capacity planning alternatives for the hospital, with special attention paid to potentially changing rates of MHA visits as a result of programs such as the META : PHI and the legalization of recreational cannabis in Canada. To the best of our knowledge, DES has not yet been applied in the context of modeling the impacts of MHA visits to the ED.
2.1. Emergency Department Overview
TWH has 272 beds  and is one of the four academic hospitals part of the University Health Network (UHN). TWH provides emergency care through its 34-bed ED and receives more than 60,000 visits a year . In addition to these 34 beds, physically located within the ED, the Psychiatric Emergency Service Unit (PESU) has an additional four beds and two chairs, where up to six patients can stay at a time. The PESU is a safe and secure environment where MHA patients are directed for treatment upon arrival to the ED .
2.2. Patient Flow
Figure 1 depicts the process flow at TWH’s ED. Patients arrive to the ED at TWH either on their own or by ambulance. Once in the ED, patients proceed to registration/triage, where they are seen by a registered nurse who assesses their health condition (e.g., reason for the visit, blood pressure, and body temperature) and provides them with an acuity score as per the Canadian Triage and Acuity Score (CTAS), which ranges from 1 to 5, with 1 being the most critical. After triage, if a stretcher is available, patients are generally assigned to a stretcher where they wait to see a physician. If a stretcher is not available, patients will remain in the waiting area until a stretcher is ready. When an ED physician initially sees a patient, lab or imaging tests may be ordered (e.g., blood work and ultrasound), and more complex cases may require the patient to be seen by another medical specialist (e.g., internal medicine and psychiatry). Patients who require testing and consultation must wait until their lab and imaging results are ready or until the consulting physician can see them. After a second assessment by the ED physician, patients commonly receive one of the following discharge dispositions: discharged, admitted, internal transfer, and external transfer. Discharged refers to patients who, after treatment, are sent to their place of residence; admitted refers to patients who were admitted to one of the hospital wards, operating room, or critical care unit; internal-transfer comprises all patients transferred within the hospital (e.g., to different clinics, or day surgery); and external transfers include all patients transferred to other acute or nonacute facilities outside of the hospital. Besides these 4 common dispositions, leaving against medical advice and dying during treatment are also possible dispositions.
For MHA patients, the flow through the ED is slightly different. After triage, if a bed is available in the PESU and the patient is medically stable and does not require a monitored bed, they are automatically transferred to the PESU. Otherwise, MHA patients occupy a regular bed in the ED until either a space in the PESU becomes available or until they are discharged (whichever comes first).
2.3. Data Source
This study was conducted using data collected from the National Ambulatory Care Reporting System (NACRS) and the Electronic Patient Records (EPR) system from UHN. The dataset included all visits paid to the TWH ED for a total of five fiscal years (i.e., 2012–2016), from April 2012 to March 2017. A fiscal year refers to the period from April 1st to March 31st, the following year. Full approval from the Research Ethics Board was obtained, and all data used were anonymized and secured.
The International Statistical Classification of Diseases (ICD-10) associated with the main problem code recorded for each ED visit was used to group the data into two general categories: MHA and NMHA. The MHA group included the following ICDs: substance abuse (F55, F10–F19), schizophrenia (F20-excluding F20.4, F21–F25, F28–F29), mood and affective disorder (F30–F34, F39), anxiety/stress (F40–F45, F48), others—behavioral syndromes associated with physiological disturbances and physical factors, disorders of adult personality and behavior, and intentional self-harm (F50–F54, F59-F60, F63–F66, F68-F69, X60–X84). The NMHA group included all other ICDs.
Since this analysis pays special attention to substance abuse visits to the ED and to allow additional scenario testing (detailed in Section 2.6), the substance abuse group was further divided into 5 subgroups: alcohol (ICD F10), opioids (ICD F11), cannabis (ICD F12), multiple substance-related visits (ICD F19), which are visits in which two or more substances are combined, and visits for other reasons (ICDs F13–F18) including cocaine, tobacco, and hallucinogens.
2.4. Data Analysis
Overall trends in the number of ED visits were calculated for both MHA and NMHA groups. To predict the future impacts of MHA ED visits, forecasting was used to estimate ED demand for fiscal years 2017 and 2018. Linear regression and Holt’s method were used to forecast demand for trend data, and exponential smoothing, moving average, and weighted moving average were used for stationary data. The mean absolute deviation (MAD) was used to evaluate the performance of each forecasting method. The method leading to the lowest MAD was then used to produce the forecast. For NMHA, substance abuse, mood, anxiety, and other visits, which presented an upward linear trend, linear regression was employed. For schizophrenia cases which showed a stationary behavior, weighted moving average was used (Figure 2 and Table 1).
Compared to observed demand in 2017.
2.5. Simulation Model Development and Validation
The DES model of patient flow (Figure 1) was created using data from the fiscal year 2016 in Simul8, a discrete-event simulation software . Stat:Fit  was used to fit statistical distributions to ED historical data. The model used current arrival rates for each visit type: NMHA, or one of the 5 MHA conditions—substance, schizophrenia, mood, anxiety, and other conditions. For processing times, the model also accounted for different acuity or CTAS (from 1 to 5) and discharge dispositions (i.e., discharged, admitted, internal and external transfer, and left/death upon arrival) associated with each visit type (Table 2).
To validate the simulation model, predicted and historical data were compared for the following parameters: (1) number of arrivals for both the NMHA and MHA group, (2) average ED LOS for both NMHA and MHA groups, and (3) ED LOS for NMHA and MHA combined average. ED LOS refers to the time from triage/registration to the time of discharge (i.e., in Figure 1, labeled as “Triage/Registration” to “Patient Discharge”). ED LOS is an important metric because for patients it represents the time they will be waiting to be serviced; from a quality-of-care perspective, several studies have linked prolonged ED LOS with adverse health outcomes [40–43]; also from a financial standpoint, the funding structure for hospitals in Ontario includes a pay for performance mechanism which awards financial incentives for hospitals that minimize ED LOS .
In addition to comparing the outputs of the model with the original data sources, face validation was conducted by subject-matter experts at TWH to ensure accurate representation of the current system. All relevant metrics calculated from TWH’s historical data fell with the 95% confidence interval of the simulation output (Table 3). Furthermore, the experts who reviewed the model were also satisfied with its performance. Hence, the model was deemed an appropriate representation of the current processes adopted in the hospital and was used to run further experiments. A screenshot of the simulation model can be seen in Figure 3.
2.6. Experimental Design
Five sets of experiments, based on specific motivating questions, were conducted to analyze different components of the system (Table 4). For succinctness, and because a previous study has already detailed the impacts on ED LOS when combining different factors (i.e., visit type-MHA and NMHA; CTAS; and disposition type) , the simulation results in this analysis will focus on two metrics: (1) the average overall ED LOS, which accounts for the ED LOS of both NMHA and MHA visits combined; (2) the number of MHA cases transferred to the PESU as a percentage of the total number of MHA arrivals to the ED. A more comprehensive list of metrics collected for each scenario tested is provided in Supplementary Materials Tables 5–10.
For each scenario, the simulation was run for 20 one-year (8,760 hours) replications. The warm-up period was 504 h (three weeks).
3.1. MHA vs. NMHA: Frequency and ED LOS
Between fiscal years 2012 and 2016, TWH received a total of 308,016 ED visits, out of which 25,114 visits (8.2%) were MHA visits. The total number of visits increased linearly by 15.5% from 56,345 to 65,078 (Figure 4). MHA visits rose from 3,923 to 6,131 visits (a 56.3% increase), while NMHA visits increased from 52,422 to 58,947 (a 12.4% increase). In 2015, there was a change in the Canadian Coding Standards for ICD-10-CA and the Canadian Classification of Health interventions, which may explain a small decrease in MHA visits for that specific year . When considering substance-related ED visits only, all 5 subgroups also experienced linear: alcohol visits increased from 1,569 to 2,119 (35.0%), opioids from 19 to 74 (289.5%), cannabis from 10 to 73 (630.0%), multiple substances from 187 to 453 (142.3%), and other-cause visits from 52 to 160 visits (207.7%) (Figure 5). As of March 2017, alcohol visits accounted for 73.6% of all substance abuse visits, followed by 15.7% for multiple substances, and 5.6% for other visits. Opioid- and cannabis-related visits accounted for a small percentage of substance abuse visits 2.6% and 2.5%, respectively.
3.2. Forecasting MHA Visits to the ED
Given that each MHA subgroup presented in a different demand pattern (i.e., either trend or stationary series) (Figure 2) and that the simulation model differentiates the interarrival rate and length of stay for each MHA subgroup, the demand for each MHA patient subgroup and for NMHA was forecasted individually for fiscal years 2017 and 2018 (Table 1). Scenario A uses these forecasted values as inputs for the simulation model.
For scenario B, only part of the substance abuse group is considered (i.e., alcohol- and opioid-related visits). The 2016 base value for these cases combined (i.e., 2,193) is adjusted according to the parameters defined in Table 4. Similarly, for scenario C, the 2016 value for the number of cannabis visits (73) is adjusted according to the parameters defined in Table 4.
3.3. Simulation: Experimental Results
3.3.1. Scenario A: ED LOS in 2017 and 2018
Using the values forecasted for the years 2017 and 2018, the average overall ED LOS increased from 6.2 h at the baseline in 2016 to 9.0 h (51.6% increase) in 2017 and 16.7 h (169.4% increase) in 2018 (Figure 6). Also, since the PESU is operating close to its capacity, the number of MHA patients seen in the PESU as a percentage of the total number of MHA visits to ED only decreased from 37.9% at the baseline to 37.1% in 2017 and 35.0% in 2018. The numbers obtained in this scenario are intuitive, considering that if demand is expected to increase and no adjustments in capacity are made, the service level (e.g., wait times) is likely to deteriorate. The reader should also be mindful that, as depicted in Figure 1, whenever the PESU is operating at its capacity, the excess of MHA patients is treated in the regular ED.
3.3.2. Scenarios B and C: Increase/Decrease in Substance Abuse Visits
In Scenario B, when reducing the arrival rate for alcohol- and opioid-related visits by 10%, 30%, 45%, and 63% the average overall ED LOS of 6.2 h at baseline decreased to 6.1 h, 5.7 h, 5.6 h, and 5.3 h, respectively (Figure 7). Moreover, when arrivals were reduced, the percentage of MHA patients seen in the PESU increased from 37.9% at the baseline to 39.1%, 41.8%, 44.2%, and 47.1%—note that the PESU capacity remains constant, so reducing the total number of MHA arrivals leads to an increment of the percentage of patients seen in the PESU. To exemplify this percent increase in patients serviced at PESU which may not be intuitive at first, consider that at most 6 patients can stay at the PESU at time (i.e., current scenario). Suppose that in the base scenario there were 30 MHA arrivals, the number of MHA cases transferred to the PESU as a percentage of the total number of MHA arrivals is 20% (i.e., 6/30); now suppose that MHA arrivals were reduced to 24, then the percentage of MHA patients seen in the PESU will increase to 25% (i.e., 6/24).
Results from Scenario B also highlight the benefits of implementing programs such as META : PHI, which include alleviating pressure from the ED/PESU by reducing the utilization of overburdened resources and likely improving patient care through reduction of wait times. Even if we consider demand reductions such as the ones observed in Sarnia (45%) and Sudbury (63%) to be overoptimistic for downtown Toronto, Scenario B shows that more conservative situations (i.e., with smaller reductions) can also produce a considerable impact on ED operations. For example, reducing the number of alcohol and opioid visits by 30%, which is equivalent to a 1% reduction in the overall ED volume, results in an 8.1% reduction in overall ED LOS (from 6.2 h to 5.7 h) and a 3.9% increase in MHA patients seen in the PESU (from 37.9% to 41.8%). Considering that most substance abuse patients are discharged from the hospital, the reduction in ED LOS can likely be attributed to the fact that discharged substance abuse visits are on average 1.8 h longer than discharged NMHA visits (5.8 h CI [5.6–6.0] versus 4.0 h CI [4.0–4.1]).
Another interesting result from Scenario B is the average MHA ED LOS (Table 6 in Supplementary Materials). Although one might have expected that reducing the number of alcohol- and opioid-related visits would produce a reduction in the average MHA ED LOS, the simulation results showed the opposite. When reducing the number of alcohol and opioid related visits by 10%, 30%, 45%, and 63%, the average MHA ED LOS increased from 7.7 h to 7.8 h, 7.9 h, 8.2 h, and 8.2 h, respectively (Table 6 in Supplementary Materials). These results are likely obtained because among MHA visits, the substance abuse group accounts for the largest population and it presents the second lowest average ED LOS, i.e., average 6.2 h and 95% CI [6.2–6.3], compared to the other MHA conditions, such as: schizophrenia, average 14.4 h and 95% CI [14.0–14.8]; mood disorders, average 12.1 h and 95% CI [11.4–12.7]; anxiety, average 4.0 h and 95% CI [3.9–4.1]; and other conditions, average 8.9 h and 95% CI [7.9–9.9]. In other words, removing a large portion of visits that account for one of the smallest average ED LOS from the MHA group, and keeping the visits that have a larger ED LOS, increased the overall average MHA ED LOS.
In Scenario C, when the arrival rate for cannabis-related visits at TWH was adjusted to mimic Colorado’s experience with recreational cannabis legalization, the average overall ED LOS of 6.2 h at the baseline increased to 6.3 h for the first year and reduced to 6.1 h in the second year. Moreover, the number of MHA patients seen in the PESU slightly reduced from 37.9% at the baseline to 37.8% in the first year, and it increased again to 37.9% in the second year (Figure 8). These numbers show that—given the very small number of cannabis-related visits to the TWH’s ED—the legalization will likely have almost no impact on ED flow.
3.3.3. Scenario D: Increased PESU Capacity in 2016
In Scenario D, when the number of beds in the PESU was increased from the current state of 6 beds to 7, 8, 9, or 10 beds, the overall average ED LOS reduced from the baseline of 6.2 h to 5.8 h, 5.6 h, 5.4 h, and 5.2 h, respectively (Figure 9). Furthermore, the percentage of MHA patients seen in the PESU increased from its current level of 37.9% to 43.8%, 49.5%, 55.1%, and 60.4% respectively. Note that, adding more beds to the PESU indeed led to a reduction in the overall ED LOS and a constant increase in the number of MHA seen in the PESU; however, the biggest reduction in ED LOS came from adding the first bed PESU (i.e., total of 7 beds) which reduced ED LOS by an average of 0.4 h, after that, each bed added only reduced ED LOS by an average of 0.2 h.
3.3.4. Scenario E: Increased PESU Capacity in 2017 and 2018
In Scenario E, when the number of PESU beds was increased following the numbers defined in Scenario D in combination with the demand forecasted for 2017 and 2018, the additional beds showed a positive and considerable impact on ED LOS as well as on the percentage of patients seen in the PESU (Figure 10). In 2017, increasing the number of beds to 7, 8,9, and 10 reduced the overall ED LOS from 9.0 h to 8.2 h, 7.3 h, 6.9 h, and 6.5 h, respectively, while the percentage of visits transferred to PESU increased from 37.1% to 43.0%, 48.6%, 54.1%, and 59.5%, respectively. Different from Scenario D, in which the biggest reduction in the overall ED LOS happened by adding one bed to the PESU, in this scenario—considering the demand for 2017—the largest reduction happens at 8 beds (i.e., with two additional PESU beds)). The initial bed added reduced the overall ED LOS by 0.8 h, the second bed by 0.9 h, and both the third and fourth bed by 0.4 h.
For 2018, increasing the number of beds to 7, 8, 9, and 10 reduced the overall ED LOS from 16.7 h to 13.9 h, 11.4 h, 10.1 h, and 8.9 h, while the percentage of visits transferred to PESU increased from 35.0% to 40.6%, 46.0%, 51.3%, and 56.4%, respectively (Figure 10). This scenario shows that the PESU capacity can greatly aid in reducing the overall ED LOS when demand further increases, in comparison with 2017, in which adding PESU beds led to an average ED LOS reduction of less than or equal to 0.9 h; in 2018, the smallest reduction is 1.2 h, but it goes up to 2.8 h when only one bed is added to the PESU (i.e., total of 7 beds).
Given the current national opioid crisis and the legalization of recreational use of cannabis, this study quantified the number of substance abuse-related visits to a single academic hospital (i.e., TWH), this study also employed DES modeling to evaluate plausible scenarios that will likely impact ED wait times, such as demand fluctuations and resource capacity adjustments due to changes in the MHA landscape in Canada.
In congruency with other studies, our results showed that the overall number of MHA ED visits is increasing [3, 5–7], particularly in the number of substance abuse visits [2, 46, 47]. Through the use of demand forecasting models, we also found that the MHA demand for ED services is expected to grow even further.
After incorporating the forecasted demand into the DES models, we were able to quantify and show that the expected growth in demand will considerably impact LOS at TWH’s ED. Prolonged LOS has been associated with poor patient management and clinical outcomes [40, 48–51], but specially for MHA patients—given the noisy and busy environment in the ED—longer waits potentially accentuate their psychological distress, which compromises their own safety and that of those around them (including other patients and staff) [5, 52–54], thus warranting possible ED process improvement and or/resource capacity adjustment (e.g., PESU number of beds).
Moreover, given the recent programs that have been spreading across the province to reduce the number of substance and opioid related visits to the ED by diverting these patients to alternative facilities and more specialized services [18, 55], we also used the DES model to evaluate the impact of such scenarios. Obtained results evidenced that patient flow in the ED could greatly benefit from care models such as the one stablished by the program META : PHI by diverting part of the substance abuse visits to other care settings, not only reduced the overall average ED LOS but also allowed the PESU, which is deemed a safer environment for patients in psychiatric crisis, to care for larger proportion of MHA patients who presented to the ED.
Even though we found that the legalization for recreational use of cannabis will likely not have a significant impact on TWH’s ED resource utilization, two factors should be considered when interpreting these results: (1) TWH’s ED number of cannabis visits could be misrepresented since data accuracy is often an issue when analyzing health administrative data, especially in substance abuse conditions when the type of substance may not be precisely recorded ; (2) our single-hospital results are not representative of other locations that have a well-documented history of struggling with substance abuse and addictions [57–63] (e.g., provinces such as British Columbia and Nova Scotia or the Thunder Bay district within Ontario). Stronger impacts on ED utilization may be observed in these places.
Lastly, we employed the DES model created to investigate how changes in PESU bed capacity could alleviate pressures from the ED. The results obtained showed that incrementing the number of PESU beds could meaningfully reduce ED LOS by servicing a larger percentage of MHA cases in the PESU. The benefits of adding more beds to the PESU became more evident when demand increase was also accounted in the model. Also, we were able to show what number of PESU beds could lead to the highest reduction in wait times.
Limitations of this study include the fact that the simulation model does not include hospital resources other than ED and PESU bed capacity. Much research is warranted to include additional staff involved in ED and PESU operations (including doctors, nurses, and social workers). Additionally, as with most simulation models, the model created here is specific to the site for which it was created, even though the overall patient flow observed in TWH’s ED is similar to several other hospitals. Also, the lack of historical data from PESU LOS may compromise the validation process. Finally, because of the ICD coding mechanism, some cannabis, alcohol, and opioid visits may not have been accurately represented in the simulation model because they were hidden in the subgroup multiple substances.
Considering the increasing number of MHA visits to the ED, and the current opioid crisis Canada is facing combined with the legalization of recreational cannabis in October 2018, this study quantified the number of visits TWH received in five fiscal years (i.e., 2012–2016), used demand forecasting techniques to predict future ED demand, and employed a discrete event simulation model to evaluate the effects of demand and capacity adjustment in ED performance. The results obtained in this analysis showed that wait times are likely to deteriorate if no adjustment in resource capacity is made. We also found that programs such as META-PHI, which aim to reduce substance- and/or opioid-related conditions to the ED, can greatly contribute to reducing pressures from the ED. Moreover, cannabis legalization will have almost no impact on TWH’s ED performance. Lastly, increasing PESU bed capacity will decrease overall ED wait times and increase the number of patients treated in a safer environment for people with MHA conditions.
The historical data used to support the findings of this study may be released upon application to the University Health Network Research Ethics Board, who can be contacted at firstname.lastname@example.org.
Conflicts of Interest
The authors have no conflicts of interest to disclose.
Additional metrics obtained from each simulated scenario are provided in the supplementary material (Appendix A, Tables 5–10). (Supplementary Materials)
- Health Quality Ontario, Under Pressure: Emergency Department Performance in Ontario, Queen’s Printer for Ontario, Toronto, Canada, 2016, http://www.hqontario.ca/portals/0/Documents/system-performance/under-pressure-report-en.pdf.
- S. Gandhi, M. Chiu, K. Lam, J. C. Cairney, A. Guttmann, and P. Kurdyak, “Mental health service use among children and youth in Ontario: population-based trends over time,” The Canadian Journal of Psychiatry, vol. 61, no. 2, pp. 119–124, 2016.
- Canadian Institute for Health Information, Care for Children and Youth with Mental Disorders, CIHI, Ottawa, Canada, 2015.
- MHASEF Research Team, Mental Health and Addictions System Performance in Ontario: A Baseline Scorecard. Chart Pack, Institute for Clinical Evaluative Sciences, Toronto, Canada, 2018.
- D. Baia Medeiros, S. Hahn-Goldberg, E. O’Connor, and D. Aleman, “Analysis of emergency department length of stay for mental health visits: a case study of a Canadian academic hospital,” CJEM, vol. 21, no. 3, pp. 374–383, 2019.
- C. Matsumoto, T. O’Driscoll, J. Lawrance, A. Jakubow, S. Madden, and L. Kelly, “A 5 year retrospective study of emergency department use in northwest ontario: A measure of mental health and addictions needs,” CJEM: Journal of the Canadian Association of Emergency Physicians, vol. 19, no. 5, pp. 381–385, 2017.
- HCUP, Statistical Brief #216: Trends in Emergency Department Visits Involving Mental and Substance Use Disorders, 2006–2013, Agency for Healthcare Research and Quality, Rockville, MD, USA, 2016.
- Canadian Institute for Health Information, Opioid-Related Harms in Canada, CIHI, Ottawa, Canada, 2017.
- J. M. Zhu, A. Singhal, and R. Y. Hsia, “Emergency department length-of-stay for psychiatric visits was significantly longer than for nonpsychiatric visits, 2002–11,” Health Affairs, vol. 35, no. 9, pp. 1698–1706, 2016.
- B. A. Nicks and D. M. Manthey, “The impact of psychiatric patient boarding in emergency departments,” Emergency Medicine International, vol. 2012, Article ID 360308, 5 pages, 2012.
- M. M. Young and R. A. Jesseman, The Impact of Substance Abuse Disorders on Hospital Use, Canadian Centre on Substance Abuse, Ottawa, Canada, 2014.
- PESU, Welcome to Psychiatric Emergency Services Unit (PESU), University Health Network, Toronto, Canada, 2018.
- St. Michael’s Hospital, Mental Health and Addiction Services: Psychiatric Emergency Services, St. Michael’s Hospital, Toronto, Canada, 2018, http://www.stmichaelshospital.com/programs/mentalhealth/emergency.php.
- St. Joseph’s Health Centre, Mental Health and Crisis Intervention, St. Joseph’s Health Centre, Toronto, Canada, 2016, https://stjoestoronto.ca/patient-care-and-services/mental-health-crisis-intervention/.
- St. Joseph’s Healthcare Hamilton, Emergency Psychiatric Services, St. Joseph’s Healthcare Hamilton, Hamilton, Canada, 2014, https://www.stjoes.ca/hospital-services/mental-health-addiction-services/mental-health-services/emergency-psychiatry-services.
- H. Lillico, “META:PHI—how one initiative is increasing access to evidence-based treatments for substance use issues,” Evidence Exchange Network for Mental Health and Addictions, 2017.
- Women’s College Hospital, Programs & Clinics—Meta:PHI, 2018, http://www.womenscollegehospital.ca/programs-and-services/METAPHI.
- META:PHI., “Mentoring, Education, and Clinicals Tools for Addiction: Primary Care-Hospital Integration (META:PHI)—A provincial initiative to support health care providers in treating people struggling with substance abuse disorders,” 2018, http://www.metaphi.ca/.
- Council of Academic Hospitals of Ontario, Addictions Program That Reduces Emergency Room Visits for Opioid Overdose and Improves Patient Experience across Ontario, Health Quality Ontario, Toronto, Canada, 2017, http://caho-hospitals.com/artic-metaphi-results/.
- T. Kula, META: PHI Dropped User Reliance on Emergency Departement in Sarnia 45 Per Cent, Doctor Says, Sarnia Observer, Sarnia, Canada, 2017, https://www.theobserver.ca/2017/07/06/metaphi-dropped-user-reliance-on-the-emergency-department-in-sarnia-45-per-cent-doctor-says/wcm/a327785f-91a7-375b-8a8a-78d1812c342e.
- META:PHI., “RAAM clinics,” 2018, http://www.metaphi.ca/raam-clinics/.
- Government of Canada, Get the Facts of the Opioid Crisis in Canada, 2018, https://www.canada.ca/en/services/health/campaigns/drug-prevention.html.
- Department of Justice, Cannabis Leagalization and Regulation, 2018, https://www.justice.gc.ca/eng/cj-jp/cannabis/.
- K. Waddell and M. G. Wilson, Rapid Synthesis: Examining the Impact of Decriminalizing or Legalizing Cannabis for Recreational Use, McMaster University, Hamilton, Canada, 2017.
- H. S. Kim and A. A. Monte, “Colorado cannabis legalization and its effect on emergency care,” Annals of Emergency Medicine, vol. 68, no. 1, pp. 71–75, 2016.
- T. S. Ghosh, D. I. Vigil, A. Maffey et al., “Lessons learned after three years of legalized, recreational marijuana: the Colorado experience,” Preventive Medicine, vol. 104, pp. 4–6, 2017.
- A. Maslov, A. Lawrence, and M. Ferguson, Cannabis Performance Metrics for Policy Consideration: What do We Need to Measure? Public Safety Canada, Canada, 2016.
- Rocky Mountain HIDTA, The Legalization of Marijuana in Colorado: The Impact, vol. 5, Rocky Mountain HIDTA, Denver, CO, USA, 2017.
- J. Patrick, K. Nelson, and D. Lane, “A simulation model for capacity planning in community care,” Journal of Simulation, vol. 9, no. 2, pp. 111–120, 2015.
- M. M. Günal and M. Pidd, “Discrete event simulation for performance modelling in health care: a review of the literature,” Journal of Simulation, vol. 4, no. 1, pp. 42–51, 2010.
- R. Ceglowski, L. Churilov, and J. Wasserthiel, “Combining data mining and discrete event simulation for a value-added view of a hospital emergency department,” Journal of the Operational Research Society, vol. 58, no. 2, pp. 246–254, 2007.
- S. Hahn-Goldberg, E. Chow, E. Appel et al., “Discrete event simulation of patient admissions to a neurovascular unit,” Journal of Healthcare Engineering, vol. 5, no. 3, pp. 347–360, 2014.
- G. R. Hung, S. R. Whitehouse, C. O’Neill, A. P. Gray, and N. Kissoon, “Computer modeling of patient flow in a pediatric emergency department using discrete event simulation,” Pediatric Emergency Care, vol. 23, no. 1, pp. 5–10, 2007.
- L. Bedoya-Valencia and E. Kirac, “Evaluating alternative resource allocation in an emergency department using discrete event simulation,” Simulation, vol. 92, no. 12, pp. 1041–1051, 2018.
- L. Chepenik and E. Pinker, “The impact of increasing staff resources on patient flow in a psychiatric emergency service,” Psychiatric Services, vol. 68, no. 5, pp. 470–475, 2017.
- C. Duguay and F. Chetouane, “Modeling and improving emergency department systems using discrete event simulation,” Simulation, vol. 83, no. 4, pp. 311–320, 2007.
- University Health Network, Toronto Western Hospital, University Health Network, Toronto, Canada, 2018, https://www.uhn.ca/corporate/AboutUHN/OurHospitals/TWH.
- Simul8, Simul8 Professional: Powerful Software for Rapid and Flexible Modeling, 2018, https://www.simul8.com/products/professional.
- Geer Mountain Software, Stat::Fit—Distribution Fitting Software, 2018, https://www.geerms.com/.
- E. M. Jones, A. K. Boehme, A. Aysenne et al., “Prolonged emergency department length of stay as a predictor of adverse outcomes in patients with intracranial hemorrhage,” Journal of Critical Care Medicine, vol. 2015, Article ID 526319, 5 pages, 2015.
- A. Guttmann, M. J. Schull, M. J. Vermeulen, and T. A. Stukel, “Association between waiting times and short term mortality and hospital admission after departure from emergency department: population based cohort study from Ontario, Canada,” BMJ, vol. 342, Article ID d2983, 2011.
- D. B. Diercks, M. T. Roe, A. Y. Chen et al., “Prolonged emergency department stays of non-ST-segment-elevation myocardial infarction patients are associated with worse adherence to the american college of cardiology/american heart association guidelines for management and increased adverse events,” Annals of Emergency Medicine, vol. 50, no. 5, pp. 489–496, 2007.
- S. L. Bernstein, D. Aronsky, R. Duseja et al., “The effect of emergency department crowding on clinically oriented outcomes,” Academic Emergency Medicine, vol. 16, no. 1, pp. 1–10, 2009.
- M. J. Vermeulen, T. A. Stukel, A. S. Boozary, A. Guttmann, and M. J. Schull, “The effect of pay for performance in the emergency department on patient waiting times and quality of care in Ontario, Canada: a difference-in-differences analysis,” Annals of Emergency Medicine, vol. 67, no. 4, pp. 496.e7–505.e7, 2016.
- Colorado Department of Public Health & Environment, Monitoring Health Concerns Related to Marijuana in Colorado: 2014, Colorado Department of Public Health & Environment, Denver, CO, USA, 2014.
- CIHI, Canadian Coding Standards for ICD-10-CA and CCI, CIHI, Ottawa, Canada, 2015, https://secure.cihi.ca/free_products/Coding%20standard_EN_web.pdf.
- Canadian Institute for Health Information and Canadian Centre on Substance Abuse, Hospitalizations and Emergency Department Visits Due to Opioid Poisoning in Canada, CIHI, Ottawa, Canada, 2016.
- Centers for Disease Control and Prevention, National Hospital Care Survey: Emergency department Visits for Substance Abuse, Centers for Disease Control and Prevention, Atlanta, GA, USA, 2011.
- B. C. Sun, R. Y. Hsia, R. E. Weiss et al., “Effect of emergency department crowding on outcomes of admitted patients,” Annals of Emergency Medicine, vol. 61, no. 6, pp. 605.e6–611.e6, 2013.
- B. G. Carr, A. J. Kaye, D. J. Wiebe, V. H. Gracias, C. W. Schwab, and P. M. Reilly, “Emergency department length of stay: a major risk factor for pneumonia in intubated blunt trauma patients,” Journal of Trauma: Injury, Infection, and Critical Care, vol. 63, no. 1, pp. 9–12, 2007.
- E. J. Carter, S. M. Pouch, and E. L. Larson, “The relationship between emergency department crowding and patient outcomes: a systematic review,” Journal of Nursing Scholarship, vol. 46, no. 2, pp. 106–115, 2014.
- A. J. Singer, H. C. Thode Jr., P. Viccellio, and J. M. Pines, “The association between length of emergency department boarding and mortality,” Academic Emergency Medicine, vol. 18, no. 12, pp. 1324–1329, 2018.
- The College of Emergency Medicine, Mental Health in Emergency Departments: a Toolkit for Improving Care, Royal College of Emergency Medicine, London, UK, 2013.
- K. Innes, J. Morphet, A. P. O’Brien, and I. Munro, “Caring for the mental illness patient in emergency departments—an exploration of the issues from a healthcare provider perspective,” Journal of Clinical Nursing, vol. 23, no. 13-14, pp. 2003–2011, 2014.
- D. E. Clarke, D. Dusome, and L. Hughes, “Emergency department from the mental health client’s perspective,” International Journal of Mental Health Nursing, vol. 16, no. 2, pp. 126–131, 2007.
- North York General Hospital, ARCS Partnership Provides Patients with Best Mental Health Care, North York General Hospital, Toronto, Canada, 2017, http://www.nygh.on.ca/Default.aspx?cid=4418&lang=1.
- J. Fahimi, A. Aurrecoechea, E. Anderson, A. Herring, and H. Alter, “Substance abuse and mental health visits among adolescents presenting to US emergency departments,” Pediatric Emergency Care, vol. 31, no. 5, pp. 331–338, 2015.
- Statistics Canada, Cannabis Stats Hub: Health, Statistics Canada, Ottawa, Canada, 2018, https://www150.statcan.gc.ca/n1/pub/13-610-x/cannabis-eng.htm.
- “Special advisory committee on the epidemic of opioid overdoses,” National Report: Apparent Opioid-Related Deaths in Canada (January 2016 to March 2018), Public Health Agency of Canada, Ottawa, Canada, 2018, https://www.canada.ca/en/public-health/services/publications/healthy-living/national-report-apparent-opioid-related-deaths-released-march-2018.html.
- Thunder Bay District Health Unit, Alcohol Infographic: Let’s Start a Conversation About Alcohol in Our Community, Thunder Bay District Health Unit, Thunder Bay, Canada, 2016, https://www.tbdhu.com/sites/default/files/files/resource/2016-10/Alcohol%20Infographic.pdf.
- Government of Canada, Canadian Tobacco Alcohol and Drugs (CTADS): 2015 Supplementary Tables, vol. 2018, Government of Canada, 2017, https://www.canada.ca/en/health-canada/services/canadian-tobacco-alcohol-drugs-survey/2015-supplementary-tables.html.
- Statistics Canada, National Cannabis Survey: 2nd Quarter, 2018, Statistics Canada, Ottawa, Canada, 2018.
- Public Health Ontario, Self-Reported Rate of Exceeding Low-Risk Alcohol Drinking Guideline for Chronic Disease, vol. 2018, Public Health Ontario, Toronto, Canada, 2018.
Copyright © 2019 Deyvison T. Baia Medeiros et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.