Table of Contents Author Guidelines Submit a Manuscript
Emergency Medicine International
Volume 2018, Article ID 9298024, 10 pages
https://doi.org/10.1155/2018/9298024
Research Article

Payment Reforms for Prehospital Care Services in a Middle Income Country: Assessing Implementation and Patient Outcomes Using a Mixed-Methods Approach

1Department of Community Medicine, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Rama 6, Ratchatewi, Bangkok, Thailand
2Department of Emergency Medicine, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Rama 6, Ratchatewi, Bangkok, Thailand
3National Institute of Emergency Medicine, Ministry of Public Health, Tiwanond, Muang, Nonthaburi, Thailand
4Department of Physiology, Faculty of Science, Mahidol University, 272 Rama 6 Rd, Rajathevi, Bangkok 10400, Thailand

Correspondence should be addressed to Paibul Suriyawongpaisal; moc.liamg@sslubiap

Received 28 February 2018; Revised 6 June 2018; Accepted 19 June 2018; Published 9 July 2018

Academic Editor: Roberto Cirocchi

Copyright © 2018 Paibul Suriyawongpaisal et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Introduction. Financing health systems constitutes a key element of well-functioning healthcare system. Prior to 2015, two new financial arrangements (direct-pay and E-claim systems) were introduced on a voluntary basis which aimed to pool more financial resources and improve cash flow of prehospital care systems. The aims of this study were to (1) assess the effects of direct-pay system in terms of (a) timeliness of reimbursement to EMS agencies, (b) changes in clinical care processes, and (c) the outcomes of patient care as compared to previous system; (2) identify the reasons for or against EMS agencies to participate in direct-pay system mechanisms; (3) identify the emerging issues with potential to significantly further the advancement of EMS systems. Using a mixed-methods approach, retrospective datasets of 3,769,399 individual records of call responses from 2015 to 2017 were analyzed which compared EMS units with the direct-pay system against those without in terms of time flow of claim data and patient outcomes. For qualitative data, in-depth interviews were conducted. Results. EMS units participating in both systems had the highest percentages of financial claim being made in time as compared to those not participating in any (p=0.012). However, there were not any practically meaningful differences between EMS units participating and not participating in either of the payment systems in terms of patient care such as appropriateness of response time, airway management, and outcome of treatment. Analysis of data from focus-group and individual interviews ended up with a causal loop diagram demonstrating potential explanatory mechanisms for those findings. Conclusion. It is evident that progress has been made in terms of mobilising more financial inputs and improving financial information flow. However, there is no evidence of any changes in patient outcomes and quality of care. Furthermore, whether the progress is meaningful in filling the gaps of financial demands of the prehospital care systems is still questionable. Room for future improvement of prehospital care systems was discussed with implications for other countries.

1. Introduction

The development and implementation of an EMS system vary among lower-middle income countries (LMICs). Many LMICs lack an organized EMS system with most ambulances used purely for transport and not as emergency care vehicles. Financial issues are the most common problems faced by LMICs [1].

In effect, developed countries like the U.S. with the so-called modern EMS systems are still facing financial constraints. Since 2010, many changes enacted by the Patient Protection and Affordable Care Act (ACA) under the Obama Care Reform have directly affected emergency care with potential indirect effects on EMS systems. New Medicaid enrollees and changes to existing coverage plans may alter EMS transport volumes. Reimbursement changes such as adjustments to the ambulance inflation factor (AIF) alter the yearly increases in EMS reimbursement by incorporating the multifactor productivity value into yearly reimbursement adjustments [2].

Another example is payment to EMS agencies in New Zealand which was found to be inconsistent in terms of payment rate and beneficiary groups among funders (the Ministry of Health and the Accident Compensation Commission, (ACC)). Under the ACC payment systems focusing on transporting live injured patients, EMS providers were incentivised to overtriage practices and perceived pressure to transport patients. In addition, only ambulance services were considered eligible for the ACC payment system despite the fact that fire services increasingly attended to emergency cases as first responders [3].

Thailand, a middle income country, formalised the development of EMS systems by establishing a national statutory lead agency, the National Institute for Emergency Medicine (NIEMS), in 2008. Since then NIEMS sought to focus its mission on strengthening EMS [4]. With expanded coverage of EMS and certain degree of performance improvement as indicated by shortened response time over the last decade, there is currently a growing concern of financial support, such as delayed payment to EMS agencies, provision of services without reimbursement, and overall deficit in the financial system. As a result, NIEMS took a policy of dubbed direct-pay system aiming at mobilisation of more financial resources and better facilitating the financial flows in 2016. The direct-pay systems channeled payment directly from the source to EMS units instead of indirect transfer through provincial health offices supervising EMS units in each province (Figure 1).

Figure 1: A comparison between the data flows of previous payment system and direct-pay system.

This study had two purposes. The first purpose was to assess whether progress has been made towards its aim. The second purpose was to draw lessons learnt to guide further improvement of the EMS systems. Specifically, we aimed to answer the following questions: (1) What are the effects of direct-pay system mechanisms in terms of timeliness of reimbursement to EMS agencies and changes in clinical care processes of patients as compared to previous mechanisms? (2) What are the reasons for or against EMS agencies to participate in direct-pay system mechanisms? (3) What are emerging issues with potential to significantly further the advancement of EMS systems after the introduction of the direct-pay system?

2. Methods

2.1. Study Design

Given the multiple objectives of the policy, we employed a mixed-methods approach comprising (a) secondary data analysis to provide quantitative assessment of the policy implementation (question no. 1) and (b) qualitative methods including documentary review, focus-group discussions, and informal individual interviews to address question no. 2 and no. 3.

2.2. Settings and Policy Interventions

Since 2009, NIEMS was established as a statutory national lead agency under the Ministry of Public Health [4]. It was mandated to formulate master plan and orchestrate its implementation for the development of EMS system including service standard setting, EMS personnel training and registering, financing of EMS services, and policy research. During 2009 to 2012, NIEMS chose to focus on expansion of infrastructure and mechanisms for prehospital care including manpower development and setting up new ambulance stations. This was built on the momentum of earlier efforts on prehospital care development which started at least 2 decades earlier. Prehospital ambulances were organized in 4 tiers (Advanced Life Support, Intermediate Life Support, Basic Life Support, and First Responder) with public financing system under NIEMS responsibility.

Under the EMS systems covering 68 million population in 76 provinces of the country, NIEMS has played a major role as a regulator and public purchaser of EMS services including operation of an emergency dispatch center for ambulances (EDC) in each province. In 2016, there were 8,669 registered EMS units under local authorities (64.7%), public hospitals (22.5%), voluntary organizations (9.7%), private hospitals (2.6%), and others (0.5%). They responded to 1.5 million calls in total per year [5].

Before the 2016 direct-pay system, NIEMS reimbursed EMS agencies by transferring the payment through provincial health office (PHO) in each province. The payment was made on fee-for-service basis with a fixed rate per call for each tier (i.e., $30 for Advanced Life Support, $15 for Basic Life Support, and $10.5 for First Responder). In 2015, NIEMS spent around $ 20 million on reimbursement of EMS operations [6]. The transfer of payment was made on monthly basis after receiving claims initially approved by the PHO, which usually took over 2 months for the whole process. At the start, each paper-based claim was filed to the PHO by EMS agencies upon completion of an operation using a standard form called “Information Technology for Emergency Medical System (ITEMS)”. The PHO would audit and approve the claim data before transferring (in bulk) to NIEMS. Then NIEMS would reaudit the claims before transferring the money to the PHO for further distribution to EMS units and EDCs. Under this payment system of paper-based financial transactions, keeping track of the claim amounts was almost impossible. In addition, an audit report of the reimbursement for EMS system in 2015 highlighted a concern of EMS agencies about provision of EMS services without being reimbursed [7]. As a result, NIEMS responded with the direct-pay system to channel the payment directly to EMS units and EDCs in 2016.

To facilitate direct-pay system, NIEMS set up a web-based claim dataset (i.e., ITEMS dataset shown in Figure 2) allowing direct data entry by each EMS unit using a modified version of the standard form. However, the audit function remains at the PHO. Once the claims get final approval by NIEMS, the money is directly transferred to each EMS units’ bank account. Figure 1 compared the data and financial flow between the previous payment system and the direct-pay system. Implementation of the direct-pay system has been undertaken on voluntary basis; i.e., each EMS unit had its own choice of either joining the system or remaining with the previous payment system. In practice, a province participating in the system does not necessarily mean every EMS agency is taking part. So far there are 47 participating provinces (61.8%). Consequently, those nonparticipating provinces mean all EMS agencies are not participating. This is due to the fact that NIEMS approached the PHO of each province in order to implement the system.

Figure 2: Data and financial flows under NIEMS and RVP collaboration on E-claim payment system. Note: EDC: emergency dispatch center; PHO: provincial health office; E-budget: electronic budgeting dataset under NIEMS (National Institute of Emergency Medicine); E-claim: electronic claim dataset under RVP (Road Accident Victims Protection Company Limited); dash line: data flows; solid line: financial flows.

In parallel to the direct-pay system, there is another ongoing financial arrangement which involves NIEMS in collaboration with a private insurance agency acting as a national clearing house mechanism. This insurance agency is responsible for the coverage of compensation to road-traffic-injury victims and EMS agencies (for ambulance services). Figure 2 shows data and financial flows under NIEMS and RVP collaboration on E-claim payment system. Data exchange takes place between ITEMS dataset and E-claim dataset with a major focus on avoiding duplicate payments. This could be achieved by making use of citizen identification number of road accident victims available on each of the datasets. It should be noted that ITEMS dataset handles data pertinent to all types of patients being transported by EMS units whereas E-claim dataset handles data specifically related to road accident victims regardless of transport status.

The insurance agency, Road Accident Victims Protection Company Limited (RVP), was set up in February 2003 as a result of revision of the Road Accident Compensation Act 1992 in order to facilitate more access of road-traffic-injury victims to compensation for loss. According to insurance statistics, loss ratios varied from 25% to 35% during 1997–2014 as a result of their compliance to the law [8]. A loss ratio is the ratio between total spending and total premiums collected. This indicated substantial deficit in coverage of the compensation for victims. In 2012, an online electronic claim system (dubbed E-claim system) was set up to better facilitate hospitals and EMS agencies in making claims. In principle, E-claim system intended to facilitate access to data elements required by the claim protocols such as registered number of vehicles involved in crash, victims’ ID, motor-vehicle-insurance-policy number, and police records of a crash event. In 2015, NIEMS linked its electronic claim database (ITEMS) to the E-claim system of the company. Again, hospitals and EMS agencies are free to choose whether to use the facilities or not. It was expected that E-claim system would shorten the time of cash flow into hospitals or EMS agencies as well as improve coverage of the compensation to them and the victims (as they received medical care). Up to 2015, EMS agencies in 32 provinces joined the E-claim system (42.1%), and 19 of them overlapped with those joining the direct-pay system mentioned above.

2.3. Quantitative Methods

ITEMS datasets from 2015–2017 were eligible for the study. The dataset included 3,769,399 individual records of call responses from 76 provinces. This study examined the effect of both the direct-pay system and the E-claim system to the reimbursement data flows including time frame from call taking to complete submission of financial claims and percentages of financial claim being made in time. We also assessed the effect of those systems on the quality of care in terms of the appropriateness of response time, airway management, bleeding control, fluid replacement, fracture stabilization, and outcome of treatment. Normally, nurses at emergency rooms would audit these prehospital treatment practices and give feedback to EMS units on a regular basis with varying frequencies across provinces. This is a result of nation-wide clinical audit systems established by NIEMS since 2011 [9].

Categorical data were reported as number with its percentage. Continuous data were reported as mean (standard deviation; SD) or median (interquartile range; IQR) for normal and nonnormal distributions, respectively. For implementation outcome, multilevel mixed-effects linear regression was applied for comparing between participating and nonparticipating EMS units. In the absence of multicollinearity between direct-pay and E-claim systems, multivariate analysis by controlling year and system was applied. For patient outcomes, only patients who needed prehospital treatment were included for final analysis. Comparing fatal outcomes across EMS units with different participation in the initiatives, the whole dataset was included. Chi-square test was applied to compare patient outcomes between participating and nonparticipating EMS units. STATA version 14 (StataCorp 2015, Stata Statistical Software: Release 14, College Station, TX: StataCorp LP) was applied for all statistical analyses and p value less than 0.05 was considered statistically significant.

2.4. Qualitative Methods

Documentary review aimed to guide the interviews and triangulate findings from the interviews. Documents were searched purposively using Google Scholar and Google Search based on the following keywords: EMS, prehospital care, payment methods, reimbursement, access, staff mix, human resource, NIEMS, RVP, road victims, compensation, policy, annual report. Key actors mentioned above were contacted for relevant documents not accessible on the Internet.

Focus-group or informal individual interviews were done using the semi-structured interview guideline according to the WHO health systems building blocks [10] (Table 2). The interviewees at provincial level were purposively chosen under two categories: 4 provinces with participating EMS agencies in direct-pay system and 4 provinces without participating EMS agencies (Table 1). Tape records were transcribed verbatim. Thematic content analysis was performed to capture emerging themes, subthemes, and details. Relationships between themes and subthemes were identified. These were carried out in parallel by the first three authors. The authors discussed the findings to achieve consensus on the final conclusions. These qualitative methods would enable us to make better sense of the results from quantitative analysis of ITEMS dataset and comprehensive understanding of how the payment initiative might influence overall performance of the EMS systems.

Table 1
Table 2: List of themes and subthemes for guiding data gathering in focus-group or individual interview sessions.

3. Results

3.1. Effect of Direct-Pay System and E-Claim System on Reimbursement Data Flows

Table 3 revealed the time frame for data flows from call taking to completed submission of financial claim in the clusters of EMS units joining direct-pay system (n = 47 provinces) which were 10.47 days shorter than that in those clusters that did not join (n=29 provinces) (p=0.294). Similar effects were observed for the E-claim system (n=32 provinces) which were 8.07 days shorter than that in the previous system (n=44 provinces) (p=0.411). Categorical approach to the data confirmed the above findings for the direct-pay system (p=0.01) but not the E-claim system (p=0.181). There were no statistically significant increases of the percentages in the E-claim system EMS unit (coefficient = 9.69%, p=0.181). In Table 4, the EMS units participating in both systems had the highest percentages of financial claim being made in time as compared to those not participating in any (p=0.012).

Table 3: Time flow of claim data under direct-pay and e-claim systems adjusted by project-year of participating.
Table 4: Time flow of claim data under double system compared with single system adjusted by project-year of participating.

Interviews’ findings corroborated with the findings from quantitative analysis (Table 5). Almost all EMS practitioners and staff of PHO in provinces with participating EMS units believed that direct-pay system lessened the burden of work related to submission of financial claim as compared to the previous system based on paper work. Apart from facilitating claim data entry, direct-pay system also allows keeping track of the financial claims. Nonetheless, there were complaints about missing data due to unregistered motor vehicles or registered motor vehicles without insurance. The missing data rendered ineligibility to make claim as required by the RVP protocol.

Table 5: Themes and representative quotations related to how the direct-pay system and e-claim system initiative might influence overall performance of EMS systems.
3.2. Effect of Direct-Pay and E-Claim System on Delivery of Prehospital Care

Table 6 reveals a failure to detect any practically meaningful differences between EMS units participating and not participating in either of the payment systems in terms of the appropriateness of response time, airway management, bleeding control, fluid replacement, fracture stabilization, and outcome of treatment.

Table 6: Comparison of quality of care processes and patient outcomes between participating EMS units and nonparticipating EMS units under the direct-pay system and the E-claim system.

Similarly, reviewing annual reports of NIEMS from 2014 to 2016 showed slightly declining trends of performance of EMS units according to standards set by NIEMS. For instance, percentages of those meeting standard response times for call taking to on-scene arrival within 10 minutes slightly declined from 76 to 74 percent whereas the time frame for traveling from scene to hospital within 60 minutes declined from 99 to 97 percent. Again, looking into insurance statistics for potential effect of E-claim system on delivery of prehospital care revealed negative impact. According to insurance statistics, loss ratio has followed a declining trend for compensating road-traffic-injury victims related to crash involved in either 4 or more wheeled motor vehicles and for two wheeled motor vehicles during the last decade. This might suggest road accident victims who needed medical care had been increasingly less likely to access the care they needed.

Why Did Direct-Pay and E-Claim System Fail to Elicit Intended Effects on the Service Delivery?. Analysis of data from focus-group and individual interviews ended up with a causal loop diagram demonstrating potential explanatory mechanisms as shown in Figure 3. Regarding financial incentive as a key performance driver, findings from the qualitative approach revealed many sources of revenues for an EMS unit including regular budget, donation, and user fees apart from those in the two payment systems. Some EMS units under charitable organizations refused to receive payment from the two payment systems altogether since the beginning of those systems. The consequence of public financial audit on a number of local authority agencies had been realized by all key informants working with the agencies and outsiders. Under the current government, news reports had covered a number of top executives of these agencies being dismissed from their offices and they faced financial penalty. Some of our key informants mentioned ending of EMS services under those local authorities. For both EMS units under public and nonpublic agencies, a common perception was unmatched expenditure for provision of EMS services to the amount of revenues from the two schemes.

Figure 3: Causal loop diagram of potential explanatory mechanisms of EMS overall performance.

4. Discussion

4.1. Progress of the New Payment Systems (Implementation Outcomes)

The findings support shortening of reimbursement time and enabling tracking of data flows. This indicates tangible progress of the implementation of the payment systems. The findings are more remarkable when focusing on the percentage of provinces meeting the NIEMS defined deadline of claim submission. With less demands on data to fulfill the reimbursement processes of direct-pay system as compared to those of E-claim system, it is quite readily understood why progress was more pronounced with direct-pay system than that of E-claim system extra requiring sizable data items to the ITEMS data requirement (Table 3). In fact, missing data as required by the insurance companies had been considered a major obstacle to improve coverage of loss compensation since the early years of implementation of the Road Traffic Accident Victim Compensation Act [11]. The remaining large deficit in the coverage implied by the maximum loss ratio (35%) in the aforementioned (settings and policy interventions) might indicate stagnation in any attempts to fill the gaps. Finally, increasing trends were observed for the number of patients being compensated (93,570,156 cases) and the amount of cash flow from insurance companies to NIEMS for prehospital care (USD 1229;8230;16,663) during the study period according to NIEMS in-house data analysis. However, the increased number of patients could be considered trivial compared to over 300,000 road-traffic injury victims with ambulance transport during the same period [6]. In exchange for those amounts of money NIEMS had to spend, unilaterally, at least USD 5,714 per annum for linking electronic databases of NIEMS and RVP.

4.2. Effects on Patient Outcomes

When we turned to explore the effects on patient outcomes of direct-pay and E-claim systems, the negative findings from analysis of huge amount of ITEMS data corresponded with findings from qualitative approaches which indicated probably nonsubstantial amount of financial support from these two sources and probably remarkable gaps in aligning any financial resources to human resource management among prehospital care agencies. A costing study in 2015 on prehospital care services clearly depicted sizable deficits of the current amount of payment to prehospital care units varying from 2.9- to 12.2-fold for BLS level and first responder level, respectively. In effect, several key informants from all the study sites clearly mentioned repeated attempts to feed back on the financial and human resource issues to NIEMS over the past several years. Furthermore, plausible explanations for some EMS units under charitable organizations which refused to receive payment from the two payment systems altogether included (a) hidden concern about being subjected to public financial audit and (b) a perception of disproportionally low contribution of revenues from the two systems to justify the risk of subjection to the public financial audit.

4.3. Leadership and Governance Functions

We believe that to a certain extent NIEMS did respond to the bottom-up feedback by sponsoring the study on the cost of prehospital care services as mentioned above. Subsequent to the costing study, NIEMS took the direct-pay initiative to improve the process of previous indirect-pay reimbursement system. Furthermore, NIEMS has tried to mobilise more financial resources by collaborating with RVP on the E-claim system. Despite limited progress in the financial reform initiatives as evident in our study, at least these concrete steps undertaken by NIEMS suggested an inherent responsiveness property of this national lead agency for advancing prehospital care services in Thailand. In this report, we used the term “responsiveness” differently from that in some earlier articles such as Calvello et al. which considered “responsiveness” as responding to patient needs [12]. Yet the essence of the meaning is quite the same, i.e., to reflect on leadership and governance functions of prehospital care systems using financial arrangement as an entry point then linked to patient outcomes (Table 6).

4.4. Lessons Learnt

Prehospital care is a labor-intensive service which means human resource management (such as training, EMS staff compensation, and welfare) is crucial to ensure good quality of care as depicted in Figure 3. Failure to demonstrate practical improvement in quality of care as a result of the financial reform (Table 6) indicates further need to keep good alignment between financial mechanisms and human resource management. Finally, considering patient outcome as an ultimate goal of prehospital care, there is a need to take into account linkage between financial reform and continuously updating information system to keep track of changes in patient outcome.

5. Conclusions

This study might be able to fill the knowledge gaps of applying a health systems framework to shape the development of prehospital care systems in LMIC settings which were considered a priority research area in this field. It is evident that progress has been made in terms of mobilising more financial inputs and improving financial information flow. However, there is no evidence of any changes in patient outcomes and quality of care.

6. Limitations

Making use of administrative data in our study, we faced a large number of missing patient outcome data of up to 40%. We believe that this might result in underestimation of undesirable outcomes. Nonetheless given similar percentages of the missing data among comparison groups, it is unlikely to affect our estimation of the associations shown in Table 6. This pointed out the importance of strengthening information systems in order to improve leadership and governance functions of the prehospital care systems. Employing multiple sources of qualitative data to cross-validate the findings from each specific source enabled us to minimize potential biases associated with a single source.

Data Availability

Datasets used in this report may be requested from the authors.

Conflicts of Interest

Khanisthar Phooseemungkun (KHANISTHAR.P@niems.go.th) and Krongkan Bunchaiyai (Krongkan.B@niems.go.th) are affiliated with National Institute of Emergency Medicine, Ministry of Public Health whose policy was evaluated by this report.

Acknowledgments

This report was funded by National Institute of Emergency Medicine, Ministry of Public Health.

References

  1. V. Plummer and M. Boyle, “EMS Systems in Lower-Middle Income Countries: A Literature Review,” Prehospital and Disaster Medicine, vol. 32, no. 1, pp. 64–70, 2017. View at Publisher · View at Google Scholar
  2. D. G. Ostermayer, C. A. Brown, W. G. Fernandez, and E. Couvillon, “Areas of Potential Impact of the Patient Protection and Affordable Care Act on EMS: A Synthesis of the Literature,” Western Journal of Emergency Medicine, vol. 18, no. 3, pp. 446–453, 2017. View at Publisher · View at Google Scholar
  3. S. Al-Shaqsi, “Current challenges in the provision of ambulance services in New Zealand,” International Journal of Emergency Medicine, vol. 3, no. 4, pp. 213–217, 2010. View at Publisher · View at Google Scholar
  4. P. Suriyawongpaisal, W. Aekplakorn, and R. Tansirisithikul, “A Thailand case study based on quantitative assessment: does a national lead agency make a difference in pre-hospital care development in middle income countries?” Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, vol. 22, no. 75, pp. 10–1186, 2014. View at Publisher · View at Google Scholar
  5. National Institute for Emergency Medicine (NIEMS), A report of the situation of emergency medicine systems in 2016, vol. 22, Panjamitr Co., Bangkok, Thailand, 2016, http://www.niems.go.th/th/View/DataService.aspx?CateId=117.
  6. National Institute for Emergency Medicine (NIEMS), Annual report 2016, Ultimate printing Co., Bangkok, Thailand, 2016, http://www.niems.go.th/th/View/DataService.aspx?CateId=119.
  7. National Institute for Emergency Medicine (NIEMS), Art qualified Co., Bangkok, Thailand, 2015, http://www.niems.go.th/th/View/DataService.aspx?CateId=117.
  8. “Statistics of non-life insurance from 1997 to 2014. Office of Insurance Commission,” http://www.oic.or.th/th/fund/performance-report.
  9. National Institute for Emergency Medicine (NIEMS), “Guideline for clinical and financial audit of prehospital care in 2011,” http://register.niems.go.th/audit/Default.aspx.
  10. WHO, “Everybody’s business: strengthening health systems to improve health outcomes: WHO’s framework for action,” Production, pp. 1–56, 2007. View at Google Scholar
  11. P. Montriwiwatchai, V. Kasantikul, and C. Taecholarn, “Clinicopathological features predicting recurrence of intracranial meningiomas,” Journal of the Medical Association of Thailand, vol. 80, no. 7, pp. 472–478, 1997. View at Google Scholar · View at Scopus
  12. E. J. B. Calvello, M. Broccoli, N. Risko et al., “Emergency care and health systems: Consensus-based recommendations and future research priorities,” Academic Emergency Medicine, vol. 20, no. 12, pp. 1278–1288, 2013. View at Publisher · View at Google Scholar · View at Scopus