Journal of Healthcare Engineering

Journal of Healthcare Engineering / 2020 / Article

Research Article | Open Access

Volume 2020 |Article ID 8857553 | https://doi.org/10.1155/2020/8857553

Thyago C. C. Nepomuceno, Wilka M. N. Silva, Késsia T. C. Nepomuceno, Isloana K. F. Barros, "A DEA-Based Complexity of Needs Approach for Hospital Beds Evacuation during the COVID-19 Outbreak", Journal of Healthcare Engineering, vol. 2020, Article ID 8857553, 9 pages, 2020. https://doi.org/10.1155/2020/8857553

A DEA-Based Complexity of Needs Approach for Hospital Beds Evacuation during the COVID-19 Outbreak

Academic Editor: Saverio Maietta
Received10 Jun 2020
Revised21 Jul 2020
Accepted17 Sep 2020
Published30 Sep 2020

Abstract

Data envelopment analysis (DEA) is a powerful nonparametric engineering tool for estimating technical efficiency and production capacity of service units. Assuming an equally proportional change in the output/input ratio, we can estimate how many additional medical resource health service units would be required if the number of hospitalizations was expected to increase during an epidemic outbreak. This assessment proposes a two-step methodology for hospital beds vacancy and reallocation during the COVID-19 pandemic. The framework determines the production capacity of hospitals through data envelopment analysis and incorporates the complexity of needs in two categories for the reallocation of beds throughout the medical specialties. As a result, we have a set of inefficient healthcare units presenting less complex bed slacks to be reduced, that is, to be allocated for patients presenting with more severe conditions. The first results in this work, in collaboration with state and municipal administrations in Brazil, report 3772 beds feasible to be evacuated by 64% of the analyzed health units, of which more than 82% are moderate complexity evacuations. The proposed assessment and methodology can provide a direction for governments and policymakers to develop strategies based on a robust quantitative production capacity measure.

1. Introduction

The past months scourged the world with a novel coronavirus identified as the cause of a pneumonia outbreak first detected in Wuhan, province of Hubei, China. The severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) is responsible for a declared worldwide pandemic having more than a million confirmed cases and dozens of thousands of deaths, keeping a quick spread [1, 2]. The prompt virus outbreak causes a much bigger problem than lethality: a large number of infected patients require hospitalization and intensive care due to complications worsening the clinical condition. When several patients need such intensive care at the same time, the hospitals and other health service units with limited resources end up overloaded. As a result, the health systems collapse due to the unavailability of beds, ventilators, and technical resources for new hospital admissions, fatigue, and overloading health teams. Thus, hospital beds acquisition and evacuation are crucial to increase the response capacity to face the crisis [3].

Data envelopment analysis is a powerful nonparametric mathematical programming tool for the technical efficiency estimation of many service units in different economic activities, such as financial institutions and educational and health systems [47]. Hospitals are a wide source of efficiency assessments. Some of the most relevant results provide the potential for health improvement based on the expansion of results (e.g., hospitalizations, patient recoveries, performed surgeries, medical prescriptions, among others) or based on the contraction of resources (e.g., nurses, assistants, physicians, infected patients (nondiscretionary), beds, equipment, among others). Such prospects are possible through the envelopment of data, which estimates the industry’s efficient production capacity.

This study introduces a novel application to provide an optimal number of hospital beds technically feasible to be evacuated and allocated for urgent hospitalizations through best practices, applicable during the COVID-19 crisis. The methodology is based on the Brazilian Healthy Complexity of Needs prioritization and can be extended to any health system with a similar or different classification of disease and medical specialties.

2. Literature

The increasing pressure on limited resources of health systems during the pandemic has highlighted the need for efficiency-based tools and methodologies to offer new combined perspectives on how to use the hospital's facilities, resources, and capabilities optimally. Ordu et al. [8, 9] develop an interesting decision support tool for modelling capacity constraints, and allocating hospitals’ resources, combining discrete event simulation and forecasting techniques. The application in the accident and emergency department captures the outpatient demand for each specialty by age and first/followup referrals and the entire service pathway on different scenarios. Similar approaches aiming at providing increased operational efficiency and high-quality patient care are claimed to offer a considerable improvement in the hospitals’ capacity response and average patient length of stay [10, 11]. A measure for the required number of optimal emergency beds, however, is a limitation acknowledged by the authors in these and other operations approach.

The nonparametric frontier estimations of data envelopment analysis can aid managers and policymakers in attaining such a prospect. The weight optimization based on pairwise evaluations scales the used resources and generated products of each service unit, providing a robust measure for the technical efficiency, which can be adapted for inverse output/input relations [12], exogenous or nondiscretionary resources [1315], and time-series self-evaluations [1618]. As a result, an estimation for the optimal production capacity for any size service unit is available for decision-making. In the case of hospitalizations, this optimal capacity measure can be translated into an efficient number of hospital beds, equipment, costs, or human resources required for the production of health using internments (hospitalizations) as a proxy for this product.

This instrument, besides offering a relative measure for hospitals’ technical efficiency based on the maximum, yet feasible, production configuration, can determine peers of efficiency for benchmarking performance metrics and identifying opportunities for improvement and support resource allocation schemas based on production slacks. Many assessments of health efficiency follow this avenue, for instance, the recommendations of Kounetas and Papathanassopoulos [19] regarding the efficiency of Greek hospitals and Zare et al. [20] using a hybrid data envelopment analysis and game theory methodology for performance measurement in health service units. This interesting perspective of frontier estimations can provide the optimal number of resources to be (re-) allocated from inefficient units through best practices during epidemic crises.

The most common variables considered in modelling the production technology of health systems are the number of beds for hospitalizations, personal protective equipment (PPE) and other technical equipment, drugs, human capital (physicians, nurses, unlicensed assistants, and other staff), hospital infrastructure, costs of service (in many categories), and funding as inputs, and medical prescriptions, number of hospitalizations, outpatient procedures, inverse mortality rate, patients discharged, number of surgeries, and testing as outputs [6,1926]. Nevertheless, different combinations of output/input can be used in assessments of hospitals’ performance, depending on the problem statement and purpose. For instance, Hadad et al. [21] show an interesting nonconventional evaluation which resorts to life expectancy and infant survival rate as the parameters for the health product in two efficiency models, considering the physicians’ density, inpatient bed density, expenditures, gross domestic product (GDP), and fruit and vegetable consumption, adding a different perspective in the efficiency assessment.

Most hospitals, in general, during the last weeks, and especially intensive care units (ICUs) and emergency departments (EDs) are constantly required to cope with a recurrent daily-based crisis ignited by the novel coronavirus outbreak. Gul & Guneri [27] and Gul et al. [28] discuss the importance of these sectors, dedicated to patients in need of urgent and commonly complex care, in a comprehensive review of literature and evaluation. In addition to the impact on these sectors, the pandemic has affected other specialties that are not directly related to the treatment of respiratory syndromes, where the resource becomes committed in order to prevent the collapse of an entire health system. In most assessments, different conditions and specialties are taken into consideration in several hospital departments, which brings a real contribution of hybrid models to the strategic planning of health service units.

The different specialties carried out by health service units are subject to different and varied heterogeneous factors that are connected to institutional arrangements, population characteristics, location, and socioeconomic or environmental determinants. The linear programming scales the differences through the output/input ratio of each health unit by comparing small units with a benchmark in the efficiency frontier presenting similar input-to-output configuration. Nevertheless, such heterogeneity has a considerable subjective value in the decision maker’s perspective, which, despite the objective programming techniques, requires value judgments and preference elicitations on different decision criteria. Multiple criteria methodologies, for instance, Pergher & Vaccaro [29] outranking model based on the Electre Tri, Mendonça et al. [30], grey theory approach for risk assessments, and many others [3136], can be relevant adapting on this prospect.

3. Methodology

The technical efficiency is traditionally understood as a ratio between the generated outputs and used inputs of a production process. Charnes et al. [37] and Banker et al. [38] through a mathematical linear dual formulation for multiple outputs/inputs configurations in the efficiency problem introduced the so-called data envelopment analysis (DEA). Today, this is the most common approach to assess the efficiency and productivity of many decision-making units (DMUs) in the number of surveys, applications, methodologies, and computational developments [39, 40]. The mathematical programming provides, among other results, the optimal amount of resources to save or products to increase so that an inefficient service unit becomes efficient.

The multidimensional production structure of hospitals and healthcare centres, however, requires a meticulous approach to define which resources need to be reduced in order to improve the health results. According to Lin & Kuo [41], different patient’s complexity relies on different health service providers for different clinical specialties, which may jeopardize the slack reduction consistency in the technical efficiency analysis because potential performance improvements in hospitalizations by equally reducing the hospital beds, for instance, for all specialties, may be neither feasible nor coherent for each particular hospital context. An interesting solution is suggested by Ferreira and Marques [42]. According to this study, there is no need for complexity adjustment if one accounts for the operational environment surrounding the hospital. Conditional frontier analysis [15, 43] can add an interesting perspective by considering those environmental determinants in the frontier estimation.

An alternative avenue through a two-step methodology is proposed in this assessment. Estimations for the beds’ evacuation is proposed by prioritizing the slack reduction according to the complexity of needs on the most common medical specialties to provide support for bed reallocations during an epidemic crisis. The first step consists of applying nonparametric frontier estimations for the full production capacity of the health service units (the maximum feasible production configuration for each hospital) based on hospital admissions as the main output and hospital beds as one of the many discretionary resources. Similar to many assessments of health systems efficiency, the number of beds is considered a proxy for hospital capital [3136, 44]. That way, depending on the scale of operations and keeping everything else constant, the lower the usage of this resource, the higher the efficiency for the health service unit. Following similar resource optimization approaches [45, 46], the objective in this assessment is to provide an optimal number of beds to be evacuated and allocated for potential COVID-19 cases, instead of reduction.

For the second step, the optimal number of beds to be reallocated (based on best practices) are prioritized according to the complexity of needs for each medical specialty. The complexity of needs in the Brazilian Health System is the degree of complexity each health problem presents and the requirement for specialized knowledge. There are three categories: basic care, moderate complexity, and high complexity. Each category is defined in Table 1.


Basic care: the first level is characterized by a set of actions and practices using low-density technologies to solve health issues of greater frequency but low severity, including a list of simpler and cheaper procedures. The procedures in this category are capable of meeting most of the community’s common health problems.

Moderate complexity: composed of actions and services aiming at meeting the main public health issues whose assistance in the clinical practice requires the availability of specialized professionals and the usage of technological resources for diagnostic, support, and treatment.

High complexity: common for more severe health issues; this category is characterized by a set of procedures involving high technology and high cost, aiming at providing access to highly specialized knowledge and qualified services.

Hospitalizations have moderate or high complexity of needs admissions. Consider a set of health service units using hospital inputs to produce outputs. Consider “o” the service unit under evaluation and “,” the sum of both moderate and high complexity of needs hospitalizations, a proxy for the prioritization of beds evacuation. The optimal feasible contraction (evacuations) of high complexity hospitalization beds is as follows:

The optimal feasible contraction (evacuations) of moderate complexity beds is as follows:where is the efficiency score for the production technology under variable returns to scale [9, 14].

Equations (1) and (2) state that the optimal number for beds evacuation of high complexity admissions depends on the number of evacuated beds of moderate complexity. In other words, the optimal number for beds evacuation of high complexity hospitalizations is the remaining feasible contraction of beds after all moderate complexity admissions are evacuated. As an example, considering an efficiency score  = 0.8, the service unit may improve efficiency by producing the same result using (1–0.8) = 20% fewer resources. Considering 100 hospital beds allocated to admissions of both low and high complexity of needs as the discretionary input  = 15 and  = 85, the number of beds to be evacuated having moderate complexity is beds and the number of beds to be evacuated having high complexity is the remaining beds.

Adding (1) and (2) into the DEA formulation, we can infer the optimal number for beds evacuation based on the complexity of needs prioritization:

Full concepts and definitions concerning the complexity of needs assistance in the Brazilian Health System and a list with the related medical specialties are available in [47].

4. Data

In the first step of the evaluation, an input-oriented variable returns to scale model is conducted. Pernambuco’s State Secretariat for Budgeting and Planning (SEPLAG) provided data regarding 373 from the 1136 health services units in the state. For this assessment, we have selected the 88 most important hospitals and healthcare centres based on the volume of hospitalizations. Due to data limitations, the number of doctors, surgeons, and general physicians is not considered in the analysis. For most medical specialties, ward rounds for inpatient care by physicians occur once a day or after a week, depending on the patient treatment plan or condition. This context let us assume that the inclusion or removal of these professionals may not shift the efficiency prospects compared to nurses and other health staff which are in direct contact with hospitalizations. The inputs are the number of nurses, nursing assistants, and licensed healthcare technicians and the cost of hospitalizations and the sum of hospital beds for three categories (specialties): medical clinics (comprehensive care for individuals aging over 12 years, in critical or semicritical conditions, and who do not need surgical treatment), surgical clinics (reserved for preoperative and postoperative care), and obstetrics. The output is the number of hospital internments (hospitalizations).

Table 2 and Figure 1 report the main descriptive statistics. Costs refer only to hospitalizations expenditure considering the three specialties. On average, R$ 8,073,821 (about US$ 1.5 million) is spent per health unit in hospitalizations for a typical year. Nursing assistants and nursing technicians are two professional categories working in outpatient sectors usually performing basic care planned by the nurse, such as administration of medicines, vaccines, dressings, performing patient hygiene, and sterilization of medical equipment. Due to the similarity of both categories, they were aggregated into one input named “assistants and technicians”.


VariablesMin.1st Qu.MedianMean3rd Qu.Max.Std. Dev.

InputsAssistants and technicians4.027.575.5185.6212.21409.0271.54
Nurses1.007.0015.5061.9579.50617.0096.98
Hospital beds11.0041.7572.50140.77155.001075.00181.54
Costs2838822508018046588073821513773610166354517038427

OutputHospitalizations74.0527.82530.05252.07625.841678.07155.14

In general, the 88 most important health units in the state sums 16336 of those professionals, 5452 nurses, and 12388 beds, spent more than R$ 710 million (about US$ 132 million) in one year, and were responsible for 462175 hospitalizations and 5252 hospitalizations per unit on average. This means 0.07% (88 hospitals) were responsible for 27.02% of all hospitalizations in the state. Figure 1 illustrates the descriptive statistics in boxplots visualizations. Most of the outliers are public hospitals characterized by a high demand for health services.

5. Results and Discussion

Tables 3 and 4 summarize the main results. We have 26 hospitals working at full capacity in the state, serving as peers (benchmarks) for the remaining inefficient health units. These units are producing the maximum possible admissions a hospital can produce during a year given the current production technology, equipment, and human resource. It is worth mentioning that, for some of the ranked hospitals, the efficiency comes at the cost of quality due to the high demand for health services and overcrowded public hospitals. The total of 3772 beds are feasible to be evacuated and reallocated for new COVID-19 cases in one year considering the remaining inefficient units formalization of new service protocols, postponing surgeries and decreasing the patient length of stay in hospitals through best practices from the peers, of which 2883 are related to moderate hospitalizations and 889 high complex cases. Table 4 has the remaining hospitals and their potential for bed evacuation during the crisis.


Health service unitsBedsPeering

IMIP1075N/A
Hospital Da Restauração7909 units
Hospital Otavio De Freitas620N/A
Hospital Getulio Vargas5452 units
Hospital Barao De Lucena3401 unit
Hospital Dom Malan2598 units
Hospital Miguel Arraes1734 units
Hospital Pelopidas Silveira1703 units
HMR Dra Merces P. Cunha15043 units
HM Santa Maria1467 units
HR Fernando Bezerra983 units
CH Dr Jose E. De Moura9115 units
HMC C. S. Bom Jesus7018 units
IBVASF674 units
HI Palmira Sales6219 units
Casa De Saúde São Jose592 units
PM Pr. Barros Lima577 units
Mat. Dr Luiz Leite424 units
Hospital Ermirio Coutinho4111 units
HMM. Olimpio M G. Lins2620 units
UM Kyola2324 units
Hosp. Genezio F. Xavier221 unit
UM Dr Jose M. Monteiro1615 units
UM Jose Dantas Filho152 units
HM Alice Figueira1413 units
UM Maria Eliziaria Paes115 units


DMUEfficiencyBedsEvacuations

10.078744686
20.586425176
30.268191140
40.427234134
50.61925597
60.51119796
70.27712892
80.35214292
90.81240776
100.66821070
110.65319869
120.67519363
130.56113861
140.66418061
150.56613056
160.87542653
170.60112550
180.68615047
190.5438137
200.68511536
210.6199034
220.6689632
230.4085231
240.6628228
250.5355224
260.6156123
270.6907423
280.7729822
290.6055622
300.4994422
310.6295922
320.6705919
330.6435419
340.6926018
350.6555118
360.6665017
370.87413016
380.593916
390.6974614
400.8107113
410.89310812
420.93317312
430.7233811
440.89611111
450.92514811
460.745379
470.892889
480.691247
490.886617
500.844325
510.9792445
520.810214
530.840264
540.895323
550.920423
560.898202
570.902202
580.966391
590.974351
600.979311
610.987611
620.978220

Figure 2 illustrates the overall production capacity with the efficiency frontier estimation by the envelopment of data under a variable returns to scale technology. In the visualization of Figure 2, the inputs in the x label are aggregated by simple summing with no specific weight for this aggregation. One should be alerted that a multiple-input to one output plot may not necessarily place the multiefficient health service units on the two-dimensional frontier, serving only illustration purposes. The traditional radial variable returns to scale model can be the most interesting option for the objective of incorporating the complexity of needs in a second step defining the feasible options for resource evacuation among the specialties. Because of the characteristic of data (beds available by medical specialties), we can prioritize the reduction of beds (and related resources uniformly) according to the complexity of their specialty. The points on the frontier represent the efficient hospitals reported in Table 3, which are benchmarks for best practices. The remaining inefficient units (under the frontier) in this illustration become efficient either by producing more hospitalizations with the same level of used inputs or by reducing the used inputs keeping hospitalizations at the same level or by a combination of both. In the input-oriented model of this assessment, efficiency is obtained by reducing (and reallocating) the number of beds keeping the same amount of hospitalization. This can be possible by applying some of the benchmark strategies for reducing the length of stay. In this representation, the most inefficient unit (the most distant point from the frontier) is one of the most important private hospitals in the state, having a considerable number of available beds for reallocation in a typical year.

Table 5 reports the main prospects for the assessment. The evacuation of hospital beds are prioritized according to the complexity of needs for the many medical specialties each health service units operate. The monthly estimates are evacuation projections based on the efficient production capacity of hospitals, which can be used during the pandemic critical months. Twenty-three out of the 57 health service units with potential for bed evacuations do not require high complexity evacuations. Twenty out of the 57 require less than 50% high complexity evacuations. This methodology helps the policymaker concentrate attention on the hospital with the best potential and less critical services to evacuate and reallocate beds and related resources through best practices referred from the benchmarking peers of the evaluation.


DMUModerate complexity(%)High complexity(%)Monthlyestimate

11008357
294015
31006712
460011
55808
66808
7100518
8100578
95506
107006
116506
1210045
1310075
14100315
150435
163904
17100264
185104
19100283
20100183
21100283
22100123
23100513
24100322
25100272
26100292
27100122
288602
29100312
3010002
31100242
32100192
33100172
34100472
35100181
36100121
372301
38100301
39100241
404301
41201
42901
431601
441601
4510031
4610011
474901
4810051
4910031
500101
512101
526801
532401
54901
552601
563801
571601
588801
5910081
607801
61100171
625301

6. Conclusions

The assessment provided a framework for the application of nonparametric frontier methods of the DEA family to estimate the technically feasible capacity of hospitalizations, which, combined with prioritization methodologies for medical specialties such as the cmplexity of needs in Brazil, can disclose valuable support for policymakers to prevent an eventual collapse of health systems during the COVID-19 epidemic crisis. The methodology can be adapted to other localities, or decision criteria, providing a systematic approach for resource allocation through hospitals during the pandemic.

A valuable extension for the assessment of the health service units technical efficiency is the frontier estimation based on time-series production data instead of pairwise comparisons. Due to the many particular differences regarding the production technology of hospitals, an approach based on internal rather than industrial capacity can be more deductive and coherent.

Another interesting value can be added by the definition of beds’ evacuation based on multiple decision criteria besides the complexity of needs. Important clinical aspects of hospital internments such as the gravity of diseases, flexibility for resource transfer among the medical specialties, and substitution potential can orientate decisions of managers and policymakers closer to each health unit reality. In addition, the usage of fuzzy data for the assessment of network system such as a hospital can aid valuable support [48]. This analysis can provide a direction for public administrations to perform some of their strategies based on an objective quantitative production capacity measure and support subjective decision-making with the inclusion of such aspects.

An extension of the current application investigating the efficiency evolution and the hospitalization efficacy against COVID-19 can be very useful for policymakers. A time-series evaluation, as suggested by Nepomuceno et al. [49], can be performed using time-series data regarding the period before and after the implementation of beds reallocation schema based on each specialty complexity of needs. The first results of this assessment were disclosed to state authorities, hoping to contribute to how to mitigate the drastic effects of the current crisis in the available resources.

Data Availability

Readers can access the data related to the findings of this study upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

The authors acknowledge Pernambuco’s State Secretariat for Budgeting and Planning (SEPLAG) for the provision of data and valuable suggestions. The authors acknowledge the funding support from the Brazilian National Council for Scientific and Technological Development (CNPq).

References

  1. S. Chen, J. Yang, W. Yang, C. Wang, and T. Bärnighausen, “COVID-19 control in China during mass population movements at New Year,” The Lancet, vol. 395, no. 10226, pp. 764–766, 2020. View at: Publisher Site | Google Scholar
  2. Coronavirus COVID-19 global cases by the center for systems science and engineering (CSSE) at johns hopkins coronavirus resource center, https://gisanddata.maps.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf, 2020.
  3. A. Remuzzi and G. Remuzzi, “COVID-19 and Italy: what next?” The Lancet, vol. 395, no. 10231, pp. 1225–1228, 2020. View at: Publisher Site | Google Scholar
  4. A. N. Berger and D. B. Humphrey, “Efficiency of financial institutions: international survey and directions for future research,” European Journal of Operational Research, vol. 98, no. 2, pp. 175–212, 1997. View at: Publisher Site | Google Scholar
  5. T. C. C. Nepomuceno, C. Daraio, and A. P. C. S. Costa, “Combining multi-criteria and directional distances to decompose non-compensatory measures of sustainable banking efficiency,” Applied Economics Letters, vol. 27, no. 4, pp. 329–334, 2020. View at: Publisher Site | Google Scholar
  6. M. D. Ibrahim and S. Daneshvar, “Efficiency analysis of healthcare system in Lebanon using modified data envelopment analysis,” Journal of Healthcare Engineering, vol. 2018, Article ID 2060138, 2018. View at: Publisher Site | Google Scholar
  7. R. D. Banker, R. F. Conrad, and R. P. Strauss, “A comparative application of data envelopment analysis and translog methods: an illustrative study of hospital production,” Management Science, vol. 32, no. 1, pp. 30–44, 1986. View at: Publisher Site | Google Scholar
  8. M. Ordu, E. Demir, C. Tofallis, and M. Gunal, “A novel healthcare resource allocation decision support tool: a forecasting-simulation-optimization approach,” Journal of the Operational Research Society, 2020. View at: Publisher Site | Google Scholar
  9. M. Ordu, E. Demir, and C. Tofallis, “A decision support system for demand and capacity modelling of an accident and emergency department,” Health Systems, vol. 9, no. 1, pp. 31–56, 2020. View at: Publisher Site | Google Scholar
  10. C. Oh, A. M. Novotny, P. L. Carter, R. K. Ready, D. D. Campbell, and M. C. Leckie, “Use of a simulation-based decision support tool to improve emergency department throughput,” Operations Research for Health Care, vol. 9, pp. 29–39, 2016. View at: Publisher Site | Google Scholar
  11. E. Demir, D. Southern, A. Verner, and W. Amoaku, “A simulation tool for better management of retinal services,” BMC Health Services Research, vol. 18, no. 1, p. 759, 2018. View at: Publisher Site | Google Scholar
  12. K. T. C. Nepomuceno, T. C. C. Nepomuceno, and D. Sadok, “Measuring the internet technical efficiency: a ranking for the world wide web pages,” IEEE Latin America Transactions, vol. 18, no. 6, pp. 1119–1125, 2020. View at: Publisher Site | Google Scholar
  13. T. C. Saquetto and C. A. Araujo, “Efficiency evaluation of private hospitals in Brazil: a two-stage analysis,” Revista De Administração Mackenzie, vol. 20, no. 5, 2019. View at: Publisher Site | Google Scholar
  14. J. Seljak and A. Kvas, “Three-stage data envelopment analysis as a tool for nurse leader performance appraisals: case study,” SAGE Open, vol. 5, no. 1, 2015. View at: Publisher Site | Google Scholar
  15. T. C. C. Nepomuceno, K. T. M. Santiago, C. Daraio, and A. P. C. S. Costa, “Exogenous crimes and the assessment of public safety efficiency and effectiveness,” Forthcoming in Annals of Operations Research, 2020. View at: Google Scholar
  16. T. C. C. Nepomuceno and A. P. C. Costa, “Resource allocation with time series DEA applied to Brazilian federal saving banks,” Economics Bulletin, vol. 39, no. 2, pp. 1384–1392, 2019. View at: Google Scholar
  17. T. C. C. Nepomuceno, V. D. H. De Carvalho, and A. P. C. S. Costa, “Time-series directional efficiency for knowledge benchmarking in service organizations,” in Proceedings of the World Conference on Information Systems and Technologies, pp. 333–339, Springer, Budva, Montenegro, April 2020. View at: Publisher Site | Google Scholar
  18. M. Baldemor, “Time series and data envelopment analysis on the performance efficiency of Dmmmsu-South La union campus,” International Journal of Scientific Engineering and Research, vol. 4, no. 4, pp. 5–10, 2018. View at: Google Scholar
  19. K. Kounetas and F. Papathanassopoulos, “How efficient are Greek hospitals? a case study using a double bootstrap DEA approach,” European Journal of Health Economics, vol. 14, no. 6, pp. 979–994, 2013. View at: Publisher Site | Google Scholar
  20. H. Zare, M. Tavana, A. Mardani, S. Masoudian, and M. Kamali Saraji, “A hybrid data envelopment analysis and game theory model for performance measurement in healthcare,” Health Care Management Science, vol. 22, no. 3, pp. 475–488, 2019. View at: Publisher Site | Google Scholar
  21. S. Hadad, Y. Hadad, and T. Simon-Tuval, “Determinants of healthcare system’s efficiency in OECD countries,” European Journal of Health Economics, vol. 14, no. 2, pp. 253–265, 2013. View at: Publisher Site | Google Scholar
  22. S. Kaveski, L. Degenhart, M. Vogt, and N. Hein, “Efficiency of the service of the municipalities associated with SUS in mato grosso do sul southwest,” Administração Pública e Gestão Social, vol. 7, no. 4, pp. 197–205, 2015. View at: Publisher Site | Google Scholar
  23. M. A. Bahrami, S. Rafiei, M. Abedi, and R. Askari, “Data envelopment analysis for estimating efficiency of intensive care units: a case study in Iran,” International Journal of Health Care Quality Assurance, vol. 31, no. 4, pp. 276–282, 2018. View at: Publisher Site | Google Scholar
  24. K. Kocisova, B. Gavurova, and M. Behun, “The importance of implementing environmental variables in the process of assessment of healthcare efficiency through DEA (1),” Ekonomicky Casopis, vol. 67, no. 4, pp. 367–387, 2019. View at: Google Scholar
  25. C. Li, M. Sun, J. J. Shen, C. R. Cochran, X. Li, and M. Hao, “Evaluation on the efficiencies of county-level Units for Disease Control and Prevention in China: results from a national survey,” Tropical Medicine & International Health, vol. 21, no. 9, pp. 1106–1114, 2016. View at: Publisher Site | Google Scholar
  26. S. Gonzalez-De Julian, S. Trillez-Araujo, R. Uso-Talamantes, V. Caballer Tarazona, M. I. Saurí-Ferrer, and J. L. Trillo, “Efficiency assessment in primary healthcare units of a health district,” Value in Health, vol. 21, no. 3, p. S318, 2018. View at: Publisher Site | Google Scholar
  27. M. Gul and A. F. Guneri, “A comprehensive review of emergency department simulation applications for normal and disaster conditions,” Computers and Industrial Engineering, vol. 83, pp. 327–344, 2015. View at: Publisher Site | Google Scholar
  28. M. Gul, A. Fuat Guneri, and M. M. Gunal, “Emergency department network under disaster conditions: the case of possible major Istanbul earthquake,” Journal of the Operational Research Society, vol. 71, no. 5, pp. 733–747, 2019. View at: Publisher Site | Google Scholar
  29. I. Pergher and G. L. R. Vaccaro, “Work in process level definition: a method based on computer simulation and electre tri,” Production, vol. 24, no. 3, pp. 536–547, 2014. View at: Publisher Site | Google Scholar
  30. M. Mendonça Silva, T. Poleto, L. Camara e Silva, A. P. Henriques De Gusmao, and A. P. Cabral Seixas Costa, “A grey theory based approach to big data risk management using FMEA,” Mathematical Problems in Engineering, vol. 2016, Article ID 9175418, 15 pages, 2016. View at: Publisher Site | Google Scholar
  31. C. A. V. Cavalcante, M. H. Alencar, and R. S. Lopes, “Multicriteria model to support maintenance planning in residential complexes under warranty,” Journal of Construction Engineering and Management, vol. 143, no. 4, Article ID 04016110, 2017. View at: Publisher Site | Google Scholar
  32. M. M. Silva, A. P. C. S. Costa, and A. P. H. De Gusmão, “Continuous cooperation: a proposal using a fuzzy multicriteria sorting method,” International Journal of Production Economics, vol. 151, pp. 67–75, 2014. View at: Publisher Site | Google Scholar
  33. L. C. E. Silva and A. P. C. S. Costa, “IT project investments: an analysis based on a sort and rank problem,” International Journal of Information Technology & Decision Making, vol. 13, no. 4, pp. 699–719, 2014. View at: Publisher Site | Google Scholar
  34. M. E. Fontana and D. C. Morais, “Decision model to control water losses in distribution networks,” Production, vol. 26, no. 4, pp. 688–697, 2016. View at: Publisher Site | Google Scholar
  35. J. G. Da Silva and R. S. Lopes, “An integrated framework for mode failure analysis, delay time model and multi-criteria decision-making for determination of inspection intervals in complex systems,” Journal of Loss Prevention in the Process Industries, vol. 51, pp. 17–28, 2018. View at: Publisher Site | Google Scholar
  36. T. C. C. Nepomuceno, J. A. De Moura, and A. P. C. S. Costa, “Modeling sequential bargains and personalities in democratic deliberation systems,” Kybernetes, vol. 47, no. 10, pp. 1906–1923, 2018. View at: Publisher Site | Google Scholar
  37. A. Charnes, W. W. Cooper, and E. Rhodes, “Measuring the efficiency of decision making units,” European Journal of Operational Research, vol. 2, no. 6, pp. 429–444, 1978. View at: Publisher Site | Google Scholar
  38. R. D. Banker, A. Charnes, and W. W. Cooper, “Some models for estimating technical and scale inefficiencies in data envelopment analysis,” Management Science, vol. 30, no. 9, pp. 1078–1092, 1984. View at: Publisher Site | Google Scholar
  39. C. Daraio, K. H. Kerstens, T. C. C. Nepomuceno, and R. Sickles, “Productivity and efficiency analysis software: an exploratory bibliographical survey of the options,” Journal of Economic Surveys, vol. 33, no. 1, pp. 85–100, 2019. View at: Publisher Site | Google Scholar
  40. C. Daraio, K. Kerstens, T. Nepomuceno, and R. C. Sickles, “Empirical surveys of frontier applications: a meta‐review,” International Transactions in Operational Research, vol. 27, no. 2, pp. 709–738, 2020. View at: Publisher Site | Google Scholar
  41. Y. Lin and R. Kuo, “Patient complexity and services provided of local clinics in Taiwan: how many of them are “primary care” providers?” Value in Health, vol. 21, pp. S49–S50, 2018. View at: Publisher Site | Google Scholar
  42. D. Ferreira and R. Marques, “Should inpatients be adjusted by their complexity and severity for efficiency assessment? evidence from Portugal,” Health Care Management Science, vol. 19, no. 1, pp. 43–57, 2016. View at: Publisher Site | Google Scholar
  43. C. Daraio and L. Simar, “Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach,” Journal of Productivity Analysis, vol. 28, no. 1-2, pp. 13–32, 2007. View at: Publisher Site | Google Scholar
  44. H. Omrani, K. Shafaat, and A. Emrouznejad, “An integrated fuzzy clustering cooperative game data envelopment analysis model with application in hospital efficiency,” Expert Systems with Applications, vol. 114, pp. 615–628, 2018. View at: Publisher Site | Google Scholar
  45. D. Ferreira, A. Nunes, and R. Marques, “Doctors, nurses, and the optimal scale size in the Portuguese public hospitals,” Health Policy, vol. 122, no. 10, pp. 1093–1100, 2018. View at: Publisher Site | Google Scholar
  46. D. Ferreira, A. Nunes, and R. Marques, “Economies of scope in the health sector: the case of Portuguese hospitals,” European Journal of Operational Research, vol. 266, no. 2, pp. 716–735, 2018. View at: Publisher Site | Google Scholar
  47. Conselho Nacional De Secretários De Saúde (Brasil), 2007, Assistência de Média e Alta Complexidade no SUS. Conselho Nacional de Secretários de Saúde, Brasília. http://bvsms.saude.gov.br/bvs/publicacoes/colec_progestores_livro9.pdf.
  48. Z. Ameri, S. S. Sana, and R. Sheikh, “Self-assessment of parallel network systems with intuitionistic fuzzy data: a case study,” Soft Computing, vol. 23, no. 2, pp. 12821–12832, 2019. View at: Publisher Site | Google Scholar
  49. T. C. C. Nepomuceno, J. A. De Moura, L. C. E Silva, and A. P. C. S. Costa, “Alcohol and violent behavior among football spectators: an empirical assessment of Brazilian’s criminalization,” International Journal of Law, Crime and Justice, vol. 51, pp. 34–44, 2017. View at: Publisher Site | Google Scholar

Copyright © 2020 Thyago C. C. Nepomuceno et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


More related articles

 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder
Views736
Downloads395
Citations

Related articles

Article of the Year Award: Outstanding research contributions of 2020, as selected by our Chief Editors. Read the winning articles.