Abstract

This research evaluates the influence of the Brazilian accreditation methodology on the sustainability of the organizations. Critical factors for implementing accreditation were also examined, including measuring the relationships established between these factors in the organization sustainability. The present study was developed based on the survey methodology applied in the organizations accredited by ONA (National Accreditation Organization); 288 responses were received from the top level managers. The analysis of quantitative data of the measurement models was made with factorial analysis from principal components. The final model was evaluated from the confirmatory factorial analysis and structural equation modeling techniques. The results from the research are vital for the definition of factors that interfere in the accreditation processes, providing a better understanding for accredited organizations and for Brazilian accreditation.

1. Introduction

Currently, health managers are increasingly concerned with issues related to improving the quality of services provided and improving care processes. In this sense, quality management became paramount for hospitals to achieve their goals, generating results for patients and for the institutions. With an increasingly competitive market, several hospitals, public and private, are facing great challenges in their management. In view of these uncertainties, there is a need to seek solutions to improve quality and cost-effectiveness [1]. In this context, hospital accreditation appears as an approach for improving the quality of health services [2].

The management of accreditation quality and effectiveness has been a subject of great interest by researchers in the health care area, since reliable and consistent research is an important factor in the development of the accreditation process in organizations. The success in identifying factors that directly affect the quality management process and accreditation is seen as crucial for sustainable performance, given that “most health care managers” are seeking to adopt new strategies and management tools that enable organizations to be more competitive, meeting customer expectations, and avoid costs by reducing errors and waste and enabling improved organizational performance [3]. Several factors have contributed to the adoption of quality management strategies by the organizations in order to improve their performance and obtain greater market share [4].

Hospital accreditation has been prominent in health environments, as an important approach in the process of improving quality management; however, few studies have been published seeking to analyze the performance of organizations that have been using hospital accreditation [3, 59]. In Brazil, hospital accreditation began to be discussed in 1995, when the Ministry of Health created the program “Quality Assurance and Improvement in Health,” which led to the formation of a technical committee, responsible for the elaboration of the new quality guidelines in the country that resulted in the creation of the “Brazilian Manual of Hospital Accreditation” and the Brazilian Accreditation System (SBA).

The standard established by the Brazilian manual is based on three levels of complexity: level 1: accredited, refers to the existence of processes aimed at ensuring the safety of the patient; level 2: full credential, refers to the integrality of the management, involving the monitoring of security barriers, processes, and protocols implemented, involving a critical analysis of the controls of care processes, establishments of action plans, improvement plans, and the intersectoral interaction; level 3: accredited with excellence, the organization has already incorporated a critical follow-up of the designed processes of its assistance results, developing cycles of improvement in a systematic way; decision making aligned with institutional strategic planning [10].

For the implementation of this process, the National Accreditation Organization (ONA) was created, a private law entity, responsible for the development, application, and follow-up of standards for the accreditation process in Brazil, with the objective of creating mechanisms for improving health services. Currently, the Brazilian Accreditation Methodology created by ONA is internationally recognized by ISQua and can be used in health services around the world [10, 11].

1.1. Organization Profile

A search conducted in June 2016 in the ONA database identified that 515 health institutions are accredited by the organization. Figure 1 shows the geographic location of the services accredited by ONA in Brazil.

However, when the geographical distribution of these institutions is verified in the Brazilian map, it is possible to observe a great inequality, being most of them located in the southeast region. This scenario shows that despite the establishment of the Brazilian Model of Hospital Accreditation, even after a decade of the implementation, it has not yet reached all regions as it should, highlighting the state of São Paulo with 221 health services, corresponding to 42.5% of accredited organizations throughout the country. According to the health service distribution ONA [12], it is possible to conclude that most hospitals in Brazil do not meet the requirements and quality standards required by the ONA. On the other hand, the increase in customer demands, market, and the public sector itself has forced institutions to meet the basic quality requirements, such as security and quality assurance of the services.

2. Literature Review

Quality management in health services has revealed that accreditation is a tool that contributes to competitiveness in the global health market; this approach was stimulated by impressive results in the industrial sector [1, 13]. Woldgebriel et al. [14] developed a study that evaluates the efforts made to improve health quality by reporting the use of different approaches, and the accreditation has been used on a large scale.

A study by the World Health Organization (WHO) in 2000 showed that hospital accreditation is directly influenced by technical competence, team integration, and personal motivation [15].

Claver et al. [3] and Xiong et al. [16] report that few scholars are willing to discuss, evaluate, or measure the results of hospital accreditation. On the other hand, theoretical models have been applied to guide health research studies and use the formal evaluation models such as the European Quality Award (EFQM), the Malcolm Baldrige National Quality Award (MBNQA), and the Deming Award [17, 18]. These models are used to examine the relationships between quality and accreditation constructs [1, 1923]. The EFQM model has been widely used, becoming an efficient tool in the process of evaluating the relationship between hospital performance and accreditation in public and private organizations [3, 24, 25]. It is also common to find instruments of quality measurement that adopt the model developed by Donabedian [26], seeking to identify the relations between three factors: structure, process, and result [27, 28]. In this context, it can be observed that several studies have developed instruments for measuring the quality of health services.

2.1. Critical Factors That Influence Quality Management of Health Services

In order to measure the influence of quality management on the sustainability of organizations, it is necessary to identify the main factors that have affected the performance of accredited organizations, so an extensive research was developed in the literature that deals with this issue as an objective to identify these factors. From this research, it was possible to identify the main constructs that have been used to measure the effect of quality management with a focus on accreditation in organizational sustainability. Table 1 summarizes the constructs found.

As seen in Table 1, the constructs used to measure the quality of health services are related to different dimensions, ranging from evaluation of administrative processes to clinical processes, in order to measure the results for the organization and patients.

3. Research Methodology

This research uses the survey method based on the work of Forza [43], which has been widely used for the development of research related to the evaluation of quality in health services, and strives to interpret the reality of organizations. However, some authors report that qualitative methods are limited by identifying only patterns of behavior, not searching deeper into causal relationships. In this sense, the use of structural equation modeling (SEM) techniques with the proposed method was combined. Figure 2 shows the steps suggested by Hair et al. [44], adding the propositions established by Forza [43].

3.1. Step 1: Development of Operational Definitions

At this stage, it is important to have a good literature review, a necessary condition for the construction of a reliable model, and to obtain useful results in SEM; it also involves the prioritization of the constructs found in the literature, in order to substantiate and justify the objective of the current research [43, 44].

3.2. Step 2: Measurement Model Development

Once the latent constructs and their respective measurement variables were defined, the measurement instrument (survey) was developed using a Likert scale [44]. The pilot test was developed with the purpose of evaluating the operationalization of the constructs and the validity of the questions used, through the suggestions of the group of experts who contributed to the elaboration of the survey according to the propositions established by Forza [43]. After choosing the constructs as well as their respective measurement variables, a path diagram of the model was constructed using the Path analysis method [44, 45]. After the construction of the model through a path diagram, the model was transformed into a system of equations, since many software used in MEE require this construction. The construction of the system of equations was developed based on the techniques established by the SEM, which is a confirmation procedure and not very exploratory [44]. The model of measurement of the dependent or endogenous variables is represented by (1) and described in Table 2 [46, 47].

From (1), the equations of the measurement model for the constructs selected for this research were developed and are shown in Table 3.

Once the equations for the factors were defined, the research hypotheses were developed, which represent a series of hypothetical cause and effect relationships between the variables according to Table 4.

3.3. Step 3: Empirical Result Research

At this stage, questions regarding issues related to the research project were considered [48]. The data used in the research correspond to the data collected by a survey conducted among all institutions accredited by the Brazilian hospital accreditation methodology. In this stage, there were questions regarding location, type of organization (public, private), classification (profitable or philanthropic), number of employees, number of beds, and level of accreditation (level 1: accredited; level 2: full accreditation; and level 3: accredited with excellence). The data were collected through a survey from SurveyMonkey, through simple sampling for an initial sample of 515 accredited institutions selected to answer the survey. Of these, 49.51% (two hundred and fifty-five) completed the survey, being the sample to be evaluated. The size of the sample was considered adequate according to the propositions established by Kline [49], Hair et al. [44], Reinartz et al. [50], M. Hill and A. Hill [51], and Alwin [52]. Analyzing the collected sample, it was possible to verify that a good part of the surveys were answered by quality managers with nursing training, with a high predominance for employees who work in the organization more than four years, corresponding to 54.90% of the answers (164 answers). Almost seventy-eight percent (78.08%) of the organizations that participated in the research are located in the southeastern region of Brazil and offer 151 to 500 beds, and almost thirty percent (30.74%) belong to the group of public organizations and 69.26% private; from these results, 41.55% are philanthropic. These results are consistent with the distribution of accredited organizations in Brazil, and most of the accredited institutions are hospital type. Of the total responses obtained, 123 organizations are accredited with excellence, followed by 89 accredited organizations at the full level, 71 accredited, and 8 organizations have a certification seal. Steps 4, 5, and 6 will be presented in the following sections.

3.3.1. Discussion on the Results Found

Before starting to evaluate the measurement models, some procedures were performed according to the propositions established by Anderson and Gerbing [53] and Vieira [54]. Initially, the exploratory factorial analysis was performed only as a data purification procedure, from a traditional perspective. Afterwards, a confirmatory factorial analysis was performed considering the following criteria: dimensionality reduction, convergent validity, reliability, and discriminant validity through LISREL®. However, before the above steps could be developed, it was necessary to make some procedural decisions that resulted in the following information: the software chosen for the analyses of this study was LISREL, using the data obtained from a covariance matrix, through of the estimation technique: maximum likelihood (ML), with the level of abstraction: partial aggregation.

No sum of scale problems was identified, and the indices chosen for model evaluation were based on the suggestions described by Baumgartner and Homburg [55, 56].

The data were adequately treated, and no coding errors were identified in the data collected [49]. The outlier analysis was done from a discriminant analysis, using the Mahalanobis distance to classify the observations in their predicted groups using Minitab® software.

The treatment of missing values was developed from the complete case study method (Listwise) established by Hair [44], and the reliability of the sample was proven from the results obtained from the Cronbach’s alpha coefficient, which presented values higher than 0.8. Observations were considered independent since the surveys were answered by different individuals and institutions, providing simple random sampling. The linearity of all relationships was verified from the analysis of sample covariance, where no null covariances were identified. From the results obtained for the asymmetry test (−1.956) and kurtosis (4.750), the Mardia coefficient (22.615) did not indicate severe violations of the normality assumption.

The absence of the multicollinearity phenomenon was confirmed by the results of the determinants > 0.00001 of the correlation matrix, calculated in the LISREL software. These results can be verified in Table 5.

The absence of multicollinearity was confirmed by the results of the variance inflation factor (VIF) < 5, due to the nonexistence of correlations above 0.8 and by R2 values of 0.54 [44, 47].

The principal component analysis method was chosen [53]. In order to perform the factor analysis, the free parameters (=108) and the number of variables observed from the formula (v (v + 1)/2) were identified—resulting in the value 820. Based on the calculated values, the model of confirmatory factorial analysis obtained 712 degrees of freedom (820–108). In this case, the results of the modification indexes for the model indicated an adequate adjustment for the data collected [44, 57].

The evaluation of the measurement models for the constructs (L, PM, O, Q, P, S, A, and SY) was developed according to the propositions established by Vieira [54]. The Bartlett’s sphericity test results were very small (), while the results obtained by the Kaiser-Meyer-Olkin test (KMO > 0.8) presented satisfactory results for all evaluated constructs.

3.4. Step 4: Measurement Model Evaluation

The results of the descriptive statistics developed using the technique of factor extraction by the principal component method with the nonrotated solution developed from the analysis of the covariance matrix can be verified in Table 6.

Analyzing the results obtained from the method of factorial analysis for the selected constructs, it can be verified that most of the constructs can be represented by two factors, except for the constructs accreditation and process orientation represented by only one factor and sustainability construct represented by three factors. All factors present commonality results above 75% of explanation, which are considered acceptable [44, 49, 54].

The factors related to the leadership construct, leadership performance nominations, and leadership involvement correspond with the factors from Mcfadden et al. [31], Awuor and Kinuthia [6], Lee et al. [21], and Woo et al. [30]. Similar results were identified in the literature for the other constructs. According to the analysis developed, it can be seen that the relationships between the variables are consistent with the perspectives found in the literature, and, in general, the factors represent the content of the questions that measure their respective construct.

3.5. Step 5: Structural Model Specification

After analyzing the measurement model of the latent variables, the results were grouped in a specification model; this model was estimated by the maximum likelihood method. The confirmatory factorial analysis was developed through the software LISREL version 9.2, in order to verify if the data fit a model. The relationships between variables, observed (independent) and latent (dependent), are illustrated in Figure 3.

This analysis can be done from the signals obtained for the respective estimated parameters; another form of verification is from the forces of these hypothetical links, which must be significant, that is, the t values must be greater than |1.96|. It is also necessary to verify the result of the variance that can be evaluated from the results obtained through the multiple square correlations (R2) for the structural equations [58]. From this result, it can be verified that some estimates are not within the normally accepted standards, and in terms of global adjustments, it can be said that the indexes of goodness of fit of the model correspond to the normally accepted limits; these results can be verified in Table 7.

From the results of the normed fit indices (NFI > 0.9), the index of comparative fit (ICF > 0.9), the relative fit index (RFI > 0.9), the goodness-of-fit index (GFI > 0.8) (PGFI < 0.5), and the standardized mean square error (RMSEA > 0.3 < 0.6), and absolute values of in the standardized residue matrix, it can be confirmed that the data do not show potential threats to unidimensionality.

From the results obtained for the coefficient , the standardized solution, and the t value, it can be stated that the models have sufficient evidence for the convergent validity [59]. The reliability of the constructs is proven from the value of Cronbach’s alpha > 0.84; analyzing the results of the correlation between the constructs, it can be verified that the correlation between the variables did not exceed 0.7, suggesting the evidence of discriminant validity according to Steenkamp and Van Trijp [60]. Another test developed was the analysis of mean variance, where it can be observed that the results are greater than 0.50 [61]. So, in this case, the sustainability is explained by a set of relationships established between the other constructs. In general, it is possible to conclude that the interaction of exogenous variables (leadership, people management, organizational culture, guiding processes, and security) with an endogenous variable, like quality management, results in a relevant influence (high positive estimates) in the endogenous variable of accreditation that consequently generates a great influence (86%) on the sustainability of health organizations accredited by the methodology developed by ONA. These relationships can be confirmed in the literature, agreeing with the studies that have been developed in several countries; however, it has not been found in the literature studies that deal specifically with this type of relationship.

4. Power Assessment

In this step, the propositions established by Diamantopoulos and Siguaw [58] consider that the evaluation of power is important but often neglected in the process of evaluation of structural models.

This is the individual evaluation of the chi-square test, which is obtained from type I errors. In this case, a rejection of a correct model with type II error can occur. Complementarily, the power test is important due to the influence of sample size, since large samples tend to obtain various types of specification errors. Then, an analysis of all chi-square results obtained during the development of this research was performed, that is, results were verified for the four models presented previously, the results of the various tests developed to identify the respecified model, and a new programming developed in the simulated model increasing the number of interactions to 50, 100, and 200.

According to this analysis, it was possible to verify that the chi-square results obtained in the several tests developed in this research presented significant values, in agreement with the propositions established by Maccallum et al. [62]. The final simulated model has 18 degrees of freedom and when it considers the propositions established by Diamantopoulos and Siguaw [58], which consider a value of 0.80 enough for “more practical purposes.”

In the development of the structural model of this research, a sample of two hundred and eighty-eight responses () was used, so there is a probability of detecting specification errors. However, the values of the chi-square statistic and the degrees of freedom for the various tests developed were considered, offering strong reasons to believe that there are no serious discrepancies between the hypothetical model and the data, that is, the data obtained from the survey applied to organizations accredited by the ONA Accreditation Methodology, and simulated data from these data fit the model that evaluates the sustainability of accredited organizations.

5. Discussion

The results presented in Figure 3, referring to the structural equations shown in Table 3, provide some valuable information about the impact of accreditation on the sustainability of health services. More specifically, it is possible to empirically recognize the importance of the five determinants of health service quality management, leadership (L), people management (PM), organizational culture (OC), process orientation (PO), and safety (S), directly affecting accreditation process and consequently organizational sustainability. Evaluating the leadership construct (standardized coefficient = 0.70), this relationship is the basis for a strong argument that the quality team, which is formed by leadership, is involved in quality improvement processes, considering accreditation as a fundamental tool. Evaluating the people management construct, which presents results with 77.0% of explanations (communalities), we can see that the hypothesis that tests its influence in people management presents positive results, however, with a low correlation value (0.22). This result is due to the fact that in Brazil the people management factor is still managed by a department that deals only with legal aspects, often having no involvement with quality management.

Values of positive and strong significance (standard coefficient = 0.86) are found between the relationships of organizational culture in quality management. In Brazil, the organizational culture is present and visible on a daily basis, involving all sectors of the company affecting directly the processes developed within the organization. This is one of the main difficulties for organizations in the beginning of the accreditation process. The influence between factor orientation for processes in quality management was confirmed starting from the standard coefficient = 0.46. This is due to the fact that organizations have been seeking greater productivity and quality in hospital services, combined with the enormous efforts to adapt to national, international, and service standards.

The related hypotheses between safety and quality management are also confirmed, however, with a standard coefficient = 0.19. In Brazil, the existence of processes related to safety is defined based on the administrative rule GM/MS Number 529/2013. The accredited health services work with the existence of patient safety cores, the obligation to report adverse events, and the elaboration of the patient safety plan. However, this factor is still perceived in isolation in many cases.

6. Conclusion

In this research, the hypothesized relationship between quality management and sustainability of the organizations accredited by the ONA methodology was empirically validated using an analytical trajectory model. From the obtained results, it was possible to conclude that the constructs, quality management, accreditation, sustainability, leadership, and organizational culture, show values of very strong positive significance for the model. That relationship confirms the importance of the constructs in hospital accreditation, in accordance with studies developed by several cited authors. Less strong positive estimates were identified in the relation of the constructs: people management, process orientation, and safety.

There are a number of directions in which this research can be extended. First, the interlinking of the internal measure of service quality that can be measured by hospital professionals as presented in this paper. The external measure of quality service can be explored together with customers.

In this case, the combination of survey methodology with structural equation modeling technique, tested in terms of dimensionality, reliability, convergent validity, and discriminant validity and validated from the leave-one-out method, can be used to prove the nature of relationships based on sustainability.

In management practice, the proposed model becomes a useful tool for managers at accredited companies providing knowledge of the effect of each construct over the organization results. So, managers can focus on their efforts, developing strategies to improve the factors that have contributed insufficiently, that is, that have low correlations in their relationships.

It was observed that the Brazilian accreditation methodology generates a positive impact on the accredited companies. With that, it is possible to better understand the influence of the constructs used in this work; the research provided a holistic view of existing processes in accredited organizations. Those have been working to increase the productivity and quality in hospital services, with combined efforts to meet national and international standards of provision of services.

The proposed model also provides an important instrument for measuring the factors that are directly related to the accreditation and sustainability of organizations accredited by ONA methodology and is a valuable tool not only for researchers, but also for managers, professionals, and accreditation’s institutions, that allows the development of several actions, such as, people management, improvement of quality practices, and presence of a safety culture, as well as other factors that can affect the accreditation and sustainability.

Finally, the results of this empirical study provided a direction and trend of quality management in the health care industry. The proposed model proves that the Brazilian accreditation methodology has generated influence in the aspects related to the sustainability of accredited health organizations and that the formalization of a quality program, with a desire for accreditation, provides greater sustainability for the organizations.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper with any authors.

Acknowledgments

The authors would like to thank CAPES, CNPq, and FAPEMIG for the support in this research.