Dynamicity of the cloud computing system, complexity of real-world decision-making problems, and nontransparent market imply numerous difficulties in finding the corresponding solution for cloud supplier evaluation and selection. Due to that reason, there is a need to develop a model that can contribute to increase of reliability of evaluation and reduction of subjectivity of the decision-maker. Having in mind the aforementioned, the authors proposed a new concept to model a cloud supplier evaluation based on technology perspective. Here, we developed a model that combined fuzzy techniques with implemented simulation of model parameters. The proposed method for cloud supplier evaluation is flexible with an objective evaluation and ensures more precise numerical value. Numerical examples are presented to demonstrate the effectiveness and pragmatism of the proposed approach.

1. Introduction

Cloud technologies, which enable new methods for provision of services and products by innovative and technological possibilities, are widely used all around us. Cloud service is a collection of computing; it usually refers to a dynamic and scalable virtualized resource. The quality of cloud service supplier is an important factor affecting the development of cloud computing. Due to increasing user-specific requirements for cloud services and differentiated quality of cloud services from numerous cloud service suppliers, selection of an appropriate cloud service supplier, based on technology, becomes a significant challenge for decision-makers.

Cloud service supplier uses different techniques such as ontologies, languages, standards, and tree structure and there is not a unified service description that describes all cloud service types, IaaS, PaaS, and SaaS. Apart from that, dynamicity of cloud computing and constant adding of new services and applications additionally make selection of the best cloud service supplier harder under the background of cloud computing emergence. Another problem in evaluation and service supplier selection is selection of a flexible and reliable model that enables fast implementation of new information.

Various mathematical techniques have been used by the researchers for selection and evaluation of suppliers. There are many evaluation methods in domain of cloud security engineering and cloud services security [1, 2], the quality of service [35], cloud storage [6], cloud manufacturing [7], and so on. Multicriteria decision-making (MCDM) allows decision-makers to face complex decision-making situations involving multiple, usually conflicting decision criteria, which include quantitative and/or qualitative aspects in a decision-making process. AHP method takes a significant place during selection of MCDM techniques for supplier evaluation and selection [8]. Critics of this method indicate that significance of elements presents only some sort of arithmetic accuracy that does not reflect real or objective evaluation. Also, when judgment matrix is not consistent, the adjustment is often with blindness and extensive calculation. Authors often combine this and other methods in order to overcome the stated deficiencies [912] and more can be seen in review paper of Le Sun [13].

In realistic environment of supplier selection and evaluation, a decision-maker must take into account different uncertain factors. Fuzzy-logic-based approach and decision-making problems under linguistic environment have been widely used in all areas of science and are one of the tools used for supplier selection [14, 15]. Authors are trying to resolve the complexity of supplier selection problem by applying hybrid (integrated) models. The research of Simić [16] presents how fuzzy set theory, fuzzy decision-making, and hybrid solutions based on fuzzy mathematics can be used in the various models for supplier assessment and selection in a 50-year period. Comprehensive paper has shown that fuzzy hybrid approaches can be used to solve very complex real-world decision-making problems such as supplier assessment, ranking, and supplier selection. Min and Due [17] used a Group Decision-Making Model Based on Regression Method with Hesitant Fuzzy Preference Relations for supplier selection problem. Pang et al. [18] proposed A Fuzzy-Grey Multicriteria Decision-Making Approach for Green Supplier Selection. A review conducted by Mardani et al. [19] on fuzzy multiple criteria decision-making techniques and applications showed that the technique of Fuzzy Analytic Hierarchy Process (FAHP) was the most used one among MCDA techniques that employed fuzzy decision-making tools and approaches. Zhi Li et al. proposed mathematical model for supplier selection in the purchasing stage [20]. Their SSOA model comprises two processes, Fuzzy Extent Analytic Hierarchy Process (FEAHP) with multiobjective dynamic linear programming technique. Cloud service supplier selection problem under the background of cloud computing emergence, an integrated group of decision methods, based on SVM, TFN-RS-AHP, and TOPSIS-CD, was suggested by Liui et al. [21].

The motivation for the present work is the recognized absence and need for flexible but reliable model for cloud service supplier evaluation and selection. We provide two-stage fuzzy logic (2sFL) model, based on FAHP and fuzzy logic approaches for cloud supplier evaluation from technology perspective. The model enables a relatively simple correction of model parameters. This approach helps decision-makers in extracting and keeping expert knowledge in the system with opportunity to choose different operators, which leads to flexibility in the decision-making process. One more specificity of methods lies in implemented simulation of model parameters in order to ensure more precise numerical value. The proposed method is based on a new model that can take into account many factors in either part of the observed system or the whole, as well as their mutual relations on the goal of evaluation.

2. Model Description

The basic idea in developing the model was to evaluate, in a quality manner, cloud service supplier so as to take into account different decision elements (variables), their mutual relationship, relative importance, and impact on the whole. The model comprises two stages.

The first stage refers to establishment of input parameters and a hierarchical structure of the problem. FAHP method includes identification of goals and criteria that are compared and evaluated, evaluation based on comparison of pairs of elements on each hierarchy level, and synthesis of results based on comparison of criteria on all hierarchy levels. According to this method, the objective is defined on top of the hierarchical structure of the observed problem. Criteria that can be further broken down into subcriteria, that is, new hierarchy levels, are defined on the next level. Cloud computing is characterized by various factors and was examined from different perspectives (technological, business issues, applications, and general aspects) [22]. The SMI framework [23] contains 7 factors and 51 subfactors, and it is not expected that the decision-makers will want or need to use measures for all of the attributes. It is common to select factors and subfactors with greatest importance in decision process, which are the most relevant to their research. Lian-hui Li [21] proposed hierarchical framework with 4 characteristics from the technology perspective, and for the purpose of this work we took into account a criterion referring to security and privacy technology.

Five major aspects of cloud service supplier from the technology perspective are performance, capability, service level, quality and security, and privacy (see Figure 1). The complexity of business systems and processes is mainly dependent on the features of their subsystems and relations between subsystems. The quantity and the character of these relations inside the system are reflected on its structure and the number of operations that should be enabled by cloud service. The availability of information and experience generated from the previous and often limited time period influences the final decision of choice. For this reason, IT, engineering and technical knowledge, intuition, and the expert experience are often used in practice. Also, some unknown and rare situations and problems may arise in practice, which can neither be foreseen nor prevented but can have impact on the work of business systems. Due to these reasons, the proposed model, which directly accepts the expert knowledge through TFN score matrices and enables minimisation of subjectivity of expert assessments through fuzzy logic and simulation of variables, is better solution in some cases compared to others, especially in the situation when it is not possible to identify or solve all uncertainties (Figure 2). This method is used in cases of high complexities and existence of numerous impact parameters, when special features of decision problems exist and so forth.

When choosing criteria and subcriteria, what should be kept in mind is the complexity of cloud services and the fact that in many cases it assumes underlying cloud supply chain (existence of underlying cloud providers). If we observe security controls, they cannot be always implemented in the same way and as expected. Also, conventional/expected security controls could be compensated with alternative security controls. This causes that whole assessment process cannot be completely performed objectively, but that subjective impression of cloud assessor will always be included.

The complexity also depends on the delivery and deployment cloud model. For example, if the company has a very low risk appetite, it will not accept deployment models other than private cloud deployment models.

Considering the fact that data about elements are often not available or sufficiently reliable, for assessment of the value of model inputs experience, intuition and expert knowledge about the elements and their impact and classification on the observed process are used. Input values are expert estimates of relationship between values expressed by fuzzy numbers and output is significance of each element and process in whole. Application of fuzzy system leads to the improvement of the value supplier services. The output is the total service assessment for every specific criterion, according to the defined value scale, based on significance of every element.

Model is carried out in two phases, and each phase consists of several steps as follows.

Stage 1. Input values are expert estimates of relationship between values expressed by fuzzy numbers and output is significance of each element and total evaluation. Today we have several formulations of the fuzzy analytical method suggested by various authors. In this model, we use Chang's method, which can be described through the following steps [24, 25].
Step 1. The expert determines the value , for elements and , where is a triangular fuzzy number with parameters , and They are least possible values, respectively, and a TFN is represented as
Step 2. Summarize rows of the matrix so as to obtain valuesNormalize value according to the equationStep 3. The degree of probability that compared to relation , where and , isDetermine the probability that the fuzzy number is greater than other fuzzy numbers according to the equation:Step 4. Determine priority vectors of comparison matrix of the fuzzy value asOutput result of this model is the value of priority, significance of each element and the total value (W = w1, low; w2, medium; w3, high).

Stage 2 (application of fuzzy logic and approximate reasoning algorithms). In order to define an approximate reasoning algorithm, it is necessary to observe variables that are present in premises and consequences of certain rules and describe them by adequate fuzzy sets. Fuzzy system for assessment includes the following steps.
Step 1 (defining input variables and output variables). Fuzzy system enables supplier assessment based on qualification of all elements. Interval of value for each element and each level i is determined based on the value of the priority of elements obtained in Stage 1.
Step 2 (defining the membership functions for selected variables). Each element can be described by fuzzy sets as low, medium, and high. The shape of membership functions of fuzzy sets , , and is the same for all elements. Values x1, x2, x3, x4, x5, and x6 for left and right border and the value with the highest level of membership of fuzzy numbers are different for each element.
Membership functions are The output value of the fuzzy system is the total assessment in specific process (TA) and membership functions of fuzzy sets: , very low; YL, low; , medium; , high; and , very high. Membership functions are defined in the range by the following relations:Step 3 (determining intervals of values of input and output variable). Based on defined interval of value Ii of input variables, left and right boundaries can be set, and the values with the highest level of membership of fuzzy numbers , , and , for each element, are as follows: = 0.1, = 0.3, = 0.5, = 0.7, = 0.9, and = . The output of the fuzzy system can be in the interval (0, 100) and represents the value of the total assessments.
The model was tested on a large number of hypothetical examples. Input parameters were obtained by generating random numbers for each element in accordance with output data in Stage 1. Each element is simulated as an independent variable with uniform distribution within interval (0, ), For level i, supplier j, and each element , the process would be as follows:



Range=[0   Ii1]


MF1=L_value:trimf,[0   0   xi2]

MF2=M_value:trimf,[xi1   xi3   xi5]

MF3=H_value:trimf,[xi4   xi6   xi6]



Range=[0   100]


MF1=VL_TE:trimf,[0   0   20]

MF2=L_TE:trimf,[5   25   45]

MF3=M_TE:trimf,[30   50   70]

MF4=H_TE:trimf,[55   75   95]

MF5=VH_TE:trimf,[80   100   100]

Step 4 (define the approximate reasoning algorithm). Let be the input space and let be the output space. Rules are defined to show the relations between all possible combinations of input and output variables in a reasonable, realistic, and efficient manner. These rules define a mapping from fuzzy sets in the input universe of discourse V ⊂ to fuzzy sets in the output universe of discourse T ⊂ R, based on fuzzy logic principles. The fuzzy if-then rules are defined as follows:where i = 1, 2,..., n, and Tl are fuzzy sets in Vn ⊂ Rn, respectively, and and t ∈ T are input and output linguistic variables that belong to the input and output universes, respectively. Let M be the number of rules in the fuzzy rule base (l = 1, 2,..., M ) and each fuzzy rule represents fuzzy set for l=1, 2,...,M, in the product space V × T; then M represents a set of variations with repetition.

Approximate reasoning includes the process of aggregation based on which the output values of all fuzzy rules compress into a single fuzzy set. In this fuzzy system, authors used the Mamdani technique.

The t-norm (minimum) is usually adopted for the logic connective ‘‘and,’’ as expressed by the following equation:For the logic connective ‘‘or’’ s-norm (maximum) is usually represented byFor each activated rule, the inference machine applies an implication relation R between the fuzzy number resulting from the logic operations and the consequent. Implication operator, commonly in use, is the minimum (Mamdani), expressed in the following equation:Alternative operators are Zadeh Max–Min and Larsen multiplication.

The output fuzzy number of each rule is explained by the composition between a fuzzy singleton and the implication relation. Commonly used composition operators of fuzzy relations are Max–Min, Max-prod, and Max-Media in the following equations [26]:

Step 5 (defuzzification). In this model, we applied the centroid method.

3. Implementation of the Model with Numerical Example

The packaging company conducts business in 100+ countries. It uses numerous systems to execute functions of the company, including numerous connections to customers, suppliers, and other partners. The company employed a relatively streamlined, mainly qualitative methodology to assess supplier. The methodology followed defined steps for analysing supplier and involved a number of standardized, systematic tools and procedures to compile and analyse data and generate reports.

Prequalification and the selection of the cloud suppliers are done first within the business stakeholders of the company in accordance with their business needs. Qualified suppliers are then considered from the technological point of view by experts and engineers in the technical sector, considering in particular the security controls implemented into the service offered by cloud suppliers in relation to all five criteria. The selection of cloud service supplier is made in relation to the assignment of implemented controls, whether they correspond to the company’s criteria and their defined policies or procedures related to the data classification and handling. Assessment is mainly performed based on questionnaire lists that will be fulfilled by cloud suppliers and supporting documentation.

The expert team and engineers used the cloud technology on comprehensive and operable principles and, to their best knowledge and experience, selected 3 suppliers from K collaborative suppliers for innovation architecture engineering solution and created the judgment matrices.

Stage 1. Experts determine pairwise comparison of the different criterion relevant to the overall objective using triangular fuzzy numbers. The value of fuzzy extent with respect to each criterion is calculated by using Step 2 from Stage 1 and the formula for algebraic operations of the fuzzy set. Matrix of the elements comparison and TFN score matrices of 3 suppliers given by experts are , with The consistency of the pairwise judgment of each comparison matrix is also checked using the calculation method of consistency index. The degree of probability can be determined by Step 3 of Stage 1.
We obtain the following values for CS1:and continuing the process,For illustration, Figure 3 presents the intersection between M1 and M2.
Minimum degree of possibility can be stated as , and similarly , , , and
The same process is applied to all suppliers and results are shown in Table 1.

Table 2 shows calculated values of the resulting vector of priorities W for each supplier.

Output result of this model is the value of priority, significance of each element and the total value of security W = w1, low; w2, medium; w3, high. Afterwards, experts define elements of comparison matrix for each level compared to each element. By applying relations from Stage 1, we calculate a local priority , for each hierarchy level. Values of all matrix elements are expressed by triangular fuzzy numbers.

Stage 2. The parameters of membership functions for all input variables of fuzzy system and different supplier are shown in Table 3. The rules allow quantitative, qualitative, and judgmental data to be integrated in a uniform manner. Approximate reasoning algorithm includes 243 fuzzy rules that represent a set of variations with repetition of set v1 × v2 × v3 × v4 × v5 × TE and levels (very low, low, medium, high, and very high).

The rules are defined as follows [27]:: IF v1 Low and v2 Low and v3 Low and v4 Low and v5 Low THEN TE Very Low: IF v1 Low and v2 LOW and v3 Low and v4 and v5 Medium THEN TE Very Low...R(120): IF v1 Medium and v2 Medium and v3 Medium and v4 Low and v5 High THEN TE MediumR(121): IF v1 Medium and v2 Medium and v3 Medium and v4 Medium and v5 Low THEN TE Low...R(242): IF v1 High and v2 High and v3 High and v4 High and v5 Medium THEN TE Very highR(243): IF v1 High and v2 High and v3 High and v4 High and v5 High THEN TE Very High

Simulation process is implemented in model and problem was solved by using MATLAB® software. Each element is simulated as an independent variable with uniform distribution within interval (0, ). For example, for variable v11 simulated on by generating random numbers, 10000 sets of input data are simulated in order to obtain output data of a fuzzy model, that is, weight elements. The output value for CS1 in Stage 1 is shown in Figure 4(a), and total evaluation of CS1 is presented in Figure 4(b).

The same process is repeated for selected subelements of the system, if experts deem it necessary. Table 4 summarized the results obtained by model for each cloud service supplier in respect of five major aspects of cloud service supplier from the technology perspective. The highest value in service supplier evaluation process has security and quality for all 3 cloud service suppliers (see Figure 5). The first two suppliers have a rather similar evaluation of parameters, , while the third supplier has According to its preferences, the company further recommends a supplier. In case of similar evaluation values, other factors can further be considered, such as financial ones.

The idea to minimize the subjectivity degree of decision-makers is realized by using fuzzy logic model. Experts assess the value for each of total elements, while assessment of the total evaluation is realized by using a fuzzy model. Assessment of particular elements can be implemented by using different scales, whose value ranges can be adjusted to the practice and mapped to the value interval of corresponding fuzzy numbers. This approach, as a consequence, increases the accuracy of the assessment of each particular evaluation that belongs to a particular class.

Comparable evaluating results of the first suppliers according to FAHP, FANP, and our methods are shown in Table 5. Results of all three methods are generally consistent. Disadvantages of the FAHP method (Wang et al. [29]) which result in inconsistency in output data in our model are overcome by introduction of fuzzy logic. Partial treatment of various elements, analysis, and assessment of individual elements, which affects the total evaluation, leads to a reduction of inadequate estimations in decision-making and reduces the possibility of error. Simulation technique is able to model the dynamic behaviour of the cloud suppler and agile strategies with generating more precise numerical value. Proposed model is flexible and enables a relatively simple correction of input parameters and fast generation of values in specific system or processes.

4. Conclusion

Fast growing and nontransparent cloud computing market with various providers and specific models of services greatly makes their evaluation difficult in order to perform comparisons. Another problem is the interoperability between providers which is not achieved and often makes selection of a provider an irreversible process or its selection requires more efforts. We proposed two-stage fuzzy logic model, based on Fuzzy Analytic Hierarchy Process (FAHP) and fuzzy logic approaches for cloud supplier evaluation. In this paper, five major aspects of cloud service supplier from the technology perspective were applied to evaluate suppliers, while other critical factors could be added to this model. Defining fuzzy rules for the proposed model needs experience from field experts and experimental results to obtain effective results. Specificity of the method lies in implemented simulation of model parameters in order to ensure more precise numerical value. It should be mentioned that this study was limited to the cloud service supplier evaluation, but the model can be used in different areas of science and practice purpose.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.


The second author acknowledges the financial support of the Ministry of Education, Science and Technological Development of the Republic of Serbia in the frame of projects applied under no. TR 34014 and no. ON 174009.