Research Article | Open Access
OTAs Selection for Hot Spring Hotels by a Hybrid MCDM Model
Tourism has been identified as one of the sectors that will contribute to Taiwan’s economic development. Online travel agencies’ role in producing economic value in the hospitality industry continues to grow. The hotel industry is used in this study as the research context to help managers of hot spring hotels select the optimal online travel agencies (OTAs) using a hybrid multi-criteria decision-making (MCDM) model. The aim of this paper is threefold: first, to obtain selection criteria for OTAs based on the fuzzy Delphi method; second, to extract interdependencies between the perspectives using decision making trial and evaluation laboratory (DEMATEL); and third, according to interdependencies between the perspectives, to rank the alternatives by analytic network process (ANP). Based on the proposed model, a real-world company was conducted and demonstrated OTAs selection problem; the results demonstrated the proficiencies and effectiveness of this model.
People can buy anything on the Internet. If they want to get around, tourism websites can be visited to find many scenic spots . Without time and geographical limitations, electronic commerce (e-commerce) makes our life more convenient . E-commerce’s rapid growth has resulted in many enterprises constructing online marketing channels. More specifically, within the hotel industry, the majority of international hotel chains have built websites to assist guests with online services . However, operating a host website is much more difficult for small or medium-sized hotels, as their visit amount is much lower . Chang et al.  also noted that not all companies have the ability or resources to build viable online channels capable of retaining consumers’ attention. Therefore, many such enterprises continue to depend on well-liked online agencies and booking sites to help them sell products. For example, hotels often maintain relationships with one or more OTAs to sell their rooms.
OTAs do not own or operate hotels; rather, they host websites that tourists can visit in order to gather information about hotels, do price comparisons, check to see if discounts are available, and review comments from people who have already visited . OTAs reduce search costs by helping prospective customers rank hotels by price, location, or quality, thereby increasing the competition between hotels. As such, they are becoming critical players within the industry, and relationship with the major sites is becoming a competitive necessity for almost all types of hotels . According to , the increasing dependence of customers on OTAs when they contemplate major purchasing decisions is due to the pervasiveness of the Internet in people’s lives. OTAs have become popular communication and distribution channels for many types of customers when it comes to travel products or services. In fact, Inversini and Masiero  claimed that traditional travel agencies have been replaced by OTAs due to their ability to present customers with a large variety of booking services associated with their travel plans.
OTAs will continue to grow exponentially in countries where they can be accessed . Moreover, OTAs dominate online information and reservation channels . Even so, while OTAs and hotels collaborate with each other, they often simultaneously are competing with each other. They cooperate as they attempt to introduce and attract new customers to a given hotel but compete with each other when it comes to repeat customers . Ling et al.  also indicated that many hotels have the challenge to develop applicable cooperative mechanisms with OTAs. As such, selecting the optimal OTAs to work with is a major issue for hotel executives. Moreover, this selection is made more difficult due to the fact that there are almost no standards or frameworks that hotels can follow .
This study is unique within the existent literature for a number of reasons. The fuzzy Delphi method can cause favorable selection criteria [14, 15]. As a result, we used the fuzzy Delphi method, which calls for the collection of expert opinions, with respect to modifying selection criteria and constructing a hierarchy to select the optimal OTAs. Second, when making decisions, it is vital to consider whether the relevant perspectives are dependent on each other. DEMATEL can lead to improved decision-making due to the fact that it can verify interdependencies between the various perspectives, and help to map out the relative relationships between them . ANP is suitable to apply for both quantitative and qualitative data and also facilitates solutions for issues related to interdependence and feedback . In this study, we also utilized DEMATEL to confirm the interdependencies between the perspectives; based on the results, ANP was used to rank the alternatives. Many studies have already highlighted the benefits of combining DEMATEL and ANP in this way [18–20].
We organized this study as follows. The literature pertaining to the selection or evaluation of OTAs is first briefly outlined. Next, the fuzzy Delphi method, DEMATEL, and ANP are discussed. Section 4 shows the integrated model to select the optimal OTAs for hot spring hotels in Taiwan. Conclusions and proposals for future research are offered in Section 5.
2. Literature Review: OTAs Selection or Evaluation
Several studies have examined issues pertaining to OTAs selection or evaluation. Kim et al.  investigated important OTAs choice attributes from online customers’ viewpoints. Park et al.  measured OTAs website quality. Using a sample of 311 respondents, they examined the influence of perceived website quality on willingness to make use of OTAs. Ku and Fan  used analytic hierarchy process (AHP) to weight the criteria for OTAs’ products based on 131 customers’ viewpoints. Chiou et al.  evaluated online travel websites from the internal perspective of an organization. Within the context of OTAs, Bernardo et al.  clarified the scope of e-service quality; they further evaluated the effect of e-quality on perceived customer value and loyalty. Sun et al.  ranked attributes in order of importance to assist Chinese travel agencies to maximize benefits associated with website design, operational efficiency, and resource allocation. Dutta et al.  identified the factors affecting customer satisfaction for OTAs in India based on a survey of 384 customers. Lee et al.  collected data from 283 users and applied it to an investigation of the importance of website serviceability of OTAs. Lee et al.  explored factors impacting cross-strait consumers’ selection of OTAs by AHP. Dash and Sharma  compared the competitiveness of Indian tourism aggregators via AHP. Niu and Lee  explored the relationship between repurchase intention of Chinese tourists and variables of OTAs websites. Yee et al.  evaluated third-party hotel booking website performance by AHP. Tandon et al.  combined intuitionistic fuzzy AHP (IFAHP) and intuitionistic fuzzy preference ranking organization method for enrichment evaluation (IFPROMETHEE) to rank OTAs websites.
Researchers have yet offered much in the way of useful guidance regarding the creation of a decision-making model pertaining to selecting the optimal OTAs for hotels. As to the MCDM methodologies, past studies suffer from some defects, including not clearly describing how to screen the selection criteria, not considering the interdependencies among perspectives or criteria in the hierarchy, and not to specifically identify the interdependent relations between perspectives or criteria by any quantitative methods. Moreover, Chiou et al.  showed that user-based surveys should be regarded as an external evaluation method with respect to deciding whether an online travel website is “doing the thing right” in terms of meeting the expectations of their users. Evaluating whether an online travel website is “doing the right thing” with respect to meeting its web strategy requirements requires an initial internal evaluation by a team of experts; once completed, the external surveys can be performed. In response, we first utilized the fuzzy Delphi method based on external and internal evaluations to adjust the relevant selection criteria. Then, we applied DEMATEL so that the interdependencies among the perspectives could be identified. Finally, ANP was to rank the available alternatives.
When multi-criteria group decision-making emerged in the early 2000s, it has been a quite vital field . Researchers have tried to combine multiple MCDM approaches for constructing optimal decision schemes in recent years . This study presented a hybrid model that blends the fuzzy Delphi method, DEMATEL, and ANP, such that the selection of the optimal OTAs becomes clear following the analysis. The steps and procedures involved are outlined below.
3.1. Fuzzy Delphi Method
In addition, using an MCDM approach, it is advised that information be collected through expert discussions as well as group decision making, for example, by following the Delphi method . The Delphi method is essentially dependent on expert professional wisdom, intuitional experience, and value judgment. At the beginning, the Delphi method requires the formation of a group with 10 to 15 experts focused on a specific issue. The Delphi method is composed of an anonymous survey conducted over two or more rounds; it is not expected that participants will ever meet each other throughout the process. After each round, the results are provided from the previous round to allow participants to review their original assessments, and then choose to maintain or revise them. Rowe et al.  noted that there exists a common belief that this approach makes better use of group interaction. Wu et al.  also pointed out that the pros of the Delphi method include the following: being reliable and practical, reducing incorrect results through anonymity, and reducing personal bias.
However, the Delphi method has been criticized for a number of issues including a low convergence, the length of the interrogation process, and the loss of pertinent information that could be gleaned from expert opinions . To avoid the shortcomings of the Delphi method, various studies [14, 38, 39] improved it in a fuzzy environment.
Chao and Kao  claimed that the fuzzy Delphi method’s primary advantage consisted of the amount of time saved due to the reduction in the number of surveys performed, in conjunction with the inclusion of expert opinions. To assess the selection criteria, the present study employed the fuzzy Delphi method as developed by Klir and Yuan . We began by collecting expert opinions through questionnaires and then establishing the triangular fuzzy number Ti. Yij was deemed the evaluation value of expert j for criterion i. Following Hsu et al. , we derived the defuzzified value of each criterion Si using the simple center of gravity method. Last, we screened out the selection criteria by setting a threshold, which was done through expert discussion.
Step 1. Establish the initial direct relation matrix A according to the scores.
Based on professional knowledge, the decision maker scores the mutual relationships between factors. Comparisons on a scale ranging from 0 (no impact) to 4 (very high impact) regarding the impact between factors must be made. Determining the degree of influence between two factors and filling in the value as defined above in the corresponding field, A can be created by consolidating the values filled in by the decision makers. The notation xij represents the degree to which the expert evaluation factor i influences factor j. For i = j, all diagonal elements values are 0. For each respondent, a positive matrix can be developed as , where k is the number of experts with , and n is the number of perspectives. To integrate the opinions from H experts, the average matrix is as follows:
Step 2. Compute the normalized initial direct relation matrix D.
D is generated from A. D = , where . Each element in D falls between 0 and 1.
Step 3. Attain the total relation matrix T.
T is defined as , where I is the identity matrix. r and c are and vectors representing the sum of rows and sum of columns of T, respectively. Assume ri to be the sum of the ith row in T; then ri summarizes both the direct and indirect impacts given by factor i to the other factor. If cj means the sum of the jth column in T, then cj represents both the direct and indirect impacts by factor j from the other factor. When j = i, the sum (ri +cj) expresses the total impacts given and received by factor i. As such, (ri +cj) indicates the degree of significance that factor i plays in the system. Moreover, driving and outcome factors can be also detected. Driving factors have positive criterion (ri−cj) values. By contrast, outcome factors are criteria with negative (ri−cj) values [48–50].
Step 4. Identify a threshold value.
While T provides a structural relation between the factors, decision makers are still required to arrange a threshold value to eliminate the unsuitable effects. Hsu  and Tsai and Lin  suggested that the threshold value can be established via expert discussions.
ANP is derived from AHP. Using pairwise comparisons, AHP is able to approximate the relative importance of every node. Nodes are compared by Saaty’s scale: a score of 1 suggests that both are equally important, while a score of 9 represents that one node is extremely more important as compared to the other. Saaty  proposed the consistency ratio (CR) for verifying the consistency of the pairwise comparison matrix. If the CR value is less than 0.1, the consistency of the pairwise comparison matrix is accepted.
AHP’s major limitation is that the decision problem is modeled as a hierarchy. In contrast, ANP can handle decision problems modeled as a network. In such a way, interdependence can be considered . ANP applied in diverse areas can be utilized to make decision problems that cannot be structured hierarchically and without the independent assumptions . ANP handles interdependence very well due to the fact that it develops a supermatrix to later procure the relevant composite weights . Wu et al.  summarized past studies and pointed out the advantages of ANP, including capability of handling feedbacks and interdependencies, being able to depict the dependence of factors involved in higher-level objective, and specific software that can be used to make solving problems more convenient. In general, ANP can be described as follows:
Step 1. Build the hierarchy and structure the problem.
Step 2. Perform pairwise comparison.
Step 3. Calculate the supermatrix.
Step 4. Select the optimal alternative.
In this section, we utilized the fuzzy Delphi method, DEMATEL, and ANP to select the ideal OTAs for hot spring hotels in Taiwan via the following steps.
Step 1. Build the hierarchy and structure the problem.
The OTAs selection criteria were based on a review of other relevant studies, as well as discussions with hot spring hotel executives. Following a purposive sampling method, members of The Hot Spring Tourism Association Taiwan were contacted and asked to provide a list of names of professionals who could competently select the optimal OTAs. Employing the fuzzy Delphi method, the scale used to measure the selection criteria in the questionnaire ranged from 1 (least important) to 9 (most important). The semi-structured questionnaire also provided space for suggestions on additional criteria. We received completed questionnaires from 64 senior executives with a minimum of five years of practical experience evaluating OTAs, and these were used to develop the OTAs selection criteria. Via the fuzzy Delphi method, we screen the selection criteria for the purpose of ensuring content validity.
Based on the process outlined above, the top 12 criteria were obtained: Quick [21, 25], Secure [13, 21–25, 27], Easy [10, 21, 22, 24, 25, 27], Flexible [10, 21, 24, 25], Responsive [13, 22, 24], Commission-based (executive proposed), User (executive proposed), Reputable , Sales-focused (executive proposed), Varied [24, 27], Unique (executive proposed), and High-quality [23, 24]. Detailed explanations for the criteria are offered in Table 1.
Based on the studies by Kim et al.  and Chiou et al.  and discussions with senior executives, the hierarchy with an overall goal of selecting the optimal OTAs for hot spring hotels in Taiwan was constructed. Level 1 included four perspectives (Use, System, Credibility, and Product). Each perspective included three criteria from those identified earlier. Level 3 consisted of the two OTA alternatives in a case company. DEMATEL was then used to confirm the interrelationships between the perspectives. The decision-making committee included two senior managers of a hot spring hotel. Following DEMATEL procedures, the initial direct relation matrix and the total relation matrix of perspectives were assessed, as shown in Tables 2 and 3. Threshold values were 19 that were determined following discussions with the same two senior executives. Based on this process, a DEMATEL impact relation map was created, as shown in Figure 1.
The threshold value is 19.0000.
Step 2. Perform pairwise comparison.
Based on the interdependencies of the perspectives, each perspective’s and criterion’s priority weight can be depicted. The pairwise comparison matrixes of perspectives are shown in Tables 4–7. About criteria, Table 8 as an example depicts a pairwise comparison within the System perspective with respect to Quick.
Step 3. Calculate the supermatrix.
Following Step 2, an unweighted supermatrix is formed in Table 9. Then, the unweighted supermatrix is converted into a weighted supermatrix via multiplying the priority weights from the perspectives, as shown in Table 10. Finally, the weighted supermatrix can converge into a stable supermatrix, called the limiting supermatrix. The final priorities weight of the selection criteria is presented in the limiting supermatrix, as indicated in Table 11.
Step 4. Select the optimal alternative.
Based on the weight of each alternative with respect to the selection criteria, as well as the limiting supermatrix, we got the overall weight of each alternative showing in Table 12. On this basis, the preferred OTA could be selected: Alternative 1 (Booking.com) clearly outperformed Alternative 2 (Expedia).
The best way to select an optimal OTA remains poorly understood. However, hotels that can make optimal decisions in this area stand to benefit. The purpose of this paper is to establish a comprehensive model for selecting OTAs. A hybrid MCDM model is utilized to achieve this purpose. In this study, the hybrid MCDM model for OTAs selection included three stages: first, we defined the research problem and constructed OTAs selection hierarchy for hot spring hotels in Taiwan; second, we identified the cause-effect relationships between perspectives; third, we evaluated the alternatives by using ANP.
In other words, the comprehensive selection model of OTAs is constructed to identify the optimal alternative. Then, the fuzzy Delphi method is to express the incomplete knowledge of experts and represent the uncertainties of information. DEMATEL is used to confirm interdependencies between the perspectives. Moreover, ANP is introduced to rank alternatives, so as to better take the relationships between the perspectives into consideration. A case is conducted to test the capabilities of the proposed model. The selection model developed in this study provides a theoretical analysis and operational insights, while the results should assist managers to make efficient and effective decisions. Theoretically, Use and System perspectives are vital parts of OTAs websites. The findings of this study fit in with those shown in the literature. Moreover, the effectiveness of the security system should be ensured that users can complete their transactions securely. The proposed model illustrated through an empirical case is useful in practice, as it integrated three validated approaches in an optimal manner. This outcome supports us to trust that this model is highly suitable as a decision-making tool for OTAs selection.
The contributions of this study are: first, the selection of the optimal OTAs is an MCDM problem with dependence and interaction factors. A literature review and fuzzy Delphi method were used to create four perspectives (Use, System, Credibility, and Product) and 12 criteria (Quick, Secure, Easy, Flexible, Responsive, Commission-based, User, Reputable, Sales-focused, Varied, Unique, and High-quality) to select OTAs for hot spring hotels in Taiwan. Two MCDM techniques (DEMATEL and ANP) were combined to design a hybrid OTAs selection model that prioritizes the weighting of perspectives and criteria and also finds the optimal OTAs for a case company. The proposed model not only handles the causal relationships between each perspective but also generates more valuable information for hot spring managers to make decisions.
Two issues should also be noted. First, all data were collected in Taiwan. Researchers are encouraged to broaden the collection area like conducting a cross-national analysis to determine whether the model remains consistent across various countries. Second, using a larger scale survey might better the generalizability of the findings and also result in the discovery of new criteria.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
- H. G. Peng, H. Y. Zhang, and J. Q. Wang, “Cloud decision support model for selecting hotels on TripAdvisor.com with probabilistic linguistic information,” International Journal of Hospitality Management, vol. 68, pp. 124–138, 2018.
- P. Ji, H. Y. Zhang, and J. Q. Wang, “A fuzzy decision support model with sentiment analysis for items comparison in e-commerce: The case study of PConline.com,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, pp. 1–12, 2018.
- X. Guo, L. Ling, and Z. Gao, “Optimal pricing strategy for hotels when online travel agencies use customer cash backs: A game-theoretic approach,” Journal of Revenue and Pricing Management, vol. 15, pp. 66–77, 2016.
- L. Ling, X. Guo, and L. Liang, “Optimal pricing strategy of a small or medium-sized hotel in cooperation with a web site,” Journal of China Tourism Research, vol. 7, pp. 20–41, 2011.
- Y. W. Chang, P. Y. Hsu, and Q. M. Yang, “Integration of online and offline channels: A view of O2O commerce,” Internet Research, vol. 28, no. 4, pp. 926–945, 2018.
- Y. W. Chang, P. Y. Hsu, and Y. C. Lan, “Cooperation and competition between online travel agencies and hotels,” Tourism Management, vol. 71, pp. 187–196, 2019.
- E. Raguseo, P. Neirotti, and E. Paolucci, “How small hotels can drive value their way in infomediation. The case of ‘Italian hotels vs. OTAs and TripAdvisor’,” Information and Management, vol. 54, pp. 745–756, 2017.
- X. Zheng and X. Guo, “Online engagement investments of online travel agencies: A game-theoretic approach,” Journal of Electronic Commerce Research, vol. 17, no. 3, pp. 256–265, 2016.
- A. Inversini and L. Masiero, “Selling rooms online: The use of social media and online travel agents,” International Journal of Contemporary Hospitality Management, vol. 26, no. 2, pp. 272–292, 2014.
- P. Sun, D. A. Cárdenas, and R. Harrill, “Chinese customers’ evaluation of travel website quality: A decision-tree analysis,” Journal of Hospitality Marketing and Management, vol. 25, pp. 476–497, 2016.
- C. Martínez-Costa, J. P. Viladecans, M. Mas-Machuca, and F. Marimon, “Behavioral profiles of consumers of online travel agencies,” International Journal for Quality Research, vol. 12, no. 3, pp. 703–722, 2018.
- L. Ling, Y. Dong, X. Guo, and L. Liang, “Availability management of hotel rooms under cooperation with online travel agencies,” International Journal of Hospitality Management, vol. 50, pp. 145–152, 2015.
- K. W. Lee, H. Han, and J. Hwang, “Developing a matrix for assessing serviceability of U.S. online travel agency websites,” Social Behavior and Personality, vol. 45, no. 1, pp. 115–126, 2017.
- T. H. Hsu and T. H. Yang, “Application of fuzzy analytic hierarchy process in the selection of advertising media,” Journal of Management and Systems, vol. 7, pp. 19–40, 2000.
- Z. Ma, C. Shao, S. Ma, and Z. Ye, “Constructing road safety performance indicators using Fuzzy Delphi Method and Grey Delphi Method,” Expert Systems with Applications, vol. 38, pp. 1509–1514, 2011.
- S. L. Si, X. Y. You, H. C. Liu, and P. Zhang, “DEMATEL technique: A systematic review of the state-of-the-art literature on methodologies and applications,” Mathematical Problems in Engineering, vol. 2018, Article ID 3696457, 33 pages, 2018.
- T. L. Saaty, Decision Making with Dependence and Feedback: The Analytic Network Process, RWS Publication, Pittsburgh, USA, 1996.
- J. S. Horng, C. H. Liu, S. F. Chou, Y. S. Yin, and C. Y. Tsai, “Developing a novel hybrid model for industrial environment analysis: A study of the gourmet and tourism industry in Taiwan,” Asia Pacific Journal of Tourism Research, vol. 19, pp. 1044–1069, 2014.
- G. Büyüközkan and S. Güleryüz, “An integrated DEMATEL-ANP approach for renewable energy resources selection in Turkey,” International Journal of Production Economics, vol. 182, pp. 435–448, 2016.
- İ. Gölcük and A. Baykasoğlu, “An analysis of DEMATEL approaches for criteria interaction handling within ANP,” Expert Systems with Applications, vol. 46, pp. 346–366, 2016.
- D. J. Kim, W. G. Kim, and J. S. Han, “A perceptual mapping of online travel agencies and preference attributes,” Tourism Management, vol. 28, pp. 591–603, 2007.
- Y. A. Park, U. Gretzel, and E. Sirakaya-Turk, “Measuring web site quality for online travel agencies,” Journal of Travel & Tourism Marketing, vol. 23, pp. 15–30, 2007.
- E. C. S. Ku and Y. W. Fan, “The decision making in selecting online travel agencies: An application of analytic hierarchy process,” Journal of Travel & Tourism Marketing, vol. 26, pp. 482–493, 2009.
- W. C. Chiou, C. C. Lin, and C. Perng, “A strategic website evaluation of online travel agencies,” Tourism Management, vol. 32, pp. 1463–1473, 2011.
- M. Bernardo, F. Marimon, and M. d. M. Alonso-Almeida, “Functional quality and hedonic quality: A study of the dimensions of e-service quality in online travel agencies,” Information and Management, vol. 49, pp. 342–347, 2012.
- S. Dutta, R. K. Chauhan, and K. Chauhan, “Factors affecting customer satisfaction of online travel agencies in India,” Tourism and Hospitality Management, vol. 23, no. 2, pp. 267–277, 2017.
- C. M. Lee, Y. Xuan, and W. L. Wan, “The study of key factors affecting cross-strait consumers selection of online travel agent,” Soochow Journal of Economics and Business, vol. 97, pp. 63–102, 2018.
- M. Dash and K. Sharma, “Competitive analysis of Indian tourism aggregators using multi-criteria analytic hierarchy process,” vol. 7, pp. 10–18, 2018.
- L. X. Niu and J. H. Lee, “The intention of repurchase on e-service quality by online travel agency site,” The International Journal of Industrial Distribution & Business, vol. 9, no. 7, pp. 61–70, 2018.
- T. B. Yee, R. Ramlan, R. Hassan, S. R. M. Shukri, and R. Mokhtar, “The evaluation of third party hotel booking website performance using analytic hierarchy process (AHP),” Journal of Advanced Research in Dynamical & Control Systems, vol. 10, no. 7, pp. 426–431, 2018.
- A. Tandon, H. Sharma, and A. G. Aggarwal, “Assessing travel websites based on service quality attributes under intuitionistic environment,” International Journal of Knowledge-Based Organizations, vol. 9, pp. 66–75, 2019.
- J. A. Morente-Molinera, G. Kou, R. González-Crespo, J. M. Corchado, and E. Herrera-Viedma, “Solving multi-criteria group decision making problems under environments with a high number of alternatives using fuzzy ontologies and multi-granular linguistic modelling methods,” Knowledge-Based Systems, vol. 137, pp. 54–64, 2017.
- Y. Liu, Y. Yang, Y. Liu, and G.-H. Tzeng, “Improving sustainable mobile health care promotion: A novel hybrid MCDM Method,” Sustainability, vol. 11, p. 752, 2019.
- N. Dalkey and O. Helmer, “An experimental application of the Delphi method to the use of experts,” Management Science, vol. 9, no. 3, pp. 458–467, 1963.
- G. Rowe, G. Wright, and F. Bolger, “Delphi: A reevaluation of research and theory,” Technological Forecasting & Social Change, vol. 39, pp. 235–251, 1991.
- C. C. Wu, D. S. Chang, and R. Wang, “Identifying key factors of adopting an RFID system in nursing care using DEMATEL-based ANP,” Corporate Management Review, vol. 38, no. 1, pp. 63–98, 2018.
- P. L. Chang, C. W. Hsu, and P. C. Chang, “Fuzzy Delphi method for evaluating hydrogen production technologies,” International Journal of Hydrogen Energy, vol. 36, pp. 14172–14179, 2011.
- T. J. Murray, L. L. Pipino, and J. P. van Gigch, “A pilot study of fuzzy set modification of delphi,” Human Systems Management, vol. 5, no. 1, pp. 76–80, 1985.
- A. Ishikawa, M. Amagasa, T. Shiga, G. Tomizawa, R. Tatsuta, and H. Mieno, “The max-min Delphi method and fuzzy Delphi method via fuzzy integration,” Fuzzy Sets and Systems, vol. 55, pp. 241–253, 1993.
- C. C. Chao and K. T. Kao, “Selection of strategic cargo alliance by airlines,” Journal of Air Transport Management, vol. 43, pp. 29–36, 2015.
- G. J. Klir and B. Yuan, Fuzzy Sets and Fuzzy Logic—Theory and Applications, Prentice Hall, New Jersey, NJ, USA, 1995.
- Y. L. Hsu, C. H. Lee, and V. B. Kreng, “The application of Fuzzy Delphi Method and Fuzzy AHP in lubricant regenerative technology selection,” Expert Systems with Applications, vol. 37, pp. 419–425, 2010.
- G. H. Tzeng, C. H. Chiang, and C. W. Li, “Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL,” Expert Systems with Applications, vol. 32, pp. 1028–1044, 2007.
- W. W. Wu, “Choosing knowledge management strategies by using a combined ANP and DEMATEL approach,” Expert Systems with Applications, vol. 35, pp. 828–835, 2008.
- J. I. Shieh, H. H. Wu, and K. K. Huang, “A DEMATEL method in identifying key success factors of hospital service quality,” Knowledge-Based Systems, vol. 23, pp. 277–282, 2010.
- Ö. Uygun, H. Kaçamak, and Ü. A. Kahraman, “An integrated DEMATEL and Fuzzy ANP techniques for evaluation and selection of outsourcing provider for a telecommunication company,” Computers & Industrial Engineering, vol. 86, pp. 137–146, 2015.
- Y. Lu, C. Jin, J. Qiu, and P. Jiang, “Using a hybrid multiple-criteria decision-making technique to identify key factors influencing microblog users’ diffusion behaviors in emergencies: Evidence from generations born after 2000,” Symmetry, vol. 11, p. 265, 2019.
- J. J. H. Liou, G. H. Tzeng, and H. C. Chang, “Airline safety measurement using a hybrid model,” Journal of Air Transport Management, vol. 13, pp. 243–249, 2007.
- Y. C. Lee, T. M. Yen, and C. H. Tsai, “Using importance-performance analysis and decision making trial and evaluation laboratory to enhance order-winner criteria: A study of computer industry,” Information Technology Journal, vol. 7, no. 3, pp. 396–408, 2008.
- J. Z. Wu and Y. H. Hua, “Key risk factors of financial holding companies in Taiwan: An integrated approach of DEMATEL-based ANP and risk management balanced scorecard,” NTU Management Review, vol. 28, pp. 205–242, 2018.
- C. C. Hsu, “Evaluation criteria for blog design and analysis of causal relationships using factor analysis and DEMATEL,” Expert Systems with Applications, vol. 39, pp. 187–193, 2012.
- P. H. Tsai and C. F. Lin, “Creating a management strategy evaluation model for taipei city sports centre by using hybrid MCDM models,” Journal of Testing and Evaluation , vol. 45, no. 5, pp. 1820–1836, 2017.
- T. L. Saaty, The Analytic Hierarchy Process, McGraw-Hill, New York, NY, USA, 1980.
- L. E. Quezada, H. A. López-Ospina, P. I. Palominos, and A. M. Oddershede, “Identifying causal relationships in strategy maps using ANP and DEMATEL,” Computers & Industrial Engineering, vol. 118, pp. 170–179, 2018.
- D. Ergu, G. Kou, Y. Shi, and Y. Shi, “Analytic network process in risk assessment and decision analysis,” Computers & Operations Research, vol. 42, pp. 58–74, 2014.
- S. Arsić, D. Nikolić, I. Mihajlović, A. Fedajev, and Ž. Živković, “A new approach within ANP-SWOT framework for prioritization of ecosystem management and case study of National Park Djerdap, Serbia,” Ecological Economics, vol. 146, pp. 85–95, 2018.
- Y. Wu, B. Zhang, C. Xu, and L. Li, “Site selection decision framework using fuzzy ANP-VIKOR for large commercial rooftop PV system based on sustainability perspective,” Sustainable Cities and Society, vol. 40, pp. 454–470, 2018.
Copyright © 2019 Sen-Kuei Liao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.