Abstract
A better-performing project gains more subsequent businesses. Many organizations worldwide apply an earned value management (EVM) system to monitor and control their projects’ performance. However, a successful EVM application requires handling multiple interinfluenced criteria with feedback effects for decision-making and continuous improvements throughout the application life cycle. The conventional decision approaches assume that preferences between criteria are independent and put their focuses on decision-making. This study employs a hybrid multiple criteria decision-making (HMCDM) method to devise a novel procedure to fulfil the deficiencies. The proposed procedure enables us to evaluate interinfluence effects and gap indices among criteria/dimensions/alternatives and then systemize the evaluation results in a context of influential network relation map (INRM). The INRM provides managers with visual information to find a route in making application decisions, while identifying critical gaps for continuous improvements. A numerical example is presented to illustrate the applicability of the proposed procedure. The results show that, by employing the HMCDM method, the proposed procedure can provide organizations with a foundation to ensure that the aspired EVM application outcomes are achieved at different levels within an organization.
1. Introduction
A project is “a temporary endeavor undertaken to transform limited resources into a unique product, service, or result,” in order to satisfy the needs of society, users, and customers [1]. A better-performing project gains more subsequent businesses and is ultimately of strategic importance to an organization [2, 3]. To attain high performances, many organizations worldwide apply an earned value management (EVM) system to monitor and control their projects [4, 5]. A successful EVM application enables us to produce reliable performance indices at initial stages of a project, as early as 15 to 20 percent of the project process [6, 7], thus allowing organizations to understand project health, predict future trends, and take required control actions to minimize deviations, thereby attaining the aspired performances throughout the project life cycle [8–10].
According to Kim et al. [11], EVM application can be formulated as a multiple criteria decision-making (MCDM) problem, which requires experts to analyze a set of interinfluenced application criteria with feedback effects throughout the application process. Some of these criteria include the following: using information systems to report project progress in an accurate and timely manner [11]; using a project management process to break down the project scope and organizational structure [7]; training stakeholders in the effective use of EVM [12]; and providing ongoing efforts to improve the application of EVM [10]. According to Fleming and Koppelman [7], a lack of accurate understanding of the above-mentioned interinfluenced criteria can lead to a series of shortcomings in the implementation of an EVM. Kwak and Anbari [5] have also noted that without adequate analysis upfront, even after an application decision has been conceived and implemented, unanticipated efforts will be required to solve new problems as the implementation proceeds. These studies demonstrate the importance of adopting a systematic procedure to analyze interinfluenced criteria associated with the EVM application decision. Additionally, to obtain aspired application outcomes, continuous improvements should be also early considered in order to prevent the selected decisions from producing negative outcomes [2, 13, 14].
However, according to the literature review of this study, most traditional MCDM approaches assume that the preferences between decision variables are independent and put their emphasis on evaluation and selection of decision alternatives without addressing practical means to implement required improvements [15–20]. Yet, as discussed previously, EVM application requires a decision approach that addresses these issues. Consequently, this study employs a hybrid multiple criteria decision-making (HMCDM) method to devise a novel procedure to fulfil the above-mentioned deficiencies. The HMCDM method contains a decision-making trial and evaluation (DEMATAEL) technique [21], a DEMATEL-based analytical network procedure (DANP) [22], and a modified multicriteria optimization and compromise solution (ViseKriterijumska Optimizacija I Kompromisno Rešenje in Serbian; VIKOR) method [23]. This combined approach was introduced by Tzeng [17] as a new trend of decision-making. Recently, it has been successfully applied in different business fields to solve and improve complex and interdependent real-world problems [18, 22, 24–27] and is thus examined in this study.
The proposed novel procedure uses experts’ judgments to model interdependent EVM application problems with a decision framework considering improvement requirements. The procedure then employs the HMCDM method to quantify gap indices with respect to aspiration levels of EVM application based on interinfluence effects among factors/dimensions/alternatives within the decision framework. Finally, the HMCDM method systemizes the quantitative results in the context of influential network relation maps (INRM). The INRM helps managers find a route for EVM application decisions, while identifying critical gaps for prior improvements throughout the life of the decisions implementation. A numerical example is presented to illustrate how the proposed procedure operates in practice. The results show that, by employing the HMCDM method, the proposed procedure can provide organizations with a foundation to ensure that the aspired EVM application outcomes are achieved at different levels within an organization. The remainder of this paper is organized as follows. In Section 2, the EVM literature is reviewed in relation to the proposed procedure; in Section 3, essential concepts of the HMCDM model are presented and the proposed procedure is introduced; in Section 4, a numerical example showing the applicability of the proposed procedure is presented, and main findings are discussed; conclusions are provided in the final section.
2. The Literature Review about Earned Value Management
This section briefly reviews research literature associated with EVM application and then identifies the dimensions and factors/criteria for establishing a decision framework in formulating the proposed procedure for pursuing the aspiration levels of EVM application through better decision-making and continuous improvements.
The EVM was originally developed as a technique by the United States Department of Defense (DoD) in the 1960s to manage the financial aspects of major acquisition projects. In 1967, the DoD adopted the 35 standardized EVM managerial criteria, defined by the United States Air Force as the Cost Schedule Control System Criteria (C/SCSC). This regulatory system was used by the DoD and its contractors to monitor and control various projects over the next three decades [7]. In 1996, the National Defense Industrial Association reduced the EVM criteria to a total of 32, which were formally accepted by ANSI/EIA in 1998 in their publication of the ANSI/EIA 748-98 standard, known as EVM system [6]. During the following year, the Project Management Institute (PMI) adopted EVM as a managerial tool and technique to monitor projects, as stated in its publication titled A Guide to the Project Management Body of Knowledge (PMBOK®Guide) and subsequently described in a separate publication, Practice Standards for Earned Value Management. These publications and the promotion of EVM principles, including their regulation, standardization, and simplification, have led to increasing interest in the use and development of innovative applications of EVM among organizations and experts worldwide [3, 5, 6, 8, 11].
However, while EVM has been widely accepted as one of the most pragmatic systems for managing project performances in both public and private organizations, the studies have also noted that the development of EVM elements and the wide acceptance of EVM do not in themselves guarantee that the EVM application will be successful for projects in all organizations [2, 6]. Some of the common issues arising in projects managed through EVM in different organizations, including the U.S. government and its subsidiary agencies, include overbudgeting, schedule delays, and unsatisfactory performance [5, 11]. These phenomena indicate that even in organizations with long-term operational experience, the implementation of EVM can result in deviations from organizations’ aspiration level [7]. Hence, the subject of the effective EVM application requires further study to assist organizations in obtaining intended outcomes. In particular, organization must enable us to assess the current capability of each subordinate unit to understand whether EVM application decisions could eventually help the unit to better manage project performance. What application factors should be in place for each unit to apply EVM and to avoid the need for unintended efforts during the implementation of EVM decisions? Furthermore, if the EVM application is justified as inappropriate, then how can each unit improve its weakness to facilitate benefits through EVM application in the future?
According to the American National Standards Institute/Electric Industries Association, a reliable EVM application should consider 32 criteria belonging to five categories: organization, planning and budgeting, accounting, analysis and revision, and data maintenance [28]. Fleming and Koppelman [7], who conducted research on many software projects, proposed ten “must-haves” that are required to fully grasp and apply the critical earned value concept in enhancing the management of all types of projects in an industry. These ten “must-haves” require the complete definition of a project’s scope of work using a work breakdown structure (WBS) at the outset of project planning as well as through the continuous management of all changes during project execution. Another study by Kwak and Anbari [5] based on the National Aeronautics and Space Association (NASA) indicated that key success factors for the implementation of EVM included the early introduction of EVM, the full involvement of users, and consistent communication with all stakeholders. Lipke [10] argued that the elements required for executing projects and facilitating continuous improvement are necessary ingredients for EVM application to ensure successful project outcomes. These studies have provided useful information for understanding the factors influencing the successful EVM application from different perspectives but lack an integrated or systematic procedure for analyzing level of readiness of these factors when making application and improvement decisions.
Stratton [12] proposed a five-step mature model of earned value management to enhance the quality and use of EVM within an organization. This model can be linked to the ANSI/ESI standard 748 to create assessment matrices that help users to evolve an EVM within their own organizations and to assess the relative strengths of various EVM applications. This study has focused on developing a systematic procedure for analyzing effectively EVM implementation while assuming the independence of the factors in the assessment matrices. This assumption conflicts with the real-world application situations discussed in many other studies [3, 5, 10].
A more comprehensive study by Kim et al. [11] used surveys mailed to 2,500 individuals and on-site case studies conducted within six organizations and concluded that approximately 40 interactive factors in four dimensions (the EVM user, the EVM methodology, the implementation process, and the project environment) could influence significantly the EVM application in four ways: accepting the concept, applying EVM by project managers and team members, enabling projects to be completed within constraints and with satisfactory performance, and bringing overall satisfaction to users of this methodology. The study concluded by proposing an implementation framework to assist both industrial and government agencies applying EVM more effectively for different sizes and types of projects. However, the proposed model and framework were qualitative in nature and did not provide a systematic mean to quantitatively analyze interrelated effects among the dimensions/factors for application decisions and management actions.
According to the literatures discussed above, the factors/criteria influencing the effective EVM application can be grouped into four dimensions: the EVM user, the EVM methodology, the implementation process, and the project environment. Each dimension contains respective factors, as shown in Table 1. In the next section, a novel procedure based on the HMADM method is proposed to evaluate and analyze these interdependent application dimensions/factors in relation to the selection and improvement of application decisions, with the goal of obtaining aspiration levels of EVM application.
3. The Proposed Procedures for Obtaining the Aspiration Levels of EVM Application
To explain the proposed procedure, this section first briefly introduces the essential concepts related to the HMCDM model that combines the following elements: DEMATEL technique, DEMATEL-base ANP, and modified VIKOR; subsequently, this section discusses how the model is employed to develop the proposed procedure.
The HMCDM model was proposed by Tzeng [17], who combined new concepts and techniques to handle complicate and dynamic real-world problems. First, the HMCDM model employs the DEMATEL technique to quantify interinfluence effects among decision variables and visualize the effects on an influential network relation map (INRM). The DEMATEL technique was developed by the Battelle Geneva Institute in 1972 for assessing and solving complex groups of problems [29]. This technique used Boolean operation and Markov Process to quantify cause and effect relationships on each dimension/criterion within a system (or subsystem). Quantitative values results are then systemized on a single map showing degree and direction that each dimension/criterion can influence each other and to the overall system performance [30]. The interinfluence values of DEMATEL can not only help managers gain valuable information for understanding specific societal problems, but also be further used with other methods to obtain more precise weighting values and gap indices in dealing with the real-world decision and improvement problems [21, 31]. Second, this model provides a procedure known as DANP that applies a basic concept of the analytic network procedure (ANP) to transform the interinfluence value of DEMATEL into influential weights (IWs) for prioritizing decision variables. ANP was proposed by Saaty [32] to address interdependence and feedback among the factors, dimensions, or alternatives associated with a decision-making problem. However, ANP assigns identical weights for each cluster per group on the normalized supermatrix, neglecting the influence in different degree. DANP used DEMATEL technique to adjust the ANP equal weighting assumption for better communication of real interdependent situations and improvement alternatives and decisions [22, 31]. These features avoid the assumption of traditional decision models, such as AHP, TOPSIS, path analysis, and SEM, that the value creation criteria are independently and hierarchically structured, thereby enabling interdependent decision situations to be viewed as decision process and outcomes [18].
Third, this model adopts the principle of “aspiration levels” [33] to replace the traditional max/min approach [15, 34], through a modified VIKOR method, when choosing a relatively good solution from existing alternatives. This feature produces the size of performance gaps to aspiration levels on each criterion/dimension/alternative, thus enabling managers to use a single value for both decision-making and continuous improvements [25]. The VIKOR method was proposed by Opricovic [35] to solve problems that involve incommensurable and conflicting factors. Originally, this method focused on analyzing a set of alternatives and selecting a compromise solution closest to the ideal state [34]. The ideal state was defined as a set of maximum/minimum values relating to each benefit/cost criterion among all alternatives. However, these traditional compromises can entail “choosing the best among inferior options/alternatives”: that is, pick the best apple in a barrel of rotten apples; thus, the traditional procedure has to entail “improving” the potential solutions [18]. Hence, Tzeng [17] proposed the modified VIKOR method to replace the maximum/minimum approach with “aspired-worst” by setting and as the aspiration level and the worst level, respectively, for criterion , if performance scores with measuring range are from 0 to 10 in questionnaires of each criterion as complete dissatisfaction/bad extreme satisfaction/good. Recently, this method has been used to aid decision makers in identifying critical gaps in need of further improvement [36, 37].
Combining all these concepts and techniques, the HMCDM model allows managers to avoid “choosing the best among inferior options/alternatives,” (i.e., avoiding “picking the best apple among a barrel of rotten apples”) [17]. More importantly, the HMCDM model extends the evaluation and selection of decision functions to include identification of critical gaps for continuous improvement over the life of decision implementation [24, 27, 37]. The detailed descriptions, notations, and computational processes can be found in [17, 19, 26, 38].
This study applies the HMCDM model to devise a novel procedure for obtaining aspiration levels of EVM application through four main stages: form an expert team, develop a decision framework, systemize and visualize decision information using HMCDM model, and make application decisions and determine improvement strategies based on INRM. A graphical representation of our procedure is depicted in Figure 1.
As shown in Figure 1, the proposed procedure first forms an expert team (ET) through a top management committee according to the predetermined qualifications. Second, the ET identifies influencing criteria to develop a novel decision framework (Figure 2) which considers both the decision-making and continuous improvements associated with an interrelated decision problem. The decision framework developed in this stage is different from traditional ones which only consider decision-making. Third, based on the decision framework, the procedure uses the HMCDM model to evaluate, systemize, and visualize decision and improvement information including the following: computing interinfluence effects using the DEMATEL technique; computing influential weights using DANP; computing gap indices using modified VIKOR method; and, lastly, systemizing the decision information obtained from the previous steps on the visualized DEMATEL’s INRM, showing preference of alternatives and how much improvement is required for each criterion and dimension associated with each alternative. Finally, referring to the INRM, the ET gains valuable information to finalize application decisions with top management and stakeholders, while determining strategies for continuous improvements in achieving the aspired EVM application outcomes in an organization. In the next section, a numerical example is presented to illustrate how the proposed procedure operates in practice.
4. A Numerical Example to Illustrate the Proposed Procedure
In this section, we use an empirical example from a defense organization to illustrate the application of the proposed procedure to a real-world problem. To preserve confidentiality, all data related to the example have been transformed into equivalent units by normalization, which does not compromise the analysis or gap measurement for each factor and dimension and overall alternatives in order to reach the desired aspiration levels.
4.1. Problem Descriptions
The Ministry of National Defense (MND) of a country has been experiencing difficulties obtaining sufficient defense funding during the economic recession and is consequently considering whether to apply EVM to its acquisition units to sustain superior defense capacities with limited resources by ensuring better regulation of the performance and progress of its projects. However, the MND has many acquisition units. As a result of the multisourcing strategy adopted by the MND to acquire its projects from manufacturers in the U.S., Europe, and the domestic market, each unit exhibits certain differences in infrastructure for the management of the projects from different sources. These differences have made EVM application in the MND more complicated than in organizations with mature or identical project management infrastructures for their subordinates. To better manage this complicated situation, the MND required a comprehensive and systematic evaluation to analyze, select, and improve the appropriate decisions that would enable the aspired EVM application outcomes to be achieved in the different units. The MND therefore applied the proposed procedure in a pilot project, to assess two units and obtain satisfactory outcomes.
4.2. Application of the Procedure
Here, we illustrate the stepwise process by which the MND applied our procedure to obtain application decisions and improvement strategies to assist subordinate units in determining how to accept and use EVM to manage project performances with aspired results.
4.2.1. Form a Team
The MND formed an ET with seven experts, one from each of following sectors: acquisition, technology, manufacturing, logistics, end users, procurement, and finance. All experts were selected based on their proficiency in relation to EVM, as assessed by a top management MND committee according to a set of predetermined qualifications.
4.2.2. Develop a Novel Decision Framework
In this stage, the ET members identify 20 influencing factors as evaluation criteria in 4 dimensions and develop a decision framework as shown in Figure 2.
In Figure 2, the highest level of the decision framework is the goal: obtaining aspiration levels of EVM application across MND for two acquisition units (two alternatives), denoted by and , where two units also represent the alternatives to be evaluated at the fourth level of the decision framework. The second and third levels contain dimensions and factors (groups of interinfluence factors), used to evaluate the alternatives. The fifth and final levels include the gaps for each dimension and factor to be measured in terms of how to reach aspiration levels through continuous improvements.
4.2.3. Systemize and Visualize Decision Information Using HMCDM Model
In this stage, the ET members first employed the DEMATEL technique to evaluate the interinfluence effects among 20 factors within the DF and averaged the results in an initial-average 20-by-20 matrix (Table 2).
The initial-average matrix was further normalized as an initial-influence matrix (Table 3), usingwhere .
Subsequently, through matrix operation using (2), a total-influence matrix was obtained as in Table 4. In Table 4, all factors in were further classified into the corresponding dimensions as matrix , and each dimension was averaged to obtain matrix :where is an identity matrix, , , , . If the summation of at least one column or one row (but not all) is equal to one, then we can guarantee that .
In matrix , the inconsistency rate (IR) of the evaluation results from all experts was only 2.70%, which is less than 5%. This result implied that the inclusion of an additional expert in this study would not influence the findings and that the significant confidence level is 97.30%.
According to Table 4, the ET employed DANP to compute the influential weights (IWs) for the dimensions and factors. During this process, the matrices and obtained through DEMATEL were normalized as and , and then we transposed matrix into an unweighted supermatrix . Subsequently, was multiplied by to obtain a weighted supermatrix , as shown in Table 5, and finally multiplied by until it converged into IWs for factors and dimensions, as shown in Table 6.
As shown in Table 6, the ET generally agreed that, in terms of the IWs of DANP, all dimensions and factors have the similar level of importance for effective EVM application. However, the DEMATEL results (Table 4) provide managers with additional information to justify the level of interinfluence among factors/dimensions to achieve the aspired EVM application.
After the DANP steps, the ET administered a questionnaire to collect the opinions of users at different units regarding the outcomes that their units can achieve through EVM application based on their current operational capabilities. Typically, the main components of the questionnaire can be designed as shown in Table 7 set scores to evaluate the respective performance outcomes on a scale from 1 to 5: “N/A ,” “A ,” “AU ,” “AUP ,” and “AUPS .”
In this case, 18 and 20 respondents in and were interviewed, respectively. The ET averaged all responses as performance value and then set the worst value and the aspiration level (best value), . Subsequently, the modified VIKOR method was employed to compute the gap indices through using (3)~(6). The computational results are summarized in Table 8:where is the IWs of the factor from DANP:where is presented as the weight of the strategy of maximum group utility (priority improvement) and is the weight of individual regret.
As shown in Table 8, the gap indices for alternatives and are 0.520 and 0.739, respectively. These values revealed the gap size that each unit would need to be improved to reach the aspiration level. These values imply that the EVM application with required continuous improvements would enhance performance of the acquisition projects in ; however, the EVM application may not help to enhance the performance of projects unless the current operational capabilities of are further improved.
Additionally, the ET developed the INRM with the use of the results of the DEMATEL and the modified VIKOR method (Tables 4 and 8). During this process, using Table 4, the ET computed the degree of total influence that a factor exerted on the other factors (sum of each row), , and the degree of total influence that a factor received from the other factors (sum of each column), . The ET also derived , indicating the degree of the central role that respective dimension/factor plays in the system, and , indicating the degree of net influence that respective dimension/factor contributes to the system. If is positive, then the dimension/factor affects other dimensions/factors and, if is negative, then the dimension/factor is influenced by other dimensions/factors. The results were summarized as shown in Table 9.
In Table 9, the degree of the central role () of the EVM users (), the EVM methodology (), the implementation process (), and the project management environment () are 3.174, 3.201, 3.243, and 3.171, respectively. These values indicate that all members of the ET generally agreed that all 4 dimensions play a central role in achieving the MND’s EVM application at aspiration levels. However, among the 4 dimensions, the degree of net influence () on the project management environment () is 0.060, and an emphasis on this dimension is the basic requirement for the MND to apply EVM in managing projects effectively. This finding also implies that if the project management environment is not well established, EVM application would be affected negatively. Table 9 also contains the interinfluence effects on factors, showing valuable indications for better understanding critical elements in EVM application in different units within MND.
Based on Tables 8 and 9, the INRM was developed as shown in Figure 3. Taking the dimensions as an example (on the top center in Figure 3), the -coordinate is the degree of central role , and the -coordinate is the degree of net influence . First, we marked the coordinates of the EVM users (), the EVM methodology (), the implementation process (), and the project management environment (), which are , , , and (3.171, 0.060), respectively. The process then referred to Table 4 to determine the arrow directions based on the degree of total influence between each dimension. For instance, according to Table 4, the degree of total influence of EVM users () on the project management environment () is 0.386; conversely, the degree of total influence of the project management environment () on EVM users () is 0.408. The arrow direction is then drawn from project management environment () to EVM users () because 0.408 is greater than 0.386. Likewise, the influential directions among all the dimensions and factors are determined and depicted accordingly. Additionally, the ET marked the gap indices on the INRM for factors/dimensions with respect to each alternative based on Table 8.
(a)
(b)
(c)
(d)
(e)
As shown in Figure 3, the INRM quantified and systemized the gap indices and the degree and direction of interinfluence effects among 20 factors within 4 dimensions associated with the aspired EVM application in the MND. Therefore, it helps managers easily analyze EVM application situations that are essential to make better application decisions. For example, the visualized interinfluence effects at the dimensional level on the INRM (on the top center in Figure 3) revealed that the project management environment () and the EVM methodology () were prerequisites for qualified EVM users () to implement an effective process () to achieve the aspired application outcome. When adopting the same approach, systematic information associated with decisions to accomplish the aspired EVM application can be realized comprehensively.
4.2.4. Make Application Decisions and Determine Improvement Strategies
In this stage, the ET arranged a series of meetings chaired by the MND’s top management, including representatives from related functional divisions. All of the participants reviewed Tables 1–9 and, with reference to the INRM, discussed application situations for each unit, and which factors or dimensions should be prioritized for improvements. The participants also discussed the affordability and availability of the resources required for potential improvements. The eventual outcome of these meetings was to apply EVM at and to delay its application in until the dimensions, factors, and/or overall gaps for that unit could be improved to a level below 0.500. Additionally, the participants determined the improvement strategies to be adopted, including allocation of the priority of and responsibility for a set of improvement activities. For instance, according to the size of the gap to the aspiration on the dimensions in Table 8, the ET classified the respective dimensional levels for and in descending order as follows: : ; and : . These values revealed that the project management environment () was a problem that arose for both and . In addition, with reference to the INRM, (3.171, 0.060) was located in the cause group; thus, improvements in the project management environment () would have the greatest effects in terms of improving the other dimensions and the selected application decisions. Furthermore, the INRM (Figure 3) showed that all five factors under the project management environment () also belonged to the cause group: the colleague-based work environment, (16.132, 0.091); ownership of EVM by lower level project managers, (15.913, 0.241); being risk free, (16.817, 0.616); culture, (16.310, 0.305); and regulations, (14.095, 0.245). These values suggested that all factors under the project management environment () should be accorded top priority for improvement and that the MND should be able to achieve the strongest improvement effects. Additionally, with the cross-referencing of Table 8 and the INRM, the factors needing prior improvements in the respective units were as follows: : resources () and open communication () in the dimension of implementation process and : () in the dimension of EVM use (), sufficient resources () in the dimension of implementation process . These factors are classified as part of the cause group, and the size of their gaps is greater than that of the other factors. In a similar fashion, the improvement strategies were determined accordingly.
4.3. Discussions and Implications
Several critical results were derived from the above-described numerical example and from the discussion with the ET members concerning the EVM application. First, according to the DEMATEL results (Tables 5, 9 and Figure 3), the interdependent relationships among 20 factors and 4 dimensions can influence the aspired EVM application outcomes. This finding is consistent with the arguments made by many studies that a set of interinfluenced criteria would significantly influence the effective EVM application and ultimately project performance [5, 11]. However, using the DEMATEL technique can analyze, systemize, and visualize these interdependencies in a single picture, thus revealing the degree and direction of interinfluence effects that each dimension and factor would exert on one another and on the aspired EVM application outcomes. Consequently, for users to be satisfied with the use of EVM to enhance their project performance, organizations require a deep understanding of these interrelationships when making application decisions. Additionally, using the DEMATEL technique can help managers to better analyze and understand interdependent application situations in detail.
Second, according to the results from the modified VIKOR method with the IWs of the DANP (Table 8), decisions regarding the MND’s application of EVM may differ for different units in terms of their capabilities in the management of different projects. The results confirm that the development of EVM elements and the wide acceptance of EVM worldwide may not guarantee that EVM application will be successful for all projects in all organizations. In other words, organizations will use a systematic procedure to thoroughly analyze application situations at different levels when making suitable application decisions for all units within an organization. The members of the ET emphasized the fact that the numerical results from the modified VIKOR method and the DANP were essential for the MND, which had no prior experience in applying the EVM and encountered many different application situations in each subordinate unit. If the HMCDM procedure had not been used, the application decisions would have been identical for all units once top management had made the decision to apply EVM.
Third, according to the DANP results (Table 7), among the 20 factors, continuous improvement (), an integrated change control system (), and an integrated product team (IPT) () are prioritized as the top three factors with IWs of 0.056, 0.055, and 0.055, respectively. This result echoes the findings obtained from the previously reviewed studies, indicating that the EVM application is not merely the delivery of a system in an organization [11]. Rather, there is considerable potential for improvement, which includes continuing to identify weaknesses in EVM and regard them as opportunities for improvements [5]. Additionally, according to the results of the modified VIKOR method (Table 8), each dimension/factor can create different sizes of gaps to impact aspired EVM application in each acquisition unit (alternative). However, the proposed procedure based on the HMCDM model, combining the DEMATEL technique, the DANP, and the modified VIKOR method, enables a cross-functional team to analyze capability gaps with respect to dimensions/factors of respective application units. Analyzing these gaps is useful in developing strategies to enable each application unit to take the most influential improvement actions to facilitate the EVM application decisions and to ensure the aspired results.
Finally, based on the above example, we argue that without the full support and participation of the various units within an organization, the proposed approach could not have been applied in the pragmatic manner described above. In particular, in the MND case, it is essential to have a small ET (with five to seven members) that includes genuine experts with full authorization from the top management to handle the application project on a full-time basis. “Genuine experts” refer to experts who are committed to taking the appropriate actions when rendering their opinions and judgments regarding the EVM application. In addition, the end users who apply the EVM must have progressive intentions to pursue performance improvement in their projects. Overall, the EVM application is not an easy task; indeed, it involves an array of interdependent variables that influence the application processes and outcomes. This example, however, has demonstrated that the procedure based on the HMCDM model combining the DEMATEL technique, the DANP, and the modified VIKOR method can not only better address application problems, but also easily identify critical factors that are highly influential in solving EVM application problems to achieve the aspiration level.
5. Conclusions
Although EVM has been widely accepted and applied to manage project performance in different types of organizations worldwide, many studies have indicated that a set of interdependent application factors can influence the EVM application process and outcomes. This study proposed a novel procedure, based on the HMCDM method, enabling organizations to obtain aspired outcomes through better decision-making and continuous improvements over the life of the application process.
A numerical example was used to demonstrate the applicability of the proposed procedure. The results showed the following merits of this study: it alone measures the interinfluence effects and gap indices to support decision-making and continuous improvements in pursuing aspired EVM application outcomes; the traditional concept of “effective EVM application” is extended from “illustrating of success factors and analysis framework for decision-making” to “analyzing, selecting, and improving selected decisions over application life cycle”; and managers obtain a visualized route showing decision information at different levels within a decision framework, allowing EVM application to be adapted to different application situations existing within the organization. These merits indicate that the proposed procedure can provide a significant foundation for ensuring that aspiration levels of EVM application are achieved at different levels in an organization.
This study has several limitations. First, the dimensions and factors used to establish the decision framework for the proposed procedure were obtained from a limited review of the literature; thus, this study may have excluded other potential influences on the decision process associated with the effective EVM application. Further research could use other approaches, such as interviews or case studies, to select additional factors and explore the differences and similarities between these approaches. Second, the conclusions drawn are based on a case from a national defense organization. Thus, future research could apply our procedure to other cases, such as organizations in the private sector, to examine our procedure across a wider range of application situations, thus making comparisons to gain additional insights into the usefulness of the proposed procedure. Finally, the improvement strategies determined from our procedure are a set of strategic guidelines. Future research can identify substantial improvement activities. This work can be characterized as an MODM problem, and future research can adopt the DINOV method with a changeable objective and decision spaces to obtain more valuable improvement outcomes. These limitations provide directions for future research to broaden the applicability of the proposed procedure.
Competing Interests
The authors declare that they have no competing interests.