Research Article  Open Access
Multilevel Comprehensive Evaluation and Decision Making of Ergonomics
Abstract
Due to the improvement of living standards, higher level of ergonomic performance is required for the products. As a result, the ergonomic evaluation has become one of the key points in the decisions making of modern products, especially the complex products. Aiming at improving the situation that the methods for ergonomic evaluation and decision making are onesided and discrete, this paper proposed several methods for measuring multiply factors and data format of products and built a comprehensive evaluation and decision making system. In this system, the data supplied by soft hardware and specialists were calculated separately to gain the preliminary scores, and the preliminary scores were processed to get the final results for the decision making using the AHPGRA analytic hierarchy processgray relational analysis method proposed in this paper.
1. Introduction
The products always change with the development of the society. At an early year of design, designers pay almost all of their attention into the realization of the functions and the function or capability of a product is the most important element in deciding whether the product is good or not. In recent years, the factor of ergonomic has drawn more and more attention of the users, and the products are required to be more humanized to satisfy the customers.
As a result, the designers have to do a lot of work on ergonomic from all angles, and the component of ergonomic can be complicated. It is always difficult for the decision makers to evaluate several proposals to find out the best one in the development process, because there are too many factors to be taken into consideration. Lots of companies and institutions have been developing software and hardware to simulate the using situation or to record data in the reality, such as the Motion Analysis, Tekscan, and Applied Science Laboratories. This equipment supplies plenty of information of the human body when using the product and can reflect the ergonomic performance in some way. On the other hand, the designers and the decision makers often have a good sense of the ergonomic performance of the product and they always judge the proposals with their experiences. The former solution for ergonomic evaluation cannot simulate perfectly and the data of a single piece of equipment can only reflect certain factors, while the latter one contains subjective elements and it is not accurate enough.
This paper proposed an evaluation system that combines the subjective and the objective evaluation to supply a comprehensive solution for decision making on ergonomics. Based on the entropy weight method and improved TOPSIS method, the data of a single piece of equipment can be processed to get the closedegree of each proposal to the positive ideal solution. The fuzzy evaluation method can be applied to process the data supplied by specialists, and the score for each proposal can be acquired. The closedegree and the score stand for the ergonomic levels and they can be put together to figure out the final decision applying a new method.
The remainder of this paper is organized as follows. In Section 2, the related works on ergonomic evaluation is discussed. Our method for ergonomic evaluation and decision making is presented in Section 3, in which we firstly build a tree of ergonomic evaluation and present the evaluation processing of soft hardware data and the fuzzy evaluation processing of the specialistsâ€™ subjective score, and finally combine the results gained above to make the comprehensive evaluation and get the final result. Section 4 reports the implementation of the method and shows examples about ergonomic evaluation of cockpit. The conclusion is drawn in Section 5.
2. Related Works
Plenty of research about ergonomic evaluation has been done by scholars from all over the world. In general, the existing research focused on three points, and the first one is research on how to evaluate specific items by using software or hardware, which paid most attention to the processing of data. The second type of research focuses on building system for the ergonomic evaluation and the structure of the system is the key point. The last type of research is about how to evaluate the ergonomics according to the score supplied by specialists, and the processing method always plays the most important part.
On the first type of research, the instruments are used to supply data. Ramsis was used to provide score labeled the Ramsis discomfort value to develop an optimal TGS lever envelop based on human characteristics [1]. Eye tracking system was used to investigate whether human eye movement dynamics can predict computerbased assessment performance in different presentation modalities. The study added empirical evidence of a prediction model between eye movement behaviors and successful cognitive performance [2]. The EMG (electromyography) instrument was applied to calculate signals under different accelerations in the simulated dynamic driving environment to evaluate human comfort under different dynamic driving environment [3]. On the second type of research, the Delphi is the most used method to build the evaluation index. Research on using the Delphi method to build the evaluation indexes for unmanned aerial vehicles ground control station, which can meet the demand and can be used as the guidance for ergonomic evaluation [4], and building evaluation index system based on modified Delphi method to evaluate the helicopter display interface [5] have been carried out. When it comes to the third type of research on ergonomic evaluation, the specialists play an important part and the MADM (multiple attribute decision making) and the fuzzy evaluation are the most used methods in the current research. Systems and theories of ergonomic evaluation based on fuzzy MADM have been developed [6â€“8].
Although the current research about ergonomic evaluation is onesided and uncomprehensive, they cover a lot of fields and can supply basic method for this paper.
3. A New Method for Ergonomic Evaluation and Decision Making
3.1. Tree of Ergonomic Evaluation
Generally, the data used to evaluate the ergonomics can be divided into two kinds, the accurate data and the fuzzy data. The accurate data is acquired through software that can simulate the using situation of the products such as Jack, Ramsis, Delmia, and hardware that can measure certain physiological index of human body, such as the EyeTrack System, the Pressure Scan System, the EMG, and the BioNex. The fuzzy data is always supplied by specialists that have good understanding of the product.
Due to the huge difference between the two kinds of data, separate processing method has to be used. This paper built an ergonomic evaluation tree, shown in Figure 1, to state the evaluation system. For the soft hardware, this paper will improve the existing method to get the result of each software or hardware, and for the specialists, the fuzzy data will be calculated using fuzzy evaluation method. Finally, the scores will be joined together to gain the ranking of all the proposals and decisions that can be made.
3.2. Evaluation of Soft Hardware Based on Entropy Weight Method and Improved TOPSIS Method
The soft hardware can supply huge number of data, and they must be classified into different indexes. Here in this paper, the number of the index was assumed to be , and the proposal number was assumed to be . All the data of different index and proposal formed the evaluation matrix . Consider
The process was carried out as in the following steps.
Step 1 (the standardization of the matrix). The data can be divided into two kinds, the costtype and the benefittype. The costtype means the greater the number, the worse the proposal, and the benefittype is opposite. The evaluation matrix must be standardized before the next calculation by the method as follows.
For the benefittype,For the costtype,The standard matrix was acquired. Consider
Step 2. Assigning weights to each index using entropy weight method [9, 10]. According to the definition of entropy in chemistry, the entropy of the index in was defined as follows:The weight of the index was
Step 3. Constructing the decisionmaking matrix
Step 4. Calculating the positive ideal solution and the negative ideal solution
Step 5. Calculating the distance of each proposal to the positive ideal solution and the negative ideal solution, because the data in is smaller than 1, the square in the Euclidean distance will make it smaller, and the distance will not be exact. This paper used the Canberra distance instead of the Euclidean distance to calculate the distance. The Canberra distance was proposed by Lance and Williams, and it was widely used in cluster analysis. The definition of Canberra distance is as follows, and it is clear that it is better dealing with small number:Then the distance to the positive ideal solution and the negative ideal solution can be gained
Step 6. Calculating the closedegree of each proposal to the positive ideal solution [8]:
Step 7. Obtaining the results, .
The same process can be applied to all the other soft hardware.
3.3. Fuzzy Evaluation of Specialistsâ€™ Subjective Score
A lot of research has been done on evaluation about the specialists that participate in the decision making, of which the MADM was the most attractive one. Plentiful mathematical methods were proposed to support the MADM as well, such as the AWA (addition weighted average), OWA (order weighted average), and TOPSIS. The MADM can be divided into accurate MADM and fuzzy MADM according to the data type processed. Due to the complexity and uncertainty of the ergonomics, people often cannot offer accurate score even the specialists. As a result, this paper will apply the fuzzy MADM to proceed the evaluation.
To express the subjective score of the specialists, the interval number must be defined. If , it can be defined as an interval number, and , will be the upper limit and the lower limit, respectively. Several definitions of the interval number are as follows.
The exponentiation of the interval number:
The multiplication of the interval number:
The length of the interval number:
The possibility degree of the interval number [11]:
3.3.1. Assigning Weight for the Specialists
The specialists are of different majors, levels, and experiences, which will affect their understanding of the proposal. Thus, different weight must be assigned to different specialists. Article [12] of the references offered a method to calculate the weight of each specialist in a group based on subjective weight assignment, which can solve the problem of weight assignment in this paper.
This method was based on the definition of the IFS (Intuitionistic Fuzzy Set).
If and is nonnull, standing for the membership degree of the element in belonging to , standing for the nonmembership degree, and , will be defined as an IFS on .
Based on the definition of IFS, the IFN (Intuitionistic Fuzzy Set) can be defined. If , the array can be named IFN [12, 13].
The linguistic variables used to describe the specialists can be transferred into IFNs as Table 1 (The scores of IFN were an example, and they can change slightly according to the situation).

Assuming the number of specialists is , the weight of each one of them can be calculated using the equation as follows [14]:
It can be known that , which means that this method assigned the whole weight in the form of a percentage.
3.3.2. Concentration of the Evaluation Data
The concentration means to combine the data and the weight to simplify the matrix.
The scores offered by the specialists were put together to form the decisionmaking matrix. After the standardization, the standard matrix was gained:
Calculated using (3), the weights of specialists were computed with the scores to get the 2nd generation decisionmaking matrix [15]:
Assuming that the weight vector of the factors of the products calculated using AHP was , the second concentration was proceeded to get the final decisionmaking matrix as the first step:
After that, the complementary judgment matrix was built by the data in using (15):
Adding all the data of each line in , the final result of the evaluation of specialists was acquired, in which .
3.4. Comprehensive Evaluation and Decision Making
To get the final result of the evaluation, the results in Sections 3.2 and 3.3 were combined to build the new decisionmaking matrix
Assigning weight for the software and specialists is complicated because the weight changes in different situations. This paper divided the process into two parts, the subjective part and the objective part, and proposed a new method AHPGRA to solve the problem.
Assuming that the importance relative to was , the judge matrix was built
After checking the consistency of , the subjective weight of each factor in was acquired [16]
Standardizing the weight to get by the computing as follows:
Finding the largest score in and building the referenced vector and then calculating the distance between the data in and [17]:
Amending the distance with
The weight of each factor in was acquired by . After the standardization through , the final weight can be acquired.
The index contains the decisionmaking data and the weight. The index before and after the amendment is as follows:
Then calculating the distance between and :
If is smaller than the set threshold , the weight is good to use. Otherwise, the value of will be transferred to , and the process above will be carried out again until .
It is clear that the final weight involves both the subjective and the objective elements and it can balance the factors better.
After getting the weight of each factor in , the same calculated process in Section 3 can be applied to acquire the final results of each proposal, and the ranking of them will tell which one is the best in ergonomic.
4. Implementation and Examples
In a cooperative project with an aircraft design organization, four proposals of the cockpit were supplied to make the decision. To evaluate these proposals, this paper applied Jack software, the ASL Eyetrack 6 System, and the Tekscan Pressure Scan System to do the evaluation separately. And 4 specialists including 3 pilots and a designer of aircraft were invited to evaluate these proposals.
4.1. Processing of Soft Hardware
The Jack software is developed by University of Pennsylvania and it supplies plenty of tools for ergonomic evaluation. After lightweight and transformation of the 3D models, the four proposals were imported into Jack. Due to the confidentiality of this project, the models have to be simplified as shown in Figure 2.
In this paper, the tool of view zone and reach zone analysis was used to calculate the number of components inside or outside the range of view zones and reach zones. At the same time, the method of RULA (rapid upper limb assessment) and the Lower Back Analysis were applied to gain the RULA score and the L4/L5 forces. The evaluation results of Jack are shown in Table 2.

The results were put together to build the evaluation matrix :
Standardizing the matrix using (2) and (3) to get the standard matrix :
The entropy of each index can be calculated by using (5):
The weight of each index can be acquired using (6):
The decisionmaking matrix :
Finding the positive solution and the negative solution:
Calculating the Canberra distance and then the closedegree using (10) and (11):
The same process can be applied to acquire the results of the ASL EyeTrack 6 System and the Tekscan System:
4.2. Fuzzy Evaluation of Specialists
The importance of the 4 specialists was decided by their experience and ages and the linguistic variables and IFN were listed in Table 3.

The weight of each specialist can be calculated using (16):
In the evaluation of the cockpit, the upper and lower limits of the interval numbers were set from 1 to 7, standing for the ergonomic levels from â€śvery badâ€ť to â€śvery good.â€ť The scores of the ejection seat, the layout of the displayers, the layout and structure of the controllers, and the color of the cockpit offered by the specialist were put together to build :
The 2nd generation decisionmaking matrix can be acquired using (18):
The weight of the ejection seat, the layout of the displayers, the layout and structure of the controllers, and the color of the cockpit were , and the final decisionmaking matrix was acquired using (19):
Applying (15) to build the complementary judgment matrix :
The final results of the specialists were acquired:
4.3. Comprehensive Evaluation and Decision Making
Applying the results in Sections 4.1 and 4.2 to build the new decisionmaking matrix and standardize the matrix using (2) and (3) to get the standard matrix :
The judge matrix was built according to the importance:
The consistency of is good and there is no need to correct it. The subjective weight of each factor can be calculated using (23):
Standardizing the subjective weight to get
Setting the reference data and calculating the distance between the data in and :
Amending the distance
Then the final weight can be acquired:
Then the final weight of each factor can be acquired:
Set the threshold , and it can be calculated that . The final weight is good.
Building the decisionmaking matrix with and the weight
Finding the positive solution and the negative solution
Calculating the Canberra distance and then the closedegree using (10) and (11)
From the ranking of closedegree, it can be known that the best proposal on ergonomics is . The final result was approved by the aircraft design organization and the scores of each factors obtained during the process was coincident with their attitudes.
5. Conclusions
Involving subjective feeling, comfortableness, reaching zones and so on, the ergonomics evaluation of products is complicated, and lots of different methods can be applied. From the global perspective, this paper proposed a comprehensive method that can combine almost all the soft hardware that are related to ergonomics and the specialists to help dealing with the decisionmaking problem among certain proposals. Compared to traditional ones, this method is more detailed and of more operability, and it can improve and speed up the ergonomic evaluation and decision making in the product development.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This work is supported by the National 111 Project (Grant no. B13044) and the National Natural Science Foundation of China (51105310).
References
 J. Nam, Y. Lee, and Y. Lim, â€śA study on optimal TGS lever envelopes based on human characteristics,â€ť SAE Technical Papers, 2013. View at: Google Scholar
 S.C. Chen, H.C. She, M.H. Chuang, J.Y. Wu, J.L. Tsai, and T.P. Jung, â€śEye movements predict students' computerbased assessment performance of physics concepts in different presentation modalities,â€ť Computers and Education, vol. 74, pp. 61â€“72, 2014. View at: Publisher Site  Google Scholar
 E. Zhang, C.R. Bi, G.H. Wang et al., â€śExperimental research on biological signal of muscle fatigue under dynamic driving environment,â€ť Journal of Engineering Design, vol. 17, no. 4, pp. 246â€“252, 2010. View at: Google Scholar
 S.J. Qi, T. Wang, and F. Wang, â€śResearch on ergonomic integrated evaluations of UAV ground control station,â€ť Advances in Aeronautical Science and Engineering, vol. 4, no. 4, pp. 474â€“479, 2013. View at: Google Scholar
 Z. Guo, D. Guo, J.C. Yang, and C. Huang, â€śStudy on evaluation index system of helicopter display interface ergonomics,â€ť Electronics Optics & Control, vol. 18, no. 5, pp. 67â€“84, 2011. View at: Google Scholar
 S.B. Zhang, Research on Manmachine Interactive Evaluation System based on Multiattribute Decision and Group Decision, Shandong Jianzhu University, 2012.
 Z. Lu and Y. Sun, â€śMaintainability evaluation model based on fuzzy multiple attribute decision making theory for virtual products,â€ť China Mechanical Engineering, vol. 20, no. 24, pp. 2978â€“2983, 2009. View at: Google Scholar
 S. Wan and J. Dong, â€śA possibility degree method for intervalvalued intuitionistic fuzzy multiattribute group decision making,â€ť Journal of Computer and System Sciences, vol. 80, no. 1, pp. 237â€“256, 2014. View at: Publisher Site  Google Scholar
 Y.Y. Wang, H. Ren, H.B. Wang et al., â€śEvaluation of energysaving building program based on entropy weight and TOPSIS method,â€ť Journal of Shandong Jianzhu University, vol. 18, no. 4, 2013. View at: Google Scholar
 J.Z. Bao, Study on Models of Multicriteria Group Decisionmaking towards Formal Safety Assessment, Dalian Maritime University, 2011.
 Z.S. Xu, Study on Methods for Multiple Attribute Decision Making under some Situations, Southeast University, Nanjing, China, 2002.
 J.Q. Wang and Z. Zhang, â€śMulticriteria decisionmaking method with incomplete certain information based on intuitionistic fuzzy number,â€ť Control and Decision, vol. 23, no. 10, pp. 1145â€“1148, 2008. View at: Google Scholar
 S.F. Zhang, Several Methods for Fuzzy Multiple Attribute DecisionMaking with Applications, Xidian University, 2012.
 I. K. Vlachos and G. D. Sergiadis, â€śIntuitionistic fuzzy information—applications to pattern recognition,â€ť Pattern Recognition Letters, vol. 28, no. 2, pp. 197â€“206, 2007. View at: Publisher Site  Google Scholar
 G.W. Wei, â€śMethod of uncertain linguistic multiple attribute group decision making based on dependent aggregation operators,â€ť Systems Engineering and Electronics, vol. 32, no. 4, pp. 764â€“769, 2010. View at: Google Scholar
 L.Y. Zhu, Research on the key technology of customer requirements processing of design for mass customization [Ph.D. thesis], Hefei University of Technology, 2008.
 J. Cui, Y.G. Dang, and S.F. Liu, â€śAn improved approach for determining weights of attributes in decision making based on grey incidence,â€ť Chinese Journal of Management Science, vol. 16, no. 5, pp. 141â€“145, 2008. View at: Google Scholar
Copyright
Copyright © 2015 Wenjun Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.