Abstract
The prosecutor is the main body of procuratorial organs. The performance appraisal system plays an important role in promoting the work efficiency of procurator. In this paper, we establish the performance appraisal system of procurators by high-order confirmatory factor analysis method and evaluate procurators’ performance by fuzzy comprehensive evaluation method based on the 360 degrees. The results have some help to performance management of procuratorial organs.
1. Introduction
Procurator is the principal and dominant part for procuratorial organs to conduct procuratorial business and perform its functions. The establishment of a scientific and rational appraisal system will mobilize their enthusiasm, raise their work efficiency, and increase the whole procuratorial organ’s work level. The existing documents, law rules, and regulations serve as basis for the establishment of the evaluation system of procurators. However, from current practical evaluation of procuratorial organs, there are prominent problems in setting targets, selecting evaluation indicators, and applying evaluation results and further improvements are needed. Many existing papers have discussed this topic such as Bouskila-Yam and Kluger (2011) [1], Jin (2010) [2], and Samuel et al. (2014) [3]. However, most of them are qualitative researches and quantitative researches are less. Given this, this paper deploys the cross validation of EFA and CFA to establish structure of the performance evaluation system to make the system more reasonable on the basis of related performance evaluation theory. This is not frequently used in other papers about the same topic and we will use fuzzy comprehensive evaluation to make instance analysis based on full circle appraisal.
2. Acquire Appraisal Index
The Article 26 of Law of Procurator stipulates that procurator appraisal includes their job performance, ideology and morality, professional skill and theoretical level of law, working attitude, and working style. And the focus lies in their job performance. Guided by this requirement, the research group has invited seven procurators in leadership position from a procuratorial organ in JiangXi in depth interview. At first, the compere introduces the purpose and requirements about this interview and invites them to analyze and discuss their work selectively. Based on related theories of performance appraisal system [4–8], we can explain performance from conduct, result, and capability. According to the three dimensionalities, we can acquire thirty-two initial evaluation factors, presented by [9, 10].
2.1. Initial Evaluation Elements Based on Conduct
These include (1) Job responsibility (); (2) observance of procedural law (); (3) work initiative and enthusiasm (); (4) observance of business specification (); (5) observance of “Responsibilities Certificate for Ethnical Members of CPC” (); (6) team spirit (); (7) observance of related prohibitions (); (8) refusal of gifts and bribery (); (9) political thoughts (); (10) political theory level (); (11) outlook of right and wrong and outlook of values (); (12) work organization (); and (13) deployment of effective methods ().
2.2. Initial Evaluation Elements Based on Results
These include (1) completing required work load (); (2) fulfilling duties and responsibilities as required (); (3) mistaken rate (); (4) the satisfaction degree of the social public (); (5) saving litigation costs (); (6) meeting targets and requirements of job performance (); and (7) saving economic costs for the country ().
2.3. Initial Evaluation Elements Based on Capability
These include (1) awareness and capability to accept professional training (); (2) professional techniques and capability (); (3) capability to deal with accidents (); (4) capability to cooperate (); (5) professional knowledge level (); (6) capability to comprehend and analyze (); (7) proficiency of professional works (); (8) ability to apply new knowledge and accommodate new fields (); (9) mastering foreign language and computer (); (10) capability to manage (); (11) capability to make observance and discovery (); and (12) oral expression and writing ().
3. Design Appraisal Index System
3.1. Determine the Structure of Appraisal Index System
We use EFA to further refine initial appraisal factors and work out the structure of appraisal index system. Based on initial appraisal factors, we designed the initial questionnaire on the basis of Likert scale and surveyed 100 procurators. We have recycled 88 valid samples and the valid return rate is 88%.
After reliability test, we figure out that Cronbach’s is 0.951, larger than the fundamental reliability requirements 0.7. So the overall reliability result is satisfactory. The outcome of KMO analysis is 0.860, larger than the fundamental requirement 0.7. in Bartlett test of sphericity is 2087 and the significance level is 0.000, smaller than 0.01. These show that the questionnaire is appropriate for component analysis.
Through the principal component analysis and Varimax orthogonal rotation, we figure out the factor loading of different components whose six eigenvalues are all larger than 1. The results are shown in Table 1.
In component one, the evaluation elements whose factor loadings are larger than 0.6 are , , , , , , and . Because these indexes primarily reflect the job performance, so we name component one job performance component. In component two, the evaluation elements whose factor loadings are larger than 0.6 are , , , , and ; we name component two job capability component. In component three, the evaluation elements whose factor loadings are larger than 0.6 are , , and and we name component three working attitude component. In component four, he evaluation elements whose factor loadings are larger than 0.6 are , , , , and and we name component four professional quality component. In component five, the evaluation elements whose factor loadings are larger than 0.6 are , , and and we name component five ethnic component. In component six, only two components’ factor loadings are larger than 0.6, that are, and . Because evaluative elements are too little and the job capability has been reflected by component two, so we delete component six. Besides, all factor loadings of , , , , , , and are smaller than 0.6. This means their convergent validities are far from satisfaction, so they should be deleted.
3.2. Determine Index Weight
There are many methods to determine the index weight. In this paper, we use CFA. Reasons are shown as follows. (1) The results of structural equation model are based on many questionnaires whose objectivity can be fully guaranteed compared with other methods which are more subjective. (2) CFA could make further verification of EFA result and make much contribution to ensure the rationality of the performance evaluation structure. (3) The structural equation model could amend the initial model with its dedicated tools to reach the ideal requirements. (4) The structural equation model has been widely used in many performance appraisal systems which are difficult to qualify and performance evaluation index of procurators in this paper is also one difficult to be qualified. So it is reasonable to use this model. (5) Now most researches are using path coefficient obtained through structural equation model to figure out the interaction intensity between components. However, this paper uses the path coefficient obtained through higher CFA model to acquire weight factor. This method has not been frequently used in researches of procuratorial organs’ performance appraisal. This has broadened the application of the structural equation model and is fairly innovative.
To conduct CFA, the research group has given out 300 questionnaires to staff in procuratorial organs in JiangXi and teachers in universities and colleges. We finally collect 273 questionnaires and the return rate is 91%. To make the CFA model more rational, this paper will start with oblique factor model and achieve the expecting results through consistent examination and correction.
3.2.1. Oblique Multifactor Model
Supposing there exists correlation between job performance, job capability, working attitude, professional quality, and ethnic, the results of the maximum likelihood method are as follows.
(1) Model Identification. The number of data point is 276 and the amount of estimated parameters is 56. Data point is larger than parameter and DOF is 220. This shows this model is an excessive identification one. So it has met the requirements of SEM model.
(2) Parameter Estimation. The results of standardized estimation of oblique multifactor model are shown in Figure 1. The correlation coefficient between the standardized regression coefficient and latent variable is verified through significance test.
(3) Verification of Incremental Fit Measures. ① The chi-square value () is 590.811 and the number of is 2.68 (590.811/220). This number is between one and three, meaning that the overall fit measure can meet requirements. ② The RMR of residual mean square and square root is 0.056, larger than 0.05 but close to 0.05. This means that the fit measure is up to requirements. ③ GFI is 0.823 and AGFI is 0.778. They both fail to meet the ideal requirements. ④ PRATIO (0.87), PNFI (0.669), and PCFI (0.73) are all larger than 0.50 so they can meet the requirements. ⑤ RMSEA is 0.82 and it means that the fit measure is general.
(4) Internal Quality Evaluation of the Model. ① Validity reflects the degree of actual measurement of underlying characteristics that target variable that it wants to measure. For SEM model, if the load capacity has reached significance level which means is smaller than 0.05 and is larger than 1.96, then target variable can effectively reflect the latent variable that it measures and the measurement has high validity. Because all load capacities are smaller than 0, so this model is of good validity.
② Individual observation variable reflects the consistency of measurement and observed variables’ multivariate square reflects the reliability of latent variable. It is larger than 0.50 and that means the individual item is reliable. After calculation, among twenty-three measured variables, there are eight individual items whose separation reliability is larger than 0.50, so this model is qualified.
③ Composite reliability is also called construct reliability which is used to evaluate the unity of potential construction indicators. Higher composite reliability means higher unity between measurement index and vice versa. The calculation formula is . is composite reliability, is standardized parameter of observed variable compared with latent variable, and is error variance of target variable. If is larger than 0.60, the composite reliability is qualified. After calculation, we figure out that , , , , and . And they, respectively, reflect composite reliability of job performance, job capability, working attitude, professional quality, and ethnic. They are all larger than 0.60, so this model is of high composite reliability.
④ Average variance extracted (AVE) indicates variation of target variable which latent variable can explain when compared with the error variance. The calculation formula is extracted variance of mean, is standardized parameter of observed variable on latent variable, and is the error variance of target variable. If is larger than 0.50, the observed variable can reflect the latent variable and the latent variable is of high reliability and validity. If is smaller than 0.50, the variation of target variable that measuring error can explain is larger than variation that basic latent variable explains. And it means the latent variable has low reliability and validity. After calculation, we figure out that , , , , and . And they, respectively, reflect composite reliability of job performance, job capability, working attitude, professional quality, and ethnic. They are all smaller than 0.50, except , and it shows that this model is of low internal quality.
From the external quality inspection (incremental fit measures) and internal quality inspection (reliability and validity test) of oblique multifactor model, we can see that partial incremental fit measures indicator and reliability and validity test indicator are unsatisfactory and needs further improvements. At the same time, correlation coefficient between latent variables shows that the five latent variables have high degree of correlation and there may exist another high-order common factor. It serves as basis for second order CFA model. So on the basis of oblique multifactor model and needs of appraisal system of procurators, we set up a second order CFA model, make amendments to it, and finally establish the appraisal system of procurators.
3.2.2. Second Order CFA Model
Supposing that job performance, job capability, working attitude, professional quality, and ethnic are all influenced by a high-order component, the five latent variables have transformed into internal latent variables and a new item-estimated residual is added. And we also suppose that there is no error covariation and cross-load and each latent variable is only influenced by one first-stage component. Then we set up a second order CFA model, modify covariance of the model, release modification indices which are larger than 15, filter four groups of variables whose critical ratio of error variance is smaller than 0.1, and restrict a same parameter for them. The results are as follows.
(1) Pattern Recognition. The data points of the model are 276, while parameter estimates in total are 51. So the data points of the model exceed parameter estimates and the degree of freedom is 225, indicating that this model is the necessary condition of the SEM Model.
(2) Simulation Model Parameter Estimation. Figure 2 presents the standardized parameter estimates of revised second order CFA models. In the diagram, standardized regression coefficient and coefficient of association among the latent variables pass the significance test.
(3) Inspection of Model Adaptation Degree. ① The chi-square value () is 399.625 and the number of is 1.776 (399.625/225), which means revised model chi-square significantly decreases, and Chi-square degrees of freedom is between 1 and 3, indicating that fitting degree of the model gets optimized, meeting the requirement. ② Residual mean square and square RMR are 0.048, below 0.05, indicating that fitting degree of the model meets the requirement. ③ Goodness-of-fit index GFI equals 0.870, fixed adaptation degree index AGFI equals 0.840, although not reaching the level of 0.9, close enough, still meeting the requirement. ④ Simple adjustment measure PRATIO equals 0.889, PNFI equals 0.751, along with PCFI, all above 0.50, meeting the requirement. ⑤ Gradual residual and square root RMSEA is 0.058, below uncorrected ones, or between 0.05 and 0.08, indicating fitting degree of the model fair.
According to the data above, most of goodness-of-fit index of second order CFA models meet the requirement, indicating the external quality of second order CFA Models favorable.
(4) Internal Quality Evaluation of the Model. ① Validity. All factor loadings in this model are far from 0, indicating the validity of the model favorable. ② Individual Item Reliability. Among 28 variables, 13 kinds of individual item reliability are above 0.50, showing that the internal quality of the model fair. ③ Composite Reliability. The composite reliability result of higher order factor “Assessment of Public Procurators” . Because is larger than 0.6, the overall composite reliability is very ideal. ④ Extracted value of variance of mean of latent variables is AVE. Variance of mean extracted of the higher order factor “Assessment of Public Prosecutors” is 0.627. The result indicates that this latent variance has favorable reliability and validity.
It is easy to find that most of goodness-of-fit index of revised second order CFA Models meet the requirement, indicating that this model has sound reliability and validity in terms of internal quality assessment. As a result, this model can be set as the final model in the construction of index system.
Final system of assessment of prosecutors’ performance can be gained by normalization of path coefficient of revised second order CFA Model, which is shown in Table 2.
4. Appraisal Instances
According to the appraisal system of prosecutors’ performance above, assessment of prosecutors’ performances can be implemented. This research group assesses one prosecutor’s performance of a certain procuratorate in Jiangxi Province by taking the fuzzy comprehensive evaluation method based on 360 degrees of main-body evaluation [11–13].
(1) Determine Appraisal Factor Aggregation. The appraisal factor aggregation stems from 5 level-1 indicators and 23 level-2 indicators in the performance appraisal system.
(2) Determine Aggregation of Factor Rankings. According to the general principle set by level appraisal aggregation, degree of each kind of indicator can be classified into 5 grades, which are excellent, favorable, medium, pass, and Poor, thus determining the fuzzy judging set , according to which, membership sets are, respectively, classified into 95, 85, 75, 65, and 55, and the grade evaluation matrix is .
(3) Determine the Appraisal Subject. The thinking of 360-degree assessment method being used for reference and in order to make the appraisal result disinteresting, 5 superior prosecutors, vis-a-vis 5, and the prosecutor itself 1, making it the total of 11 participants of the fuzzy comprehensive appraisal. Respective weights are determined through discussion among the experts, making the superior 0.6, vis-a-vis 0.2 and the self 0.2.
(4) Determine Fuzzy Relation Matrix. Primitive matrix of fuzzy comprehensive appraisal is gained by fuzzy comprehensive appraisal of each main part. See Table 3.
According to the method of fuzzy comprehensive appraisal, the prosecutor’s level-1 indicator grades can be computed to be 86.821, 86.7725, 87.0010, 86.5850, and 86.8560, making it final grade 86.821, 86.7725, 87.0010, 86.5850, and 86.8560 and work performance ranking number 2 in the 5 indicators, showing that the most important work performance of the prosecutor is sound in the 4 indicators. Generally speaking, all indicator grades are close. According to the maximum membership principle, the appraisal result of the prosecutor is “favorable.” The comprehensive grades of other prosecutors can be gained by employing the same method. The ranking can be important factors for promotion and reward through sorting different prosecutors’ grades based on the final grades. In the actual operations, the computation process can be completed by computer software, simplifying the operation process.
5. Conclusion
This study combined uses exploratory factor analysis and high-order confirmatory factor analysis to establish the prosecutor performance appraisal system. The study also conducts instance analysis based on 360-degree fuzzy comprehensive appraisal of the main target. Adopting this method is a beneficial trial of using high-order CFA Model, perfecting, and enriching the existing appraisal system of prosecutors’ performance and then making the appraisal and evaluation more scientific and reasonable. Meanwhile, such a system built through this thinking not only helps to compare different working indicator result of prosecutors, but also can enlighten what should be corrected and improved. Besides, such a system can make the ranking of various appraisal grades, through which promotion, rewards, and punishments can find their grounds. In practice, it is very operative-oriented because all computations can be accurately done by computers. In the future studies, this system will constitute an important role in further segmenting the appraisal indicators in order to enhance the operability of the indicator system.
Appendix
A. Questionnaire of Prosecutors’ Performance Assessment
Dear Sir or Madam,
Thank you very much for taking the time out of your busy schedule to fill in this questionnaire! The questionnaire aims to gather information, based on which related factors and incidence influencing a prosecutor’s performance can be understood and evaluated in order to provide evidences for the design of assessment system. This questionnaire employs the method of anonymous survey to acquire data which is used only for the study. Therefore, we promise you the confidentiality of all of your provided information. To guarantee the reliability and the validity, please answer the questions according to your actual situation without being affected by other people’s opinion. Thanks very much for your cooperation!
There are two parts in the questionnaire. The first part is your personal information and the second is the main part.
A.1. Personal Information
Please mark the “√” in the brackets.(1)Gender: male ( ); female ( )(2)Politics status: Member of communist party of China ( ); general public ( ); democracy parties ( )(3)Age: under 25 ( ); 26–35 ( ); 36–45 ( ); 46–55 ( ); older than 55 ( )(4)Education background: senior high school graduates ( ); junior college graduates ( ); undergraduate graduates; postgraduate or above ( )(5)Ranks or positions: section member ( ); vice section ( ); section chief ( ); deputy director ( ); directing officer ( ).
A.2. Main Part of the Questionnaire
Indicator factors involving behaviors, results, and abilities which possibly influence prosecutors’ performances are listed above. Please give your opinion on the importance of each factor by marking “√.” Note that “1,” “2,” and “3,” respectively, represent “Dispensable,” “Unimportant,” “Important,” “Necessary,” and “Imperative.” See Table 4.
Conflict of Interests
The author declares that there is no conflict of interests regarding the publication of this paper.