Abstract

The effectiveness evaluation of the Electronic Information (ELINT) system, which plays an important role in guiding the theoretical research, equipment development, and practical application, is the key technology of the ELINT system. In practical applications, the effectiveness evaluation of ELINT system is mainly aimed at evaluation methods. However, the establishment of evaluation criteria and the construction of the index system are still two main challenges in this field, especially the optimization of the evaluation index system. In this paper, we aim at establishing the ELINT system index evaluation criteria and optimizing the ELINT system evaluation index system. Based on the principle structure of the ELINT system, we directly construct the original efficiency index system, establish specific evaluation criteria for each index, and quantify the indexes using the criteria. To optimize the proposed index system, we introduce the idea of rough set reduction and develop an index system reduction model based on the mutual information heuristic knowledge reduction (MIBARK) algorithm. Simulation analysis shows that the proposed evaluation criteria quantify each index scientifically, and the established indicator reduction model can eliminate the redundancy of the ELINT efficiency indicator system, making the indicator system more streamlined and reasonable.

1. Introduction

With the increasing complexity of modern electronic warfare, the role of electronic intelligence has become more and more obvious. The ELINT system is an important combat equipment for acquiring electronic intelligence on the battlefield, and the evaluation of its overall combat effectiveness is one of the important issues currently faced [1].

ELINT system effectiveness evaluation is a process of multi-index comprehensive evaluation, which mainly involves the construction of the index system, the establishment of evaluation criteria, and the selection of evaluation algorithms [26]. The current algorithm research for multi-index system evaluation is relatively extensive, from basic ADC method [7], analytic hierarchy process [8], SEA method [9], and grey relational analysis method [10] to widely used neural network algorithm [11, 12], which has a relatively mature theoretical system. However, the research and development of the effectiveness evaluation index of ELINT system are very slow. On the one hand, there is a lack of unified evaluation criteria to analyze, evaluate, and measure indicators. In [13, 14], the authors put forward evaluation criteria for radar jamming effects, but they are not suitable for ELINT systems. On the other hand, the research on the efficiency index system is relatively scarce. The electronic equipment efficiency index system, which is constructed in the traditional method, lacks objectivity and comprehensiveness [15, 16]. It is only constructed based on expert experience, without the reasonable analysis of complexity and redundancy of the index system. In addition, in terms of algorithm optimization, [1719] proposed an optimal solution based on the ant colony optimization (MSICEAO) algorithm and an improved quantum evolutionary algorithm; these algorithms can find the optimal solution but the computational complexity is relatively high.

Thus, this article establishes the ELINT system evaluation criteria and develops an innovative method to optimize the ELINT system index system. First of all, based on the actual application requirements of the ELINT system, a more comprehensive indicator system is constructed, and the corresponding evaluation criteria for each indicator are established. Then, the rough set attribute reduction theory is introduced, and a reduction model of ELINT index system based on MIBARK algorithm is constructed. By calculating the mutual information of the indicators, the indicators with greater relevance and redundancy are eliminated, and the optimization of the ELINT system indicator system is realized. The new method makes the ELINT system effectiveness evaluation research more comprehensive and objective.

2. Data and Methods

2.1. Data Sources

In the evaluation, a fixed test condition is set using the battlefield environment, and then combined with the evaluation criteria of each index, the test data corresponding to each index of the 5 systems under test are collected, and the index sample value is obtained after normalization. Experts score the interception performance, parameter measurement performance, signal processing performance, intelligent processing performance, and system performance of the system under test based on the data.

2.2. Rough Set Attribute Reduction Theory
2.2.1. Basic Theory

Rough set attribute reduction theory is a mathematical tool for dealing with fuzzy and uncertain knowledge. It is to obtain systematic classification rules through knowledge reduction under the condition that the system classification ability remains unchanged, and based on mutual information, heuristic knowledge reduction (MIBARK) algorithm is a commonly used attribute reduction algorithm. The theory can dig out decision rules from a large amount of data without any prior information and external information, reveal the relationship between attributes, and delete redundant attributes. All conclusions come from the data itself [20].

Definition 1. Let be a knowledge base. On the nonempty finite domain U, R is the set of equivalence relations, and the family of all equivalence relations defined in K is denoted as Ind (K). Let P be a family of equivalence relations, . For , if , then p is necessary in P. If every p is necessary in P, then P is independent. The reduction set composed of necessary relations in P is called the core of P, denoted as . In addition, if , if Q is independent, and , then Q is called a reduction of P.

Definition 2. For an information system S, , where represents a nonempty finite set of objects, also known as the universe of discourse; the attribute set is , . Among them, C is the conditional attribute set, D is the decision attribute set; V is the attribute value range; and : is an information function. Then the information system S is the decision information system, denoted as follows.

Definition 3. Information system ; P and Q are equivalent relations in U. The positive domain of P of Q is denoted as , that is, all the objects in U that can be accurately classified into the equivalence class of the relationship Q according to the information of the classification U/P. Let , A be the Q reduction of P if and only if A is an independent subfamily of Q of P and ; the Q reduction of P is called relative reduction for short. The set of all necessary primitive relations of Q in P is called the core of Q of P, referred to as the relative core, and denoted as .

Definition 4. The division of conditional attribute set C on U is X: ; and are the cardinality of the set, and its information entropy H(C) is defined as

Definition 5. The division of decision attribute set D on U is Y: ; then a conditional entropy of condition attribute set C relative to decision attribute set D is defined as

Definition 6. The average mutual information of condition attribute set C and decision attribute set D on U is

Definition 7. Information system S, , , after adding an attribute to R, the mutual information increment isThe larger the increment, the more important the attribute a is to the decision D under the condition that the attribute set R is known.

2.2.2. MIBARK Algorithm Principle

In rough set attribute reduction theory, attribute reduction mainly has two types: algebraic viewpoint and information theory viewpoint. Practice has proved that the reduction under the information viewpoint is more scientific and accurate than the reduction under the algebraic viewpoint [21]. This paper chooses the MIBARK algorithm in the information viewpoint to deal with the problem of conditional attribute redundancy in rough sets. The commonly used reduction strategy is to find the relative reduction in a bottom-up manner. It starts from the relative core of the decision table. According to the importance of the attribute, the most important attributes are successively selected and added to the relative core until the termination condition is satisfied. The MIBARK algorithm reduction process is shown in Figure 1, and the specific steps are as follows [22]:Input: a decision-making system S, , where U is the universe of discourse, and C and D are conditions and decision attribute sets, respectively.Output: a relative reduction of the decision table.(1)Calculate the average mutual information of condition attribute C and decision attribute D in decision table S: .(2)Calculate the core of C compared to , generally sometimes the relative core C0 is an empty set; at this time .(3)Let ; repeat the condition attribute set CB:(1)For each attribute , calculate .(2)Choose the attribute that maximizes the mutual information increment, denoted as p, and .(3)If , terminate; otherwise, go to (1).(4)The final B is a relative reduction of C relative to D.

2.3. The Reduction Method of ELINT System Efficiency Index Based on MIBARK Algorithm

The ELINT system mainly monitors and intercepts the electromagnetic signals of radiation sources in space, then measures, analyzes, and sorts the parameters of the intercepted signals, and finally completes the identification of targets, thereby providing intelligence support for operations [23]. The ELINT system efficiency index is the embodiment of the system’s reconnaissance ability in different aspects. The reduction of ELINT system performance indicators based on the MIBARK algorithm mainly involves three aspects: establishing a system performance evaluation indicator system, combining evaluation criteria to quantify indicators, and using an algorithm to reduce the indicator system [24].

2.3.1. Index System

When constructing the ELINT system effectiveness evaluation index system, the selection of the index is generally determined in combination with the actual work of the system. In addition, when constructing the indicator system, in order to achieve systematic scientific evaluation, evaluation indicators must be selected according to the principles of systemicity, completeness, independence, scientificity, and feasibility [25, 26]. The performance of ELINT system is mainly composed of the performance of signal interception, parameter measurement, signal processing, and intelligent processing. Therefore, the original performance index system is shown in Figure 2.

2.3.2. Evaluation Criteria

In order to better grasp the system capability in practical applications, the index needs to be quantified to obtain an intuitive system performance value. Evaluation criteria are the basis and methods for quantitative evaluation of indicators, and indicators of different natures are bound by corresponding evaluation criteria [27, 28]. The working principle of the ELINT system is complex, its effectiveness is comprehensively reflected by multiple indicators, and the evaluation criteria involved are also more complex.

(1) Performance Guidelines. For a complex system, its effectiveness is related to the real performance of the system on the one hand and closely related to the working environment on the other hand. Performance indicators are indicators determined by the design, principles, and hardware capabilities of the system and are generally not affected by the working environment. When evaluating the effectiveness of ELINT systems, system performance indicators are a part that must be considered. Therefore, a performance criterion is introduced to quantify the system’s azimuth coverage, frequency coverage, dynamic range, instantaneous bandwidth, and system storage capacity according to the real performance value of the system.

(2) Parameter Guidelines. From the perspective of information, the working process of the ELINT system is actually the process of obtaining the signal information of the other party’s radiation source. The system extracts and measures the radiation source information through the receiver to obtain various parameter values of the target. Therefore, the accuracy of the ELINT system to measure signal parameters reflects the system’s parameter measurement capability [29]. For the ELINT system index system, the pulse parameter measurement accuracy, intrapulse characteristic analysis ability, interpulse characteristic analysis ability, polarization characteristic analysis ability, and resolution can all be quantified by referring to the parameter criterion and can be measured by comparing the ELINT system. The difference between the signal parameter value and the real signal is to determine the indicator value.

(3) Sensitivity Criterion. The essence of electronic warfare is a contest in the energy domain. For the ELINT system, sensitivity is an index that measures the efficiency of the system’s energy domain. Only when the signal power of the radiation source is higher than the sensitivity of the ELINT system, that is, , can the radiation source signal be intercepted by the system [30]. Therefore, the sensitivity criterion is a criterion that must be followed to effectively evaluate the energy domain of the system.

(4) Efficiency Criterion. The efficiency criterion is also called the tactical application criterion, or the probability criterion, which refers to the ability of the ELINT system to complete combat tasks under certain conditions to evaluate the effectiveness of the system [31]. For the ELINT system, many of its indicators are measured under certain signal conditions, such as probability of interception, environmental adaptability, sorting ability, and recognition ability.

(5) Competence Criteria. With the continuous development of radar systems, traditional ELINT systems have gradually become functionally difficult to adapt to the challenges of complex radar systems. In order to improve the combat effectiveness of the ELINT system, many emerging technologies have been continuously applied to the ELINT tradition, which has greatly improved the effectiveness of the system. However, because the current effects are difficult to concretize, this paper introduces ability criteria to quantify the indicators. The ability criterion is based on the principle of 0 and 1. It only distinguishes whether or not the ability is available and does not specifically quantify the size of the ability. The intelligent processing efficiency of the ELINT system can be quantified using this criterion, and the capability criterion solves the problem of some emerging indicators that are difficult to quantify and compare to a certain extent.

(6) Time Criterion. Under certain conditions, it takes a certain amount of time for each link of the weapon system to complete any task. The ELINT system needs time to intercept signals, parameter measurement, and signal processing. The completion time can intuitively reflect the pros and cons of the system. For the ELINT system, both the interception time and the sorting time can be quantified and analyzed using the time criterion, which is an intuitive and effective evaluation criterion for system capabilities.

2.3.3. ELINT System Index Reduction Process Based on MIBARK Algorithm

The ELINT system index system is reduced based on the MIBARK algorithm. First, the indicators that need to be collected are defined according to the established index system; then the indicators to be measured are quantified according to the evaluation criteria of the indicators; finally, the indicator system is optimized with the MIBARK algorithm to remove redundancy and related indicators, keep key indicators, and get an optimized indicator system. The specific process is shown in Figure 3.

3. Results and Discussion

For the ELINT system, the decision information system , U is the system under test ; the attribute set , C is the system under test index set, where is the bottom index of interception efficiency, is the bottom index of parameter measurement efficiency, and is the underlying indicator of signal processing performance, and is the underlying indicator of intelligent processing performance. D is the performance decision set, where D0 is the system performance level, D1 is the interception performance level, and D2 is the parameter measurement performance level.D3 is the signal processing performance level; D4 is the intelligent processing performance level; V is the performance value set, and the score is three points; the value set is . The sample values of the system indicators to be tested are shown in Table 1.

3.1. Results

Combining with the principle of MIBARK algorithm, it can be known that ELINT system efficiency index system reduction generally obtains the optimal index system in the order of average mutual information, relative core, increment of each index information, and comparison analysis. Therefore, for the five aspects of interception efficiency, parameter measurement efficiency, signal processing efficiency, intelligent processing efficiency, and system efficiency, the average mutual information, relative core, and information increment of each index of the conditional attribute set to the decision attribute set are, respectively, obtained as shown in Tables 2 and 3; the reduced performance indicators are shown in Figure 4, and the reduced system performance indicator system is shown in Figure 5.

3.2. Discussion

Generally speaking, a decision system with zero conditional entropy H (D/C) is a consistent decision system. The larger the average mutual information of the condition attribute set in the consistent decision-making system, the greater the amount of information provided by the condition attribute set to the decision attribute set, and the more obvious the role it plays in decision-making. It can be seen from Table 2 that the conditional entropy of each part of the efficiency index set relative to the decision attribute set is zero, so the ELINT system is a consistent decision system. Combining the average mutual information of each performance level index, we can know the following: parameter measurement performance = signal processing performance > intelligent processing performance = interception performance. Therefore, for the ELINT system, the parameter measurement performance and signal processing performance indicators have a greater impact on the system performance, and the interception performance and intelligent processing performance have a smaller impact on the system performance.

The greater the information increment of the indicator is, the more important the indicator is in the index set C to the decision attribute set D. By comparing the information increment of each indicator, the importance of each indicator in each efficiency layer and the overall effectiveness of the system can be obtained. It can be seen from Table 3 that for the interception efficiency, the three indicators of system interception probability, dynamic range, and instantaneous bandwidth play a significant role in evaluating interception efficiency. However, the information increment of the two indicators of azimuth coverage and interception time is relatively small, which does not play a significant role in the evaluation of interception effectiveness. Combining with the working principle of the ELINT system, we can see that the data characteristics of the indicator conform to the working principle of the system, so the result is reasonable; For all other performance levels, the importance of indicators can be analyzed equally. Finally, comparing each index compared to the information increment of each efficiency layer and the information increment of each index compared to the system efficiency, the changes of each index are not obvious, indicating that this method can effectively measure the performance of different indicators in the system effectiveness evaluation process.

By comparing Figures 24, it can be seen that the interception time, pitch coverage, pitch measurement accuracy, pulse loss probability, sorting parameter resolution, sorting accuracy, and big data analysis capabilities are completely redundant indicators. Regardless of whether each performance layer is reduced individually or the system performance is reduced, these redundant indicators will be reduced.

In addition, by comparing the index system after reduction of each performance layer and the index system after system performance reduction, it can be seen that the more obvious changes are the parameter measurement performance layer index and the signal processing performance layer index. In terms of system performance, the parameter measurement, there is a certain correlation between performance level indicators and signal processing performance level indicators and other performance level indicators. Therefore, if only the performance of ELINT system is considered, its index set should be constructed with reference to the index system in Figure 5.

4. Conclusions

The construction of the ELINT system effectiveness index system is a complicated process. Numerous indicators from different aspects together reflect the ability of the system to complete tasks, forming an organic whole. This article first establishes the evaluation criteria of each indicator based on the working principle of the system, then uses the evaluation criteria to quantify the indicators, and uses the MIBARK algorithm to reduce the quantized ELINT indicator system. Without affecting system performance, the model proposed in this paper minimizes redundant indicators, reduces the complexity of ELINT system evaluation, and improves the objectivity and scientificity of the evaluation conclusion.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of the paper.