Abstract
Automatic frequency-hopping (FH) signal network-station sorting is one of the most difficult and import problems in the field of electronic warfare, especially in a complex electromagnetic environment. In this paper, an automatic and reliable network-station sorting method of FH signal with maxout network feature extraction and generative-based classification method is proposed. Experiments on real FH data sets demonstrate that the proposed method not only outperforms the competitive feature extraction methods with a higher accuracy of FH signal network-station sorting but also has a better robustness against noise, especially Gaussian noise.
1. Introduction
Frequency-hopping (FH) communication has become an important means of counter reconnaissance and antijamming in military field and been widely applied in military and civilian communications because of its low probability of interception, antijamming performance, networking capability, and inherent security feature. At the same time, these characteristics also pose a serious challenge to FH communication’s application on radio reconnaissance.
The network-station sorting of the frequency-hopping (FH) signal refers to separating the hop signals corresponding to all or a specific network station from the mixed signals of the multiple FH network stations, which is a difficult point in the field of FH signal detection and processing. The technology of network-station sorting of FH signals is prosperous in the communication countermeasure and radio-monitoring domain. How to quickly and effectively realize the FH signal network-station sorting becomes a severe challenge in signal processing.
To address this problem, a number of works have appeared in literatures [1–7]. In view of those methods, most of them consider two steps, i.e., feature extraction and classification, which resulted in that the extracted FH signal features may be very crucial in sorting accuracy of FH signal network-station.
Due to the device dispersion of the FH station and the inconsistency in the manufacturing process, it comes with unavoidable subtle differences of FH signals from each radio transmitter, which are generally generated during the production process of their component, e.g., filters, power amplifiers, and digital-to-analog converters. Especially in the radio frequency part, owing to the use of analog devices, it will inevitably lead to subtle differences in the FH radio, which reflect the individual feature of the station uniquely. These subtle differences are also called radio frequency (RF) fingerprints of FH radio stations. Through RF fingerprint, it is possible to discriminate radio emitters.
Based on the different types of RF fingerprint feature extraction, current feature extraction method of FH signal can be classified into two main categories: transient feature extraction and steady-state feature extraction [8–10]. Considering the fact that when a FH station is activated or “keyed,” it goes through a relatively short transient phase during which the FH signal emanating from the unit displays characteristics that are believed to be unique to the extent that they can be used to unambiguously identify an individual FH station. Individual feature analysis of steady-state signals is more difficult than transient signal feature extraction [10]. Under steady-state operation, the internal device differences of the station are expressed in the form of “synthesis.” Therefore, it is difficult to mathematically model the influence of internal variations of all devices on the signal. Interesting, the main characteristic of FH signal is the pseudo-random variance of carrier frequencies according to a certain hopping pattern. It takes a certain amount of time to adjust the signal from one frequency point to another, which makes each hop signal have a switch transient moment before it is established, as shown in Figure 1. Therefore, hopping switch transient analysis can be used to analyze the FH signal. Motivated by this fact, this paper proposes a new FH signal network-station sorting method that is based on maxout network and generative method. FH signals generated by five kinds of stations are collected and analyzed. Maxout network model is used to acquire the fingerprint characteristics of the FH signal, based on the transient feature extraction of the FH switch transient analysis. Generative method optimized by expectation maximization (EM) optimization algorithm is employed as classifier to realize the network-station sorting of the five kinds of FH station. Results show that the proposed method can effectively improve the sorting accuracy of FH network-station. Although our implementation deals exclusively with FH signal network-station sorting, the approach itself is general and will work with any identical radio sources recognition scheme. Procedures of FH signal network-station sorting based on maxout network model and generative method are illustrated in Figure 2.
More specially, this paper is organized as follows: in Section 2, we briefly review some related feature learning methods, which motivated our research. In Section 3, we describe our FH signal fingerprint feature extraction method according to the maxout network model and the network-station sorting algorithm by generative method, whereas in Section 4, we make an evaluation of performance and present some comparison results. Finally, in Section 5 we draw conclusions.
2. Related Work
The main goal of feature extraction is to convert FH transient signal into its distinctive feature space, making the FH signal sorting process easily. Recently, deep neural networks have been widely used in pattern classification and feature extraction because of its formidable generalization ability brought by its inherent ability to fit complex functions and its powerful characteristic representation from multiparameters and high dimensionality [11].
By training features on very large datasets, several deep-learning methods achieved very high pattern recognition rates. The convolutional neural network (CNN) is one of the state-of-the-art learning methods for pattern recognition. DCNN as a deeper model of CNN has been designed to automatically transform input data into its distinct feature space. Although this method can be more successful than traditional pattern recognition method in recognition rate due to its deep architecture, running this model is extremely time consuming because of its multiparameters and high dimensionality. In 2013, Goodfelow [12] proposed a maxout network model, which can reduce the computational costs by minimizing the number of necessary neurons and the number of network parameters in each maxout layer. In 2015, Schroff [13] successfully applied maxout networks in face recognition, which gain high recognition accuracy rates on challenging face datasets. Inspired by these deep-learning techniques, the maxout network is designed as a real-time distinctive features extraction model. In addition, the generative method is combined to realize the FH signal network-station sorting finally. The detailed proposed approach is as follows.
3. Proposed Approach
3.1. Fingerprint Feature Learning with Maxout Network
The maxout model is simply a feed-forward architecture, such as a multilayer perceptron or deep convolutional neural network, which uses a new type of activation function: the maxout unit [12]. Given an input data , where may be an original data, or may be a hidden layer’s state, the function of a maxout hidden layer is given by where , , and are learned parameters, in which is the dimension of input data, is the number of hidden layer nodes, and denotes that each hidden layer node expands intermediate nodes, which are all linear output, and each node of maxout takes the maximum output value of the intermediate nodes. In a convolutional network, a single maxout unit can be interpreted as making a piecewise linear approximation to an arbitrary convex function. Maxout networks learn not just the relationship between hidden units, but also the activation function of each hidden unit [12]. See Figure 2 for a graphical depiction of how this works. Because of the intrinsic superiority of the maxout network in arbitrary convex function approximation, it can achieve excellent performance in fingerprint feature learning.
3.2. FH Signal Network-Station Sorting with Generative Method
For the extracted fingerprint features, this paper uses the generative method to realize the network-station sorting of FH signal. Given feature set , assume it belongs to station , where is all possible station classes. This paper assumes that the feature data are generated by a Gaussian mixture model (GMM), and each network-station class corresponds to a Gaussian mixture component. In other words, the feature data is generated based on the following probability density.where mixing coefficient , , is the probability that feature set belongs to the -th FH network-station and and are the parameters of the Gaussian mixture component.
Let denote the predictive network-station class of function to and the network-station class of feature set , which is known by maximizing a posteriori probabilitywhere in which is the a posteriori probability that the feature set belongs to the -th FH network-station, and denotes the probability that the feature set belongs to the -th FH network-station but its predictive network-station class is . As we can see, if and only if , ; otherwise .
Given the feature data , where represents the feature set of known network-station classes and represents the unknown feature set, where , as mentioned above, this paper assumes that all feature data are independent and identically distributed and are generated by the same GMM. The parameters of GMM are estimated by maximum likelihood methodwhere denotes ’s logarithmic likelihood function, which consists of two items: known FH network-station class features and unknown network-station class features. Then the above model parameters can be solved by EM algorithm [14], and the iterative update algorithm is as follows
3.2.1. Expectation Step
where denotes the probability that the unknown network-station feature set belongs to each network-station class.
3.2.2. Maximization Step
where denotes the number of feature sets for known network-stations in class . After the model parameters are obtained by iterative convergence of the above algorithm, the classification and recognition of unknown network-station feature sets can be realized by using formula (3) and (4).
By replacing the Gaussian mixture model in the above process with the mixture expert model [15], the naive Bayesian model [14] can be used to derive other generative learning methods.
4. Evaluation of Performance
After the successful FH signal fingerprint feature extraction and generative classification process, the scheme must discriminate the FH transmitters of the FH signals. To test the feature extraction and network-station sorting together, a set of 60000 real FH signals was used. They were distributed approximately among 5 different FH transmitters, each transmitter has 12000 FH signal.
4.1. Sorting Result with Different Number of Training Signals
In this section, we investigate the influence of the number of training signals on the performance of this paper’s proposed method. To train the maxout network, the number of 1000, 2000, , 10000 labeled signals arbitrarily taken from each transmitter was used to train the network; the remaining signals are used for testing. The average result of one hundred individual experiments with different training numbers is shown in Figure 3. From the result we can learn that this paper’s method has higher sorting accuracy than other methods. The reason is the maxout network model’s powerful characteristic representation from multiparameters and high dimensionality. And with the increase of the training numbers, the sorting rate increases, and when the number of training signals is more than 10000, the sorting rate changes slowly.
4.2. Robustness of Our Method to Noises
Considering the fact that the FH signals obtained in the actual electronic environment are greatly affected by the environmental noise, however, the acquisition environment of the FH signals in this paper is relatively clean, and there is no obvious noise. To test the impact of noise on robustness in sorting result for FH signals, in this test we mixed the obtained FH signals with Gaussian white noise of different intensity to simulate the onsite circumstance. As mentioned above, we have 12000 signals of each FH station, 50% signals are randomly chosen t as training samples; the rest 50% signals added with different intensity Gaussian white noise are selected as testing samples. We use the signal-to-noise ratio (SNR) to reflect the intensity of noise, which is presented as follows:where is the original FH signal, is interference noise, and is the length of the two signals. The length of original signal in this paper is 1024, and the results are shown in Figure 4. From Figure 4 we can see that the results of our method are stable for Gaussian white noise of different intensity because of the robustness of the Gaussian mixture model to noise.
4.3. Robustness of Noise with Different Training Numbers
Then we test the noise robustness with different training number of FH signals. As previously mentioned, we have 12000 signals of each FH station, 1000, 2000, , 10000 of which are selected as training samples, and the remaining signals added with Gaussian white noise are selected as testing samples at random. The experimental result is shown in Figure 5. From Figures 5 and 4 we can see that the results of our method are robustness to noise in a certain range of SNR.
5. Conclusion
In this paper, we propose a novel FH signal network-station sorting method. Firstly, our method takes advantage of the deep neural network, which is maxout network model in this paper, to learn the fingerprint feature of each FH station; thus the network-station sorting accuracy is improved by the powerful feature representation capability of the maxout network model. And then the maxout network’s outputs regard as the FH station’s features are used as inputs to the generative-based classifier to realize the FH signals’ network-station sorting. Experimental results on 5 real work FH stations show that our method achieves obviously better performance than other state-of-the-art methods in terms of accuracy.
Data Availability
The experimental data of my manuscript is the common result of my laboratory. It is still in the research stage and individuals do not have public rights.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
Acknowledgments
The authors are grateful to the support from the National Natural Science Foundation of China (Grant no. 61601500, no. 61871396).