Intelligent Techniques for Simulation and ModellingView this Special Issue
Time-Domain Joint Parameter Estimation of Chirp Signal Based on SVR
Parameter estimation of chirp signal, such as instantaneous frequency (IF), instantaneous frequency rate (IFR), and initial phase (IP), arises in many applications of signal processing. During the phase-based parameter estimation, a phase unwrapping process is needed to recover the phase information correctly and impact the estimation performance remarkably. Therefore, we introduce support vector regression (SVR) to predict the variation trend of instantaneous phase and unwrap phases efficiently. Even though with that being the case, errors still exist in phase unwrapping process because of its ambiguous phase characteristic. Furthermore, we propose an SVR-based joint estimation algorithm and make it immune to these error phases by means of setting the SVR's parameters properly. Our results show that, compared with the other three algorithms of chirp signal, not only does the proposed one maintain quality capabilities at low frequencies, but also improves accuracy at high frequencies and decreases the impact with the initial phase.
Chirp signals, that is, second-order polynomial phase signals, are common in various areas of science and engineering. For example, in a synthetic aperture radar (SAR) system, when the target is moving, the regulated signals will change into chirp ones after being reflected . The SAR imaging quality may be degraded by shifting and/or defocusing due to inaccurate estimation of instantaneous frequency (IF) and instantaneous frequency rate (IFR), respectively . In optical communications, coding or instability of the laser diode results in chirp phenomenon . The research on estimating these chirp parameters is divided into two parts: one is based on cubic phase function (CPF), even high-order phase function (HPF) [4–6] and the other is based on maximum likelihood (ML) [7–9]. The former has the advantage in fast calculation of IFR, but costs more to find IF. The latter tries its best to maximize an ML function mainly in frequency domain, which involves a two-dimensional nonlinear optimization. Unfortunately, there is no exact, closed-form solution for solving this general nonlinear programming problem. The solution either resorts to a burdensome numerical search or is approximated by linearized techniques. Djuric and Kay proposed an efficient time-domain ML estimator , which can achieve optimum estimation at a moderate complexity. By extending the phase noise model of  to chirp signals, Li et al. derived an improved ML estimator and analyzed its performance in the time domain [12, 13]. However, both of them are suitable only at high signal-to-noise ratio (SNR), for the reason of approximations of noise phase model and imperfections in phase unwrapping process.
By introducing structural risk minimization (SRM) principle, support vector regression (SVR) exhibits excellent capabilities for generalizing and learning. From the viewpoint of the quadratic relationship between absolute signal phase and time series, therefore, this paper employs SVR to unwrap phases and estimate IF and IFR recursively. We avoid taking the rationality of phase noise model into account by not making any approximations in it. At one time, we reduce the estimation performance’s dependence on phase unwrapping process with a proper choice of SVR’s parameters. It has been shown that, except for the property of low sensitivity to initial phase and closely approaching the Cramer-Rao lower bound (CRLB) at low frequencies, the proposed algorithm improves its estimation performance at high frequencies.
2. The Proposed Algorithm
2.1. Signal Model
Here, is an independent symbol; , and are the amplitude, deterministic but unknown IF, IFR, and initial phase, respectively; is the sampling period; is the sample size; is an independent complex additive white Gaussian noise (AWGN) with zero mean and variance . For the sake of simplicity, we set and rearrange (1): where is still an independent complex AWGN with zero mean and variance . Absolute phase of is presented as
When is large enough, the approximate model in  is expressed as
A more reasonable model proposed in  is given:
2.2. SVR-Based Phase Unwrapping Process and Frequency Estimation Algorithm
In (5), there are two approximations still existing. Based on the quadratic relation in (3), this paper utilizes SVR’s excellent capability for learning unknown models to unwrap phases and estimate frequency. We yield a training set at time point , where denotes the estimation value of .
At first, we present a line , where is an inner product operator and is a nonlinear mapping from low to high dimension feature space. And also, we define its -insensitive loss function as where is insensitive loss coefficient at time point .
Next, we assume insofar as for to completely fit all elements of , and we denote as the distance from point to :
According to (7), we optimize through maximizing , that is, minimizing . Thereby, SVR is presented as
In fact, fitting errors larger than always exist. By introducing slack variables , and penalty factor at time point , (8) is converted into where , is a transpose operator, and is a positive constant to take compromise in SVR’s generalization capability and fitting errors which are denoted by the first and second items of , respectively.
Equation (9) is a strict convex quadratic programming (QP) problem in optimal theories. Then, using Lagrange multiplier method: where , and are the th Lagrange multipliers of , and , respectively.
Not only does (6) guarantee less fitting errors, but it also possesses a good generalization capability. It means that, after learning previous unwrapped phases , (6) can predict the variation trend of a phase efficiently for the next time point and derive . The phase is then unwrapped within a interval centered around , by adding multiples of to the principal value of when the absolute difference between and the principal value of is greater than . Namely, we select a proper to satisfy . Till time point , we get , and as the ultimate estimation values. This algorithm can be implemented recursively in time, as shown schematically in Figure 1.
2.3. SVR’s Parameter Settings
Setting SVR’s parameters is a difficult problem, but has a pronounced impact on SVR’s performance, for example, insensitive loss coefficient , penalty factor . There is no complete theoretical basis or explicit closed form. Cross-validation is a widely used method until now, but it is complex and time consuming. In this study, we formulate proper parameter values by understanding SVR’s theory and integrating a large number of references and experiments.
When is small, imperfect phase unwrapping at a particular time point can easily have an impact on the variation trend of . In order to avoid this discrepancy, a new model must be constructed with the aptitude of better generalization capability. As increases, its necessity decreases contrarily, which is due to the degrading impact of improperly unwrapped phase. Simple speaking, the model’s generalization capability is inversely proportional to the size of the set .
Intuitively, insensitive loss coefficient is the vertical height of -tube. The larger is, the less support vectors there are. Nevertheless, too large will cause unfixable . Noted that, if the predicted phase is in the vicinity of ’s odd times, the estimation performance is deteriorated rapidly for its ambiguous phase characteristic. Selecting a proper can reduce this impact. At the same time, is inversely proportional to SNR, so insensitive loss coefficient at time point is given by  where is a positive constant, and is set in this study after experimental comparisons and validations, and SNR is assumed to be known.
Penalty factor controls the penalty degree of vectors outside the -tube and determines SVR’s generalization capability. is directly proportional to the sample size and SNR. As (12) is a line in a two-dimension plane, the first item of target function during solving SVR’s QP problem is directly proportional to its slope; so a very small will result in a horizontal and underfitting . Inspired by [14, 15], penalty factor at time point is given by where , is a section of the element of training set ; as (13), SNR is assumed to be known; are positive constants and are set in this study, by the same way as .
3. Results and Analyses
3.1. Phase Unwrapping Process
Because HPF estimator does not need the phase unwrapping process, Figure 2 illustrates the arbitrary phase unwrapping processes of the other three, while , , and . The number of Monte Carlo experiments is 10000, and , and dB. It is shown that SVR estimator can unwrap phase accurately, whatever the value of and is. However, errors emerge in DK and LFK ones as and increase.
3.2. Estimation Performance
It is shown that whether , , or , SVR estimator is the best one during both IF and IFR estimations all the while; also, MSE performances of IF and IFR totally decrease as and increase, but SVR estimator is the most robust and has had a great advantage already when or .
3.3. Impact of the Sample Size
Everything is as in Figure 2 other than ; the MSE curves of IF and IFR of SVR estimator versus SNR while is 8, 16, 32, and 64 are plotted in Figures 5 and 6, respectively. It is clear that as increases, MSE performances of IF and IFR of SVR estimator are both improved.
3.4. Impact of Initial Phase
Everything is as in Figure 3 except that ; the MSE curves of IF and IFR are plotted against SNR in Figures 7 and 8, respectively. Comparing with Figures 3(a) and 4(a), we can see that SVR estimator is immune to , but the other three are not.
3.5. Computational Complexity
Because we translate SVR into QP problem and need to search the minimums during the process, we can not derive the explicit form of the computational complexity of SVR estimator. So everything is as in Figure 2 except that the number of Monte Carlo experiments is 100, SNR is 8 dB, and ; the consuming times are listed in Table 1, while is 8, 16, 32, and 64, respectively. The running computer is ASUS-PC1111 having, Intel(R) Pentium 2.13 GHz CPU and 2.00 GB RAM.
We can see that SVR estimator’s consuming times are more than the others’, especially when becomes larger. As a matter of fact, however, it is acceptable and tolerable.
Phase unwrapping process is a key point in phase-based frequency estimation of chirp signal. Firstly, we adopt SVR to learn the unwrapped phases at previous time points, predict the variation trend of phase efficiently, and derive the estimation value for the next time point. Once acquired, in terms of relationship between absolute signal phase and time series, we address a simple and effective frequency estimation algorithm of chirp signal. The proposed algorithm completely exhibits its advantages of higher estimation accuracy, lower sensitivity of frequency, and initial phase, by sacrificing more consuming times.
Because SVR predicts the curve’s variation trend merely in terms of training set which consists of previous points’ values, we even can estimate the frequency of chirp signal under the nonGaussian condition by the same way.
Stressing that the proposed algorithm learns training set and gets the approximate values of SVR’s insensitive loss coefficient and penalty factor , as a next step, therefore, improving SVR’s parameter setting is an important research point.
This research is supported by the National Natural Science Foundation of China (Grant no. 61201380).
J. C. Curlander and R. N. McDonough, Synthetic Aperture Radar Systems and Signal Processing, Wiley, New York, NY, USA, 1992.
R. Ramaswami, K. N. Sivarajan, and G. H. Sasaki, Optical Networks: A Practical Perspective, Morgan Kaufmann, San Mateo, Calif, USA, 1998.
S. Ma, J. Jiang, and Q. Meng, “A fast, accurate and robust method for joint estimation of frequency and frequency rate,” in Proceedings of the 2011 International Symposium on Intelligent Signal Processing and Communications Systems (ISPACS '11), pp. 1–6, Chiang Mai, Thailand, December 2011.View at: Publisher Site | Google Scholar
H. Fu and P.-Y. Kam, “Phase-based, time-domain estimation of the frequency and phase of a single sinusoid in AWGN—the role and applications of the additive observation phase noise model,” IEEE Transactions on Information Theory, vol. 59, no. 5, pp. 3175–3188, 2013.View at: Publisher Site | Google Scholar | MathSciNet
Y. Li and P. Y. Kam, “Improved chirp parameter estimation using signal recovery method, approximate, time-domain ML estimators of signal s and their performance analysis,” in Proceedings of the IEEE 71st Vehicular Technology Conference, pp. 1–5, Taipei, Taiwan, May 2010.View at: Google Scholar
V. Cherkassky and Y. Ma, “Selection of meta-parameters for support vector regression,” in Proceedings of the International Conference on Artificial Neural Networks, pp. 687–693, Madrid, Spain, August 2002.View at: Google Scholar