Abstract
Under the condition that the step size is less than one, a statistical tracking behavior analysis for the affine projection algorithm based on direction error is discussed. When the unknown true weight vector is modeled by the stochastic walk model, the mean weight error is derived under the four assumptions based on the deterministic recursive equation. Furthermore, the statistical tracking behavior of the steady state is analyzed for the affine projection algorithm based on direction error. Simulation analysis is shown to suppniort the mathematical results.
1. Introduction
Since the normalized least mean square Wen algorithm is computational simplicity, this algorithm is widely put into use by the adaptation algorithm. And the normalized least mean square algorithm is also robust to the length of the finite word effects and ease of implementation in the signal processing. However, the highly colored input signals will cause the normalized least mean square algorithm converge slowly [1]. Compared to the normalized least mean square algorithm, the affine projection (AP) algorithm is a better alternative. The AP algorithm was firstly given by Ozeki and Umeda, and it improves the convergence speed by reusing the input signal [2]. Based on the idea that the successive vectors of the input signal are orthogonal with each other, the best improvement convergence will be obtained; the normalized least mean square based on orthogonal correction factors (NLMS-OCF) was shown in [3]. When we set the step size to be equal one, according to the input direction vectors of the input signal, a novel definition was given for the affine projection algorithm [4]. A pseudo-AP (PAP) algorithm is a simplified definition form to the affine projection algorithm, and this algorithm is ease of implementation [5]. Since the weights update direction and the direction that is caused by the adaptive error are not the same for the PAP algorithm, an AP algorithm based on direction error (AP-DE) was given to resolve the nonconformity problem [6]. Fast AP algorithms have been given as well [7]. These algorithms, including the AP, PAP, and NLMS-OCF, can be considered a class of the AP algorithms, which updates the adaptive weights according to the multiple vectors of the input signal. Some recent studies are as follows. A new class of AP algorithm is proposed based on the high-order error power criterion [8] and can achieve reliable performance under Gaussian interference. The effect of the noise vector on the weight-error vector is considered. The edified filtered-x affine projection algorithm is effective for active noise control owing to its good convergence behavior and medium computational burden [9]. The proposed method of sparsity aware affine-projection-like robust set membership M-estimate (SAPL-RSM) filtering has been utilized for alleviating the impact of impulsive noise on the adaptation of feedback canceler’s weights [10]. A time-varying parameter PAPLM (TV-PAPLM) algorithm is proposed, which uses a modified exponential function to adjust the time-varying parameter according to the ratio of the mean square score function to the system noise variance [11].
There are lots of work that has been done to analyze the statistical convergence and tracking behavior of the AP and NLMS-OCF algorithms. Based on the assumption that the input signal is the identically and independent distributed form, the statistical analysis of the class of the AP algorithms was shown, in which the mean weight error (MWE) and the mean-square error (MSE) were shown to study the convergence behavior for the NLMS-OCF algorithm [12, 13]. When we set the step size to be one, the closed-form expression is given for the convergence behavior of the MWE and MSE, appropriate for autoregressive-moving average (ARMA) input signal models of the AP algorithm, as in [14]. In the adaptive direction of the weight update, when we set each weight error to be zero, the optimal step size for the PAP algorithm was given; then using this model, the MWE and MSE were derived based on the deterministic recursive equations [15]. The statistical analysis of convergence model for the AP algorithm has been shown by using the (AR) input model [16–18]. Under the assumption given by [12, 13], the convergence model was shown for the kind of AP-DE algorithm in [19]. When the step size was equal to one, the statistical tracking behavior was given for the AP-DE algorithm [20], in which the MWE and MSE behaviors are analyzed.
In this paper, four assumptions are made for the input vectors and the direction vectors. When the unknown true weight vector is modeled by the stochastic walk model, the tracking MWE and MSE are obtained for the AP-DE algorithm. At last, the simulation analysis is given to show the proposed statistical tracking behavior.
2. AP-DE Algorithm
An affine projection algorithm with direction error (AP-DE) is presented to solve the nonconformity between the iterated direction of the adaptive filter and the direction caused by the iteration error. In the adaptive filtering system identification model, the colored input signal is transformed into the successive input vector , and then, we have obtained
According to the most recent successive input vectors for the input signal, we can obtain the input matrix as
The AP-DE algorithm updates of the weight vector are implemented by the adaptive filter [6], as follows: where denotes a transposed matrix or vector and the direction vector of the input signal is estimated based on
And from the least-squares formulation, the vector is found as
The iterated direction of AP is the input vector , which causes the iteration error. Compared with AP algorithms, if the measurement noise is absent, the iteration error of the AP-DE algorithm is caused only by the direction vector , which is also the iterated direction of the adaptive filter. Thus, the AP-DE algorithm improves the convergence rate compared with the PAP and AP algorithms.
3. Statistical Properties of the Direction and Input Vectors
In order to study the tracking performance of the AP-DE algorithm, the four assumptions are as follows: (A1)The successive input vector is zero mean, identically and independent distributed, and then the covariance matrix can be obtained as [12, 13]where are the eigenvalues of and the corresponding eigenvectors are orthonormal to each other, i.e., (A2)Using assumption A1 and assuming three different independent stochastic variables constitute the direction vector . That is,where the matrix trace is denoted by the expression , means that the stochastic variable , and the input vectors have the same distribution. Similar assumption has also been given in [12, 13] (A3)Based on assumption A2, make the following assumption. The direction vectors of the successive input signal are independent on the weight vector , and they are the Gaussian stochastic vectors with variance and zero mean. Therefore, the direction vectors are also three independent stochastic variables [20], i.e.,where the stochastic variable means that has the same distribution as the direction vectors of the input signal, and then, the square of the stochastic variable is denoted by (A4)Based on assumption A3, make assumption about the vector . The desire output signal is given by the mathematical model as follows:where the measurement noise is identically distributed, independent, and stationary with variance and zero mean and the time-variant vectors are the system model parameters. The unknown weight vector is modeled by the stochastic walk model given, where the vector is an independent, stationary zero mean vector process with the variance and it is also the three independent stochastic variables that are identically and independent distributed. That is, where the independent stochastic variable means that it has the same distribution as the vector and the square of the independent stochastic variable is denoted by
Therefore, based on (3a) and (9), the iteration error of the adaptive filtering can be obtained as
From (3c) and (14), it yields where
4. Behavior of Mean Weight Error
In order to study the tracking performance of (3b), according to (15), we have
Combining (10), (16), and (17), the adaptation equation is shown as
Since the parameter and the stochastic vector are both white noise with zero mean, we can take expectation on both sides of (18), and the last three terms in (18) becomes zero, so they can be obtained as
Based on the vectors which are orthonormal to each other, the representation of can be defined as the vector . That is,
Therefore,
Using this result, according to (7), premultiplication on both sides of (19) by , we have
For the orthonormality of the vector . That is,
5. Statistical MSE Behavior
Under assumption A3 where the direction vectors of the input signal are independent on the vector , according to (18), the covariance of the weight error is proposed as
Under the assumption that is white noise with zero mean and the vector is an independent, stationary, zero mean white noise vector, so the six different polynomials, including the second, third, fourth, fifth, seventh, and eighth items, all turn into zero. Because the direction vector of the input signal is independent of the vector , so we obtain the following:
Since is identically distributed, independent with variance and zero mean, under assumptions A2, A3, and A4, using (5), (7), and (11), (26) becomes as follows:
For the covariance matrix, we define the diagonal elements as . So we have
We premultiply and postmultiply on both sides of (27) by and , respectively; under assumption A3, using (29), we can obtain where is a dimension matrix; we can obtain
Based on assumptions A3 and A4, we can obtain that the vectors and both have the probability of to be , respectively. From (30), we can obtain
According to (15), we have the statistical MSE of tracking performance for the AP-DE algorithm as
For and which are independent, stationary white noise vectors with zero mean, so the second, third, fourth, fifth, seventh, and eighth terms all become zero. According to assumption A3 that the direction vector is independent on the weight vector , we can obtain
Under assumptions A3 and A4, based on the definition of , from (33), the statistical MSE of the tracking performance for the AP-DE algorithm can be rewritten as
6. Steady-State Behavior
Assuming convergence, as , (31) can be transformed into
Combining with (34) and (35), based on , the mean square error of the steady-state tracking performance can be written as
7. Simulation
We give the statistical MSE of the tracking performance learning curves from the simulations in this section, and the derived models are given by (34) and (36). The initial system true weight is stochastic produced by 32 taps. The length of the adaptive filtering is given with the same as the derived model. The weight of the initial estimated values is given as . The 100 independent simulations are averaged for each experiment, and each step size is equal to 0.1. The variance of the measurement noise and the vector are set to be and , respectively.
Case 1. Consider that the input signal model defined by is an AR (1) model and the parameter is the white Gaussian noise with the zero mean. The parameter is set to be one. The statistical MSE for tracking behavior predicted by the model given by (34) and (36) are shown in Figure 1, together with the simulation results. We observe that the derived models are almost the same simulation results in this case.
Case 2. When the parameter is assumed to be the white Gaussian noise with the zero mean, the input signal is an ARMA (2, 1) model defined by. The parameter is set to be . The mean square error of the tracking behavior predicted by the derived model given with (34) and (36) is shown in Figure 2. We find that the derived model cooperates with the simulation results well for the input ARMA (2, 1) model.
8. Conclusion
Under the condition that the unknown true weight vector is given by the stochastic walk model, a statistical tracking model for the AP-DE algorithm is analyzed. We give four assumptions that show the properties for both the input and direction vectors. A statistical tracking model of the MWE and the MSE is derived based on these four assumptions. A prediction tracking model of the statistical steady-state MSE of the AP-DE algorithm is also proposed. According to the derived models in this paper, the simulation results for the input given by AR (1) and ARMA (2, 1) show the affine projection algorithm based on direction error, the better statistical tracking behavior.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported in part by the Science, Technology and Innovation Commission of Shenzhen Municipality (Grant no. JCYJ20170815161351983) and the National Natural Science Foundation of China (Grant nos. U20B2040 and 61671379).