Abstract

This letter proposes a sequential selection normalized subband adaptive filter (SS-NSAF) in order to reduce the computational complexity. In addition, a variable step-size algorithm is also proposed using the mean-square deviation analysis of the SS-NSAF. To enhance the performance in terms of the convergence speed, we propose an improved variable step-size SS-NSAF using a two-stage concept. The simulation results show the low computational complexity and low misalignment errors using the proposed algorithm.

1. Introduction

The normalized least mean-square (NLMS) algorithm has been used in a variety of applications such as network echo cancellation, system identification, and channel estimation because of its low computational complexity and ease of implementation. However, it suffers from the performance degradation in terms of the convergence rate for colored input signals. To address this drawback, affine projection algorithm (APA), zero-attracting algorithms, -norm constrained algorithms, and normalized subband adaptive filter (NSAF) have been proposed [14].

The NSAF improves a convergence rate for colored input signals using multiple subbands with small computational complexity compared to APA. To achieve better performance in terms of the steady-state error and the convergence rate, variable step-size schemes have also been proposed. In [5], the variable step-size NSAF (VSS-NSAF) was developed by minimizing the mean-square deviation (MSD) of the NSAF. In [6], the variable step-size matrix NSAF effectively estimates the noise variance of each subband. Furthermore, several algorithms have been proposed to reduce the computational complexity of the NSAF. The simplified selective partial update subband adaptive filter reduces the computational complexity by updating partial filter coefficients in each subband rather than the entire filter at every adaptation [7]. The dynamic selection NSAF (DS-NSAF) updates only a selected subset of subband filters [8], leading to the largest decrease between the successive MSDs at every adaptation. Recently, Rabiee [9] introduced the flexible complexity VSS-NSAF (FC-VSS-NSAF) to reduce the computational complexity and improve the convergence performance.

This paper proposes a sequential selection NSAF (SS-NSAF) to reduce complexity and a variable step-size algorithm to improve performance in terms of the convergence speed and the misalignment errors. The variable step-size algorithm is derived by the MSD analysis of the SS-NSAF. In addition, to improve the convergence speed, we propose an improved variable step-size algorithm using a two-stage concept [10]. It carries out the conventional NSAF with a fixed step size in the first stage to achieve a fast convergence rate and then performs SS-NSAF with variable step size. We confirm that the proposed algorithm has low misalignment errors while reducing the computational complexity.

2. Sequential Selection NSAF (SS-NSAF)

We consider data derived from an unknown system:where is an m-dimensional unknown vector to be estimated, accounts for a measurement noise with zero mean and variance , and denotes an m-dimensional input vector.

Figure 1 shows the structure of the NSAF, where is the number of subbands. The desired system output signal and the filter output signal of the th subband are divided into subbands by the analysis filters . These signals are then critically decimated. In this letter, the variables and are used to index the original sequences and the decimated sequences, respectively. The decimated filter output signal is defined as , where . The output error of the th subband is defined as , where .

The conventional NSAF update equation iswhere is a step size.

The SS-NSAF updates using sequentially selected subband filters to reduce the computational complexity, where . The proposed SS-NSAF iswhere has 1 or 0, which is an element of vector . The is obtained as follows:where the initial values are

3. Variable Step-Size SS-NSAF (VSS-SS-NSAF)

A weight-error vector is defined as and the SS-NSAF update equation (3) can be rewritten in terms of as follows:where and is the identity matrix. For a given set , the covariance matrix and MSD are defined aswhere is the expectation value of a random variable and is the trace of a matrix. Let us define as the conditional covariance matrix of (7) as follows:By substituting (6) into (9), we haveAfter taking the trace on both sides of (10), the update recursion of the has the formwhere . Using the result [11] with , we can assume thatis available, which leads toFrom (7), after taking the expectation value of both sides of (13), because a probability , the update recursion of the MSD is derived as follows:where [12]. From the MSD analysis of the NSAF given by (14), the steady-state value of the MSD can be obtained asThe steady-state MSD values are same when setting at same step size for various .

By minimizing the value of with respect to step size , the optimal step size is derived by

4. Improved VSS-SS-NSAF (IVSS-SS-NSAF)

Since the SS-NSAF updates only subband filters at every iteration, small leads to low computational complexity and slow convergence rate. Therefore, the VSS-SS-NSAF also has slow convergence rate when it uses small . To improve the convergence rate of the VSS-SS-NSAF, we propose the IVSS-SS-NSAF that has two stages. In the first stage, the NSAF for a large step size is performed to guarantee a fast convergence. Then, when the NSAF reaches the steady state, the proposed algorithm uses only subband filters with optimal step size as (16), resulting in low computational complexity. From (15), the steady-state value of the MSD with can be obtained asTherefore, the proposed algorithm uses all subband filters when .

4.1. Practical Considerations

The proposed algorithm achieves the optimal step size using the current MSD value; however, it is always decreased, which leads to the performance degradation in a fast-varying system. To reflect the nonstationarity of the system, the current MSD value can be rewritten by output error variance as follows [11, 13]:whereBecause it is hard to obtain the exact value of and , they are estimated by a moving average method as follows:where is smoothing factor. Algorithm 1 summarizes the proposed algorithm and Table 1 shows the computational complexity of the NSAF, FC-VSS-NSAF, VSS-SS-NSAF, and IVSS-SS-NSAF for every iteration. To reduce the computational complexity, we used a recursive computation of the norms of the input signals [6, 14]. The FC-VSS-NSAF and IVSS-SS-NSAF have more computational complexity than conventional NSAF algorithm when ; however, they can reduce average computational complexity and power consumption by the number of selected subbands, , based on the value of complexity reduction factors, and , respectively.

Initialization:  , , ,
,
Parameters:   : known or estimated a priori
,: predefined
For each iteration
1. and estimation
,
2. estimation
3. , NSAF, and MSD update
if
,
,
else
,
,
end
end

5. Simulation Results

In this section, computer simulations in the system identification are used to illustrate the performance of the proposed algorithm. In these simulations, the unknown system is the acoustic impulse response of a room truncated to 512 for 128 taps. We assume that the adaptive filters and the unknown system have the same number of taps, i.e., or . The colored input signals are generated by filtering white Gaussian noise through the following system:

The measurement noise is added to the output such that the signal-to-noise ratio (SNR) = 30 dB, where SNR is defined asIn addition, the normalized mean squared deviation (NMSD) is defined asAssume that is known, since it can be easily estimated during silences and online [1518]. Each subband adaptive filter uses an eight-band filter bank that has 32 filter lengths, i.e., and . We set to 1 for initialization of the proposed algorithm. In addition, the proposed algorithm is performed for when and when . The simulation results were obtained by ensemble averaging over 30 trials.

5.1. MSD Estimation of SS-NSAF

Figures 2, 3, and 4 show the estimated MSD curves (as in (18)) and simulation results when setting at , , and for different . As it is shown, all curves have same steady-state value regardless . However, the smaller leads to the slower convergence rate. The estimated MSD curves are close to simulation results.

5.2. Performance Comparison

Figures 5(a) and 5(b) compare the NMSD learning curves of the conventional NSAFs, SM-NLMS[19] (), VSS-NLMS[20] (, , , , ), FC-VSS-NSAFs, VSS-SS-NSAFs, and IVSS-SS-NSAFs () for colored input generated by when and , respectively. Figure 6 shows average number of selected subband filters for updating in FC-Vss-NSAFs, VSS-SS-NSAFs, and IVSS-SS-NSAFs when . This simulation abruptly changes the unknown system at the midpoint of the test interval. The FC-VSS-NSAFs perform differently depending on the value of the complexity reduction factor [9]. The IVSS-SS-NSAFs also perform differently depending on the but the IVSS-SS-NSAF for has lower steady-state errors and lower computational complexity than the FC-VSS-NSAF for , which has best performance among them. As can be seen, this simulation results confirm that the proposed algorithm, which has the lower computational complexity than the FC-VSS-NASF which performs well in terms of misalignment errors. Figures 7(a) and 7(b) show the NMSD learning curves of the conventional NSAFs, SM-NLMS, VSS-NLMS, FC-VSS-NSAFs, VSS-SS-NSAFs, and IVSS-SS-NSAFs () for colored input generated by when and , respectively. Figure 8 shows average number of selected subband filters for updating in FC-VSS-NSAFs, VSS-SS-NSAFs, and IVSS-SS-NSAFs when . Figure 9 describes the comparisons of NSAFs (), SM-NLMS (), VSS-NLMS (, , , , ), FC-VSS-NSAFs (), VSS-SS-NSAF (), and IVSS-SS-NSAF (, ) in an acoustic echo-cancellation application. We used the speech signal as input signal that is sampled by 8kHz.

6. Conclusion

In this paper, we proposed the SS-NSAF and variable step-size algorithms to reduce computational complexity and achieved low steady-state errors. By the MSD analysis of the SS-NSAF, the variable step size algorithm was derived. In addition, to improve the convergence performance, we proposed IVSS-SS-NSAF using a two-stage concept. The simulation results showed that the proposed algorithm is better than the FC-VSS-NSAF in terms of misalignment errors.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIP; Ministry of Science, ICT & Future Planning) (no. 2017R1C1B5017968). This work was supported by the Soonchunhyang University Research Fund.