Abstract

A novel algorithm is developed based on fractional signal processing approach for parameter estimation of input nonlinear control autoregressive (INCAR) models. The design scheme consists of parameterization of INCAR systems to obtain linear-in-parameter models and to use fractional least mean square algorithm (FLMS) for adaptation of unknown parameter vectors. The performance analyses of the proposed scheme are carried out with third-order Volterra least mean square (VLMS) and kernel least mean square (KLMS) algorithms based on convergence to the true values of INCAR systems. It is found that the proposed FLMS algorithm provides most accurate and convergent results than those of VLMS and KLMS under different scenarios and by taking the low-to-high signal-to-noise ratio.

1. Introduction

Parameter estimation methods have been applied in many important applications arising in applied science and engineering including linear and nonlinear system identification, signal processing, and adaptive control [19]. Nonlinear systems are generally categorized into input, output, feedback, and hybrid, that is, combination of input and output nonlinear systems. Many nonlinear systems are modeled with Hammerstein model, a class of input nonlinear systems that consists of static nonlinear blocks followed by linear dynamical subsystems [10, 11]. Such models have been broadly used in diverse fields such as nonlinear filtering [12], biological systems [13], actuator saturations [14], chemical processes [15], audiovisual processing [16], and signal analysis [17].

A lot of interest has been shown by the research community for parameter estimation of Hammerstein nonlinear controlled autoregression models also known as input nonlinear controlled auto-regression (INCAR) systems. For instance, Ding and Chen have developed a least square based iterative procedure and an adaptive extended version of the least square algorithm for Hammerstein autoregressive moving average with exogenous inputs (ARMAX) system [18], Ding et al. also present an auxiliary model using recursive least square algorithm for Hammerstein output error systems [19], and Fan et al. have developed the least square identification algorithm for Hammerstein nonlinear autoregressive with exogenous inputs (ARX) models, while Wang and Ding have developed the extended stochastic gradient algorithm for Hammerstein-Wiener ARMAX models. As per authors’ literature survey adaptive or recursive algorithms based on fractional signal processing approach like fractional least mean square algorithm (FLMS) and its normalized version have not been exploited in this domain.

The application of fractional signal processing has been arising in many fields of science and technology including modeling of fractional Brownian motion [20], description of fractional damping [21], charge estimation of lead acid battery through identification of fractional systems [22], which differintegration [23], and Identifying a transfer function from a frequency response[24] etc. Fundamental description, subject terms, importance, and history of fractional signal process can be seen in [25, 26]. Wealth of information about fractional signal processing is also available in special issues of renewed journals [27, 28]. Fractional time integral approach to image structure denoising [29] and design for the adjustable fractional order differentiator [30] are other illustrative recent applications of these approaches. These are also motivation factors for the authors to explore applications of fractional signal processing specially in the area of Hammerstein nonlinear systems.

In this paper, adaptive algorithm based on fractional least mean square (FLMS) approach is applied for parameter estimation of INCAR model to find unknown parameter vector. The FLMS algorithm with different step size parameters is applied to two examples of INCAR model, and performance of the proposed scheme is analyzed for different scenarios of signal-to-noise ratios. The optimization problem is also adaptive with Volterra LMS and recently proposed kernel LMS, and comparison of the results is made with FLMS algorithm for each case of both examples.

The organization of the paper is as follows; in Section 2 the description of the problem based on INCAR model is presented. In Section 3, proposed adaptive algorithms are described. Results of detailed simulations are given in Section 4 alone with necessary discussion. We conclude our finding in the last sections along with few future research directions in this domain.

2. Input Nonlinear Control Autoregressive Systems

In this section, the brief description of input nonlinear control autoregressive (INCAR) systems is presented.

Let us consider the following governing equation of INCAR model as [18, 31] here represents the output of system, is the disturbance noise, is output of nonlinear block and is given as a nonlinear function of known basis of the system input as where is the vector of constants, and are known polynomials and given in term of unit backward shift operator , as where and are the constants coefficient vectors. Rearranging equation (1) one has Using (3) in (4) one has where the parameter vector and information vector are defined as Equation (5) represents the linear-in-parameters identification model for Hammerstein control autoregressive systems using parameterization. The detail studies of input nonlinear systems, interested reader are referred to [32].

3. Methodologies for Parameter Estimation of INCAR Model

In this section, brief introductory material is presented for proposed adaptive algorithms for identification of INCAR model given in Section 5. Three recursive algorithms are used: optimization of the model including fractional least mean square (FLMS), Volterra least mean square (VLMS), and kernel least mean square (KLMS).

3.1. Fractional Least Mean Square (FLMS) Algorithm

FLMS belongs to the class of nonlinear adaptive algorithms which is introduced by Zahoor and Qureshi [33] in their work of identification of autoregressive (AR) systems. Since origination of FLMS algorithm, it has been utilized immensely in various problems effectively such as dual-channel speech enhancement [34, 35], acoustic echo cancellation [36], and performance analysis of Bessel beamformers [37, 38]. Our intention is thin study to use FLMS with a different order for parameter estimation of INCAR systems.

The cost function for adaptive algorithm like FLMS is given as where represents the difference between desired and filter response, is the input to the filter, and is the step size parameter.

Normally, the filter weight update equation for least mean square (LMS) algorithm is written as where is the number of tap weight and indicates the th filter weight at time index. The final weight updated equation for LMS algorithm [39] is given in vector form as Accordingly, for FLMS algorithm, filter weight update equation for th tap weight is written with inclusion of fractional term as where represents the fractional order which is generally taken as real value between 0 and 1, and is fractional step size parameter. The final weight updated equation for th tap in case of FLMS algorithm is written as [33] The detailed derivation of (12) can be seen in [33, 40].

3.2. Third-Order Volterra Least Mean Square (VLMS) Algorithm

In this section, brief description of third-order Volterra is presented. Volterra model is widely used in many applications of nonlinear systems including system identification, echo cancellation, acoustic noise control, and nonlinear channel equalization and is also used in transmission channels to compensate the nonlinear effects [4143].

The governing mathematical relations for Volterra series for a causal discrete time nonlinear system having input and output are introduced by Schetzen, in 1980, and given as [42, 44] where represents the degree of nonlinearity in the model, is the filter memory, is the th-order Volterra kernel. By taking in (13), the input-output expression for third-order Volterra filter is given as here is the third-order Volterra kernel of the system. In case of symmetric kernels having memory , then coefficient is required for third-order kernel [44]. For the third degree of nonlinearity with memory , the volterra kernel coefficient vector W is given as: The corresponding input vector for is written as The weights update equation for third-order VLMS is given as where is the error and is the step size parameter. For the detail description of VLMS, interested readers are referred to [44].

3.3. Kernel LMS (KLMS) Algorithm

Pokharel et al. have developed the least mean square (LMS) adaptive algorithm in kernel feature space known in the literature as kernel least mean square (KLMS) algorithm [45]. The basic idea of KLMS algorithm is to transform the data from the input space to a high-dimensional feature space. The importance, fundamental theory, the definition of mathematical term, and applications can be seen in [4649].

The KLMS algorithm is a modified version of LMS with introduction of kernel feature space, and its weight updating equation is written as where represents the error term similar to (8) but for KLMS, filter output is computed as here represents inner product in the kernel Hilbert space and is a mapping which transforms input vector to high-dimensional kernel feature space such that where defines the Hilbert space associated with the kernel and can be taken as a nonlinear transformation from the input to feature space. Using (20) in (19) gives Equation (21) is called the KLMS algorithm and further detail about the procedure for the derivation of the algorithm is given in [45, 46].

In this study we will only consider most widely used Mercer kernel which is given by translation invariant radial basis (Gaussian) kernel as

4. Simulations and Results

In this section, results of simulations are presented for two case studies of INCAR model using proposed FLMS, VLMS, and KLMS algorithms. The parameter estimation is carried in both studies by taking different levels of signal-to-noise ratio (SNR) and with various step size μ parameters. Moreover, FLMS operates based on different values of fractional orders.

4.1. Case Study 1

The INCAR model for this case is taken as follows: In numerical experimentation, the input is taken as persistent excitation signal sequence with zero mean and unit variance, and is taken as a white noise sequence with zero mean and constant variance. Before applying the design methodology, a figure of merit or fitness function is developed based on estimation error as where is vector of adaptive parameter for INCAR model based on th iteration of the algorithm and vector for the true or desired values is represented by . Now the requirement is to find weight vector such that the value of fitness function given in (24) approaches zero, and, consequently, the approaches .

The proposed adaptive algorithms based on FLMS, VLMS, and KLMS are applied to find the optimal weight vector for INCAR system using sufficient large number of iteration, that is, . Two types of step size variation strategy are adopted for each algorithm. Firstly, up to iterations, the larger values of step size parameter are taken, that is, , for fast convergence and for remaining iteration smaller value of step size is used, that is, , for the stability. Secondly, initially the step size is taken as and later on for . The design schemes are evaluated for INCAR models based on four different levels of signal-to-noise ratio, that is, 30 dB, 20 dB, 10 dB, and 3 dB. The iterative results of each algorithm against the values of merit function are shown graphically in Figures 1 and 2 for first and second strategy of μ, respectively, for all four variants of SNR. It is found that for higher values of SNR and lower values of step size, all the three algorithms are convergent but the accuracy and convergence of the FLMS algorithm are much better than those of VLMS and KLMS. Moreover, with the increase in step size VLMS algorithm diverges, while efficiency of both KLMS and FLMS algorithms increases and remains convergent.

The design parameters of INCAR model obtained with adaptation procedure of VLMS, KLMS, and FLMS1 for and FLMS2 for are listed in Tables 1, 2, 3, and 4 for SNR = 30 dB, 20 dB, 10 dB, and 3 dB, respectively, for both step size strategies. The values of mean square error (MSE) from true parameters of INCAR model are calculated and its values are also tabulated in Tables 1, 2, 3, and 4 for each algorithm. The values of absolute error (AE) for each element of the design parameter are calculated from reference value of INCAR model and results are presented in Figure 3 for each variant of SNR and for both step size strategies. In order to broaden the small difference in the values, results are plotted on semilog scale. It is seen from the results presented that for high SNR values, like 30 dB, the values of MSE for FLMS1 and FLMS2 are of the order 10−07 to 10−06 and for low SNR values like 3 dB the values of MSE are around 10−04 to 10−05 for FLMS algorithm. Moreover, for increased values of step size, that is, , the VLMS algorithm is not providing the convergent results while both KLMS and FLMS give accurate results. The MSE and AE values of KLMS algorithm are considerably inferior to FLMS algorithm. Generally, it is observed that with decrease in the values of step size parameter, the stability of the algorithm is observed but needs more computational budget to achieve better results.

4.2. Case Study 2

Another INCAR system has been taken in this case as The numerical experimentation for this case has been performed on a similar pattern as in the previous case study. The proposed schemes based on FLMS, VLMS, and KLMS methods are applied to find vector of design parameters for INCAR system using sufficient large number of iterations, that is, . The same types of step size variation strategy and variants of SNR are used for each algorithm in this case as described in the last example. The iterative results of each algorithm against the values of merit function are plotted in Figures 4 and 5 for first and second strategy of μ, respectively, for all four variants of SNR. The vector for design parameters of INCAR systems optimized with VLMS, KLMS, and FLMS1 for and FLMS2 for are tabulated in Tables 5, 6, 7, and 8 for SNR = 30 dB, 20 dB, 10 dB, and 3 dB, respectively, for both step size strategies. The values of MSE and AE of the proposed schemes from true parameters of INCAR model are calculated and results are given in Tables 5, 6, 7, and 8 and Figure 6, respectively.

It is seen from the results presented that with high SNR values, that is, 30 dB, the values of MSE for FLMS1 and FLMS2 are around 10−06 to 10−07 while for low SNR values, that is, 3 dB, the values of MSE are around 10−04 to 10−05. By increasing the values of step size, that is, (10−03 and 10−05), the VLMS algorithm is also giving the convergent results for this case, as well as both KLMS and FLMS provide accurate and convergent results. The MSE and AE values for the KLMS and VLMS algorithms for this case are also found to be inferior from FLMS algorithm. Moreover, it is found that with decrease in the values of step size parameter, the stability in the algorithm is observed but needs relatively more computations to get better results.

5. Conclusion

On the basis of the simulation and results presented in the last section, the following conclusions are drawn.(i)The adaptive algorithms based on fractional signal processing approach are used effectively for parameter estimation of input nonlinear control autoregressive (INCAR) models for both case studies.(ii)The variation of step size strategies shows that for smaller and relatively larger value of step size parameter both order of fractional least mean square (FLMS) algorithms provide accurate and convergent results than those of VLMS and KLMS algorithms. (iii)The variants of signal-to-noise ratio (SNR) in INCAR models show that the performance of all the algorithm decreases as SNR decreases from higher level to lower level, but FLMS algorithm still achieved the values for mean square error around 10−04 to 10−05 for even SNR = 3 dB. (iv)Comparative studies between FLMS, VLMS, and KLMS algorithms for each variants of both case studies validate the correctness of the adaptive algorithms based on FLMS algorithm.In future, one may look for heuristic computing techniques based on genetic algorithms, swarm intelligence, differential evolution, genetic programming, and memetic computing approaches, and so forth, for parameter estimation of INCAR models.