#### Abstract

Recently a new blind equalization method was proposed for the 16QAM constellation input inspired by the maximum entropy density approximation technique with improved equalization performance compared to the maximum entropy approach, Godard’s algorithm, and others. In addition, an approximated expression for the minimum mean square error (MSE) was obtained. The idea was to find those Lagrange multipliers that bring the approximated MSE to minimum. Since the derivation of the obtained MSE with respect to the Lagrange multipliers leads to a nonlinear equation for the Lagrange multipliers, the part in the MSE expression that caused the nonlinearity in the equation for the Lagrange multipliers was ignored. Thus, the obtained Lagrange multipliers were not those Lagrange multipliers that bring the approximated MSE to minimum. In this paper, we derive a new set of Lagrange multipliers based on the nonlinear expression for the Lagrange multipliers obtained from minimizing the approximated MSE with respect to the Lagrange multipliers. Simulation results indicate that for the high signal to noise ratio (SNR) case, a faster convergence rate is obtained for a channel causing a high initial intersymbol interference (ISI) while the same equalization performance is obtained for an easy channel (initial ISI low).

#### 1. Introduction

It is well known that ISI is a limiting factor in many communication environments where it causes an irreducible degradation of the bit error rate, thus imposing an upper limit on the data symbol rate. In order to overcome the ISI problem, an equalizer is implemented in those systems.

Recently [1], a new blind equalization method was proposed for the 16QAM constellation input inspired by the maximum entropy density approximation technique. In this new equalization technique [1], the conditional expectation was approximately derived using Bayes rules where the input and equalized output probability density function (pdf) were approximated using the maximum entropy density approximation technique. In order to find the Lagrange multipliers, a closed-form approximated expression was derived for the MSE where the idea was to bring the MSE to minimum according to the Lagrange multipliers following [2]. Since the obtained expression for the Lagrange multipliers leads to a nonlinear equation for the Lagrange multipliers, the part in the MSE expression that caused the nonlinearity in the Lagrange multipliers’ equation was ignored. Thus, a linear closed-form approximated expression was obtained for the Lagrange multipliers from which the proposed Lagrange multipliers [1] were calculated for the 16QAM case.

Up to now, it is not clear whether it is worth finding those Lagrange multipliers that bring the approximated MSE to minimum. Namely, it is not clear if the optimal (from the MSE point of view) Lagrange multipliers derived from the nonlinear equation for the Lagrange multipliers will lead to significant equalization performance improvement or not.

In this paper, we derive the Lagrange multipliers for the 16QAM input case that bring the approximated expression for the MSE to minimum. Namely, we obtain a new set of Lagrange multipliers from the nonlinear equation for the Lagrange multipliers. We show in this paper that the new derived Lagrange multipliers are different in sign and magnitude from the recently obtained set. Simulation results indicate that when we deal with an easy channel, no difference is seen in the equalization performance if we use the Lagrange multipliers derived from the linear or nonlinear equation for the Lagrange multipliers. But, when we deal with a difficult channel (where the initial ISI is considered as very high) and high SNR case, a much faster convergence rate is obtained when using the Lagrange multipliers from the nonlinear equation for the Lagrange multipliers instead of those calculated from the linear part.

The paper is organized as follows. After having described the system under consideration in Section 2, we introduce in Section 3 our new derived Lagrange multipliers for the 16QAM input case. In Section 4, simulation results are presented and the conclusion is given in Section 5.

#### 2. System Description

The system under consideration is the same system used in [1], illustrated in Figure 1, where we make the following assumptions as used in [1].

The input sequence belongs to the 16QAM constellation where and are the real and imaginary parts of , respectively. The unknown channel is a possibly nonminimum phase linear time-invariant filter in which the transfer function has no “deep zeros”; namely, the zeros lie sufficiently far from the unit circle. The equalizer is a tap-delay line. The noise is an additive Gaussian white noise. The function is a memoryless nonlinear function that satisfies the analyticity condition: , where , are the real and imaginary parts of the equalized output, respectively.

The sequence is transmitted through the channel and is corrupted with noise . Convolving with the received sequence, we obtain where is a constant delay, is a constant phase shift, and is the convolutional noise, namely, the residual intersymbol interference (ISI) arising from the difference between the ideal and the guess value for and , where “” denotes the convolution operation. In this paper (as it was done in [1]), we assume that and , since does not affect the reconstruction of the original input sequence and can be removed by a decision device [3]. The ISI is often used as a measure of performance in equalizers' applications, defined by where is the component of , given in (3), having the maximal absolute value: where is the Kronecker delta function and stands for the difference (error) between the ideal and the guess value for . Next, we define some estimator of , which is produced by the function . Thus, the error signal is . This error is fed into the adaptive mechanism which updates the equalizer's taps. The conditional expectation (, where stands for the expectation operation) is touted as a good estimate of [3].

According to [1], the equalizer's taps are updated according to where is a positive stepsize parameter, stands for the conjugate operation on , stands for the th tap of the equalizer, , , , , and where and , are the Lagrange multipliers related to and , respectively, and , are the variances of the real and imaginary parts of the source signal, respectively. The variances of the real and imaginary parts of the equalized output signal are defined as and , respectively, and may be estimated by [1] where stands for the estimated expectation, , and is a positive stepsize parameter.

#### 3. New Lagrange Multipliers

In this section, we present the Lagrange multipliers for the 16QAM input case that brings the approximated MSE derived in [1] to minimum. Since we are dealing with the 16QAM case, the MSE () is twice the MSE obtained for the real valued case.

According to [1], the approximated MSE for the real valued case is given by where where , (where is the real part of ), and () are the Lagrange multipliers. Next, we wish to find those Lagrange multipliers that bring the MSE (8) to minimum. Namely, we are looking for those Lagrange multipliers that comply with the following equation: . By carrying out () and taking into account that we obtain the following expression: where For the 16QAM constellation input case we use two Lagrange multipliers , as was done in [2], thus having where . By using (10) we obtain the following equations for and : Please note that the following expressions and were set to zero when the Lagrange multipliers were derived in [1]. According to [1], . But by solving the nonlinear equation (12) with MATLAB software we obtain As we may see, the new values for and are very different (opposite in sign and different in magnitude) from those obtained in [1]. Thus, it is not clear whether the new values for and will lead to improved equalization performance compared with the previous obtained set or not. In the next section, we will try to answer on that issue.

#### 4. Simulation

In this section, the equalization performance with the new values for and was investigated by simulation. For that purpose we used Godard's [4] algorithm, the maximum entropy algorithm [2], and the previously derived values [1] for and for comparison. In the following, we denote “,” “,” and “” as the algorithm described in [2], (4) with , and (4) with (13), respectively. The step-size parameters for the “” algorithm are defined as and . The step-size parameters for the “” algorithm are defined as and . The step-size parameters for the “” algorithm are defined as and and the step-size parameter for Godard's algorithm is defined as . For the “,” “,” and “” algorithm we used for initialization. Two different channels were considered.

*Channel 1 (initial **).* Taken according to [5], ; ; for .

*Channel 2 (initial **).* Taken according to [6], . For Channel 1 and Channel 2, we used an equalizer with 13 and 21 taps, respectively. The equalizers were initialized by setting the center tap equal to one and all others to zero. The step-size parameters , , , , , , and were chosen for fast convergence with low steady state ISI. Figures 2 and 3 show the equalization performance with the new derived Lagrange multipliers (13), namely, the ISI as a function of iteration number for the constellation input sent via channel1 for and , respectively, compared with the equalization performance obtained from the maximum entropy [2], Godard's [4], and algorithm. According to simulation results (Figures 2 and 3), our new proposed algorithm (4) with the Lagrange multipliers defined in (13) has a much faster convergence time, compared with the maximum entropy [2] and Godard's [4] algorithm, but has approximately the same equalization performance as the algorithm. Namely, the new and previously obtained Lagrange multipliers lead approximately to the same equalization performance. Thus, there is no advantage by using the new Lagrange multipliers over the previously obtained set. Figure 4 shows the equalization performance with the new derived Lagrange multipliers (13), namely, the ISI as a function of iteration number for the constellation input sent via channel 2, compared with the equalization performance obtained from the and Godard’s [4] algorithm. According to simulation results (Figure 4), our new proposed algorithm (4) with the Lagrange multipliers defined in (13) has better equalization performance, namely, a much faster convergence time, compared with the and Godard’s [4] algorithm. As a matter of fact, the convergence speed of the equalizer with the new proposed Lagrange multipliers (13) is faster with approximately 5000 symbols (the eye-diagram is already open at ) and with over 30000 symbols compared with the equalizer with the previously obtained Lagrange multipliers and Godard's [4] algorithm, respectively. Thus, the new proposed Lagrange multipliers (13) are more attractive than the previously derived set.

#### 5. Conclusion

In this paper, we derived new Lagrange multipliers for the 16QAM input case that bring the approximated MSE to minimum. Simulation results have shown that when we deal with an easy channel, no difference is seen in the equalization performance if we use the new or previously obtained Lagrange multipliers. But, when we deal with a difficult channel (where the initial ISI is considered as very high) and high SNR case, a much faster convergence rate is obtained when using our new proposed Lagrange multipliers over the previously derived set.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.