#### Abstract

Recently, a closed-form approximated expression was derived by the same author for the achievable residual intersymbol interference (ISI) case that depends on the step-size parameter, equalizer's tap length, input signal statistics, signal to noise ratio (SNR), and channel power and is valid for fractional Gaussian noise (fGn) input where the Hurst exponent is in the region of . But this expression was obtained for the blind adaptive case and cannot be applied to the nonblind adaptive version. Up to now, the achievable residual ISI for the non-blind adaptive case could be obtained only via simulation. In this paper, we derive a closed-form approximated expression (or an upper limit) for the residual ISI obtained by non-blind adaptive equalizers valid for fractional Gaussian noise (fGn) input where the Hurst exponent is in the region of . This new obtained expression depends on the step-size parameter, equalizer's tap length, input signal statistics, SNR, channel power, and the Hurst exponent parameter. Simulation results indicate that there is a high correlation between the calculated results (obtained from the new obtained expression for the residual ISI) and those obtained from simulating the system.

#### 1. Introduction

We consider a nonblind deconvolution problem in which we observe the output of an unknown, possibly nonminimum phase, linear system (single-input-single-output (SISO) FIR system) from which we want to recover its input (source) using an adjustable linear filter (equalizer) and training symbols. During transmission, a source signal undergoes a convolutive distortion between its symbols and the channel impulse response. This distortion is referred to as ISI [1, 2]. It is well known that ISI is a limiting factor in many communication environments where it causes an irreducible degradation of the bit error rate thus imposing an upper limit on the data symbol rate. In order to overcome the ISI problem, an equalizer is implemented in those systems [1–12].

In this paper, we consider the nonblind adaptive equalizer where training sequences are needed to generate the error that is fed into the adaptive mechanism which updates the equalizer’s taps [9–12]. The nonblind adaptive approach yields in most cases a better equalization performance considering convergence speed and equalization quality compared with the blind adaptive version [6]. In addition, the blind adaptive version has a higher computational cost compared with its nonblind approach [6].

The equalization performance from the residual ISI point of view depends on the channel characteristics, on the added noise, on the step-size parameter used in the adaptation process, on the equalizer’s tap length and on the input signal statistics [13, 14]. Fast convergence speed and reaching a residual ISI where the eye diagram is considered to be open (for the communication case) are the main requirements from a blind or nonblind equalizer. Fast convergence speed may be obtained by increasing the step-size parameter. But, increasing the step-size parameter may lead to a higher residual ISI which might not meet the system’s requirements any more. Recently [2], a closed-form approximated expression was derived for the achievable residual ISI case that depends on the step-size parameter, equalizer’s tap length, input signal statistics, SNR, Hurst exponent, and channel power. But this expression is valid only for the blind adaptive case and cannot be used for the nonblind version.

Up to now, the achievable residual ISI for the nonblind adaptive case (for the noisy or noiseless case) could be obtained only via simulation. Thus, the system designer had to spend a lot of time in simulating the whole system in order to find the best values for the step-size parameter and equalizer’s tap length that meet the system’s requirements from the residual ISI point of view. In this paper, we derive a closed-form approximated expression (or an upper limit) for the residual ISI obtained by nonblind adaptive equalizers that depends on the step-size parameter, equalizer’s tap length, input signal statistics, SNR, channel power, and Hurst exponent parameter. This expression is valid for fGn input where the Hurst exponent is in the region of . Please note, is the limit case, which does not have much practical sense [15–17]. It should be pointed out that a white Gaussian process is a special case () of the fractional Gaussian noise (fGn) model [18]. FGn with corresponds to the case of long-range dependency (LRD) [18]. Thus, the new obtained expression for the achievable residual ISI is not only valid for the special case of white Gaussian process but also covers those cases that correspond to the case of LRD.

The paper is organized as follows. After having described the system under consideration in Section 2, the closed-form approximated expression (or upper limit) for the residual ISI is introduced in Section 3. In Section 4, simulation results are presented, and the conclusion is given in Section 5.

#### 2. System Description

The system under consideration is illustrated in Figure 1, where we make the following assumptions.(1)The input sequence belongs to a two independent quadrature carriers case constellation input with variance , where and are the real and imaginary parts of , respectively, and is the variance of . (2)The unknown channel is a possibly nonminimum phase linear time-invariant filter in which the transfer function has no “deep zeros"; namely, the zeros lie sufficiently far from the unit circle.(3)The equalizer is a tap-delay line.(4)The noise consists of , where and are the real and imaginary parts of , respectively, and and are independent. Both and are fractional Gaussian noises (fGn) with zero mean. Note that , , for = and = , where denotes the expectation operator on and is the Hurst exponent.(5)The variance of is denoted as , where and is the conjugate operation on .

The transmitted sequence is sent through the channel and is corrupted with noise . Therefore, the equalizer’s input sequence may be written as where “” denotes the convolution operation. The equalized output signal can be written as where is the convolutional noise, namely, the residual intersymbol interference (ISI) arising from the difference between the ideal equalizer’s coefficients and those chosen in the system and . The ISI is often used as a measure of performance in equalizers’ applications, defined by where is the component of , given in (4), having the maximal absolute value. Consider that where is the Kronecker delta function and stands for the difference (error) between the ideal and the actual value used for .

Next, we turn to the adaptation mechanism of the equalizer which is based on training symbols [9–12, 19]: where is the step-size parameter, is the equalizer vector where the input vector is , and is the equalizer’s tap length. The operator denotes for transpose of the function . Please note that for the nonblind adaptive case, during the training period, a known data sequence is transmitted. A replica of this sequence is made available at the receiver in proper synchronism with the transmitter, thereby making it possible for adjustments to be made to the equalizer coefficients in accordance with the adaptive filtering algorithm employed in the equalizer design [19].

#### 3. Residual ISI for Fractional Gaussian Noise Input

In this section, a closed-form approximated expression (or an upper limit) is derived for the residual ISI valid for the fGn input case.

Theorem 1. *Noted the following assumptions.*(1)*The convolutional noise is a zero mean, white Gaussian process with variance . The real part of is denoted as and .*(2)*The source signal is a rectangular Quadrature Amplitude Modulation (QAM) signal (where the real part of is independent of the imaginary part of ) with known variance and higher moments. *(3)*The convolutional noise and the source signal are independent. *(4)*The gain between the source and equalized output signal is equal to one.*(5)*The convolutional noise is independent of .*(6)*The added noise is fGn with zero mean.*(7)*The channel has real coefficients.*(8)*The Hurst exponent is in the range of .*

The residual ISI expressed in dB units may be defined as where is defined by and is the channel length, is the variance of ( is the real part of ), and SNR is given by .

*Comments*. It should be pointed out that assumptions from above are precisely the same assumptions made in [2, 14].

*Proof. *Let us first recall the expression for the adaptation mechanism of the equalizer given in (5). Then, we substitute (2) into (5) and obtain

Next, we recall from [14] the expression for , where is the real part of and :
where is the real part of and is given in our case as

According to [13, 14], when the equalizer has converged, we may assume that . Therefore, by setting into (9), we obtain

In [13], the expression was approximated as . It should be pointed out that this approximation fits the MPSK case where QPSK is a special case of it. However, satisfying results were obtained in [13] for the 16QAM and 64QAM cases in spite of the fact that the above mentioned approximation was applied. Thus, it makes sense to use the same approximation also here for our case. The expression may be written as

Next, we turn to find a closed-form approximated expression for . The real part of , namely, , may be expressed as

Thus, the variance of is given by:

which can be also written as

According to [2], expression (15) can be approximately written as

by using assumption from the system description section, assumptions and from this section, the Holder inequality [20], and the following approximation [21]:

Now, by substituting (12) and (16) into (11) we obtain (7). This completes our proof.

#### 4. Simulation

In this section, we test our new proposed expression for the residual ISI for the 16QAM case (a modulation using levels for in-phase and quadrature components) with the algorithm described in (5) for different SNR, step-size, and equalizer’s tap length values and for two different channel types. The following two channels were considered. *Channel1* (initial ): the channel parameters were determined according to [22]

*Channel2* (initial ) the channel parameters were determined according to

The equalizer was initialized by setting the center tap equal to one and all others to zero.

In the following, we denote the residual ISI performance according to (6) with (7) as “Calculated ISI.” Figure 2 to Figure 8 show the ISI performance as a function of the iteration number of our proposed expression (6) with (7) for the achievable residual ISI compared with the simulated results for two different channels and equalizer’s tap length and various values for , SNR and step-size parameter. According to Figures 2, 3, 5, 6, 7, and 8, a high correlation is observed between the simulated and calculated results even for . According to Figure 4, the calculated ISI may be considered as an upper limit for the simulated results for .

#### 5. Conclusion

In this paper, we proposed a closed-form approximated expression (or an upper limit) for the residual ISI obtained by nonblind adaptive equalizers valid for the fGn input case where the Hurst exponent is in the region of . This new obtained expression depends on the step-size parameter, equalizer’s tap length, input signal statistics, SNR, channel power, and the Hurst exponent parameter. According to simulation results, a high correlation is obtained between the calculated and simulated results for the residual ISI for some cases, while for others the new obtained expression is a relative tight upper limit for the averaged residual ISI results.