Identifying Odd/Even-Order Binary Kernel Slices for a Nonlinear System Using Inverse Repeat m-Sequences

Hu, Jin-yan; Yan, Gang; Wang, Tao

doi:https://doi.org/10.1155/2015/454638

Computational and Mathematical Methods in Medicine

On this page

Abstract Introduction Discussion Conclusion Acknowledgments References Copyright Related Articles

Special Issue

Biomedical Signal Processing and Modeling Complexity of Living Systems 2014

View this Special Issue

Research Article | Open Access

Volume 2015 | Article ID 454638 | https://doi.org/10.1155/2015/454638

Identifying Odd/Even-Order Binary Kernel Slices for a Nonlinear System Using Inverse Repeat m-Sequences

Jin-yan Hu,¹Gang Yan,¹and Tao Wang¹

Academic Editor: Shengyong Chen

Received27 Jun 2014

Revised09 Sept 2014

Accepted01 Oct 2014

Published22 Mar 2015

Abstract

The study of various living complex systems by system identification method is important, and the identification of the problem is even more challenging when dealing with a dynamic nonlinear system of discrete time. A well-established model based on kernel functions for input of the maximum length sequence (m-sequence) can be used to estimate nonlinear binary kernel slices using cross-correlation method. In this study, we examine the relevant mathematical properties of kernel slices, particularly their shift-and-product property and overlap distortion problem caused by the irregular shifting of the estimated kernel slices in the cross-correlation function between the input m-sequence and the system output. We then derive the properties of the inverse repeat (IR) m-sequence and propose a method of using IR m-sequence as an input to separately estimate odd- and even-order kernel slices to reduce the chance of kernel-slice overlapping. An instance of third-order Wiener nonlinear model is simulated to justify the proposed method.

1. Introduction

Living systems usually exhibit complex and nonlinear behaviors [1–3], which can be characterized by a mathematical model carefully tuned to represent the relationship between the input and output data. A linear system is capable of determining the input and output relationships through an impulse response function; however, for a nonlinear system, a higher order transfer function has to be used for this purpose. A nonlinear system can be typically modeled by Volterra or an equivalent Wiener series expansion, in which the Volterra or Wiener kernels to be estimated can fully define the system characteristics [4–6].

The kernel estimation for such nonlinear system usually requires the input signal to be a long Gaussian white noise to completely activate the underlying system. Under such conditions, Lee and Schetzen proposed a convenient cross-correlation method widely used to estimate the kernel functions [7, 8].

In several circumstances, particularly for a variety of living biosystems, input signals are constrained as a series of impulse trains instead of continuous signals, such as the Gaussian white noise [9, 10]. For instance, the auditory system is usually studied by stimulating the ear with a series of click sounds to activate the corresponding neurons in the cochlea and neural pathway to evaluate the hearing integrity [11, 12]. A well-studied impulse train for the input is a pseudorandom binary sequence called maximum length sequence (short for m-sequence), which has an important role in nonlinear system identification. The correlation property of an m-sequence is analogous to a Gaussian white noise such that to model the system by borrowing the idea of the cross-correlation method for Gaussian white noise input is possible. Hence, the binary kernels are defined using cross-correlation method for m-sequence inputs [3, 13–18].

Using the m-sequence approach, Sutter studied the binary kernel for identifying multifocal retinosystem through electroretinography and explained the visual function using the binary kernels [15]. Shi and Hecox transferred the m-sequence into an m-impulse sequence in a study on the nonlinear properties of the auditory system by measuring the electrical response from the scalp [16]. In a study on the dynamic characteristics of the primate retinal ganglion cell, Benardete and Victor developed a hybrid m-sequence allowing the summation of multiple m-sequences as input to estimate the main diagnostic kernel slice [17].

However, the binary kernel slices—derived by making use of the shift-and-product property of the m-sequence—are all laid in the first-order cross-correlation function between the m-sequence input and the system response, that is, the observed output. The specific location of any kernel slice in the cross-correlation function is determined through a complex shift function that cannot be explicitly determined. If the kernel slices are improperly arranged such that overlaps among neighboring slices occur, then the kernel estimation is inevitably distorted. A straightforward approach to solve this problem is to multiply the length of the input m-sequence, which is unfavorable for living systems with more or less time-varying property. Another approach to alleviate the overlap issue is to sparsify the impulse train of the m-sequence at risk of suffering the underestimation caused by the reduced number of available kernel slices [18].

In this study, we addressed the overlap problem through a new strategy using an inverse-repeat (IR) m-sequence. We will drive the estimation equations for the binary kernel slices corresponding to the IR m-sequence, through which the odd- and even-order kernel slices can be separately estimated and thus reduce the chance of slice overlapping. Last, a third-order nonlinear system is simulated to demonstrate the process of the proposed method.

2. Binary Kernel Identification for m-Sequence

2.1. The Properties of an m-Sequence

An m-sequence consisting of digit −1 and +1 that pseudorandomly occurred can be generated through the output of a linear circular shift register. The structure of which is determined through a primitive polynomial of degree , which is also the degree of the periodical m-sequence [19, 20]. And the period or length of the m-sequence is . An m-sequence is called a balanced sequence because the number of −1 is , which is just one more than the number of +1, that is, . Two crucial properties of the m-sequence used in the present study are as follows.

(i) Shift-and-product propertywhere is referred to as shift function representing the circular shift lag of the m-sequence . The exact value of a shift function depends on the shifting lags of the m-sequences to be multiplied. This property indicates that the product of the m-sequences with different circular shifts is also the same m-sequence circular shifting to a lag determined by a shift function that is unknown a priori. A straightforward approach to calculate the specific value of a shift function is to compare bit-by-bit the original m-sequence and the resulting -bit shifting version until , such that .

For , that is, the product of the same m-sequences, it yieldswhere denotes an all-one sequence—all members of the sequence are 1s.

Equation (2) provides an exception for the shift-and-product property that an all-one sequence instead of an m-sequence is produced under a certain condition when multiplying the same m-sequences. When more than two different m-sequences are multiplied, we have another exception for the shift-and-product property: Equation (3) implies that when dealing with higher-order kernels , the m-sequence should be selected with caution in case invalid results occur for the kernel estimation.

(ii) The autocorrelation function is a periodical real value function with the same minimal period of ; that is, In analogy to the Gaussian white noise method, this autocorrelation property of (4) is important to account for the derivation of the m-sequence in identifying a nonlinear system.

2.2. From Volterra Kernels to Binary Kernels

The output of a general th-order nonlinear dynamic system in response to the input can be modeled by a Volterra series expansion [5, 21], where is called the th-order Volterra operator which is defined as where represents the memory length of the dynamic system, and represents the th-order Volterra kernel.

To estimate the Volterra kernel for Gaussian white noise, input is not theoretically feasible for the difficulty of nonorthogonality. Instead, it is preferred to estimate the Wiener kernel after the Gram-Schmidt orthogonal process on the Volterra series expansion [21]. This method can be extended to deal with m-sequence input yielding the so-called binary kernel estimation [13, 16]. A th-order binary kernel is given by where the th-order cross-correlation of input and output is Let and , and then (7) and (8) become According to the shift-and-product property, (10) becomeswhich transfers the multivariable correlation function into a single variable cross-correlation function . Substituting (11) to (9) yields Given , (12) presents a portion of the kernel function values along the diagonal and subdiagonal dimensions and is called binary kernel slice. Considering the confinement for the independent variables for , the kernel slice is probably unable to completely cover the true binary kernel along this dimension. Given the memory length similar to (6), all variables for th-order kernel slice must be in the range of the memory length ; hence,suggesting that is defined through the cross-correlation function between and . Therefore, if the shift functions of two neighboring slices satisfythat is, the interval between an arbitrary kernel slice of order and another kernel slice of order is less than the length of the prior slice, then a slice overlap occurs. The kernel slices overlapping condition is illustrated in Figure 1.

(a)

(b)

3. Estimate Binary Kernel Slices Using IR m-Sequence

3.1. The Properties of IR m-Sequence

The IR m-sequence of an m-sequence is defined as where is a square wave-like function with alternates 1 and −1. Several useful properties of an IR m-sequence are given as follows [22, 23].

(i) The minimal period of is twice as that of , and satisfies the inverse repeatability, that is,

(ii) The output of a nonlinear system in response to the input can also be modeled by Volterra series expansion. If we dichotomize into an odd-order response , = odd, and even-order response , is even, they satisfy,

(iii) The cross-correlation function of and is zero, that is,

(iv) The autocorrelation of isIf the minimal period of the m-sequence is odd, then ; that is, is also inversely repeated. The proof of property (iv) is given in Appendix A.

(v) IR m-sequence also has the following shift-and-product property, The proof of property (v) can be found in Appendix B. In reference to Volterra series expansion for a nonlinear system, this property for an IR m-sequence implies that the higher-order Volterra operators can be separated into odd- and even-order cases.

3.2. Odd- and Even-Order Kernel Slices for IR m-Sequences

Based on the above properties of the IR m-sequences, we can derive the binary kernel slices in response to an IR m-sequence. Let be the input of the system, and then the output of the th-order nonlinear system expressed in terms of Volterra series expansion is Again, let and , and, using IR m-sequence property (v), the Volterra operator on the input becomesExploiting (20) for the property (v) of the IR m-sequences, we can derive that the cross-correlation function between the m-sequences and odd-order Volterra series term , ( = odd), is zero and that the cross-correlation function between IR m-sequences and even-order Volterra series term ( = even) is also zero; that is, The proof for (23) is given in Appendix C.

We can derive the th-order cross-correlation for IR m-sequence input with the same approach as that of getting (7)–(12) to give the expression of the th-order kernel slices as where, according to the definition of cross-correlation function, the right side member isBy exploiting the property (v) of an IR m-sequence , (25) can be separately formulated for being odd and even, Therefore, (24) becomesEquation (27) indicates that the kernel slices of odd-order exist exclusively in the cross-correlation function between the IR m-sequence and output , and likewise, kernel slices of even-order exist exclusively in the cross-correlation function between the m-sequence and output .

According to (21), which expresses the output in terms of Volterra series expansion, we can rewrite the left-side member of (27) as . Moreover, (23) does not state even-order in the odd-order , or the even-order Volterra kernels are also excluded from the odd-order binary kernel slices. The similar argument can be obtained for the case of even-order binary kernel slices.

4. Simulation Results and Discussion

4.1. Nonlinear Wiener Model Generation

A general nonlinear dynamic system can be represented by a Wiener model consisting of two subsystems in cascade form [24]. This system consists of a dynamic linear subsystem followed by a static nonlinear subsystem , as shown in Figure 2. The output of the dynamic subsystem is where represents the memory length of the system.

For simplicity, we simulate a three-order nonlinear system expressed in the second module . Then, the output isTherefore, the output of the whole nonlinear system is expressed as a high-order convolution of the input and the Volterra kernels asFrom (3), the following relationships between Volterra kernels and the parameter model holdLet , , and , and then the binary kernel slices can be associated with the Volterra kernel for this model [12] which is

In the present study, the memory length , impulse response function , and the third-order polynomial coefficients , , , and are set.

We assume that represents the total length of all the kernel slices spread along the cross-correlation function, as illustrated in Figure 1. To avoid the overlap among these slices, at least the length of the cross-correlation function, , should be larger than , indicating that the degree of the m-sequence should satisfy the condition,where denotes the integer part of .

According to (13), the shift lags are set to start with minimal values , and we can obtain the total slice length for this three-order nonlinear system as for , and the degree of the m-sequence should be to avoid the slice overlap.

4.2. Comparison of m- and IR m-Sequence Inputs

We select an arbitrary eight-degree m-sequence in this identification instance. Figure 3 shows the binary input m-sequence , output signal , and cross-correlation . The estimated kernel slices are plotted in solid trace superimposed on the cross-correlation signal (in dashed trace). The red trace segments indicate the occurrence of slice overlaps. According to the overlap condition defined in (14), a total of 10 overlaps occurred in the cross-correlation function.

The kernel slices estimated for the IR m-sequence input are shown in Figure 4. The odd- and even-order kernel slices are separated into two traces of the cross-correlation, as indicated in (27). All slices are notably separated without any overlap.

The distortion severity due to overlapping does not display in Figure 3 without the true kernels. Therefore, we extract and compare the estimated and the true kernel slices for the second- and third-order systems in Figures 5 and 6, respectively. These are two-dimensional illustration, where the kernel slices with different lags are plotted by projecting them to the main-diagonal direction of that order. Notably, the length of the kernel slices decreases with increasing values of shift lags. The kernel slices with the length less than four data samples were excluded in Figures 5 and 6 for less practical significance.

Six second-order kernel slices estimated by the m-sequence (in read traces) and proposed IR m-sequence (in blue traces) methods are shown in Figure 5. The true or theoretical kernel slices are also given as a benchmark. Four kernel slices determined using the m-sequence evidently deviated from the true values; however, no such distortion was observed for IR m-sequence method.

A series of third-order kernel slices are shown in Figure 6. Similar to Figure 5, IR m-sequence method shows more consistent results with the true values. However, the third-order kernel slices for show a slightly opposite behavior that needs to be accounted for, because no overlap occurs at these affected kernel slices. This inconsistency is only observable at a significantly small scale (see the amplitude scales in Figure 6) caused by approximating the orthogonality of the IR m-sequence and has no appreciable effects upon practical application. Alternatively, increasing the length of the m-sequence will alleviate this problem. Further analysis of this intrinsic property is beyond the scope of the present study and more details can be found in [25, 26].

5. Conclusion

The shift-and-product property of the m- and IR m-sequence is crucial in the derivation of new properties to address the overlap problem for short-length m-sequence. It is apparently not beneficial to use a redundantly higher order m-sequence or to sacrifice the number of the estimated slices using sparse m-sequence. In this study, we alternatively propose an approach by introducing the IR m-sequence. We provide and prove several relevant properties of the IR m-sequence allowing the estimation of the binary kernel slices. By examining the special shift-and-product properties of the IR m-sequence derived for odd and even shifts, the odd- and even-order kernel slices can be separately represented in the cross-correlation functions, such that the chance of overlapping significantly decreases. Furthermore, this separation will be useful in some special applications where only odd- or even-order kernel slices might be of significant interest.

Appendices

A. The Proof of (19)

Given an IR m-sequence , using (15) which relates it to the corresponding m-sequence , we have the autocorrelation functionSince and are uncorrelated, (A.1) becomesSince , it is easy to get that , and then (19) is proved.

B. The Proof of (20)

According to the relationship between and in (15), and the shift-and-product property in (1), the shift-and-product of becomes Since , , we get Equation (B.1) is rewritten as Because the relationship between and its circular shift to lag is , then the left-side member of (B.3) for odd number becomes Substitute it into (B.3), and then (20) is proved.

C. The Proof of (23)

According to the shift-and-product property of IR m-sequence in (20), the th-order Volterra series term becomesIf is odd, the cross-correlation between and is If is even, by the similar process, the cross-correlation between and isAccording to the property (iii) of IR m-sequence in (18) which tells that the cross-correlation between and is zero, we can get that both (C.2) and (C.3) are zero. Equation (23) is thus proved.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (no. 61172033 and no. 61271154). The authors would like to thank the reviewers for their valuable comments and contributions to the improvement of this work.

References

V. Z, Nonlinear Dynamic Modeling of Physiological Systems, Wiley-IEEE Press, Hoboken, NJ, USA, 2004.
R. B. Pinter and B. Nabet, Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks, CRC Press, Boca Raton, Fla, USA, 1992.
B. A. Lavoie, R. Mehta, and A. R. D. Thornton, “Linear and nonlinear changes in the auditory brainstem response of aging humans,” Clinical Neurophysiology, vol. 119, no. 4, pp. 772–785, 2008.
View at: Publisher Site | Google Scholar
M. C.-K. Wu, S. V. David, and J. L. Gallant, “Complete functional characterization of sensory neurons by system identification,” Annual Review of Neuroscience, vol. 29, pp. 477–505, 2006.
View at: Publisher Site | Google Scholar
M. O. Franz and B. Schölkopf, “A unifying view of Wiener and Volterra theory and polynomial kernel regression,” Neural Computation, vol. 18, no. 12, pp. 3097–3118, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
J. J. Eggermont, “Wiener and Volterra analyses applied to the auditory system,” Hearing Research, vol. 66, no. 2, pp. 177–201, 1993.
View at: Publisher Site | Google Scholar
Y. W. Lee and M. Schetzen, “Measurement of the Wiener kernels of a non-linear system by cross-correlation,” International Journal of Control, vol. 2, no. 3, pp. 237–254, 1965.
View at: Google Scholar
S. Orcioni, M. Pirani, and C. Turchetti, “Advances in Lee-Schetzen method for Volterra filter identification,” Multidimensional Systems and Signal Processing, vol. 16, no. 3, pp. 265–284, 2005.
View at: Publisher Site | Google Scholar | MathSciNet
V. Z. Marmarelis and T. W. Berger, “General methodology for nonlinear modeling of neural systems with Poisson point-process inputs,” Mathematical Biosciences, vol. 196, no. 1, pp. 1–13, 2005.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
N. Kolokotronis, G. Gatt, and N. Kalouptsidis, “On the generation of sequences simulating higher order white noise for system identification,” Signal Processing, vol. 84, no. 5, pp. 833–852, 2004.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
R. F. Burkard, M. Don, and J. J. Eggermont, Auditory Evoked Potentials: Basic Principles and Clinical Application, Lippincott Williams & Wilkins, Philadelphia, Pa, USA, 2007.
M. Baldwin and P. Watkin, “Predicting the degree of hearing loss using click auditory brainstem response in babies referred from newborn hearing screening,” Ear and Hearing, vol. 34, no. 3, pp. 361–369, 2013.
View at: Publisher Site | Google Scholar
E. E. Sutter, “A practical nonstochastic approach to nonlinear time-domain analysis,” in Advanced Methods of Physiological Systems Modeling, V. Z. Marmarelis, Ed., pp. 303–315, University of Southern California, Los Angeles, Calif, USA, 1987.
View at: Google Scholar
B. Lineton, O. Kuponiyi, and A. R. D. Thornton, “The effect of stimulus rate and time-separation on Volterra slices of otoacoustic emissions,” Hearing Research, vol. 239, no. 1-2, pp. 34–53, 2008.
View at: Publisher Site | Google Scholar
E. E. Sutter, “Imaging visual function with the multifocal m-sequence technique,” Vision Research, vol. 41, no. 10-11, pp. 1241–1255, 2001.
View at: Publisher Site | Google Scholar
Y. Shi and K. E. Hecox, “Nonlinear system identification by m-pulse sequences: application to brainstem auditory evoked responses,” IEEE Transactions on Biomedical Engineering, vol. 38, no. 9, pp. 834–845, 1991.
View at: Publisher Site | Google Scholar
E. A. Benardete and J. D. Victor, “An extension of the m-sequence technique for the analysis of multi-input nonlinear systems,” in Advanced Methods of Physiological System Modeling, Z. Vasilis and Z. Marmarelis, Eds., pp. 87–110, Springer, Berlin, Germany, 1994.
View at: Google Scholar
H.-W. Chen, C. J. Aine, E. Best et al., “Nonlinear analysis of biological systems using short M-sequences and sparse-stimulation techniques,” Annals of Biomedical Engineering, vol. 24, no. 4, pp. 513–536, 1996.
View at: Publisher Site | Google Scholar
A. H. Tan and K. R. Godfrey, “The generation of binary and near-binary pseudorandom signals: an overview,” IEEE Transactions on Instrumentation and Measurement, vol. 51, no. 4, pp. 583–588, 2002.
View at: Publisher Site | Google Scholar
A. Mitra, “On the construction of M-sequences via primitive polynomials with a fast identification method,” International Journal of Computer Science, vol. 3, no. 3, pp. 158–163, 2008.
View at: Google Scholar
M. Schetzen, “Nonlinear system modeling based on the Wiener theory,” Proceedings of the IEEE, vol. 69, no. 12, pp. 1557–1573, 1981.
View at: Publisher Site | Google Scholar
R. Srinivasan and R. Rengaswamy, “Use of inverse repeat sequence (IRS) for identification in chemical process systems,” Industrial and Engineering Chemistry Research, vol. 38, no. 9, pp. 3420–3429, 1999.
View at: Publisher Site | Google Scholar
G.-B. Stan, J. J. Embrechts, and D. Archambeau, “Comparison of different impulse response measurement techniques,” Journal of the Audio Engineering Society, vol. 50, no. 4, pp. 249–262, 2002.
View at: Google Scholar
F. Giri and E. W. Bai, Block-Oriented Nonlinear System Identification, Springer, Berlin, Germany, 2010.
View at: Publisher Site | MathSciNet
Z. Yen-Jone, “Inverse-repeat m sequence and system identification,” Automatica Sinica, vol. 5, no. 2, pp. 107–115, 1979.
View at: Google Scholar
N. Ream, “Nonlinear identification using inverse-repeat $m$ sequences,” Proceedings of the Institution of Electrical Engineers, vol. 117, no. 1, pp. 213–218, 1970.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2015 Jin-yan Hu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1286

Downloads

1201

Citations