Modeling and Control of Complex Dynamic Systems 2014View this Special Issue
Review Article | Open Access
Daniel D. Silveira, Thiago V. N. Coelho, Alexandre Bessa dos Santos, "Evolution of Black-Box Models Based on Volterra Series", Journal of Applied Mathematics, vol. 2015, Article ID 638978, 8 pages, 2015. https://doi.org/10.1155/2015/638978
Evolution of Black-Box Models Based on Volterra Series
This paper presents a historical review of the many behavioral models actually used to model radio frequency power amplifiers and a new classification of these behavioral models. It also discusses the evolution of these models, from a single polynomial to multirate Volterra models, presenting equations and estimation methods. New trends in RF power amplifier behavioral modeling are suggested.
Modeling nonlinear systems has shown to be a challenge in different areas of science. Most natural phenomena and physical devices present a nonlinear behavior. In this sense, it is very useful to classify nonlinear systems, so the right model can be used for each system.
In , a complete classification of nonlinear systems is given. If any of the following phenomena occurs, a nonlinear dynamic model has to be used:(1)asymmetric responses to symmetric input signal changes (ASYM),(2)generation of higher-order harmonics in response to a sinusoidal input (HARM),(3)input multiplicity, meaning that one steady-state response corresponds to more than one steady-state input (IM),(4)output multiplicity, meaning that one steady-state input corresponds to more than one steady-state output (OM),(5)generation of subharmonics in response to any periodic input (SHAM),(6)highly irregular responses to simple inputs like impulses, steps, or sinusoids (CHAOS),(7)input-dependent stability (IDS).
A nonlinear system is classified due to phenomena presence as follows:(i)mild: ASYM, HARM, and IM,(ii)intermediate: IDS,(iii)strong: OM, SHAM, and CHAOS.
In electrical engineering, signal amplifiers are very often used for different purposes. One of the main uses is for signal transmission, where a power amplifier (PA) is needed. A radio frequency (RF) power amplifier is a typical nonlinear system. Even when the transistor is operating in a quasilinear region, driven with small variance input signals, the output signal has nonlinear components, due to the physics of the transistor.
A PA behavioral model (BM) remains in the mildly nonlinear class. The known PAs to be modeled present these characteristics in normal operation conditions, when tested with sinusoid stimuli. None of the other phenomena (OM, SHAM, CHAOS, or IDS), which imply the need of intermediate or strong nonlinear dynamic models, were observed in amplifier measurements.
This paper will present a classification of BMs and discuss the evolution of BMs based on VS used in the modeling of RF PAs, from some of the simplest models to recent ones reported in the literature.
2. Classification of Power Amplifier Behavioral Models
The classification of PA BMs used in this work is as in :(i)memoryless (ML): the output envelope reacting instantaneously to variations in the input envelope,(ii)linear memory (LM): BMs that account for envelope memory effects attributable to the input and output matching networks’ frequency characteristics,(iii)nonlinear memory (NLM): dynamic interaction of nonlinearities through a dynamic network.
Figure 1 is used by the authors to classify the various BMs. Memoryless models are represented by the block “nonlinear/memoryless.” Linear memory models are models that account for the “linear dynamic”: and blocks (matching networks). Models that care for nonlinear memory contain all previously mentioned blocks and the feedback path with the block , attributed to electrothermal and/or bias circuitry dynamics.
Although this classification was very complete by the time of this paper , further developments in the field were noticed, and so an extension of this classification has to be done. Some models were recently reported:(i)the pruned Volterra series (rVS1) ,(ii)the pruned Volterra series (rVS2) ,(iii)a parallel cascade model (PCM) composed of a static nonlinearity and a reduced Volterra model (PNLrVS) ,(iv)a parallel cascade subsampled reduced Volterra series with the first branch composed of a static nonlinearity and a rVS model and other branches being rVS models, all with the same memory depth (PssVS), as detailed in . The last model (PssVS) is a multirate parallel reduced VS. This model presented the best performance among all BMs reported in the literature, in an extensive comparison presented in .
A timeline of publications related to the accuracy of VS models is presented in Figure 2, based on a search in the database of the IEEE Xplore. This search was focused on PA BMs.
A graphical representation of all these models from the initial classification of nonlinear systems to the modern VS models is presented in Figure 3.
3. Evolution of Power Amplifier Behavioral Models
This section presents the evolution of PA BMs and their equations from nonlinear memoryless models to reduced Volterra Series models.
3.1. Nonlinear Memoryless
The nonlinear part of an amplifier model represents the intermodulation distortion (IMD), or the static part, and is usually composed of polynomials or other nonlinear functions (e.g., tangent-sigmoids, look-up tables). These models do not account for dynamics of the system.
In this section, some of the memoryless nonlinear models will be covered.
3.1.1. Power Series
A nonlinear system can be represented by a power series:where are the polynomial coefficients and is the order.
A simple form to estimate a power series is using linear regression methods, as polynomial coefficients are linear in parameters. The polynomial regression matrix for measurements, a polynomial degree , and the parameter vector is 
Then LS equation can be applied:This regression matrix results in a Hessian with a high condition number (CN), defined as the ratio of the largest to smallest singular value in the singular value decomposition of a matrix . A large CN is not desirable in the estimation process, as it implies that small errors in the input can cause large errors in the output. For very high CN, orthogonalization of the regression matrix is required to find the solution.
The Hessian CN can be improved if orthogonal polynomials are used. These polynomials are derived based on the input signal used in the system. Thus, the regressors are closer to the ideal situation for a Hessian (regressors mutually orthogonal).
For real valued input signals, Chebyshev (derived for single tones) and Hermite (derived for Gaussian distribution) polynomials are typically applied.
3.1.2. Baseband Power Series
Although polynomial LS estimation is a reasonable possibility to calculate the IMD components, it generates also “out-of-band” harmonics, as shown as an example in Figure 4. The numbers above show the respective IMD products (second, third, and so on) of a Taylor series expansion when a two-tone excitation is applied .
These are uninteresting for predistortion purposes, the main objective of behavioral modeling. To solve this problem, the first-zone equivalent (or baseband) polynomial is necessary. It can be derived writing the input signal as 
So, a binomial based expression for can be obtained:
Only the terms where is odd and can contribute for the first-zone output or and . Then (7) can be written as
Using the binomial property and the relation observed in (5),
Finally the first-zone filtered input signal can be found as
The component corresponds to the baseband power series coefficients.
If no bias is present in the input/output signals, the regression matrix for the estimation of the coefficients of the baseband polynomial can be written asThe baseband polynomial can be written in a compact form:For complex Gaussian baseband input signals, a derivation of orthogonal polynomials is found in .
3.1.3. Bessel-Fourier Model
The complex Bessel approximation of a memoryless RF power amplifier is obtained by the periodic extension of the instantaneous voltage transfer characteristics by a complex Fourier series expansion. This derivation was extracted from :where is the input signal and the output signal, both with finite dynamic range, and are Fourier series coefficients. The parameter is determined by the maximum dynamic range of the input, ,which defines the period of the Fourier series periodic extension. Hence, for the general -carrier inputthe output isAnd, employing the Bessel function series approximation,with and , it is possible to write (16) asRearranging some terms,Defining for and (as only the first zonal components will be considered),and denotes the th-order Bessel function of the first kind. The coefficients may be obtained by using a LS approximation.
3.1.4. Look-Up Tables
Look-up tables (LUTs) are the most common type of nonlinear static models in real-world implementations . An advantage in comparison with other methods is the configuration possibility of the interpolation and extrapolation behavior. LUTs also present good accuracy and very fast evaluation. The drawbacks are poor physical interpretation, high number of parameters, and being not continuously differentiable. Linear interpolation is normally used to determine the points among intervals, but also other methods as cubic interpolation and splines are possible .
3.2. Linear Memory
The two-box modeling techniques are a possibility to represent the linear memory of an amplifier. They are also known as modular approaches  or feed-forward block oriented models . They are obtained by combining components from the following two classes: static (or memoryless) nonlinearities and causal, linear time-invariant dynamic subsystems. Parametric and nonparametric modeling methodologies can be used. Flexible arrangements of block structured models in two possibilities are feasible: Wiener model (linear-nonlinear) and Hammerstein model (nonlinear-linear) .
The most frequently used configuration for the linear block of this model is a FIR filter. The nonlinear block is commonly represented by a polynomial . Examples of these structures are shown in Figure 5.
If the linear dynamic block is represented by a FIR filter, the output of this block for the Wiener model is
For the Hammerstein model, the FIR filter output is
If the static nonlinearity block is represented by a power series, the output of this block can be formulated for the Wiener Model and for the Hammerstein Model as follows:
The overall model output is then the combination of these equations for each model:
Equations (25) are a simple way to model a nonlinear amplifier with memory.
3.3. Nonlinear Memory
More complex models are necessary to estimate the nonlinear memory, like parallel models or Volterra series. Examples of these models are parallel cascade models.
This technique is the association in branches of various models (Wiener, Hammerstein, Wiener-Hammerstein, etc.). The overall model structure becomes more complicated with each iteration, as each branch is composed of a single model. The value of the cost function decreases or stays constant with each additional branch . An example of this configuration is seen in Figure 6.
This method combines the following favorable properties:(i)computationally efficient even for high-order models with large memory-bandwidth products,(ii)allowing the direct extraction of the Volterra kernels,(iii)offering the convenience to use different methods for the identification of the linear and nonlinear blocks .
As a drawback, this method is very sensitive to noise if too many paths are used . Consequently, a proper selection of the paths using parametric FOMs and the system order of the nonlinearity should be made, in order to achieve low noise and good convergence models.
Although the best estimation methods to identify the parallel Wiener model’s coefficients would be the nonlinear ones, Korenberg proposed initially linear methods with acceptable results, as described in his paper .
3.4. Volterra Series
Volterra series accounts for a mildly nonlinear class of nonlinear systems and has the property of dynamic interaction of nonlinearities, so it is well suited for the description of PAs.
The finite, discrete VS model is given by where is the kernel of order , and are discrete indices of the sampling interval, and is the memory length. The sampling interval must be selected to cover the needed input/output signal’s bandwidth.
The main disadvantage of a VS based BM is the number of parameters necessary to estimate and consequently to represent the model. A VS model using delay taps needs , , , and parameters for the st, rd, th, and th order kernels, respectively. These values are not practical, since an estimation using so many coefficients is very computational intensive, even for actual computers.
By using the symmetry condition, the complexity of the Volterra kernels as a function of the order of nonlinearity is given by the binomial :where is the number of delay taps used and is the order of the kernel. Using (27), the above cited model is reduced to , , , and parameters. Unfortunately, this equation is valid only for real valued signals.
3.4.1. Complex Valued Baseband Volterra Series
In order to obtain the best model performance, it is necessary to adapt the BMs under study to the modern PA input/output industry standard signals, once these models are designed for linearization purposes. The excitation signals are complex valued, and as a practical issue only first-zone filtered (baseband) equivalent BMs are frequently used, due to the difficulties to implement bandpass models in hardware.
A closed form for determining the number of independent terms for baseband VS using complex signals is the binomial :where is the floor operation.
As an example, the numbers of parameters of a complex valued baseband VS using delay taps are , , , and for the st, rd, th, and th order symmetric kernels. The use of the Volterra kernels symmetry property is necessary in the model extraction process, since it eliminates the linear dependent columns of the kernel to be estimated.
Several techniques are employed to estimate VS. If the system is memoryless, VS are reduced to a Taylor series and can be estimated as described in Section 3.1. If the system has only linear memory, it can be estimated using the techniques listed in Section 3.2. If the system presents only nonlinear memory or linear and nonlinear memory, some strategies described in Section 3.3 can be employed.
As shown above, VS presents a very high number of coefficients. This can lead to ill-conditioned Hessian matrices, as shown in . The best way to estimate a BM using VS is to prune some terms, losing the minimum accuracy as possible. This simplification includes the use of only main diagonals terms of the VS kernels, the popular parallel Hammerstein models (PH) .
3.4.2. Pruned Volterra Series
There are other models that take into account some physical knowledge of the device and include important interactions of the input signal, as in [4, 22, 23]. These are the pruned or reduced VS models, because they include interactions different than the terms in the main diagonal. The accuracy is naturally higher than the PH models, but they also use more coefficients in the model.
3.4.3. Cascade Multirate Pruned Volterra Series
Joining pruning techniques of VS, multirate techniques, and also parallelization of models (cascade), a new model was developed. This model presented different models composing the cascade. The first branch is a nonlinear static block, and the next branches are reduced Volterra series, each one estimated at a different subsampling rate (PssVS). This model and its estimation method are fully explained in , and it is shown in Figure 7.
The second output signal, , is the output of an estimated reduced Volterra series BM. Its input signal is , and its output signal is the first residue, . Then the second residue isSo the th residue for isThe overall output of the PssVS model is described as
This equation is also described as in (33). This equation is linear in parameters and its coefficients can be found using linear regression methods such as least-squares (LS) :The excitation signals are complex valued, and thus a first-zone filtered odd-order model was designed. This approach is expressed by the polynomial basis function showing only odd terms . The input vector is , is the number of branches used in the model, is the NL order of the model, and is the memory depth. A higher order can be used in the static nonlinear branch, as it can also be replaced by any other static nonlinear block. The advantage of this model is that it can account for different memory effects existing in a PA also at different sampling rates. Applying the input signal at different rates emphasizes the flexibility of the model.
A comparison of this model with other models here cited using simulated and measured data obtained from a LDMOS RF PA is firstly presented in , using only one FOM (NMSE). Further on, a comparison was presented in  using five different FOMs, namely, normalized mean square error (NMSE) , normalized root mean square error (NRMSE) , mean absolute error (MAE) , maximal absolute error (MaxAE) , and coefficient of efficiency () . Final results show a superior performance of the PssVS.
These results show a trend in LDMOS RF PA behavioral models that can not be override. Multirate models allow simpler hardware to be used in linearization devices that are the end products of BM. They also present a higher accuracy than any other model reported so far for LDMOS RF PAs. Further efforts in this research direction can reveal even more accurate models that use fewer coefficients with simpler hardware.
This paper presented a classification of nonlinear systems and also a modern classification of behavioral models of RF power amplifiers. Then an evolution of behavioral models was also presented, including all equations that characterize these models. This review showed several models, from basic baseband power series to the recent parallel multirate pruned Volterra series models, commenting also on their accuracy. Remarks about future trends in power amplifiers behavioral models were also made.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by the PPEE-UFJF, http://www.ufjf.br/ppee/, Federal University of Juiz de Fora, http://www.ufjf.br/, Programa de Apoio à Publicação/Pró-reitoria de Pesquisa/Universidade Federal de Juiz de Fora (PROPESQ/UFJF), and Fundação de Amparo a Pesquisa do Estado de Minas Gerais (FAPEMIG), http://www.fapemig.br/.
- R. K. Pearson, “Selecting nonlinear model structures for computer control,” Journal of Process Control, vol. 13, no. 1, pp. 1–26, 2003.
- J. C. Pedro and S. A. Maas, “A comparative overview of microwave and wireless power-amplifier behavioral modeling approaches,” IEEE Transactions on Microwave Theory and Techniques, vol. 53, no. 4, pp. 1150–1163, 2005.
- A. Zhu and T. J. Brazil, “RF power amplifier behavioral modeling using volterra expansion with laguerre functions,” in Proceedings of the IEEE MTT-S International Microwave Symposium, pp. 963–966, June 2005.
- J. Reina-Tosina, C. Crespo-Cadenas, and M. J. Madero-Ayora, “A compact volterra model for power amplifiers with memory,” in Proceedings of the IEEE MTT-S International Microwave Symposium (IMS '09), pp. 1585–1588, IEEE, Boston, Mass, USA, June 2009.
- D. D. Silveira, P. L. Gilabert, P. M. Lavrador et al., “Improvements and analysis of nonlinear parallel behavioral models,” International Journal of RF and Microwave Computer-Aided Engineering, vol. 19, no. 5, pp. 615–626, 2009.
- D. D. Silveira, P. L. Gilabert, A. B. dos Santos, and M. Gadringer, “Analysis of variations of volterra series models for RF power amplifiers,” IEEE Microwave and Wireless Components Letters, vol. 23, no. 8, pp. 442–444, 2013.
- O. Nelles, Nonlinear System Identification, Springer, Berlin, Germany, 2001.
- D. Lichtblau and E. W. Weisstein, “Condition Number,” MathWorld—A Wolfram Web Resource, December 2004, http://mathworld.wolfram.com/ConditionNumber.html.
- J. Vuolevi and T. Rahkonen, Distortion in RF Power Amplifiers, Artech House, Norwood, Mass, USA, 2003.
- M. C. Jeruchim, P. Balaban, and K. S. Shanmugan, Simulation of Communication Systems: Modeling, Methodology, and Techniques, Kluwer Academic Publishers, Norwell, Mass, USA, 2000.
- R. Raich and G. T. Zhou, “Orthogonal polynomial for complex Gaussian processes,” IEEE Transactions on Signal Processing, vol. 52, no. 10, pp. 2788–2797, 2004.
- M. S. O'Droma, “Dynamic range and other fundamentals of the complex Bessel function series approximation model for memoryless nonlinear devices.,” IEEE Transactions on Communications, vol. 37, no. 4, pp. 397–398, 1989.
- Mathworks, “Matlab version 7,” 2005.
- V. Z. Marmarelis, Nonlinear Dynamic Modeling of Physiological Systems, John Wiley & Sons, 2004.
- W. J. Rugh, Nonlinear System Theory—The Volterra/Wiener Approach, Johns Hopkins University Press, Baltimore, Md, USA, 1981.
- T. M. Panicker and V. John Mathews, “Parallel-cascade realizations and approximations of truncated Volterra systems,” IEEE Transactions on Signal Processing, vol. 46, no. 10, pp. 2829–2832, 1998.
- M. J. Korenberg, “Parallel cascade identification and Kernel estimation for nonlinear systems,” Annals of Biomedical Engineering, vol. 19, no. 4, pp. 429–455, 1991.
- M. Schetzen, The Volterra and Wiener Theories of Nonlinear Systems, Krieger Publishing, 1980.
- V. J. Mathews and G. L. Sicuranza, Polynomial Signal Processing, Wiley Interscience, 2000.
- D. D. Silveira and G. Magerl, “Extraction and improvements of a behavioral model based on the wiener-bose structure used for baseband volterra kernels estimation,” in Proceedings of the IEEE MTT-S International Microwave Symposium (IMS '07), vol. 1, pp. 2007–2010, Honolulu, Hawaii, USA, June 2007.
- A. S. Tehrani, H. Cao, S. Afsardoost, T. Eriksson, M. Isaksson, and C. Fager, “A comparative analysis of the complexity/accuracy tradeoff in power amplifier behavioral models,” IEEE Transactions on Microwave Theory and Techniques, vol. 58, no. 6, pp. 1510–1520, 2010.
- A. Zhu, J. C. Pedro, and T. R. Cunha, “Pruning the volterra series for behavioral modeling of power amplifiers using physical knowledge,” IEEE Transactions on Microwave Theory and Techniques, vol. 55, no. 5, pp. 813–820, 2007.
- C. Crespo-Cadenas, J. Reina-Tosina, M. J. Madero-Ayora, and J. Munoz-Cruzado, “A new approach to pruning Volterra models for power amplifiers,” IEEE Transactions on Signal Processing, vol. 58, no. 4, pp. 2113–2120, 2010.
- S. Benedetto and E. Biglieri, Principles of Digital Transmission, Kluwer Academic Publishers, Norwell, Mass, USA, 1999.
- A. Zhu, P. J. Draxler, J. J. Yan, T. J. Brazil, D. F. Kimball, and P. M. Asbeck, “Open-loop digital predistorter for RF power amplifiers using dynamic deviation reduction-based volterra series,” IEEE Transactions on Microwave Theory and Techniques, vol. 56, no. 7, pp. 1524–1534, 2008.
- C. J. Willmott and K. Matsuura, “Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance,” Climate Research, vol. 30, no. 1, pp. 79–82, 2005.
- P. Karras and N. Mamoulis, “One-pass wavelet synopses for maximum-error metrics,” in Proceedings of the 31st International Conference on Very Large Data Bases (VLDB '05), pp. 421–432, September 2005.
- M. J. Hall, “How well does your model fit the data?” Journal of Hydroinformatics, vol. 3, pp. 49–55, 2001.
Copyright © 2015 Daniel D. Silveira et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.