Mathematical Modeling, Analysis, and Advanced Control of Complex Dynamical SystemsView this Special Issue
Research Article | Open Access
Frequency Weighted Model Order Reduction Technique and Error Bounds for Discrete Time Systems
Model reduction is a process of approximating higher order original models by comparatively lower order models with reasonable accuracy in order to provide ease in design, modeling and simulation for large complex systems. Generally, model reduction techniques approximate the higher order systems for whole frequency range. However, certain applications (like controller reduction) require frequency weighted approximation, which introduce the concept of using frequency weights in model reduction techniques. Limitations of some existing frequency weighted model reduction techniques include lack of stability of reduced order models (for two sided weighting case) and frequency response error bounds. A new frequency weighted technique for balanced model reduction for discrete time systems is proposed. The proposed technique guarantees stable reduced order models even for the case when two sided weightings are present. Efficient technique for frequency weighted Gramians is also proposed. Results are compared with other existing frequency weighted model reduction techniques for discrete time systems. Moreover, the proposed technique yields frequency response error bounds.
Model reduction has played a significant role in modern control system design and caught a lot of attention in the last few decades [1–5]. It is desirable that reduced order model preserves the fundamental properties of original system like stability, passivity, and so forth. Moreover, the approximation error between original and reduced order system is required to be small. Balanced truncation  is prominent model reduction scheme, which not only ensures stability of reduced order systems but also provides frequency response a priori error bounds. Other schemes like Hankel norm approximation , Pade approximation , Krylov technique [9, 10], linear matrix inequality (LMI) technique [11, 12], and so forth, are also useful for model reduction. Hankel norm approximation has complex implementation and does not preserve steady state . Pade and Krylov approximation sometimes provide unstable reduced order models and there exist no global error bounds [14, 15]. LMI technique is based on mathematical iterative methods (i.e., convex optimization and bisection algorithm); therefore, much computational power is consumed . However, LMI technique has been applied on various model reduction problems for different types of systems (including time delay , discrete state delay [18, 19], switched hybrid , and nonlinear stochastic ). Applications of model reduction are not only restricted to control engineering but also find utility in medical  and text summarization  areas, and so forth. Most model reduction algorithms tend to minimize the reduction error over the whole frequency range; however there are certain situations (like controller reduction ), wherein the approximation error is more critical over a certain band of frequencies.
Enns  has enhanced the balanced truncation  to incorporate frequency weights for model reduction of higher order systems. This technique can work with input, output, and two sided weightings. However, in two sided weighting case, this technique may give unstable reduced order models . To circumvent instability issue in the presence of two sided weightings, many techniques appear in the literature (including Lin and Chiu , Wang et al. , Varga and Anderson , Ghafoor and Sreeram , etc.).
In Lin and Chiu  technique weightings are strictly proper. It was improved to include more general proper weightings in . Varga and Anderson  technique yields proper model for strictly proper systems also. Ghafoor and Sreeram  technique is a parameterized technique. Wang et al.'s technique is relatively useful, since other techniques [27, 29] are not applicable for controller order reduction. Moreover, Wang et al.'s technique yields easily computable expression for a priori error bounds.
Various partial fraction based techniques appear in the literature [31–35] that works for continuous as well as discrete time systems. Unfortunately, most of these techniques yield large frequency response error  as compared to Enns technique. However,  incorporates free parameters to reduce the approximation error.
Most frequently, frequency weighted model reduction problem is treated in continuous time; however, there are few papers (like [36–38]) which deal with this problem explicitly in discrete time. Sahlan et al.'s  technique (discrete time version of ) is a modified version of Lin and Chiu  technique. Campbell et al.'s  technique is discrete time counterpart of Wang et al.'s  technique, which not only provides stability for two sided case but also gives easily computable error bounds. Campbell et al.'s  technique involves taking absolute values of eigenvalues. This may introduce a large change to the system and hence a larger error if it contains some negative eigenvalues. Varga and Anderson's  tend to minimize the distance between Enns and Campbell et al.'s techniques Gramians by eliminating negative eigenvalues.
In this work, a technique is developed for frequency weighted balanced model order reduction for discrete time systems. The large change in eigenvalues is avoided by yielding similar effect on all eigenvalues. The stability is guaranteed even for double sided weighting. The proposed technique provides comparable frequency response error and yields easily computable a priori error bounds. Numerical examples are given to show the usefulness and comparison of proposed technique with the existing frequency weighted balanced reduction techniques.
Consider a stable full order original system with transfer function , a stable input weighting system with input transfer function , and a stable output weighting system with output transfer function ; the augmented systems are given by where
Let the Gramians satisfy the following Lyapunov equations:
Expanding the (1,1) and (2,2) blocks of above equations, we get where
2.1. Enns Technique 
Let be contragredient matrix obtained as where and . By transforming and then partitioning the original system, we have where . The reduced order system is obtained as follows: .
Remark 1. It is not guaranteed to ensure that and ; the reduced order models obtained using Enns technique may not remain stable for both sided weightings.
2.2. Campbell et al.’s Technique 
Campbell et al.’s  (a discrete time version of ) guarantees the positive semidefiniteness of symmetric matrices and to ensure stability. Let the new controllability and observability Gramians, respectively, be calculated by solving the following Lyapunov equations: which are used to obtain contragredient matrix as where and , and . The fictitious input and output matrices shown in the above Lyapunov equations are defined as and , respectively. Since the expressions , , , and are calculated by orthogonal eigen decomposition and , where , , and . The reduced order systems are calculated by transforming and then partitioning the original system.
Remark 2. The stability of reduced order models in the presence of both input and output weightings is guaranteed and the following error bound holds  where and .
2.3. Varga and Anderson's Technique 
Note that the Gramians satisfy and . For minimizing the distances between the Gramians, and , Varga and Anderson proposed the following technique.
Let new controllability and observability Gramians and , respectively, be calculated as the solutions to Lyapunov equations which are used obtain contragredient matrix as where , and , , . The new fictitious input and output matrices in the above Lyapunov equations are defined as and , respectively. The terms , , , and are calculated from the orthogonal eigen decomposition of symmetric matrices where , , , , , , , .
The reduced order systems are calculated by transforming and then partitioning the original system.
Remark 3. The stability of the reduced system is guaranteed and the following error bound holds  where and .
3. Main Results
In Campbell et al.’s  technique, the symmetric matrices and are guaranteed positive/semipositive definite by taking the square root of absolute values of the eigenvalues obtained by eigen decomposition of symmetric matrices and . This may lead to a large change in some eigenvalues and may not affect other eigenvalues. Although in Varga and Anderson's  technique, this large change was slightly improved by eliminating negative eigenvalues, but the problem persists with the other eigenvalues. In the following, a new technique is proposed in which a similar effect on all eigenvalues of indefinite matrices and guarantees stability, error bound, and improved frequency response error.
3.1. Proposed Technique
Let a new controllability and observability Gramians, respectively, be calculated by solving the following Lyapunov equations:
The matrices and are the new fictitious input and output matrices, respectively, and are defined as
The terms , , , and are calculated by the orthogonal eigen decomposition of symmetric matrices and , where , , , and .
Let a contragradient transformation matrix be obtained as where , and , , . The reduced order system is calculated by transforming and partitioning the original system.
Remark 4. Since , , and , therefore, the realization is minimal. Moreover, the reduced order models are stable.
Proof. We show proof of (i) (whereas (ii) and (iii) are special cases of (i)). Since the rank conditions and are satisfied, the relationships and hold. By partitioning , and then substituting , , respectively, yields If is reduced order model obtained by partitioning a balanced realization , we have [7, 39] Therefore,
Remark 6. For the case when symmetric matrices and , then and . However, when matrices and are indefinite, then and . Moreover, frequency weighted Hankel singular values satisfy .
Remark 7. For the case when input weights are co-inner and output weights are inner , then and , where and are unweighted Gramians defined as
3.2. Computational Aspects
The frequency weighted balanced truncation model reduction techniques balance the original system and then truncate the balanced realization to get the desired reduced order system. The balancing procedure involves computation of transformation matrix from controllability and observability Gramians. Sometimes these matrices become numerically low rank especially in large scale systems (possibly) due to rapid decay of their eigenvalues . Due to this reason, balancing procedure becomes inefficient. Accuracy enhancing techniques for different frequency weighted model reduction techniques appear in [4, 29].
For unweighted case, Hammarling's technique  is used to obtained Cholesky factors of Gramian matrices from original system realization without actually computing controllability and observability Gramian matrices, respectively.
In frequency weighted techniques, Cholesky factors of the Gramian matrices are obtained from the augmented system realizations. Let and be the Cholesky factors of the augmented system Gramians matrices and of (4) and (5), respectively,
By making use of Cholesky factors and calculated above, the Cholesky factors corresponding to Gramians in frequency weighted model reduction techniques like Enns , Campbell et al.'s , Varga and Anderson's , and proposed technique can be obtained as follows:
(1) Enns Technique. The Cholesky factors and satisfy 
(2) Campbell et al.'s Technique. The Cholesky factors and satisfy and .
(3) Varga and Anderson's Technique. The Cholesky factors and satisfy and .
(4) Proposed Technique. The Cholesky factors and satisfy and .
In the following we establish a relationship between Cholesky factors of Gramian matrices used in Enns and proposed techniques. Equations (18) and (19) can be expressed as Since By using Hammarling technique to calculate Cholesky factors of Gramians and from realization , we can write and . Therefore, frequency weighted controllability (18) and observability (19) Gramians can be expressed as
Remark 9. Note that, Cholesky factors for Enns and proposed technique are computed directly from augmented system realization using Hammarling technique without calculating augmented system realization Gramian matrices and .
4. Illustrative Examples
In this section, using numerical illustrative examples we show the usefulness of the proposed technique in comparison with existing frequency weighted balanced model reduction techniques for discrete time systems. Note that, proposed work deals with frequency weighted model reduction problem for discrete time systems, therefore, comparison is done with existing frequency weighted balanced model reduction techniques only.
Example 1. Consider (example C appeared in ) a 4th order stable discrete time system
with the following weightings
The first order reduced model obtained by Enns  technique is unstable while reduced order model obtained by Campbell et al.'s, Varga and Anderson's,and proposed techniques is stable yielding frequency response errors , , and , respectively. Note that, proposed technique provides stability with relatively lower error when compared to other techniques.
Example 2. Consider a 6th order stable low pass digital elliptic filter with dB of peak-to-peak ripple and a minimum stopband attenuation of dB represented by with the following input and output weightings, respectively,
Table 1 gives the comparison of error and error bounds for reduced order systems obtained by Enns, Campbell et al.'s, Varga and Anderson's, and proposed techniques for the input and two sided weighting cases. Note that, the proposed technique mostly yields lower error as compared to other techniques.
Example 3. Consider a 4th order stable discrete time system 
with the following input weighting:
Table 2 gives the comparison of error and error bounds for reduced order systems obtained by Enns, Campbell et al.'s Varga and Anderson's and proposed techniques for the input weighting case. Note that, the proposed technique compares well and yields relatively lower error as compared to other techniques.
Example 4. Consider a 4th order stable low pass digital Chebychev type 1 filter with 0.1 dB of peak-to-peak ripples in the passband represented by with the following output weighting:
Table 3 gives the comparison of error and error bounds for reduced order systems obtained by Enns, Campbell et al.'s Varga and Anderson's and proposed techniques for output weighting. Note that, the proposed technique compares well and yields relatively lower error as compared to other techniques.
A new frequency weighted technique for model reduction of discrete time systems is explored. The reduced order models obtained in the presence of input, output, and two sided weightings are stable. A comparison with existing schemes shows that proposed technique provides comparable results (mostly produces lower error) for reduced order models.
Conflict of Interests
The authors declare that there is no conflict of interests.
- K. Zhou, J. C. Doyle, and K. Glover, Robust and Optimal Control, Prentice Hall, New York, NY, USA, 1996.
- S. Gugercin and A. C. Antoulas, “A survey of model reduction by balanced truncation and some new results,” International Journal of Control, vol. 77, no. 8, pp. 748–766, 2004.
- A. C. Antoulas, Approximation of Large-Scale Dynamical Systems, vol. 6, SIAM, Philadelphia, Pa, USA, 2005.
- A. Ghafoor and V. Sreeram, “A survey/review of frequency-weighted balanced model reduction techniques,” Journal of Dynamic Systems, Measurement and Control, vol. 130, no. 6, Article ID 061004, 16 pages, 2008.
- P. Benner, S. Gugercin, and K. Willcox, “A survey of model reduction methods for parametric systems,” Tech. Rep. MPIMD/13-14, Max Planck Institute Magdeburg Preprint, Magdeburg, Germany, 2013.
- B. C. Moore, “Principal component analysis in linear systems: controllability, observability, and model reduction,” IEEE Transactions on Automatic Control, vol. 26, no. 1, pp. 17–32, 1981.
- K. Glover, “All optimal Hankel-norm approximations of linear multivariable systems and their -error bounds,” International Journal of Control, vol. 39, no. 6, pp. 1115–1193, 1984.
- Z. Bai and R. W. Freund, “A partial Padé-via-Lanczos method for reduced-order modeling,” Linear Algebra and Its Applications, vol. 332–334, pp. 139–164, 2001.
- S. Gugercin, “An iterative SVD-Krylov based method for model reduction of large-scale dynamical systems,” Linear Algebra and Its Applications, vol. 428, no. 8-9, pp. 1964–1986, 2008.
- P. Benner, T. Breite, and T. Damm, “Krylov subspace methods for model order reduction of bilinear discrete-time control systems,” Proceedings in Applied Mathematcs and Mechanics, vol. 1, no. 10, pp. 601–602, 2010.
- S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, Philadelphia, Pa, USA, 1994.
- P. Gahinet and P. Apkarian, “Linear matrix inequality approach to control,” International Journal of Robust and Nonlinear Control, vol. 4, no. 4, pp. 421–448, 1994.
- T. Bechtold, E. B. Rudnyi, and J. G. Korvink, Fast Simulation of Electro-Thermal MEMS, Springer, Berlin, Germany, 2007.
- D. K. Kumar, S. K. Nagar, and J. P. Tiwari, “Model order reduction of interval systems using mihailov criterion and factor division method,” International Journal of Computer Applications, vol. 28, no. 11, 2011.
- B. Besselink, U. Tabak, A. Lutowska et al., “A comparison of model reduction techniques from structural dynamics, numerical mathematics and systems and control,” Journal of Sound and Vibration, vol. 332, no. 19, pp. 4403–4422, 2013.
- C. Y. L. Dick, Multiplicative H∞ model reduction and fixed order output feedback controller [thesis], University of Hong Kong, Hong Kong, 2009.
- H. Gao, J. Lam, C. Wang, and S. Xu, “ model reduction for discrete time-delay systems: delay-independent and dependent approaches,” International Journal of Control, vol. 77, no. 4, pp. 321–335, 2004.
- L. Wu, P. Shi, H. Gao, and C. Wang, “ mode reduction for two-dimensional discrete state-delayed systems,” IEE Proceedings: Vision, Image and Signal Processing, vol. 153, no. 6, pp. 769–784, 2006.
- L. Wu, X. Su, P. Shi, and J. Qiu, “Model approximation for discrete-time state-delay systems in the TS fuzzy framework,” IEEE Transactions on Fuzzy Systems, vol. 19, no. 2, pp. 366–378, 2011.
- L. Wu and W. X. Zheng, “Weighted model reduction for linear switched systems with time-varying delay,” Automatica, vol. 45, no. 1, pp. 186–193, 2009.
- X. Su, L. Wu, P. Shi, and Y. D. Song, “ model reduction of Takagi-Sugeno fuzzy stochastic systems,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 42, no. 6, pp. 1574–1585, 2012.
- K. Zuhtuogullari, N. Allahvardi, and N. Arikan, “Genetic algorithm and rough sets based hybrid approach for reduction of the input attributes in medical systems,” International Journal of Innovative, Computing Information & Control, vol. 9, no. 7, pp. 3015–3037, 2013.
- N. H. T. Thu and Q. N. Huu, “A supervised learning method combine with dimensionality reduction in Vietnamese text summarization,” International Journal of Innovative, Computing Information & Control, vol. 9, no. 12, pp. 4903–4915, 2013.
- B. D. O. Anderson and Y. Liu, “Controller reduction: concepts and approaches,” IEEE Transactions on Automatic Control, vol. 34, no. 8, pp. 802–812, 1989.
- D. F. Enns, “Model reduction with balanced realizations: an error bound and a frequency weighted generalization,” in Proceedings of the 23rd IEEE Conference on Decision and Control, vol. 23, pp. 127–132, Las Vegas, Nev, USA, 1984.
- V. Sreeram, B. D. O. Anderson, and A. G. Madievski, “New results on frequency weighted balanced reduction technique,” in Proceedings of the American Control Conference, vol. 6, pp. 4004–4009, Seattle, Wash, USA, June 1995.
- C.-A. Lin and T.-Y. Chiu, “Model reduction via frequency weighted balanced realization,” Control Theory and Advanced Technology, vol. 8, no. 2, pp. 341–351, 1992.
- G. Wang, V. Sreeram, and W. Q. Liu, “A new frequency-weighted balanced truncation method and an error bound,” IEEE Transactions on Automatic Control, vol. 44, no. 9, pp. 1734–1737, 1999.
- A. Varga and B. D. O. Anderson, “Accuracy-enhancing methods for balancing-related frequency-weighted model and controller reduction,” Automatica, vol. 39, no. 5, pp. 919–927, 2003.
- A. Ghafoor and V. Sreeram, “Partial-fraction expansion based frequency weighted model reduction technique with error bounds,” IEEE Transactions on Automatic Control, vol. 52, no. 10, pp. 1942–1948, 2007.
- V. Sreeram and S. Sahlan, “Improved results on frequency-weighted balanced truncation and error bounds,” International Journal of Robust and Nonlinear Control, vol. 22, no. 11, pp. 1195–1211, 2012.
- U. M. Al-Saggaf and G. F. Franklin, “Model reduction via balanced realizations: an extension and frequency weighting techniques,” IEEE Transactions on Automatic Control, vol. 33, no. 7, pp. 687–692, 1988.
- G. A. Latham and B. D. O. Anderson, “Frequency-weighted optimal Hankel-norm approximation of stable transfer functions,” Systems and Control Letters, vol. 5, no. 4, pp. 229–236, 1986.
- Y. S. Hung and K. Glover, “Optimal Hankel-norm approximation of stable systems with first-order stable weighting functions,” Systems and Control Letters, vol. 7, no. 3, pp. 165–172, 1986.
- V. Sreeram, S. Sahlan, W. M. W. Muda, T. Fernando, and H. H. C. Iu, “A generalised partial-fraction-expansion based frequency weighted balanced truncation technique,” International Journal of Control, vol. 86, no. 5, pp. 833–843, 2013.
- S. Sahlan, R. A. Rahim, and V. Sreeram, “New results of frequency weighted balanced truncation technique on Schur decomposition,” in Proceedings of the 6th IEEE Conference on Industrial Electronics and Applications (ICIEA '11), pp. 113–117, Beijing, China, June 2011.
- K. Campbell, V. Sreeram, and G. Wang, “A Frequency-weighted discrete system balanced truncation method and an error bound,” in Proceedings of the American Control Conference, vol. 4, pp. 2403–2404, Chicago, Ill, USA, June 2000.
- A. Varga and B. D. O. Anderson, “Accuracy enhancing methods for the frequency-weighted balancing related model reduction,” in Proceedings of the 40th IEEE Conference on Decision and Control (CDC '01), vol. 4, pp. 3659–3664, Orlando, Fla, USA, December 2001.
- U. M. Al-Saggaf and G. F. Franklin, “An error bound for a discrete reduced order model of a linear multivariable system,” IEEE Transactions on Automatic Control, vol. 32, no. 9, pp. 815–819, 1987.
- S. Sahlan, Frequency weighted model order reduction techniques with error bounds [Ph.D. thesis], University of Western Australia, Perth, Australia, 2009.
- S. J. Hammarling, “Numerical solution of the stable, non-negative definite Lyapunov equation,” IMA Journal of Numerical Analysis, vol. 2, no. 3, pp. 303–323, 1982.
- A. Ghafoor and V. Sreeram, “Model reduction via limited frequency interval gramians,” IEEE Transactions on Circuits and Systems I, vol. 55, no. 9, pp. 2806–2812, 2008.
Copyright © 2014 Muhammad Imran et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.