Complexity

Volume 2018, Article ID 4073531, 12 pages

https://doi.org/10.1155/2018/4073531

## Affine Tensor Product Model Transformation

Correspondence should be addressed to József Kuti; uh.adubo-inu.bori@ituk.feszoj

Received 26 October 2017; Accepted 27 December 2017; Published 20 March 2018

Academic Editor: Eulalia Martínez

Copyright © 2018 József Kuti and Péter Galambos. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper introduces the novel concept of Affine Tensor Product (TP) Model and the corresponding model transformation algorithm. Affine TP Model is a unique representation of Linear Parameter Varying systems with advantageous properties that makes it very effective in convex optimization-based controller synthesis. The proposed model form describes the affine geometric structure of the parameter dependencies by a nearly minimum model size and enables a systematic way of geometric complexity reduction. The proposed method is capable of exact analytical model reconstruction and also supports the sampling-based numerical approach with arbitrary discretization grid and interpolation methods. The representation conforms with the latest polytopic model generation and manipulation algorithms. Along these advances, the paper reorganizes and extends the mathematical theory of TP Model Transformation. The practical merit of the proposed concept is demonstrated through a numerical example.

#### 1. Introduction

The importance of polytopic system descriptions is beyond doubt since the development of influential polytopic model-based analysis and synthesis methods initially introduced by Boyd et al. in [1]. These approaches offer a simple way for stability verification and robust or gain-scheduling controller design via Linear Matrix Inequality (LMI) based methods for polytopic Linear Parameter Varying (LPV) and quasi-LPV (qLPV) models.

TP Model Transformation was introduced as a numerical approach to constructing polytopic TP forms of LPV/qLPV models [2] serving as an alternative to analytical procedures such as the sector nonlinearity technique [3]. Furthermore, the separated parameter dependencies within the TP structure can be exploited during the controller design extending the polytopic model-based control analysis and synthesis methods [4, 5].

In the past decade, TP Model Transformation has been matured and became an extensive framework within polytopic model-based control [2, 3, 6]. Former related works (e.g., [7–11]) obtained the polytopic TP Model through the HOSVD-based intermediate TP form [12], although the resulting polytopic model does not really benefit from the properties of the HOSVD-based form such as complexity reduction capability and uniqueness.

A recent paper of the authors [13] established the affine geometric background of polytopic TP Model generation and proposed a direct way to determine the polytopic structures. First, it obtained the affine hulls of the subtensors of the discretized tensor and then the enclosing polytopes were established on the affine subspaces.

The paper proposes the Affine TP Model that substantially improves the polytopic TP Model generation and manipulation methodology by combining the affine geometric interpretations [13] with the benefits of higher-order SVD (HOSVD) based TP Model [2, 12, 14].

Consolidating the affine geometry-based approach, the main contribution of this paper is the introduction of a new intermediate TP Model (like the HOSVD-based form) that provides a unique description of affine geometric properties serving as direct input for polytopic model construction methods (see [13, 15–17]). Furthermore, it reserves all the benefits of the HOSVD-based form: similar uniqueness, compact representation, and capability of complexity reduction. We refer to the new intermediate form as* Affine TP Model*.

The next section discusses the abbreviations and notations used in the paper. Section 3 recalls some concepts of tensor algebra related to polytopic TP modeling; then Section 4 discusses the polytopic form of univariate functions showing its relevance to affine geometrics and introduces the affine SVD. In Section 5, affine SVD is applied to obtain the Affine TP Model. Section 6 describes the application to generate and manipulate polytopic TP Models; then Section 7 shows a simple numerical example. Finally, Section 8 concludes the paper.

#### 2. Notations

The following abbreviations and notations are used within this paper: (q)LPV: (quasi)Linear Parameter Varying LMI: Linear Matrix Inequality SVD: Singular Value Decomposition HOSVD: higher-order singular value decomposition TP Model: Tensor Product Model : scalar values : vectors : matrices : a Hilbert space, in general : elements of , in general , : size matrix of zeros/ones : size identity matrix : dirac-delta (, if ) : sets on : tensors : -mode unfold matrix of tensor : indexing of different matrices, tensors : -mode tensor product : multiple tensor product as : lower and upper bounds for the scalar : convex hull (set of all convex comb.).

#### 3. Basic Concepts

The section briefly discusses the related concepts of tensor algebra, polytopic LPV/qLPV modeling, and the goals of TP Model Transformation introducing the notations that are used in the followings.

##### 3.1. Tensor Algebra

First, the key definitions and properties of tensor algebra of De Lathauwer et al. [18] are recalled and extended to Hilbert spaces by considering multidimensional arrays on a Hilbert space denoted by in general.

They can be multiplied with real matrices along the th index that is called -mode tensor product.

*Definition 1 (-mode tensor product). *The -mode product of a tensor and the matrix , denoted by , is a tensor with size that is given by

The definition implies the following properties.

Lemma 2 (commutativity of -mode tensor products). *Given the tensor and the matrices , (), one has *

Lemma 3 (multiple -mode tensor products). *Given the tensor and the matrices , , one has *

The inner product and norm are defined.

*Definition 4 (inner product and norm of tensors). *The inner product of tensors is defined as Then the Frobenius norm of a tensor is defined as .

To perform other matrix operations (e.g., SVD) along the th index, the tensor can be unfolded to a matrix and restored back to tensor.

*Definition 5 (-mode unfold tensor). *Assume an th-order tensor , where the elements can be described on an orthonormal basis with finite elements; then its -mode matrix unfolding is denoted by with a size of and it contains the th coordinate of element at the position , where

##### 3.2. Hilbert-Space Valued Multivariate Functions

Consider the : function, where is a hyperrectangle on the real numbers and is a Hilbert space in general. The measure of set will be denoted as .

*Definition 6 (inner product and norm). *The inner product of , : functions: we will use the following quantity: then their norms are as follows: .

Along the paper, we will assume that for the considered functions this norm exists and it is finite without mentioning it.

The decompositionwill be called(i)orthonormal, if the weighting functions are orthonormal as ,(ii)homogeneous, if ,(iii)polytopic, if the functions denote convex combinations as

Then, in geometric sense, the vertices construct an enclosing polytope for the image of . Its elements are inside the polytope because they can be described as a convex combination of the vertices. In these cases, letter will denote the weighting functions through the paper.

##### 3.3. Polytopic LPV/qLPV Modeling

Consider the following form of LPV/qLPV models:where(i) denotes the state variables, the control inputs, the disturbances, the measured outputs, and the performance outputs,(ii)it is defined on a hyperrectangular parameter domain:(iii)for the sake of brevity, the parameter-dependent system matrices will be denoted asso we have the function, where denotes the space of real matrices with appropriate size.

That is often extended with delayed inputs, delayed states, and so on according to the dynamics of the investigated system; see [19].

Polytopic models are polytopic decomposition of the system matrix. They are described as convex combinations of so-called vertex system matrices, as and this form allows for using LMI-based control analysis and synthesis methods.

##### 3.4. TP Model Transformation

TP Model Transformation is aimed at transforming the parameter-dependent system matrix into polytopic form with decoupled parameter dependencies, resulting in a nested parameter-wise polytopic representation that is expressed as multiple tensor products.

*Definition 7 (polytopic TP Model). *Polytopic TP Models are (q)LPV models with system matrices:in which(i)the core tensor contains the vertex system matrices of the polytopic model,(ii)the -mode weighting functions denote convex combinations .

Let us recall its expanded form and highlight that it is polytopic for all parameter dependencies because the short TP notation can be extended asfor all .

It is easy to see that this form is a special polytopic model. This way, the polytopic model-based control analysis and synthesis methodology can apply to them. Furthermore, the parameter separated structure can be exploited during control analysis and synthesis; for more details, see [5].

#### 4. Affine Decomposition of Univariate Functions

The section shows the role of affine geometry in the derivation of polytopic decomposition of univariate functions, and it introduces the Affine Singular Value Decomposition to represent the geometric structure in a unique way that will be applied in the Affine TP Model.

##### 4.1. Enclosing Polytope on the Affine Hull

Consider the univariate function, where is a Hilbert space. Denote its image to be enclosed by the polytopic form as

Although the considered Hilbert space can be higher dimensional, there may exist polytopic descriptions with a finite number of vertices. It depends on the dimension of the so-called affine hull that is the minimum dimensional affine subspace which contains every object. It can be expressed as the set of affine combinations of the values of the function

The dimension of the affine hull is called affine dimension and denoted by . Then the elements of the image can be given as the sum of a value on the basis and an offset, by applying homogeneous coordinates aswhere . With this description, the objects are characterized by coordinates on the affine hull.

Obtaining an enclosing polytope for the coordinates in the -dimensional Euclidean space with vertices as the homogeneous coordinates can be expressed as convex combinations of the vertices with weights asand it provides an enclosing polytope for the image set with the following vertices: because it can be described as their convex combinations:

This way, the polytopic description can be constructed for the original image in the space by considering the -dimensional geometric problem.

##### 4.2. Affine Singular Value Decomposition of Univariate Functions

Consider the description on the affine hull in (17) and restrict it to orthogonal bases and homogeneous, orthonormal coordinate functions. Then we can define the following unique form that is called Affine Singular Value Decomposition.

*Definition 8 (affine SVD (ASVD)). *The form represented by (17) is called affine SVD of function if it is a homogeneous, orthonormal decomposition and the elements of the basis are orthogonal and ordered by their norms as which are called singular values.

The decomposition’s uniqueness property is inherited from the uniqueness of SVD.

Lemma 9 (uniqueness of ASVD). *The singular values and the offset are unique.**Now consider the ordered singular values and let denote their multiplicities such thatThen the forms and only these forms are valid decomposition where and are arbitrary real orthogonal matrices with size , respectively.*

*Proof. *These kinds of decomposition are ASVD because(i)by multiplying the orthonormal functions with a orthogonal matrix, they remain orthonormal,(ii)by multiplying the orthogonal values of the same norm with a orthogonal matrix, they maintain their orthogonality and norm as well. This way, the singular values and their order do not change. Only this kind of decomposition is ASVD, because(i)to ensure the and the orthonormality of functions, the offset part cannot change:(ii)the remaining part must be the SVD of function inheriting its uniqueness properties, which results in the structure of .

Obviously, if every singular value is different, only the signs of objects and functions () can be varied, because the lemma allows for only values in these cases.

Lemma 10 (complexity trade-off). *Consider the affine SVD in (17) with singular values, where is the dimension of the affine hull.**The best -dimensional approximation (in terms of the defined norm) can be obtained as*

*Proof. *It was shown in (26) that the average value of function is so it is the best -dimensional approximation.

And if the best -dimensional approximation is known, the best -dimensional can be obtained by adding the a product with maximal possible norm (as in the Eckhart-Young theorem [20]), which is here .

Because the complexity of enclosing polytope generation depends on the dimension of the affine hull, this property allows for its reduction with minimal error in the defined norm.

The following lemma describes the numerical reconstruction assuming a vector function given as a homogeneous, orthonormal decomposition.

Lemma 11 (ASVD from a homogen. orthonorm. decomp.). *Consider the function, which is given as a homogeneous, orthonormal decomposition in matrix form as .**Then ASVD can be obtained as where the matrices , , and come from the SVD computation: omitting the zero singular values and the corresponding columns of singular matrices.*

*Proof. * is orthonormal, because is orthonormal and blockdiag is orthogonal. It is homogeneous because . The values () are orthogonal and ordered by norm from properties of SVD.

#### 5. Definition of Affine Tensor Product Form

This section presents the derivation of polytopic TP forms for multivariate functionsbased on the Affine TP form, which represents the affine geometric structure for all parameter dependency, respectively.

*Definition 12 (Affine TP form). *The following form of function (31)is called Affine TP form, in which the core tensor is on as , the () values are called -mode dimensions, and the -mode expansion of (32) is an ASVD with singular values for all , respectively.

*Remark 13 (ASVD on functions). *The definition exploits the fact that functions with norm in Definition 6 constitute Hilbert spaces. This way, the function can be considered as a univariate function for all , where is the Hilbert space of functions and the ASVD is defined for it.

The polytopic TP form can be obtained by determining enclosing polytopes for all trajectories in the -dimensional spaces for all and applying the following theorem.

Theorem 14 (derivation of polytopic TP form). *If for all the vertices construct enclosing polytopes for trajectories , they can be expressed as (see (19)). Then which is a polytopic TP form.*

*Proof. *From Section 4.1, the uniqueness of the Affine TP form can be characterized by the following theorem.

Theorem 15 (uniqueness). *The singular values are unique; let denote their multiplicities as in (23).**If (32) is an Affine TP form, the following and only the following forms are Affine TP Models: where the matrices are defined as and is a block-diagonal matrix constructed by arbitrary orthogonal matrices with sizes , , and so on as shown in Lemma 9.*

*Proof. *Only these forms are allowed by uniqueness properties of ASVD (see Lemma 9) and their -mode expansions show that these forms are ASVD, so the TP form is affine.

The form enables the -mode dimension reductions with the following error (regarding the defined norm) based on the properties of TP forms on orthonormal weighting functions, which are discussed in the Appendix.

Theorem 16 (complexity reduction). *The reduction of one -mode dimension from to with minimal error in the defined norm can be achieved by omitting the th subtensors of and the corresponding elements of . Then the error is The approximation error of dimension reduction in multiple () parameter dependencies is bounded as*

*Proof. *Construct a tensor with the same sizes as that contains zeros in the omitted subtensors. Then, if , the approximation error can be written as If only one -mode dimension is decreased, the error of the approximation can be written as (based on Lemma A.2) that is minimal as Lemma 10 indicated.

Considering the case when more than one n-mode dimension is decreased, the worst case (equality) of (40) occurs if there are zero elements in the intersection of the omitted subtensors. Otherwise, the error of the approximation is smaller.

Finally, the method is presented for its exact derivation or at least approximate reconstruction.

*Method 17 (numerical reconstruction of Affine TP form). *The first step is to obtain an initial TP form with the desired parameter groupsHere we describe two approaches for it.

*Step 1a* (analytical initial form). If the function is analytically given, the initial form may be constructed analytically.

*Step 1b* (discretization based initial form). The function can be approximated by the TP form as via discretization in general: For each parameter, choose discrete points denoted as and appropriate interpolatory functions (as Lagrange polynomials, piecewise linear/constant functions, etc.).

Then the initial TP form (43) can be constructed to approximate the function by choosing elements of the core tensor denoted by which is the value of function at .

*Step 2* (homogeneous orthonormalization). Determine the homogeneous, orthonormal weighting functions : as to obtain the following orthonormal TP form: where Some examples are Gram-Schmidt orthogonalization [21], the Householder transformation [22–24], or the Givens rotation [25].

*Step 3* (sequential ASVD). Denote the TP form as whose initial value is and for .

Then for index , compute the ASVD of form as (see Lemma 11) and continue with , , and until .

Then the resulting TP form is affine.

*Proof. *For TP forms on orthonormal weighting functions, if is ASVD, then is ASVD as well; see Lemma A.3 of the Appendix.

The method proves the existence of Affine TP forms for cases where the separation of parameter dependencies is possible, and it extends the previous approach by allowing exact analytical separation or the application of discretization with varying density along the parameter domain with different interpolation strategies.

*Remark 18. *The sequential truncation approach (see [26]) can also be applied by using the complexity reductions in iterations of Step 3 in order to decrease the computational cost.

*Remark 19. *By applying SVD instead of ASVD in Step 3 (and optionally simple orthonormalization in Step 2), the method can be used to determine the so-called HOSVD-based TP form as well.

#### 6. Application for LPV/qLPV Models

The results of the previous section are appropriate for system matrices of (q)LPV models (9). By defining the inner product and norm for system matrices as the space constitutes a Hilbert space and the following TP Model can be defined.

*Definition 20 (Affine TP Model). *The system matrix of the (q)LPV model (9) is given in Affine TP form assee Definition 12.

The elements of core tensor are system matrices and the functions are -dimensional trajectories given by homogeneous coordinates.

The uniqueness of the description is inherited from Theorem 15. Complexity (dimension of the affine hull) reduction can be done based on Theorem 16 but it must be mentioned that it does not give guarantee about its distribution along the parameter domain in terms of dynamical effects, and thus, it is not closely related to its dynamical properties in ill-conditioned cases. It means that if the omitted details are not only numerical error (representing essential information about the system dynamics), it is recommended to apply robust design methods taking into account the neglected part as in [27].

Furthermore, it has direct link with polytopic model generation based on Theorem 14.

Corollary 21 (polytopic model generation). *The determination of vertices () for all constructs an enclosing polytope for the trajectory and the weighting functions (interpreting convex combination for all ) in such a way that (as in (19)).**Then the polytopic TP Model (13) can be formalized with weighting functions and core tensor *

There exist numerical methods for enclosing simplex polytope generation (where ) such as the Minimal Volume Simplex Approach [13] and other simplex methods: CNO, IRNO, and SNNN [15, 17]. The classical convex hull methods [28, 29] can also be applied, but they usually result in enclosing polytopes with too many vertices (up to infinity).

Fine-tuning manipulation/optimization is an important technique in polytopic model-based design. Similarly to the polytope generation methods, manipulation techniques are also immediately connectible to the Affine TP Model.

Corollary 22 (polytopic model manipulation). *As manipulation of mode enclosing polytopes, determinate the vertices () and weighting functions for all that constructs an enclosing polytope for the trajectory in such a way that as in (19), taking into account the control design experience with previous enclosing polytopes.**Then the manipulated polytopic TP Model can be formalized as where *

Relevant examples are the manipulation of the constraints in MVS method based on the achievable performance with the previous polytopes (see [13, 30]) or the nonsimplex method where problematic regions are cut off from the polytope [16].

#### 7. Numerical Example

This section discusses a control-related example that gives hands-on insight into a realistic design scenario.

Consider the translational oscillator with an eccentric rotational mass actuator (TORA) system shown in Figure 1. The goal of the control effort is to stabilize its translational motion using a rotational actuator [31–35].