Cyber-Physical ControlView this Special Issue
Affine Tensor Product Model Transformation
This paper introduces the novel concept of Affine Tensor Product (TP) Model and the corresponding model transformation algorithm. Affine TP Model is a unique representation of Linear Parameter Varying systems with advantageous properties that makes it very effective in convex optimization-based controller synthesis. The proposed model form describes the affine geometric structure of the parameter dependencies by a nearly minimum model size and enables a systematic way of geometric complexity reduction. The proposed method is capable of exact analytical model reconstruction and also supports the sampling-based numerical approach with arbitrary discretization grid and interpolation methods. The representation conforms with the latest polytopic model generation and manipulation algorithms. Along these advances, the paper reorganizes and extends the mathematical theory of TP Model Transformation. The practical merit of the proposed concept is demonstrated through a numerical example.
The importance of polytopic system descriptions is beyond doubt since the development of influential polytopic model-based analysis and synthesis methods initially introduced by Boyd et al. in . These approaches offer a simple way for stability verification and robust or gain-scheduling controller design via Linear Matrix Inequality (LMI) based methods for polytopic Linear Parameter Varying (LPV) and quasi-LPV (qLPV) models.
TP Model Transformation was introduced as a numerical approach to constructing polytopic TP forms of LPV/qLPV models  serving as an alternative to analytical procedures such as the sector nonlinearity technique . Furthermore, the separated parameter dependencies within the TP structure can be exploited during the controller design extending the polytopic model-based control analysis and synthesis methods [4, 5].
In the past decade, TP Model Transformation has been matured and became an extensive framework within polytopic model-based control [2, 3, 6]. Former related works (e.g., [7–11]) obtained the polytopic TP Model through the HOSVD-based intermediate TP form , although the resulting polytopic model does not really benefit from the properties of the HOSVD-based form such as complexity reduction capability and uniqueness.
A recent paper of the authors  established the affine geometric background of polytopic TP Model generation and proposed a direct way to determine the polytopic structures. First, it obtained the affine hulls of the subtensors of the discretized tensor and then the enclosing polytopes were established on the affine subspaces.
The paper proposes the Affine TP Model that substantially improves the polytopic TP Model generation and manipulation methodology by combining the affine geometric interpretations  with the benefits of higher-order SVD (HOSVD) based TP Model [2, 12, 14].
Consolidating the affine geometry-based approach, the main contribution of this paper is the introduction of a new intermediate TP Model (like the HOSVD-based form) that provides a unique description of affine geometric properties serving as direct input for polytopic model construction methods (see [13, 15–17]). Furthermore, it reserves all the benefits of the HOSVD-based form: similar uniqueness, compact representation, and capability of complexity reduction. We refer to the new intermediate form as Affine TP Model.
The next section discusses the abbreviations and notations used in the paper. Section 3 recalls some concepts of tensor algebra related to polytopic TP modeling; then Section 4 discusses the polytopic form of univariate functions showing its relevance to affine geometrics and introduces the affine SVD. In Section 5, affine SVD is applied to obtain the Affine TP Model. Section 6 describes the application to generate and manipulate polytopic TP Models; then Section 7 shows a simple numerical example. Finally, Section 8 concludes the paper.
The following abbreviations and notations are used within this paper: (q)LPV: (quasi)Linear Parameter Varying LMI: Linear Matrix Inequality SVD: Singular Value Decomposition HOSVD: higher-order singular value decomposition TP Model: Tensor Product Model : scalar values : vectors : matrices : a Hilbert space, in general : elements of , in general , : size matrix of zeros/ones : size identity matrix : dirac-delta (, if ) : sets on : tensors : -mode unfold matrix of tensor : indexing of different matrices, tensors : -mode tensor product : multiple tensor product as : lower and upper bounds for the scalar : convex hull (set of all convex comb.).
3. Basic Concepts
The section briefly discusses the related concepts of tensor algebra, polytopic LPV/qLPV modeling, and the goals of TP Model Transformation introducing the notations that are used in the followings.
3.1. Tensor Algebra
First, the key definitions and properties of tensor algebra of De Lathauwer et al.  are recalled and extended to Hilbert spaces by considering multidimensional arrays on a Hilbert space denoted by in general.
They can be multiplied with real matrices along the th index that is called -mode tensor product.
Definition 1 (-mode tensor product). The -mode product of a tensor and the matrix , denoted by , is a tensor with size that is given by
The definition implies the following properties.
Lemma 2 (commutativity of -mode tensor products). Given the tensor and the matrices , (), one has
Lemma 3 (multiple -mode tensor products). Given the tensor and the matrices , , one has
The inner product and norm are defined.
Definition 4 (inner product and norm of tensors). The inner product of tensors is defined as Then the Frobenius norm of a tensor is defined as .
To perform other matrix operations (e.g., SVD) along the th index, the tensor can be unfolded to a matrix and restored back to tensor.
Definition 5 (-mode unfold tensor). Assume an th-order tensor , where the elements can be described on an orthonormal basis with finite elements; then its -mode matrix unfolding is denoted by with a size of and it contains the th coordinate of element at the position , where
3.2. Hilbert-Space Valued Multivariate Functions
Consider the : function, where is a hyperrectangle on the real numbers and is a Hilbert space in general. The measure of set will be denoted as .
Definition 6 (inner product and norm). The inner product of , : functions: we will use the following quantity: then their norms are as follows: .
Along the paper, we will assume that for the considered functions this norm exists and it is finite without mentioning it.
The decompositionwill be called(i)orthonormal, if the weighting functions are orthonormal as ,(ii)homogeneous, if ,(iii)polytopic, if the functions denote convex combinations as
Then, in geometric sense, the vertices construct an enclosing polytope for the image of . Its elements are inside the polytope because they can be described as a convex combination of the vertices. In these cases, letter will denote the weighting functions through the paper.
3.3. Polytopic LPV/qLPV Modeling
Consider the following form of LPV/qLPV models:where(i) denotes the state variables, the control inputs, the disturbances, the measured outputs, and the performance outputs,(ii)it is defined on a hyperrectangular parameter domain:(iii)for the sake of brevity, the parameter-dependent system matrices will be denoted asso we have the function, where denotes the space of real matrices with appropriate size.
That is often extended with delayed inputs, delayed states, and so on according to the dynamics of the investigated system; see .
Polytopic models are polytopic decomposition of the system matrix. They are described as convex combinations of so-called vertex system matrices, as and this form allows for using LMI-based control analysis and synthesis methods.
3.4. TP Model Transformation
TP Model Transformation is aimed at transforming the parameter-dependent system matrix into polytopic form with decoupled parameter dependencies, resulting in a nested parameter-wise polytopic representation that is expressed as multiple tensor products.
Definition 7 (polytopic TP Model). Polytopic TP Models are (q)LPV models with system matrices:in which(i)the core tensor contains the vertex system matrices of the polytopic model,(ii)the -mode weighting functions denote convex combinations .
Let us recall its expanded form and highlight that it is polytopic for all parameter dependencies because the short TP notation can be extended asfor all .
It is easy to see that this form is a special polytopic model. This way, the polytopic model-based control analysis and synthesis methodology can apply to them. Furthermore, the parameter separated structure can be exploited during control analysis and synthesis; for more details, see .
4. Affine Decomposition of Univariate Functions
The section shows the role of affine geometry in the derivation of polytopic decomposition of univariate functions, and it introduces the Affine Singular Value Decomposition to represent the geometric structure in a unique way that will be applied in the Affine TP Model.
4.1. Enclosing Polytope on the Affine Hull
Consider the univariate function, where is a Hilbert space. Denote its image to be enclosed by the polytopic form as
Although the considered Hilbert space can be higher dimensional, there may exist polytopic descriptions with a finite number of vertices. It depends on the dimension of the so-called affine hull that is the minimum dimensional affine subspace which contains every object. It can be expressed as the set of affine combinations of the values of the function
The dimension of the affine hull is called affine dimension and denoted by . Then the elements of the image can be given as the sum of a value on the basis and an offset, by applying homogeneous coordinates aswhere . With this description, the objects are characterized by coordinates on the affine hull.
Obtaining an enclosing polytope for the coordinates in the -dimensional Euclidean space with vertices as the homogeneous coordinates can be expressed as convex combinations of the vertices with weights asand it provides an enclosing polytope for the image set with the following vertices: because it can be described as their convex combinations:
This way, the polytopic description can be constructed for the original image in the space by considering the -dimensional geometric problem.
4.2. Affine Singular Value Decomposition of Univariate Functions
Consider the description on the affine hull in (17) and restrict it to orthogonal bases and homogeneous, orthonormal coordinate functions. Then we can define the following unique form that is called Affine Singular Value Decomposition.
Definition 8 (affine SVD (ASVD)). The form represented by (17) is called affine SVD of function if it is a homogeneous, orthonormal decomposition and the elements of the basis are orthogonal and ordered by their norms as which are called singular values.
The decomposition’s uniqueness property is inherited from the uniqueness of SVD.
Lemma 9 (uniqueness of ASVD). The singular values and the offset are unique.
Now consider the ordered singular values and let denote their multiplicities such thatThen the forms and only these forms are valid decomposition where and are arbitrary real orthogonal matrices with size , respectively.
Proof. These kinds of decomposition are ASVD because(i)by multiplying the orthonormal functions with a orthogonal matrix, they remain orthonormal,(ii)by multiplying the orthogonal values of the same norm with a orthogonal matrix, they maintain their orthogonality and norm as well. This way, the singular values and their order do not change. Only this kind of decomposition is ASVD, because(i)to ensure the and the orthonormality of functions, the offset part cannot change:(ii)the remaining part must be the SVD of function inheriting its uniqueness properties, which results in the structure of .
Obviously, if every singular value is different, only the signs of objects and functions () can be varied, because the lemma allows for only values in these cases.
Lemma 10 (complexity trade-off). Consider the affine SVD in (17) with singular values, where is the dimension of the affine hull.
The best -dimensional approximation (in terms of the defined norm) can be obtained as
Proof. It was shown in (26) that the average value of function is so it is the best -dimensional approximation.
And if the best -dimensional approximation is known, the best -dimensional can be obtained by adding the a product with maximal possible norm (as in the Eckhart-Young theorem ), which is here .
Because the complexity of enclosing polytope generation depends on the dimension of the affine hull, this property allows for its reduction with minimal error in the defined norm.
The following lemma describes the numerical reconstruction assuming a vector function given as a homogeneous, orthonormal decomposition.
Lemma 11 (ASVD from a homogen. orthonorm. decomp.). Consider the function, which is given as a homogeneous, orthonormal decomposition in matrix form as .
Then ASVD can be obtained as where the matrices , , and come from the SVD computation: omitting the zero singular values and the corresponding columns of singular matrices.
Proof. is orthonormal, because is orthonormal and blockdiag is orthogonal. It is homogeneous because . The values () are orthogonal and ordered by norm from properties of SVD.
5. Definition of Affine Tensor Product Form
This section presents the derivation of polytopic TP forms for multivariate functionsbased on the Affine TP form, which represents the affine geometric structure for all parameter dependency, respectively.
Definition 12 (Affine TP form). The following form of function (31)is called Affine TP form, in which the core tensor is on as , the () values are called -mode dimensions, and the -mode expansion of (32) is an ASVD with singular values for all , respectively.
Remark 13 (ASVD on functions). The definition exploits the fact that functions with norm in Definition 6 constitute Hilbert spaces. This way, the function can be considered as a univariate function for all , where is the Hilbert space of functions and the ASVD is defined for it.
The polytopic TP form can be obtained by determining enclosing polytopes for all trajectories in the -dimensional spaces for all and applying the following theorem.
Theorem 14 (derivation of polytopic TP form). If for all the vertices construct enclosing polytopes for trajectories , they can be expressed as (see (19)). Then which is a polytopic TP form.
Proof. From Section 4.1, the uniqueness of the Affine TP form can be characterized by the following theorem.
Theorem 15 (uniqueness). The singular values are unique; let denote their multiplicities as in (23).
If (32) is an Affine TP form, the following and only the following forms are Affine TP Models: where the matrices are defined as and is a block-diagonal matrix constructed by arbitrary orthogonal matrices with sizes , , and so on as shown in Lemma 9.
Proof. Only these forms are allowed by uniqueness properties of ASVD (see Lemma 9) and their -mode expansions show that these forms are ASVD, so the TP form is affine.
The form enables the -mode dimension reductions with the following error (regarding the defined norm) based on the properties of TP forms on orthonormal weighting functions, which are discussed in the Appendix.
Theorem 16 (complexity reduction). The reduction of one -mode dimension from to with minimal error in the defined norm can be achieved by omitting the th subtensors of and the corresponding elements of . Then the error is The approximation error of dimension reduction in multiple () parameter dependencies is bounded as
Proof. Construct a tensor with the same sizes as that contains zeros in the omitted subtensors. Then, if , the approximation error can be written as If only one -mode dimension is decreased, the error of the approximation can be written as (based on Lemma A.2) that is minimal as Lemma 10 indicated.
Considering the case when more than one n-mode dimension is decreased, the worst case (equality) of (40) occurs if there are zero elements in the intersection of the omitted subtensors. Otherwise, the error of the approximation is smaller.
Finally, the method is presented for its exact derivation or at least approximate reconstruction.
Method 17 (numerical reconstruction of Affine TP form). The first step is to obtain an initial TP form with the desired parameter groupsHere we describe two approaches for it.
Step 1a (analytical initial form). If the function is analytically given, the initial form may be constructed analytically.
Step 1b (discretization based initial form). The function can be approximated by the TP form as via discretization in general: For each parameter, choose discrete points denoted as and appropriate interpolatory functions (as Lagrange polynomials, piecewise linear/constant functions, etc.).
Then the initial TP form (43) can be constructed to approximate the function by choosing elements of the core tensor denoted by which is the value of function at .
Step 2 (homogeneous orthonormalization). Determine the homogeneous, orthonormal weighting functions : as to obtain the following orthonormal TP form: where Some examples are Gram-Schmidt orthogonalization , the Householder transformation [22–24], or the Givens rotation .
Step 3 (sequential ASVD). Denote the TP form as whose initial value is and for .
Then for index , compute the ASVD of form as (see Lemma 11) and continue with , , and until .
Then the resulting TP form is affine.
Proof. For TP forms on orthonormal weighting functions, if is ASVD, then is ASVD as well; see Lemma A.3 of the Appendix.
The method proves the existence of Affine TP forms for cases where the separation of parameter dependencies is possible, and it extends the previous approach by allowing exact analytical separation or the application of discretization with varying density along the parameter domain with different interpolation strategies.
Remark 18. The sequential truncation approach (see ) can also be applied by using the complexity reductions in iterations of Step 3 in order to decrease the computational cost.
Remark 19. By applying SVD instead of ASVD in Step 3 (and optionally simple orthonormalization in Step 2), the method can be used to determine the so-called HOSVD-based TP form as well.
6. Application for LPV/qLPV Models
The results of the previous section are appropriate for system matrices of (q)LPV models (9). By defining the inner product and norm for system matrices as the space constitutes a Hilbert space and the following TP Model can be defined.
The elements of core tensor are system matrices and the functions are -dimensional trajectories given by homogeneous coordinates.
The uniqueness of the description is inherited from Theorem 15. Complexity (dimension of the affine hull) reduction can be done based on Theorem 16 but it must be mentioned that it does not give guarantee about its distribution along the parameter domain in terms of dynamical effects, and thus, it is not closely related to its dynamical properties in ill-conditioned cases. It means that if the omitted details are not only numerical error (representing essential information about the system dynamics), it is recommended to apply robust design methods taking into account the neglected part as in .
Furthermore, it has direct link with polytopic model generation based on Theorem 14.
Corollary 21 (polytopic model generation). The determination of vertices () for all constructs an enclosing polytope for the trajectory and the weighting functions (interpreting convex combination for all ) in such a way that (as in (19)).
Then the polytopic TP Model (13) can be formalized with weighting functions and core tensor
There exist numerical methods for enclosing simplex polytope generation (where ) such as the Minimal Volume Simplex Approach  and other simplex methods: CNO, IRNO, and SNNN [15, 17]. The classical convex hull methods [28, 29] can also be applied, but they usually result in enclosing polytopes with too many vertices (up to infinity).
Fine-tuning manipulation/optimization is an important technique in polytopic model-based design. Similarly to the polytope generation methods, manipulation techniques are also immediately connectible to the Affine TP Model.
Corollary 22 (polytopic model manipulation). As manipulation of mode enclosing polytopes, determinate the vertices () and weighting functions for all that constructs an enclosing polytope for the trajectory in such a way that as in (19), taking into account the control design experience with previous enclosing polytopes.
Then the manipulated polytopic TP Model can be formalized as where
Relevant examples are the manipulation of the constraints in MVS method based on the achievable performance with the previous polytopes (see [13, 30]) or the nonsimplex method where problematic regions are cut off from the polytope .
7. Numerical Example
This section discusses a control-related example that gives hands-on insight into a realistic design scenario.
Consider the translational oscillator with an eccentric rotational mass actuator (TORA) system shown in Figure 1. The goal of the control effort is to stabilize its translational motion using a rotational actuator [31–35].
The equation of motion is usually reformulated in the following dimensionless form: where where denotes the dimensionless translational position, the dimensionless input, dimensionless time, and the coupling parameter.
The nonlinear ODE is used for the purpose of constructing the qLPV model; the state variables are chosen as and the parameters as
Then the constructed qLPV realization readswhere and here the domain is considered with value.
In order to obtain the Affine TP form of function (59), the parameter dependencies are separated leading to an initial TP form with the following weighting functions: performing Step of Method 17. After orthogonalization and sequential ASVD, we get the affine form where the -mode dimensions are and and the corresponding weighting functions are depicted in Figure 2. The singular values: , , , and . (By applying discretization and interpolator functions, numerically reconstructed approximations of this TP form can be obtained.)
The enclosing polytope generation for dependency is trivial, because it is a one-dimensional problem. The vertices: and .
The three-dimensional problem of dependency is more challenging. The methods for generation of the enclosing polytope can be applied as MVS (or SNNN, CNO); see Section 6. Figure 3 shows the resulting tetrahedron enclosing polytope and Figure 4 the weighting functions (denoting convex combinations) and the vertices are
The resulting polytopic TP Model has two parameter dependencies, and it has the following general form:where
For the sake of brevity, only the quadratic stabilization via state feedback problem is recalled and applied. To exploit the separated parameter dependencies, the controller-candidate depends only on the first parameter as Then the closed-loop system is stable if there exist symmetric matrix and matrices such that and the gains of the state feedback are .
Here the problem is feasible with gains:
The proposed Affine TP Model Transformation is a significant development in polytopic model-based control providing a general yet practically advantageous methodology for polytopic model generation. The unique Affine TP Model as a central concept serves as starting point for complexity reduction, polytopic model creation, and various polytope manipulation/optimization approaches helping to fully exploit the directly applicable powerful LMI-based synthesis methods. The most important benefits of the proposed intermediate TP form are the geometrically appropriate representation of the LPV structure in each dimension and the capability of dimension reduction with minimal error and low computational cost. In addition to the theoretical discussion, for the sake of technical completeness, an illustrative numerical example was provided to clearly show the practical merit of the Affine TP form.
In some sense, the paper sums up and consolidates the theoretical basis of TP Model Transformation that has been evolved in the past decade through the contribution of a broader research community.
Mathematical Background of Affine TP Form
First, the following lemma highlights important properties of orthonormal decomposition.
Lemma A.1 (inner product and norm of orthonormal decomp.). If functions are given with the same orthonormal weighting functions, their inner product and norm can be computed as
This property appears in orthonormal TP forms in the following way.
Lemma A.2 (inner product and norm of orthonormal TP forms). If there are two TP functions given on the same orthonormal weighting function system as their inner product can be obtained as Furthermore, their norm can be derived as
This way, the functions’ orthogonality depends only on the orthogonality of the core tensors. Based on this property, the following lemma formalizes an important property of the Affine TP form.
Lemma A.3 (-mode ASVD of orthonormal TP forms). If the weighting functions of TP form are orthonormal, the following statements are equivalent for all :(i)The following form is an ASVD along parameter(ii)The form is an ASVD along parameterFurthermore, their singular values are equal.
Proof. The requirements for the weighting functions are the same and the inner products of the bases are also equal because from Lemma A.2 this way, their orthogonality, order, and norms are the same.
Conclusively, the -mode singular values can be obtained as norm of the -mode subtensors of the core tensor and the ASVD on parameter dependency is invariant for inner transformations among orthonormal decomposition on other parameter dependencies.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
The authors thankfully acknowledge the financial support of this work by the ÚNKP-16-3 and ÚNKP-16-4 New National Excellence Program of the Ministry of Human Capacities and the support of the Doctoral School of Applied Informatics and Applied Mathematics of Óbuda University and Research and Innovation Center of Óbuda University.
K. Tanaka and H. O. Wang, “Fuzzy control systems design and analysis a linear matrix inequality approach,” in 1em plus 0.5em minus 0.4em, Wiley, New York, 2001.View at: Google Scholar
J. Kuti, P. Galambos, and P. Baranyi, “Polytopic TP Model based control analysis and synthesis concept,” IFAC, p. accepted, 2017.View at: Google Scholar
G. G. Angelis, System analysis, modelling and control with polytopic linear models [Ph.D. thesis], Technische Universiteit Eindhoven, 2001, Ph.D. dissertation.
P. Baranyi, L. Szeidl, and P. Várlaki, “Numerical reconstruction of the HOSVD based canonical form of polytopic dynamic models,” in Proceedings of the INES 2006: 10th International Conference on Intelligent Engineering Systems 2006, pp. 196–201, gbr, June 2006.View at: Google Scholar
P. Baranyi, Y. Yam, and P. Várlaki, “Tensor Product Model Transformation in Polytopic Model-Based Control,” in 1em plus 0.5em minus 0.4em Taylor, Francis Group, 4em Taylor, 2013.View at: Google Scholar
J. Kuti, P. Galambos, and P. Baranyi, “Non-simplex enclosing polytope generation concept for Tensor Product model transformation based controller design,” in Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016, pp. 3368–3373, Hungary, October 2016.View at: Publisher Site | Google Scholar
C. Briat, Linear parameter-varying and time-delay systems, vol. 3 of Advances in Delays and Dynamics, Springer, Heidelberg, 2015.View at: MathSciNet
J. Kuti, P. Galambos, P. Baranyi, and P. Varlaki, “A Hands-On Demonstration of Control Performance Optimization Using Tensor Product Model Transformation and Convex Hull Manipulation,” in Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, SMC 2015, pp. 2609–2614, Hong Kong, October 2015.View at: Publisher Site | Google Scholar