Abstract

Commutative symmetric operator families of the so-called ??+_-class are considered in Krein spaces. It is proved that the restriction of a family of this type on a special kind of invariant subspace is similar to a family of operators adjoint to multiplication operators by scalar functions acting on a suitable function space.

1. Introduction

In the well-known monograph of Colojoara and Foias [1], it is mentioned (in Chapter 5, Corollary 5.7) that ??-unitary and ??-self-adjoint operators in Pontrjagin spaces give examples of generalized spectral operators. Actually, it is clear that this observation can be applied also to many operator classes in Krein spaces, so Operator Theory in Krein spaces is a good laboratory where different methods of general Operator Theory can be tested. One of these methods is related with model spaces of function type.

The main goal of the paper is a problem of model representation for a commutative operator family ?? acting on a separable Krein space and possessing a maximal nonnegative invariant subspace, presented as a direct sum of a neutral subspace with a finite dimension and a uniformly positive subspace. As it is known (see [2]), this family generates a spectral function ???? with a peculiar spectral set ? that provides a resolution of the spectral type for the family. In particular, with every operator ??, one can associate a scalar function ????(??) such that?????(?)=?????(??)??????,(1.1)where ? runs through the set of all closed intervals of the real line disjoint with ?.

The key results (Theorems 6.5, 6.19, and 6.29) say that there is a suitable function space (so-called basic model space) where ????(??) generates a multiplication operator similar to a compression of ?? on a subspace calculated through ????.

Section 2 gives a draft of problems considered in the paper, analyzing a simple case of self-adjoint operator in Pontryagin space. Section 3 contains definitions and well-known results used throughout the paper. Section 4 deals with a model representation of a resolution of the identity that is simultaneously ??-orthogonal and similar to an orthogonal resolution of the identity. In Section 5 a notion of unbounded elements conformed with a resolution of the identity is introduced and studied. Roughly speaking, a resolution sets a correspondence between a Hilbert space and a (vector-valued) function space ??2???. From this point of view, the unbounded elements correspond to measurable vector-valued functions outside of ??2???. The main results are presented in Section 6, where the notion of a basic model space is introduced. Also, a relation is established between multiplication operators by scalar functions acting in a basic model space, and operators of a commutative ??-symmetric algebra of ??+??-class. Here, emphasis is made on the problem of uniqueness of a basic model space for such algebras. Section 6.2 corresponds to resolutions of the identity with properties like those in Pontryagin spaces. Section 6.3 deals with general ??-orthogonal resolutions of the identity of ??+??-class, and Section 6.4 contains a theorem on a model representation of a commutative ??-symmetric operator family of ??+??-class. Historical and bibliographical remarks are presented in the last section.

It is assumed that the reader is familiar with elements of Krein space geometry and Operator theory (see [37]). In this paper, the terminology given in [8] will be used.

2. An Elementary Description of the Problem

Let H be a separable Hilbert space with a scalar product (·,·). H is said to be an indefinite metric space if it is equipped by a sesquilinear continuous Hermitian form (indefinite inner product) [·,·] such that the corresponding quadratic form has an indefinite sign (i.e., [??,??] takes positive, negative, and zero values). The indefinite inner product can be represented in the form [·,·]=(??·,·), where ?? is a so-called Gram operator. The operator ?? is bounded and self-adjoint. If the Gram operator for an indefinite metric space is boundedly invertible and its invariant subspace that corresponds to the negative spectrum (or, alternatively, to the positive spectrum) of ?? is finite dimensional, the space is called a Pontryagin space. In this section, we consider Pontryagin spaces only.

Now, let ??: H?H be a bounded linear operator. This operator is said to be ??-self-adjoint (??-s.a.) if [????,??]=[??,????] for all ??,???H. The properties of ??-s.a. operators differ from the properties of ordinary self-adjoint operators. For instance, a ??-s.a. can have a nonreal spectrum or/and a nontrivial Jordan chain. If ?? has only a real spectrum, then there is, on R, the eigen spectral function (e.s.f.) ???? of ?? with a finite set ? of critical points such that (?=(??;??),??,????) (a)forevery???R??itholdsthat??????=??????;(b)??(??|??(?)H)??;(c)if?n?=Øthenthesubspace??(?)Hispositive;(d)if?n??Øthenthesubspace??(?)Hisnegativeorinde?nite.(2.1)Let ??0??. Then for every point of ? there are three options.(1)For an interval ?=(??;??) such that ?n?={??0} and ??,????, the spectral function ????|??(?)H is bounded and the representation ??????(????) takes place.(2) For an interval ?=(??;??) such that ?n?={??0} and ??,????, the spectral function ????|??(?)H is bounded but the representation ??????(????) does not take place.(3) For an interval ?=(??;??) such that ?n?={??0} and ??,????, the spectral function ????|??(?)H is unbounded.

The first item means that the operator ??|??(?)H is similar to a self-adjoint operator, that is, it is a scalar spectral operator. The second item corresponds to a spectral operator with a nontrivial finite-dimensional nilpotent summand. Thus only the third item represents a situation that is out of the ordinary theory of model representation for spectral operators with real spectrum. Below, we consider this exceptional case. Let us give an example of the case in discussion.Example 2.1. Let the system h,??,??1,??2,??3, be an orthonormalized basis in a Hilbert space H and let ?[??,??]=(??,h)(??,??)+(??,??)(h,??)+8??=1(??,????)(????,??). Then this space is a Pontryagin space with ??=1. Let an operator ?? be given by the conditions (i)??h=0,(ii)??????=1/??·(????+h), ??=1,2,,(iii)?????=h+8??=1(1/??)·????. These conditions define a bounded operator, so ?? is naturally defined on H and, moreover, is a ??-self-adjoint operator. The spectral function of ?? can be described by the following conditions: 1??({??})??=[??,(????+h)]·(????+h),(2.2) so 1??({??}????=1)??=?????=1[??,(????+h)]·(????+h).(2.3) Put ?????=1/??·????=1????. Then ??({1/??}????=1)?????=1/??·????=1(????+h)=h+????. At the same time ?????v?=1/???0 for ???8. Thus, for ?? and its spectral function ????, we have the following results:(i)???? is unbounded;(ii)h belongs to the closure of the linear span ?H generated by the subspaces ??(?)H, where ?=(??;??), 0<??<??, so the kernel of the operator ??|?H is not trivial;(iii)?H is degenerated, ??HHn[?]={??h}???C.

Let us note that the coexistence of these properties reflects a general situation (in particular, the first item yields the other two). Indeed, it is shown by the following theorem.

Theorem 2.2 (see [8, Theorem I.9.6]). Let a subspace L be positive. Then there is a constant ??>1 such that (??,??)=??[??,??] for every ???L.

For simplicity everywhere below in this section, we assume that(a)?={0},(b)????isunbounded,(c)foreveryinterval?=[??;??],suchthat0??theoperator??|??(?)Hhassimplespectrum.(2.4)Then by Theorem 2.2, the subspace ?H generated as the closed linear span of the subspaces ??(?)H, where ?=[??;??], 0??, is not a positive subspace, thus it has the nontrivial isotropic part, ??HHn[?]?{0}. Let us denote, below, that H1??H:=Hn[?]. Since the subspace ?H is evidently nonnegative, it can be presented in the form?H=H1?H2,(2.5)where H2 is a positive subspace. Note that H2 is not uniquely defined. Note also that, due to the general theory, the subspace ?H is a part of a maximal nonnegative subspace L+ invariant with respect to ??.

Theorem 2.3. Let ???? be the e.s.f. of a ??-self-adjoint operator ??. Then there are a scalar Lebesgue measure ????, the Hilbert space ??2?? associated with ????, and a collection of ????-measurable scalar functions {?????(??)}????=1 such that if ?=[??,??],0??, the operator ??(?)|?H is similar to the operator acting by the formulae ??(??)????(??)??(??)+?????=1????(??)?????(??)????(??)·????,?????0??=1,2,,??(2.6) on the formal linear span of ??2?? and {????}????=1, where {????}????=1 is a basis on H1, ???(??) is the indicator of ?, ???(??)?????(??)???2?? for ??=1,2,,??, and ?????=1?????????(??)???2?????1=??2=?=????=0.(2.7)Proof. According to Equality (2.5), the restriction ??(?)|?H has the following matrix representation:??(?)|?H=?0??12(?)0??22?(?).(2.8)With no loss of generality (see Proposition 3.3 below for details), one can assume that (·,·)=[·,·] on H2 and H1?H2. Then the operator-valued function ????:=??22((-8,??)) represents an (orthogonal) resolution of the identity acting in the Hilbert space H2. From the classical theory, we know that there is a Hilbert space ??2?? of scalar functions that is a model space for ???? with some corresponding operator ??: ??2???H2 of similarity, that is,??-1??22(?)????(??)=???(??)??(??).(2.9)Let {????}??1 be an orthonormalized basis in L1. Then, for every ?=[??,??], 0??, and ??=1,2,??, the expression ?????????(??):=(??12(?)????(??),????) defines a continuous linear functional in ??2??. Thus, for every ??=1,2,??, there exists the ??-measurable function ?????(??) such that, for an arbitrary ?=[??,??], 0??, and ??(??)???2??, the representation??????????(??)=???(??)??(??)????(??)(2.10)holds. Since the spectral function ?? is unbounded, ?1-1|??(??)|2????(??)=8 for at least one ??=1,2,,??. It means that at least one function (maybe all) of the collection{?????(??)}????=1(2.11)is not in ??2??. Then we just need to prove (2.7).
Let ?????=1????·?????(??)???2??. Then the linear functional (?????2??)?????:=R??(??)?????=1????·?????(??)????(??)(2.12)is bounded.
Next, by definition, the space ?H is the closure of all vectors having the form????(??)+?????=1?R??(??)?????(??)????(??)·????,(2.13)with ?????2?? vanishing near zero; so, for every ???H1, there is a sequence {????}8??=1 such thatlim???8????????2??=0,lim?????8???=1?R????(??)?????(??)????(??)·????=??.(2.14)The latter yields(??,?????=1????·????)=lim?????8???=1?R????(??)?????????(??)????(??)=lim???8??????=0.(2.15)Thus ?????=1????·????=0, therefore ??1=??2=?=????=0.
Theorem 2.3 gives a possibility to construct a partial model representation for ?? in a sense exposed below. With no loss of generality, one can assume that the Hilbert scalar product (·,·) on H is such that the corresponding Gram operator re-denoted as ?? (i.e., [·,·]=(??·,·)) has the properties ??=??-1=??*. Let (see (2.5))H0=??H1.(2.16)Then H0??H. Additionally, one can assume that the basis {????}????=1 from Theorem 2.3 is orthonormalized, [·,·]=(·,·) on H2 and H1?H2. Let ??0 and ??2 be orthoprojections onto subspaces H0 and H2, respectively.

Theorem 2.4. Let a space ??2?? and functions {?????}????=1 be related with the e.s.f ???? of a ??-s.a. operator ?? as in Theorem 2.3, and let ???2?? be a Hilbert space formed as the linear span of ??2?? and {?????}????=1, where the functions in {?????}????=1 are mutually orthogonal, have unit norm, and are orthogonal to the space ??2?? which conserves its Hilbert structure. Then ??????? belongs to the linear span of ???2?? for every ??=1,2,,??, and the compression (??0+??2)??|H0?H2 of ?? is similar to the multiplication operator by ?? acting on ???2??.

Theorem 2.4 is not new (see, e.g., a more general result in [9] and its applications in [10, 11]) but it opens some ways to generalization and generates some open questions and problems. For instance, (2.4)(c) is restrictive and must be dropped. This, in turn, implies a replacement of the space ???2?? of scalar functions by a suitable space of vector-valued functions. Next, the passing from a single self-adjoint operator to a family of self-adjoint operators in the case of indefinite metric spaces has some difficulties which must be taken into account. Let us consider the following example.Example 2.5. Let the union of systems {h1,h2,h3}, {??1,??2,??3}, and {????}8??=1 give an orthonormalized basis in a Hilbert space H. We define a fundamental symmetry ?? on H by formulae??????=h??,??h??=????,??=1,2,3,??????=????,??=1,2,.(2.17)Thus H becomes a Pontryagin space. Next, we define operators ?? and ?? by formulae??h1=h2,??h2=8???=11??·????,??h3=8???=11??4/5·????,????1=????3=0,????2=??1,??????=1??·????+1??·??2+1??4/5·??3,??=1,2,,??h1=h3,??h2=8???=11??4/5·????,??h3=8???=11??3/5·????,????1=????2=0,????3=??1,??????=1??4/5·????+1??4/5·??2+1??3/5·??3,??=1,2,.(2.18) It is easy to check that the operators ?? and ?? are ??-self-adjoint and commute. Next, the eigen spectral function (e.s.f.) of ?? has the form????=??????0,if??=0;??-??:(1/??)=??[·,????]·????,if???(0;1];??,if??>1,(2.19) where ????=????+????1+??2+(??)1/5??3, ??=1,2,. Moreover, for every ??>??>0, we have the representations?????([??,??))=?????????(????),????([??,??))=????(??)4/5??(????).(2.20)Therefore, ???? can be considered as an “e.s.f.” of the family {??,??}; however,????01+0?????(????),???01+0(??)4/5??(????),(2.21)because both integrals are nonconvergent. Next, dimKer(??)=dimKer(??)=2, but Ker(??)?Ker(??). Thus ???Alg(??) and ???Alg(??), where Alg(·) means the weakly closed algebra generated by the identity operator and the corresponding ??-self-adjoint operator. The same reasoning shows that there is no ??-self-adjoint operator ?? for which, simultaneously, ???Alg(??) and ???Alg(??). Therefore, the description of the operator family in discussion cannot be reduced to a representation of one operator. At the same time the existence of the spectral function with (2.20) is not occasional (see Theorem 3.11 below) and gives a possibility to construct a partial model for the whole family.

So one of the problems is to generalize Theorem 2.4 to commutative families of self-adjoint operators in Pontryagin and Krein spaces. Next, it is clear that the space ???2?? depends on the choice of (2.5), but the latter is not uniquely determined. Thus, another problem is a description of the ambiguity of ???2?? or its analog with vector-valued functions. The present paper is devoted mainly to these two problems.

Of course, the direction marked by Theorem 2.4 is not unique in relation to the goal to construct a model representation of function type for operators in Pontryagin spaces. In particular, in [12], it was shown that a bounded cyclic self-adjoint operator ?? in a Pontryagin space is unitary equivalent to the operator ??F of multiplication by the independent variable in some space ?(F) generated by a “distribution” F. This distribution, in turn, is associated with a quasiintegral representation for the moment sequence {[????h,h]}8??=0, where h is a cyclic vector. The model in consideration describes the behavior of ?? on the whole Pontryagin space, and in this sense, it is complete. On the contrary, the model from Theorem 2.4 is a partial one; it describes only the part of ?? that can be restored via its e.s.f.. It gives, indeed, an advantage to the model [12] but this advantage concerns mainly cyclic operators because in the case of a non-cyclic operator the corresponding space ?(F) contains matrix-valued functions, and this space has a more or less complicated structure. The latter, however, is not the main obstacle. The experience with a canonic representation of normal operators in finite-dimensional spaces with an indefinite metric (see, e.g., [13, 14]) shows that any attempt to give an observable and, simultaneously, complete description for a commutative family of self-adjoint operators in spaces with indefinite metric with the rank of indefiniteness more than 2 has little chances to prosper. On the contrary, a partial model representation in the style of Theorem 2.4 can be generalized easily to commutative families of ??-self-adjoint operators and to commutative families of ??-self-adjoint operators of the so-called ??+??-class. A previous experience shows that, in spite of some incompleteness, this model was useful in some applications concerning a single ??-self-adjoint operator, see Section 7 for more details.

3. Preliminaries

3.1. Krein Spaces

Let H be a Krein space with an indefinite sesquilinear form [·,·], let H=H+[+]H- be its canonical decomposition, let ??+ and ??- be canonical projections H+=??+H and H-=??-H, let ??=??+-??- be a canonical symmetry, and let (·,·)=[??·,·] be a canonical scalar product. Note that one of these canonical objects uniquely determines the others. Everywhere below, we fix, on H, a unique form [??,??]=(????,??). At the same time, let us note that, in the question we consider, a concrete choice of Hilbert scalar product is not really essential. One needs only to fix the topology (defined by the above-mentioned scalar product) and the structure of ??. Let us mention the following result (see [15]) concerning some redefinitions of a Hilbert structure in Krein spaces.Proposition 3.1. Let H=H+?H- be a canonical decomposition of the Krein space H and let H = L+[+]L- be another canonical decomposition of the same space. Let the first decomposition define the canonical scalar product (·,·) and let the second decomposition define the canonical scalar product (·,·)1, that is, [·,·]=(??·,·)=(??1·,·)1. Then spectrum of the operator ??=??1?? is strictly positive, and the operator ??:??2=??, ??(??)?(0,+8), has the properties (a)[????,????]=[??,??](b)(????,????)1=(??,??)(3.1)(c)??H+=L+,??H-=L-.(1)Definition 3.2. The operator ?? that we introduced in Proposition 3.1 is called the canonical isometry that maps the Krein space H with the scalar product (·,·) on the same Krein space H, but with the scalar product (·,·)1. If it is necessary to exactly indicate the corresponding scalar products or the canonical decompositions of the space H, we replace ?? with??H,(·,·),(·,·)1or??{H+,H-}{??+,??-}.(3.2)

Below nonnegative (especially maximal nonnegative) subspaces will play an important role. The set of all maximal nonnegative subspaces of the Krein space H is denoted ??+(H).

A subspace L is called pseudoregular [16] if it can be presented in the form?LL=+L1,(3.3)where ?L is a regular subspace and L1 is an isotropic part of L (i.e., L1=LnL[?]).Proposition 3.3. Let (i)??+???+(H) and a pseudoregular subspace,(ii)??0 the isotropic subspace of ??+,(iii)(·,·)? a scalar product on ??0 such that the norm v(??,??)? is equivalent to the original one,(iv)??-=??+[?],
and ??+=???++??0,??-=???-+??0,(3.4)where ???+ and ???- are uniformly definite subspaces. Then one can define, on H, a canonical scalar product (·,·) such that (a)on??0:(·,·)=(·,·)?(b)??0????+,??0????-???(c)on+???:(·,·)=[·,·](d)on-:(·,·)=-[·,·].(3.5)
Definition 3.4. If a canonical scalar product of Krein space H has (3.5), it is said to be compatible with (3.4) and the choice of the scalar product (·,·)? on ??1.Definition 3.5. Let ?? be a pseudoregular subspace and let??=??(1)+??1,??=??(2)+??1(3.6)be two different decompositions of ?? as a direct sum of a regular subspace and the isotropic subspace. We will call the map M??,??(1),??(2):??(1)???(2), defined by the condition [M??,??(1),??(2)??,??]=[??,??](??????),(3.7)the standard map associated with (3.6).Remark 3.6. The map M??,??(1),??(2) is uniquely determined by the condition (3.7) since the subspaces ??(1) and ??(2) are projectionally complete and the subspace ??1 is neutral. This map preserves the sesquilinear form [·,·] (i.e., is ??-isometric). Furthermore, the subspaces ??(1) and ??(2) can be presented in the form??(1)=??+(1)[+]??-(1),??(2)=??+(2)[+]??-(2),(3.8)where ??+(1) is uniformly positive, ??-(1) is uniformly negative and??±(2)=M??,??(1),??(2)??±(1).(3.9)Then the union of (3.6) and (3.8) generates two decompositions of the type (3.4).Define a special case of pseudoregular subspaces: a nonnegative (non-positive) subspace L is called a subspace of the class h+ (h-) if it is pseudoregular and dimL1<8 for L1 as in (3.3). In Pontryagin spaces, every subspace is pseudoregular, and every semidefinite subspace belongs to class h+ or h-.

Here, the term “operator” means “bounded linear operator.” By the symbol ??#, we denote the operator ??-adjoint (??-a.) to an operator ??. Thus, if ??=??#, then ?? is a ??-s.a. operator. For an operator ??, the symbol ??(??) denotes its spectrum treated in the same way as in [17] or [8].

If an operator family ?? is such that the condition ????? implies ??#???, then this family is said to be ??-symmetric. An operator algebra ?? is said to be a ????*-algebra if it is closed in the weak operator topology, ??-symmetric, and contains the identity ??. The symbol Alg?? means the minimal ????*-algebra which contains ??.

One of the most important directions in the development of the operator theory is connected to the existence of invariant maximal semidefinite subspaces for certain operator sets (see [18] for references) and the study of the properties of the operators in such sets. A subspace L is said to be ??-invariant (??-invariant) if it is invariant with respect to the operator ?? (operator family ??).Proposition 3.7. Let ?? be an operator that acts in H and has an invariant pseudoregular subspace ??, and let ??1 = ??n??[?] be also an ??-invariant. Consider two different decompositions of the space ??, ??=??(1)+??1,??=??(2)+??1,(3.10)as a direct sum of the isotropic part and a projectionally complete subspace. Let ??|??=???(1)0??1(1)??1?,??|??=???(2)0??1(2)??1?(3.11)be two matrix representations of ??|?? corresponding to these decompositions. Then ??(1)=(M??,??(1),??(2))??(2)(M??,??(1),??(2))-1,(3.12)where M??,??(1),??(2) is the standard map associated with (3.10).Proposition 3.8. Let H=H+[+]H-,H=??+[+]??-(3.13)be two different canonical decompositions of the Krein space H, and let H+ and ??+ be invariant subspaces of a ??-s.a. operator ??. Then ??·??{H+,H-},{??+,??-}=??{H+,H-},{??+,??-}·??,(3.14)where ??{H+,H-},{??+,??-} are associated with Definition 3.2.Definition 3.9. A ??-symmetric operator family ?? belongs to the class ??+?? if there is a subspace L+ in H such that(i)L+ is ??-invariant,(ii)L+???+(H)nh+,(iii)dim(L+nL+[?])=??.Remark 3.10. If a ??-symmetric family ?????+?? and L+ is a ??-invariant subspace corresponding to Definition 3.9, then the pseudoregular subspace L+[?] is ??-invariant too.

3.2. Spectral Functions with Peculiarities

The spectral resolution for different operator classes is one of the important problems in the operator theory. Let us start with the following definition.

Let ? = {????}??1 be a finite set of real numbers and let R? be the family {??} of all Borel subsets of R such that ????n?=Ø, where ???? is the boundary of ?? in R. Let ??:?????(??) be a countably additive (in the weak topology) function, that maps R? to a commutative algebra of projections in a Hilbert space H, where ??([??-??,??+??])?0 for every ????, and ??>0, and, moreover, ??(R)=??. ??(??) is called a spectral function on R with the peculiar spectral set ?; the mention of ? can be omitted. The symbol Supp(??) means the minimal closed subset of R such that ??(??)=0 for every ??: ???R??? and ???R?. Besides the symbol ??, we will use also, as a notation of a spectral function, the symbol ????, ???R, where ???? = ??((-8,??)).

A spectral function ??, that acts in a Krein space, is said to be ??-orthogonal or ??-s.a. if ??(??) is a ??-orthoprojection for every ???R?.

Let us recall the definition of scalar spectral operator with real spectrum [19]. An operator ?? acting in a Hilbert space is said to be a scalar spectral operator if there exists a spectral function ?? with empty peculiar spectral set ? such that, for every ???R?:??(??)??=????(??), ??(??|??(??)H)??? and ????(??) = ???????(????) in the weak sense.

Now, let ?? be a spectral function with peculiar spectral set ?. A scalar function ??(??) is said to be defined almost everywhere (with respect to ??), to have a finite value almost everywhere, and so on, if the corresponding property holds almost everywhere in the weak sense on an arbitrary set ???R?, ??n?=Ø. We will assume that the function ??(??) is not defined at ?.

The following theorem was announced in [2] and proved in [20].

Theorem 3.11. Let ?????+?? be a commutative family of ??-s.a. operators with real spectra. Then there exists a J-orthogonal spectral function ???? with a finite number of spectral peculiarities ? (? may be the empty set) such that the following conditions hold (a)?????Alg??????R??;(b)thereisanonnegativesubspaceL+,correspondingtoDe?nition3.9,forwhichthedescomposition??(?)H=??(?)L+[+]??(?)L-holds,?beinganyclosedsegment??Rsatisfying??R?and?n?=Ø;(c)foreveryoperator?????,thereexistsade?nedalmosteverywhereand(uniformly)boundedfunction??(??)suchthatforeveryinterval??R,??R??,?n?=Ø,thedecomposition????(?)=????(??)??(????)isvalid;(d)thesubspaceH=CLin??R?,?n?=Ø{??(?)H}ispseudoregularanditsisotropicparthas?nitedimension;(e)if??0??andH??0:=n??0????(?)H,thenforeveryoperator?????theset??(??|H??0)isasingletone{????}andthereisapositiveinteger????suchthat(??-??????)????|H??0=0;(f)if??0??,thenlimsup?????0??????=8oratleastforone?????theoperator??|H??0isnotaspectraloperatorofscalartype.(3.15)A spectral function ?? with a peculiar spectral set ?, satisfying ((3.15)), is called an eigen spectral function (e.s.f.) of the operator family ??.Definition 3.12. Let ???? be an e.s.f. of an operator family ?? and let an operator ????? and a function ??(??) be connected by the system of equalities from (3.15)(c). Then the function ??(??) is said to be the portrait of the operator ??, and the operator ?? is said to be the original of ??(??) in ?? (with respect to ????).Let a spectral function ?? with a peculiar spectral set ? be an e.s.f. of ??. If ????, then ?? will be called a peculiarity of ??. Let ?? be a peculiarity. Fix a set ???R?: ??n?={??}. The peculiarity ?? is called regular if the operator family {??(??n??)}???R? is bounded; otherwise, it is called singular. Note that the notion of regular and singular peculiarities is correctly defined since the boundedness of the family {??(??n??)}???R? does not depend on ??.

3.3. Some Function Spaces

Assume that ??(??) is a nondecreasing function defined on the segment [-1;1], continuous in the points -1, 0, and 1, continuous (at least) from the left in all other points of the segment, and having an infinite number of growth points, where zero is one of these points. This function ??(??) generates, on [-1;1], a Lebesgue-Stieltjes measure ???? and spaces (??2??, ??8??, etc.) of complex-valued functions. At the same time we will consider also some spaces of vector-valued functions; so, from time to time, we will note, after a symbol of a space a symbol of a range for the functions forming this space, for instance, ??2??(C). Next, let us consider a slightly different construction. Let ??(??) be a ????-measurable function defined a.e. on [-1;1] and such that a.e. ??(??)=1 for every ???(0;1], it is true that ?-??-1??(??)????(??)<8 and ?1????(??)????(??)<8, but ?1-1??(??)????(??) = 8. Set????????(??)=??-1-???(??)????(??),if???[-1;0];1????(??)????(??),if???[0;1];(3.16) The function ??(??) is nondecreasing in both segments [-1;0) and (0;1], but it is unbounded in neighborhoods of zero. Define, for it, a corresponding function space. Let ??(??) and ??(??) be arbitrary functions continuous in [-1;1] and vanishing in some neighborhoods (different in the general case for ??(??) and ??(??)) of zero. Then the integral ?1-1??(??)??(??)????(??) is well defined and generates a structure of pre-Hilbert space on the set of all such functions. The completion of the space will be denoted ??2?? (or ??2??(C)). Note that, due to (3.16), the spaces ??8?? and ??2?? form a Banach pair, so the space ??8??n??2?? is well defined (for details, see [21]).

Let us pass to some notation relating to direct integrals of Hilbert spaces and corresponding model descriptions of self-adjoint operators (see [22, Section 41]; [23, Chapter 7]; [24, Chapter 4.4]; [25, Chapter VII]). We will use definitions close to the “coordinate notation” given in [22]. A difference between [22] and the definitions that follow is related to the fact that direct integrals, here, will be used not only for a resolution of Hilbert spaces but also for a resolution of Krein spaces. Let E be some separable Hilbert space (E can be finite dimensional), let {????}??1 be an orthonormalized basis of this space, let ??(??) be be the same as above. Let {????(??)}??1 be a system of nonnegative ????-measurable functions defined almost everywhere (a.e) on the segment [-1;1] and such that every function of the system is the indicator of some set of nonzero measure and ????{??:????(??)=0,??=1,2,,??}=0. Denote?????(??)=?????=1????????(??)????(??).(3.17)In this case the sum in the right part of the formula is considered as a formal expression without any suggestion of its convergence or divergence.

Here the space ?????(E) means the space of vector-valued functions {??(??)} defined a.e. (with respect to ????) on the segment [-1;1] and taking values in E under the conditions??(??)=?????=1????(??)????,(3.18)where ????(??) runs the set of all ????-measurable a.e. finite scalar functions such that(a)????(??)=????(??)????(??),??=1,2,,??;(b)a.e.???(??)?2E=?????=1|????(??)|2<8.(3.19)The topology on ?????(E) is introduced by a base for neighborhoods of zero, where any neighborhood of the base is defined by a couple of positive numbers ?? and ?? (the couples are different for the different neighborhoods) and contains all functions satisfying the condition ????{??:???(??)?2E=??}<??. Next, the symbol ??2???(E) means here a Hilbert space of functions ??(??)??????(E) such that ?1-1???(??)?2E????(??)<8.

The spaces ?????(E) and ??2???(E) are said to be a standard space of measurable functions and a standard Hilbert space, respectively.

The choice of {????}??1 in the construction of spaces ?????(E) and ??2???(E) is not essential if????(??)=????(??)for??,??=1,2,,??.(3.20)Spaces ??2???(E) of this type correspond, in particular, to model representations of self-adjoint operators with uniform multiplicity (see [25]). So ?????(E) and ??2???(E) are said to be spaces of uniform multiplicity ?? if conditions (3.20) are fulfilled.

If ??2???(E) is not a space of uniform multiplicity, it can be represented as an orthogonal sum of spaces of uniform multiplicity. Note a special case of such representation.Definition 3.13. A space ??2???(E) is said to be orderly decomposable on uniform components if (see (3.17))??2???(E)=??2???1(E1)???2???2(E2)?,(3.21)where ?E=?????=1E?? (both ??=8 and ??<8 can occur), the above decomposition of E is concordant with the choice of the basis {????}??1 in the sense that E??=CLin{????}?????E??, ??2?????(E??) is a space of uniform multiplicity dimE??, E???E??+1, dimE??<dimE??+1,????(??) = ???-1????(??)????(??), ????(??) is the indicator of some ????-measurable set ????,???????0, ???????(??)=(???:?????E??????)???????(??), ????n????=Ø, ??, ??=1,2,,??, ?????.Spaces orderly decomposable on uniform components play the key role in the theory of model representation for self-adjoint operators (for details, see, [25, Theorem VII.6]). Practically the same definition can be given for spaces ?????(E). Definition 3.14. ?????(E) is said to be orderly decomposable on uniform components if?????(E)=?????1(E1)+?????2(E2)+,(3.22)where ???????(E??) is a space of uniform multiplicity, the rest of the elements in (3.22) are the same as in (3.21).We introduce some notation related to multiplication operators by scalar functions. Everywhere below we assume a scalar function ??(??) to be defined a.e. on [-1;1], ????-measurable, and a.e. bounded. For ??(??)??????(E), set(F??)(??)=??(??)??(??).(3.23)It is clear that (F??)(??)??????(E), so (3.23) defines on ?????(E) the continuous operator F (= the multiplication operator by the function ??(??)). If ??(??) satisfies some additional conditions, one can consider the operator F as acting simultaneously on different spaces. If, for instance, ??(??) is continuous, then the operator F is well defined on every space ????(E) independently of ???(??) and E. If ??(??)???8??(C), then ??2???(E) can also be taken as a domain of F. So, if it is necessary, we will mention, simultaneously, the operator F and its domain using the notation {F,??(F)}, say, {F,??2???(E)}.

Let X?? be the multiplication operator by the indicator ??[-1;??)(??) of the set [-1;??), X??={X??, ??2???(E)}. Pass to the description of automorphisms acting on ??2???(E) and commuting with operators X??, ???[-1;1]. Denote, by ????, the subspace of the space E spanned by all vectors of the set {????}????=1 such that ????(??)?0 (see (3.17)). The following result is well known (e.g., Birman, Solomjak [23, Chapter 7]; [24, Theorem 4.4.6]; [22, Proposition 1, Subsection 2; Section 41]).

Proposition 3.15. Let ?? be a unitary operator commuting with {X??,??2???(E)} for a.a. ???[-1;1]. Then there is an operator-valued weakly ????-measurable function ???? defined a.e. on [-1;1] such that, for a.e. ???[-1;1], the operator ???? is unitary on E and (a)(????)(??)=??????(??);(b)????????=????;(c)????|?????=??|?????.(3.24)Remark 3.16. The space ??2???(E) is a complete linear set in ?????(E). So if initially an operator ?? acts on ??2???(E) and satisfies conditions (3.24), its domain can be extended to ?????(E) via the passage to the limit. Thus the operator {??,?????(E)} is a continuous bijective mapping.

4. On a Model Representation for ??-Orthogonal Spectral Functions without Peculiarities

We define, on ??2???(E), an additional structure of a Krein space. Let ?? be an operator acting on ??2???(E), being at the same time self-adjoint, unitary and commuting with X?? for a.e. ???[-1;1]. By Proposition 3.15, the operator ?? has the representation(????)(??)=??????(??),???[-1;1],(4.1)where ???? is self-adjoint a.e. on [-1;1]. Let[??1(??),??2(??)]E=(??????1(??),??2(??))E.(4.2)Then the inner product[??1(??),??2(??)]??2???(E)=?1-1[??1(??),??2(??)]E????(??).(4.3)converts the space ??2???(E) to a Krein space. This Krein space is denoted ??-??2???(E) and it is said to be a standard Krein space.

Remark 4.1. The product [??1(??),??2(??)]E is a.e. well defined both for ??1(??),??2(??)???2???(E) and ??1(??),??2(??)??????(E).

A standard Krein space can be used for a model representation of a ??-spectral function (= ??-orth.sp.f.) ???? without peculiarities. For simplicity everywhere below, we will assume that??-1=0,??+1=??,??-1=??-1+0.(4.4)Definition 4.2. Let ???? be a ??-orth.sp.f. with the empty set of peculiarities. A space ??-??2???(E) is said to be a model space for ???? if, for some canonical scalar product on H, there is an isometric and ??-isometric operator ??:??-??2???(E)?H such that, for every ???[-1;1],????=??X????-1,(4.5)where, as above, X?? is the multiplication operator by the indicator ??[-1;??)(??) of the set [-1;??), X??={X??,??-??2???(E)}. The operator ?? is said to be an operator of similarity.

Proposition 4.3. Every ??-orth.sp.f. ???? with an empty set of peculiarities has a model space ??-??2???(E).Proof. By [19, Lemma XV.6.2], one can define, on H, a new scalar product (noncanonical in the general case) (·,·)1, topologically equivalent to the initial scalar product (·,·) and such that the spectral function ????, is orthogonal with respect to (·,·)1. Then [·,·]=(??·,·)1, where the operators ???? commute with ?? for a.a. ???[-1;1]. Now one can introduce, on H, a new canonical scalar product (·,·)2=(|??|·,·)1, where |??|=(??2)1/2 is the module of ??. The new scalar product generates the canonical decomposition H=H+(2)?2H-(2). It easy to show that the subspaces H+(2) and H-(2) are ????-invariant for a.a. ???[-1;1]. Thus there are model spaces ??-??2???+(E+) and ??-??2???-(E-) for orth.sp.f. ????|H+(2) and ????|H-(2), respectively. Without loss of generality one can assume that the scalar functions (see (3.17)) ??+(??) and ??-(??) are such that??+?(??)=??-1??+(??)????(??),??-?(??)=??-1??-(??)????(??),??2+(??)=??+??(??),2-(??)=??-?(??),??(??)=??-1(??+(??)+??-(??)-??+(??)??-(??))????(??).(4.6) Put ??-??2???(E):=??-??2???+(E+)???-??2???-(E-). The rest is straightforward.Remark 4.4. As is well known, a model representation for an orth.sp.f. is not uniquely determined. At the same time, all scalar measures for such representations in the case of the same orth.sp.f. are equivalent among themselves and the function (see (3.24)) ??(??)=dim???? does not depend on the choice of the model representation. This is the reason why a model representation for orth.sp.f., usually is taken in the class of Lebesgue spaces orderly decomposable on uniform components. In the case of ??-orth.sp.f., the situation is slightly more complicated. Specifically, for all model representations for a fixed ??-orth.sp.f., all admissible scalar measures are equivalent among themselves and two functions ??+(??)=dimKer((????-??)|????) and ??-(??)=dimKer((????+??)|????) do not depend among themselves and of the choice on the model representation. Conversely, if data include a class of equivalent measures, functions ??+(??) and ??-(??), then a ??-orth.sp.f. with empty set of peculiarities can be restored up to ??-isometric equivalence. In particular, one can choose a suitable function ??(??), construct a space ??-??2???+(E+) using ??(??) and ??+(??), construct a space ??-??2???-(E-) using ??(??) and ??-(??), and put ??-??2???(E):=??-??2???+(E+)???-??2???-(E-). Note that, even if the spaces ??-??2???+(E+) and ??-??2???-(E-) are orderly decomposable on uniform components, the spaces ??-??2???(E) in the general case do not have this property.Proposition 4.5. Assume that ???? is a ??-orth.sp.f. with empty set of peculiarities, ??-??2???(E) and ???-??2???(E) are two different standard Krein spaces such that each of them is a model space for ???? and is derived from the same space ??2???(E) by canonical symmetries ?? and ???, respectively. Then, in ??2???(E), there is a unitary operator ?? satisfying (3.24) and such that ???=??-1????.Proof. In the general case the operators of similarity ?? and ??? correspond to different canonical scalar products on the same space H, say, ??:??-??2???(E)?{H,(·,·)} and ???:???-??2???(E)?{H,(·,·)1}, where (·,·):=[??·,·] and (·,·)1:=[??1·,·]. On the other hand thanks to Definition 4.2, ???? is self-adjoint simultaneously with respect to the scalar products (·,·) and (·,·)1, hence it commutes with ?? and ??1. Thus, taking into account Proposition 3.1, we can assume that (·,·)=(·,·)1. Then the required operator ?? can be defined by the formula ??:=??-1???. Indeed, first, this ?? is unitary because the canonical scalar product on H is the same for ?? and ???; second, for every function ??(??)???2???(E) is true, (?????(??),??(??))??2???(E)=[??(??),??(??)]??'-??2???(E)=[????(??),????(??)]??-??2???(E)=[??????(??),????(??)]??2???(E); third, ??X????(??)=??-1?????????(??)=X??????(??). The rest follows from Proposition 3.15.The proof of the next proposition will be omitted because it contains the same well-known ideas as the proof of Proposition 3.15.Proposition 4.6. Let M be a ??-unitary operator in a standard Krein space ??-??2???(E) commuting with {X??,??-??2???(E)} for a.a. ???[-1;1]. Then there is an operator-valued weakly measurable function ???? defined a.e. on [-1;1] and taking values in the set of bounded operators acting in E such that, for a.a. ???[-1;1], (a)(M??)(??)=??????(??);(b)????????=????,?????????=?????,????|?????=??|?????;(c)[??????,??????]=[??,??]????E;(d)EssSup???[-1;1]??????E=?M???2???(E).(4.7)

5. Unbounded Elements in Hilbert Spaces

First, let us consider the notion of unbounded elements.

Assume that H is a Hilbert space, ???? is a resolution of the identity (= an orthogonal spectral function with the empty set of peculiar points) defined on the segment [-1;1], continuous in zero (with respect to the ??-topology), and(a)??-1=0,??1=??;(b)forevery???[-1;1]theunilaterallimitsw-lim?????-0????andw-lim?????+0????exist,whereforde?niteness????-0=????.(5.1)Set ????,??=??+????-????+0, where ???[-1;0), ???(0;1].

Next, let ????,?? be a mapping of the numerical set [-1;0)×(0;1] into H (???[-1;0), ???(0;1]). The function ????,?? is said to be conformed with ???? if the following condition is fulfilled; for every ??,???[-1;0), ??,???(0;1]; the equality ????,??????,??=????,?? holds, where ??=min{??,??}, ??=max{??,??}.

Note that ????,?? has the following property:ifsup???[-1;0)???(0;1]{?????,???}<8thenthereisanelement???Hsuchthatforevery???[-1;0),???(0;1]theequality????,??=????,????holds.(5.2)It is clear that the element ?? from (5.2) is uniquely defined by ????,?? and can be found by the formula ??=w-lim???-0???+0????,??.Definition 5.1. A function ????,??, which is conformed with ????, is said to be an unbounded element conformed with ???? (or, if it cannot produce a misunderstanding or an unbounded element) if sup???[-1;0)???(0;1]{?????,???}=8.Note that unbounded elements conformed with ???? exist if and only if zero is a point of growth for ????, that is, for every ??> 0 it is true that ??+??-??-???0. Everywhere below in this section, this condition for ???? is assumed to be fulfilled.

For brevity everywhere below unbounded elements will be denoted by symbols ??, ??, and so on. For ???[-1;0), ???(0;1], we set ????,??:=????,????.

Definition 5.2. Unbounded elements ???1,???2,,?????, conformed with a (common) resolution of the identity ????, are said to be linearly independent modulo H if every nontrivial linear combination of them is an unbounded element from H.Next, for every bounded ????-measurable function ??(??), one can define, on H, the following operator F:?F??:=1-1??(??)????????.(5.3)Using the previous notation, rewrite the last formula as(F??)??,??=???-1??(??)?????????+1????(??)????????.(5.4)Representation (5.4) allows a possibility to treat the operator F in a more general sense; unbounded elements conformed with ???? can be naturally included to the domain of F. Note that the portrait of an unbounded element can be both a bounded element and an unbounded element. Moreover, ??(??) in (5.4) could also be taken unbounded. In this case the portrait of a bounded element, optionally, is an unbounded element.Proposition 5.3. If a function ??(??) is unbounded on every subset of complete ????-measure, then the vector space FH contains an infinite number of unbounded elements conformed with ???? and a linearly independent modulo H.The last proposition shows (see also below, Proposition 5.4) that if we need to operate with a finite number of unbounded elements, then only bounded functions ??(??) are admissible in (5.4).

Until the end of the present section, the orthogonal resolution of the identity ???? and a nondecreasing function ??(??), such that ????-measurability on [-1;1] coincides with the ????-measurability, will be fixed. Note that the existence of ??(??) follows from the separability of H (see [26, Section 76, Theorem 1]).

We give an additional notation. Let {?????}??1 be a fixed family of unbounded elements conformed with ???? and a linearly independent modulo H. Both the unbounded elements and the ordinary vectors from H can be considered as functions defined on [-1;0)×(0;1] and taking values in H (see (5.2)). The linear span of vectors from H and unbounded elements from {?????}??1, consistently taken as functions on [-1;0)×(;1], is denoted ?H. Additionally ?H will be considered as a Hilbert space, where H is a subspace with the the same scalar product that was given on H from the beginning, and unbounded elements from {?????}??1 are mutually orthogonal and orthogonal to H. The space ?H is said to be an expansion of H (generated by {?????}??1).

Next, using the system {?????}??1, introduce the function ??(??);?????????(??)=??(??)+?????=1???????????2,if???[-1,0);-??(1)+??(??)-?????=1?(????-??)??????2,if???[0,1).(5.5) The connection between ???? and ??(??) implies that the function ??(??) introduced in (5.5) has (3.16). In this case the function ??(??) from (3.16) can be calculated directly through ??(??) and ??(??).Proposition 5.4. Let {?????}??1 be a system of unbounded elements, forming together with H the space ?H, let ??(??) be a ????-measurable function, let F be the operator defined by (5.4). Then F?H?H if and only if ??(??)???8??n??2??.Proof. Sufficiency of the formulated condition is clear, so we will consider its necessity only. Note that, by virtue of Proposition 5.3, condition F?H?H implies the boundedness of the function ??(??). Next, since F??????H for ??=1,2,,??, then, by (5.4) it is true that ?F??????2=?1-1|??(??)|2?????????????2<8 and, moreover, ?1-1|??(??)|2????(??)<8. Thus (5.5) implies ??(??)???8??n??2??.

For future applications, both the cases F?H?H andF??HH?(5.6)are important.Proposition 5.5. Let {?????}??1 be a system of unbounded elements, generating together with H the space ?H. Then there are no more than ??2????-measurable functions ??(??) linearly independent modulo ??8??n??2?? such that (5.6) is fulfilled.Proof. Due to (5.6), every element from the system {F?????}??1 can be uniquely represented (modulo H) as a linear combination of elements from {?????}??1, that is,F?????=?????=1???????????(modH),??=1,2,,??.(5.7)Thus the operator F generates the matrix??F=(??????)????,??=1,(5.8)in addition, F?H?H if and only if ??F=0. Hence functions comparable modulo ??8??n??2?? have the same matrix (5.8).

Remark 5.6. For the function ??(??)=1, (5.7) is always fulfilled. At the same time the example of the unbounded elements {(1)??}8??=1 and {(??)??}8??=1 from the space ??2 shows that the case, where there are no functions different from a constant modulo ??8??n??2?? and simultaneously satisfying (5.6), is possible. Moreover, the estimation mentioned in Proposition 5.5 is excessive for every ??>1 because two arbitrary matrices of the form (3.19) generated by (5.7) commute. For a discursion of the linear dimension of a group of commutative matrices, see, for instance, [27, Part 2, Section 10].

6. A Function Model for a ??-Symmetric Family of the Class ??+??

6.1. Some Remarks

In this section a function model of ??-symmetric family ?????+?? with real spectrum will be discussed. This model is defined with the help of an e.s.f. ???? of ?? (see Section 3). It is incomplete because the model describes the operator family restricted on some important subspaces (in particular, on the subspace ?H (see (3.15)(d))) and not this family itself. By virtue of Theorem 3.11, it is clear that the general situation can be reduced to the case of ??-orth.sp.f. ???? with a unique spectral peculiarity in zero. Furthermore, the case of a regular peculiarity is trivial because, under this condition, all operators from ?? are spectral in the sense of Dunford and have a finite-dimensional nilpotent part. Thus ???? is such that(a)??-1=??-1+0=0,??+1=??;(b)?={0};(c)sup???[-1;1]?{0}{??????}=8.(6.1)During the first stage, assume additionally that, for every closed interval ??[-1;0)?(0;1], the following condition holds:if??(?)?0,thenthesubspace??(?)Hispositive.(6.2)Note that (6.2) does not necessarily mean that H is a Pontryagin space because the subspace ?H[?] can contain both positive and negative subspaces of infinite dimension. We introduce some notation. LetH1=??HHn[?],H2=H?1n?H,H0=??H1,????beanorthoprojection(inthesenseofHilbertspaces)ontoH??,?????=0,1,2,??:=????|?H.(6.3)Note that, by virtue of (6.1)(c), the equality H1?{0} holds, and due to (6.2), the subspace H2 is uniformly positive (recall that the subspace H1 is finite dimensional). Without loss of generality one can assume that, on H2,(·,·)=[·,·].(6.4)Now, we pass to a detailed analysis of the structure of ????. First, let ???R? and???[-1;1]?{0}.(6.5)Then??(??)|(H0+H1+H2)[?]=0,(6.6)thus it is enough to study the behavior of ??(??) on the subspaceH0+H1+H2.(6.7)Assume that a canonical scalar product on H is such that (H0+H1+H2)[?]?(H0+H1+H2). In this case, (6.7) is an invariant subspace for ??.

A direct verification shows that, if (6.5) holds, the operator ??(??) has the following matrix realization:??(??)|H0+H1+H2=??????00010(??)0??12??(??)20(??)0??22????(??),(6.8)with respect to (6.7), where??10(??)=??12(??)??*12(??)??;??20(??)=??*12??(??)??;222(??)=??*22(??)=??22(??);??12(??)??22(??)=??12(??),(6.9)and the operator ?? corresponds to the representation??|H0+H1+H2=????0??-10??0000??2????.(6.10)Let ??0 be a family of all sets under Condition (6.5). If ??,?????0, then, for the operators ??(??) and ??(??), the condition of the form (6.8) holds simultaneously. Since ??(??)??(??)=??(??)??(??)=??(??n??), then??22(??)??22(??)=??22(??)??22(??)=??22??(??n??),12(??)??22(??)=??12(??)??22(??)=??12(??n??)??22(??n??).(6.11)Now, we discuss the spectrum multiplicity of the family ?????. Recall that a subspace ?? is said to be cyclic with respect to ????? if CLin???[-1;1]?{0}{?????H??}=.Definition 6.1. In what follows, a nonsingular multiplicity of ??-orth.sp.f. ???? means the minimal dimension of all cyclic subspaces with respect to ?????.Remark 6.2. Due to the choice of ?H one can assume that a cyclic subspace ?? is taken such that ???H2, so the nonsingular multiplicity of ???? coincides with the multiplicity (in the ordinary sense) of the (orthogonal) spectral function ??2????|H2.Proposition 6.3. If (6.1) and (6.2) are fulfilled and the nonsingular multiplicity of ???? is greater than dimH1, then there is a decomposition ?H=H(1)+H(2) such that H(1)[?]H(2), ????H(1)?H(1), ????H(2)?H(2) for every ???[-1;1]?{0}, the subspace H(1) is uniformly positive and the ??-orth.sp.f. ????|(H(1))[?] has nonsingular multiplicity less than or equal to dimH1.

Proof. Since H1??H and (6.2) holds, there is a sequence of disjoint subsets {????}81 such that a condition of the type (6.5) holds for all ??=1,2,, ?8??=1????=[-1;1]?{0}, and for every ??, the equality ??12(????)H2=H1 is true. It is clear that dim(??*12(????)H1)=dimH1. Let {????(??)}??1 be some orthonormalized basis in ??*12(????)H1, ??=1,2,. Set????=8???=1v(1/2)??????(??),??=1,2,,??;H(3)=CLin?????0{??22(??)????}????=1,(6.12)H(1)=(H(3))?nH2, H(2)=CLin?????0{??(??)H(3)}. We show that the subspaces H(1) and H(2) are as desired. First, we prove that, for every set ?????0, the equality??12(??)H(1)={0}.(6.13)holds. Indeed (see (6.11)), if ???H(1) and ???H1, then (??12(??)??,??)=(??,??*12(??)??)=(??,8???=1??22(????)??*21(??)??)=8???=1(??,??22(??n????)??*21(????=)??)8???=1(??,??22(??n????)?????=1????(??)????(??))=0.(6.14) Next, it is clear that H(3) is an invariant subspace with respect to the operators ??22(??), therefore, the subspace H(1) has the same property. Thus, taking into account (6.13), one can conclude that H(1) is invariant with respect to ????.

Remark 6.4. Proposition 6.3 shows that, in some problems one can assume that the nonsingular multiplicity of ???? is finite. At the same time, this hypothesis is not convenient in many cases because the decomposition ?H=H(1)+H(2) is not uniquely defined and, moreover, the subspace H(1) can be always extended saving all properties enumerated in Proposition 6.3. Basically, Proposition 6.3 gives a possibility to illustrate peculiarities of ??-orth.sp.f. in question using ??-orth.sp.f. with finite nonsingular multiplicity.In addition to (6.3), set ?H?=H0?H2,?????=????|?H,??????=(??0+??2)????|?H?.(6.15)Now, let ??2???(E) and ??2???(E) be some standard Hilbert space and some standard space of measurable vector-functions, respectively, and let ???1(??),???2(??),,?????(??) be a finite collection of vector functions such that(??)?????(??)??????(E),??=1,2,,??;(??)theset{?????(??)}????=1??isasetofunboundedelementsfrom2???(E)linearlyindependentmodulo??2???(E)andconformedwithX??.(6.16)Below ???2???(E)??????(E) is the linear span formed by ??2???(E) and the collection {?????(??)}????=1, where (see Section 5) the functions from {?????(??)}????=1 are assumed to be normalized, pairwise orthogonal, and orthogonal to ??2???(E), that is, on ???2???(E), a structure of Hilbert space is defined. Note that, sometimes, ???2???(E) will be considered without its Hilbert structure as a vector subspace from ?????(E) but this case will be noted explicitly.

6.2. Functional Model of ???? (A Special Case)

Theorem 6.5. If, for ??-orth.sp.f. ????, (6.1) and (6.2) hold, and for a canonical scalar product (·,·), (6.4) holds, then there exist a standard Hilbert space ??2???(E), a collection {?????(??)}????=1 satisfying (6.16) which generates the expansion ???2???(E) of ??2???(E), and an isometric operator ??: ???2????H(E)?, ????2???(E)=H2 such that, for every ???[-1;1]?{0}, the following representations take place (see (6.10)): ?????=??·??*??·(??)-1,???=(??2??????)??,???=???·X??·(???)-1,(6.17)where X??={X??,???2???(E)}, ??=dimH0=dimH1.Proof. First, ??2????|H2 is an orthogonal (in the ordinary Hilbert sense) spectral function, so there is a space ??2???(E) such that the operator ??2???? is similar to the operator X??={X??,??2???(E)}. Let a space ??2???(E) be already chosen and let an isometric operator ??2: ??2???(E)?H2 be such that ??2????|H2=??2X????2-1. Now, it is necessary to find a collection of unbounded elements {?????(??)}????=1, so that the corresponding space ???2???(E) and the operator ?? would be as desired. Choose, in H1, some orthonormalized basis {????}????=1. Let ??[-1;1]?{0} be a closed interval. Consider the expression (??(?)??,????), where ???H2. It can be considered as a continuous linear functional acting in H2 or, equivalently, in ??2???(E). By the well-known theorem of Riesz on the general representation of continuous linear functional, there is a function ????,?(??)???2???(E) such that(??(?)??,?????)=1-1(??(??),????,?(??))E????(??),(6.18)where ??(??)=??2-1?? or (thanks to properties of the spectral function)(??(?)??,?????)=?(??(??),????,?(??))E??????(??),(6.19)??,?(??)=0,if????.(6.20)Condition (6.20) means that there is a function ?????(??)??????(E) such that, for every interval ? as defined above,????,?(??)=???(??)?????(??),(6.21)where ???(??) is the indicator of the interval ?. The collection {?????(??)}????=1 is as desired. We show this. First, we prove that the set {?????(??)}????=1 is linearly independent modulo ??2???(E). Suppose the contrary, that is, suppose the existence of a collection of coefficients {????}????=1 such that0<?????=1|????|,?????=1?????????(??)???2???(E).(6.22)Let ???=????=1????????. By the definition of the space ?H, there is a sequence {????}81?Lin{??(?)H} such that ?????-????0 for ???8. Set ??2-1(??2????)=????(??). Note that ????(??)=0 in some neighborhood of zero, therefore, the representation?????-???2=(?????(??)???2???(E))2+?????=1|????-?1-1(????(??),?????(??))E????(??)|2(6.23)is valid, hence lim???8?????(??)?=0,lim???8?1-1(????(??),?????(??))E????(??)=????,??=1,2,,??.(6.24)These equalities and (6.22) imply?????=1|????|2=lim?????8???=1?????1-1(????(??),?????(??))E????(??)=lim???8?1-1(????(??),?????=1?????????(??))E????(??)=0,(6.25) which is a contradiction, that is, (6.22) is impossible.
Second, form ???2???(E) according to the above procedure using the space ??2???(E) and the collection of unbounded elements {?????(??)}????=1. Next, set????(??)=??2??(??),if??(??)???2???(E);???????(??)=????,??=1,2,,??.(6.26)In this case the dual operator ??? is defined by the equalities?????(??)=??2??(??),if??(??)???2?????(E);??????(??)=h??,whereh??=??-1????,??=1,2,,??.(6.27)Now, pass to (6.17). Assume (as above) that for a closed interval ? the condition ??[-1;1]?{0} holds. Then, in concordance with (6.8) and (6.19), one has ??12?(?)??=????=1(??,????(?))????, where ????(?)=??????,?(??), ??=1,2,,??, so ??20(?)h??=????(?), ??=1,2,,??. The last equalities, (3.21), and (3.23) imply (see the notation introduced in (6.15)) ??-1????(?)???????(??)=???(??)?????(??), ??=1,2,,??. Due to the choice of ??2???(E), the rest follows from (6.9) and (6.27).
Definition 6.6. If ??-orth.sp.f. ???? satisfies (6.1) and (6.2), and the space ???2???(E) has (6.17), then ???2???(E) is said to be a basic model space for ???? (compatible with (6.3) and (6.15)), and the operator ?? is said to be an operator of similarity (generated by ???2???(E)).

Theorem 6.7. Let a space ???2???(E) be the expansion of a standard Hilbert space ??2???(E) generated by a collection {?????(??)}????=1 satisfying (6.16). Then there exist a Pontryagin space H and a ??-orth.sp.f. ???? on H such that ???2???(E) is a basic model space for ????.Proof. Let H be the set of triples (??,??,??(??)) with ??,???C?? and ??(??)???2???(E). For ??1=(??1,??1,??1(??)) and ??2=(??2,??2,??2(??)), put(??1,??2)=(??1,??2)C??+(??1,??2)C??+(??1(??),??2(??))??2???(E),[??1,??2]=(??1,??2)C??+(??1,??2)C??+(??1(??),??2(??))??2???(E).(6.28) Next, let {????}????=1 be the canonical basis in C??. Then, for intervals ?=[??,??), where 0?? and ???0, we put??(?)(????,0,0)=(0,?????=1(???(??)?????(??),???(??)?????(??))??2???(E)·????,???(??)?????(??))for??=1,2,,??,??(?)(0,??,0)=(0,0,0)forevery???C??,??(?)(0,0,??(??))=(0,?????=1(???(??)??(??),???(??)?????(??))??2???(E)·????,???(??)??(??)).(6.29) Direct verification shows that ??(?) generates a ??-orth.sp.f. with (6.1) and (6.2). Let us check thatH1={(0,??,0)}???C??,H2={(0,0,??(??))}??(??)???2???(E).(6.30)We denote, by the symbol (??2???(E))0, the set of all functions from ??2???(E) vanishing near zero, and for every ??(??)?(??2???(E))0, we set ??1???:=????=1(??(??),?????(??))??2???(E)·????. Then the space ?H is the closure of the set{(0,??1??,??(??))}??(??)?(??2???(E))0.(6.31)Let a system {????}????=1 be an orthonormalized basis in C??. Then????=?????=1??????????(6.32)and (6.31) can be rewritten as{(0,?????=1(??(??),????(??))??2???(E)·????,??(??))}??(??)?(??2???(E))0,(6.33)where, by (6.32), ?????(??)=????=1???????????(??). Note that system {????(??)}????=1 also has (6.16).
Initially, the basis {????}????=1 was arbitrary but now we pass to choose it in a special way. Since the elements from {?????(??)}????=1 are unbounded, there is a sequence {????(??)}8??=1?(??2???(E))0 such that lim???8?????(??)???2???(E)=0 and ???1?????C??=1 for every ??. Let ????=??1????. Since ?????C??, one can assume that there exists lim???8????, and put ??1:=lim???8??????H. Now, we apply the same scheme for defining ??2. Let ??2??:=?????=2(??(??),????(??))??2???(E)·????=??1??-??1·(??1??,??1)C??. Then (0,??2?H??,??(??))? for every ??(??)?(??2???(E))0. Since the elements from {????(??)}????=2 are unbounded for every choice of {????}????=1, there exists a (new) sequence {????(??)}8??=1?(??2???(E))0 such that lim???8?????(??)???2???(E)=0 and ???2?????C??=1 for every ??. Let ????=??2????. Since ?????C??, one can assume that there exists lim???8????, and put ??2:=lim???8??????H. Then ??1???2. The rest of the proof of (6.30) is now evident. Next, we put ????(??)=(0,0,??(??)) for every ??(??)???-??2???(E), and ???????(??)=(0,????,0) for ??=1,2,,??. The rest is straightforward.
We note that a basic model space for a given ??-orth.sp.f. is not uniquely defined and discusses the arbitrariness for the choice of a concrete model. The construction of the basic model space was started from (6.3) and these depend on the choice of a canonical scalar product. So the first question is the following: does the basic model space depend on a choice of canonical scalar product? In order to answer this question, note, first, that H1 does not depend on any canonical scalar product and is calculated using only the Hermitian sesquilinear form [·,·] and ??-orth.sp.f. ????. Second, one can consider the factor space ?H/H1. Then, by virtue of (6.2), the sesquilinear form [·,·] generates in it the structure of Hilbert spaces, and the spectral function induced on ?H/H1 by the operator function ????? is orthogonal. Third, by Definition 4.2 and Proposition 4.3, this induced function is similar to the spectral function ??2????|H2. Summarizing all mentioned arguments, we obtain the following proposition.Proposition 6.8. If ???2???(E) is a basic model space for ??-orth.sp.f. ???? satisfying (6.1) and (6.2), and ?? is the corresponding operator of similarity, then the orth.sp.f. *????, induced on the Hilbert factor space *H?:=H/H1 by the ??-orth.sp.f. ????, is similar to the operator family X?? acting in ??2???(E), and the corresponding operator of similarity *??:??2???(E)?*H is induced by the operator ??.Thus the choice of ??2???(E) as a source for constructing a basic model space ???2???(E) is realized in the same class of spaces as for the orth.sp.f. *???? and does not depend on a canonical scalar product on ?H.Proposition 6.9. Let spaces ???2???(E) and ???2???(E) be expansions of a space ??2???(E) generating, respectively, by collections {?????(??)}????=1 and {?????(??)}????=1 with (6.16), let both ???2???(E) and ???2???(E) be a basic model space for the same ??-orth.sp.f. ???? with (6.1) and (6.2), and let ??(1) and ??(2) be the corresponding operators of similarity. If for every function ??(??)???2???(E), the relation (??(1)-??(2))??(??)?H1,(6.34)holds, then the spaces ???2???(E) and ???2???(E) coincide as vector subspaces in ?????(E).Proof. The complete proof will be divided in several stages. First, consider the case??(1)??2???(E)=??(2)??2???(E).(6.35)This equality means that, in particular, the basic model spaces ???2???(E) and ???2???(E) were constructed according to the procedure mentioned during the proof of Theorem 6.5 using the same decomposition ?H=H1+H2, but, generally speaking, a different choice of scalar products (·,·)(1), (·,·)(2), and (or) basis in H1. Put????(1):=??(1)?????(??),????(2):=???(2)????(??),??=1,2,,??.(6.36)Since the Hilbert structure of the spaces ???2???(E) and ???2???(E) is not in question, only the choice of the bases {????(1)}??1 and {????(2)}??1 in H1 is important (if scalar products are different then corresponding bases are necessarily different). Let????(1)(?)=(??(?)??,????(1))(1),????(2)(?)=(??(?)??,????(2))(2),??[-1;1]?{0},???H2,????(2)=?????=1??????????(1),??=1,2,,??.(6.37)Then, by (6.19) and (6.21)????(1)?(?)=?(??(??),?????(??))E????(??),????(2)?(?)=?(??(??),?????(??))E????(??),(6.38)where ??(??)=(??(1))-1??=(??(2))-1??. But {????(1)(?)}??1 and {????(2)(?)}??1 are the coefficients of decomposition for the same vector with respect to bases {????(1)}??1 and {????(2)}??1, respectively. Thus (6.37) gives the collection of equalities ????(2)?(?)=????=1??????????(1)(?), ??=1,2,,??, hence??(??(??),?????(??))E?????(??)=?(??(??),?????=1???????????(??))E????(??).(6.39)Since the segment ? is arbitrary and ??(??) runs through the set of all functions from ??2???(E), this equality gives?????(??)=?????=1???????????(??),??=1,2,,??.(6.40)Thus ???2???(E)????2???(E). Since the spaces ???2???(E) and ???2???(E) have an equal status, the inverse inclusion is also true. So ???2???(E) and ???2???(E) coincide as subsets of ?????(E). The proposition is proved under (6.35).
For the second stage assume that the model spaces ???2???(E) and ???2???(E) are constructed using different decompositions of the space ?H, that is, ?H=H1+H2(1), ?H=H1+H2(2), but the basis in H1 and, moreover, the scalar product in H1 for both spaces are the same. Thus????=??(1)?????(??)=???(2)????(??),??=1,2,,??.(6.41)Next, the space H2(2) can be represented in the formH2(2)={??+????}???H2(1),(6.42)where ??:H2(2)?H1 is a linear operator. It is clear that ?????=????=1????(??,????), where {????}??1 is a vector set from H2(1). Note that the equality(??(1))-1??=(??(2))-1(??+????)(6.43)holds for all ???H2(1). Indeed, if ??(??):=(??(1))-1??, then by (6.42), ??(2)??(??)=??+????, where ???H2(1). This implies (??(1)-??(2))??(??)=??-??-????, and thanks to (6.34), one has ??=??. Since ??(2) is a one-to-one mapping, (6.43) is proved.
Now, let ???H2(1)n(??(?)H+H1). Then by (6.15), the representation ?H=H1+H2(1) implies ???(?)??=??+????=1????(??,????(1)), where (cf., (6.19))????(1)=??(1)???(??)?????(??),??=1,2,,??,(6.44)so if (??(1))-1??=??(??), then??(?)??=??+?????=1??????(??(??),?????(??))E????(??).(6.45)The last equality can be rewritten as ??(?)??=(??+????)+?????=1????(??,????(1)-????)=(??+????)+?????=1??????(??(??),?????(??)-????(??))E????(??),(6.46)where ????(??)=(??(1))-1???????2???(E), ??=1,2,,??. On the other hand, by (6.15) and (6.43), the representation ?H=H1+H2(2) and the equality ??(?)??=??(?)(??+????) imply??(?)??=(??+????)+?????=1??????(??(??),?????(??))E????(??).(6.47)The comparison between (6.46) and (6.47) gives?????=1??????(??(??),?????(??))E????(??)=?????=1??????(??(??),?????(??)-????(??))E????(??).(6.48)Since the function ??(??) is subjected only to the condition ??(??)=???(??)??(??)???2???(E) and the closed segment ? is arbitrary, then ?????(??)=?????(??)-????(??), ??=1,2,,??. The proposition is proved under Hypothesis (6.41). The general case can be reduced to the two particular cases considered above, so the rest is straightforward.

The following proposition is a partial inverse of Proposition 6.9.Proposition 6.10. Let spaces ???2???(E) and ???2???(E) be the expansions of a space ??2???(E) generated, respectively, by collections {?????(??)}????=1 and {?????(??)}????=1 satisfying (6.16). If ???2???(E) and ???2???(E) coincide as vector subspaces in ?????(E) and the space ???2???(E) is a basic model space for some ??-orth.sp.f. ???? with (6.1) and (6.2), then the space ???2???(E) is also a basic model space for ????.

Proof. Let ?? be the operator of similarity for ???? that corresponds to the basic model space ???2???(E). The scheme of the proof will be the same as for Proposition 6.9; two particular cases will be considered and the superposition of these will give the general case.
So let a system {?????(??)}????=1 be such that?????(??)=?????=1???????????(??),??=1,2,,??.(6.49)Set H2:=????2???(E). The corresponding decomposition ?H=H1+H2 (generated by ??) will be taken also for the construction of an operator of similarity ??? corresponding to ???2???(E). First, set ?????(??):=????(??) for ??(??)???2???(E).
Next, for ???H2, ??=????(??), one has??1??(?)??=?????=1????·??(??(??),?????(??))E????(??),(6.50)this, jointly with (6.49) implies??1??(?)??=?????=1?????·??(??(??),?????(??))E????(??),(6.51)where ?????=?????=1??????????, ??=1,2,,??. The vector system {?????}????=1 is taken as the new orthonormalized basis in H1 (so, generally speaking, the Hilbert structure on H1 is redefined). Set ????????(??):=?????, ??=1,2,,??. Case (6.49) has been finished.
Now let ?????(??)=?????(??)+????(??), ????(??)???2???(E), ??=1,2,,??. Put?????(??)=????(??)+?????=1????·?1-1(??(??),????(??))E????(??),(6.52)where ??(??)???2???(E) and ????????(??)=????, ??=1,2,,??, that is, H?2=?????2???(E). Note also that the Hilbert structure of H1 does not change. It is easy to check that the operator ??? and the decomposition ?H=H1+H?2 are as required.
Remark 6.11. The proof of Proposition 6.10 shows that, if ???2???(E) is a basic model space for ??-orth.sp.f. ???? with (6.1) and (6.2), ?? is a corresponding operator of similarity, and ???2???(E) and ?? are conformed with the decomposition ?H=H1+H2, where H2???=??2???(E), then for every different decomposition ?H=H1+H?2 it is possible to find a new Hilbert structure of the vector set ???2???(E) (evidently this change does not touch ??2???(E)) and a new isometric map (an operator of similarity) ???: ???2????H(E)? such that ?????2???(E)=H?2 and (e.g., (6.34)) (??-???)??2???(E)?H1. An analogous proposition can be formulated for a change of the given Hilbert structure on H1.Remark 6.12. Propositions 6.9 and 6.10 show that the Hilbert structure of the basic model space ???2???(E) introduced during an expansion of ??2???(E) is not, in some sense, really important. On the other hand, an example mentioned below demonstrates that spaces ???2???(E) and ???2???(E) obtained as different expansions of a common space ??2???(E) can be basic model spaces for the same ??-orth.sp.f. ???? and be different vector subspaces in ??2???(E). Thus (6.34) in Proposition 6.9 cannot be omitted.Example 6.13. Let H be the totality of triples (??h,????,??(??)), where h and ?? are some fixed abstract vectors ??,???C, ??(??)???2??(C), so the measure defining the space ??2??(C) is the standard Lebesgue measure. For ??1=(??1h,??1??,??1(??)) and ??2=(??2h,??2??,??2(??)), put(??1,??2)=??1??2+??1??2+?1-1??1(??)??2(??)????,[??1,??2]=??1??2+??1??2+?1-1??1(??)??2(??)????.(6.53) Next, let???????=(0,(????-1(1/??2?)????+??-1(1/??)????)??,??[-1;??)(??)((??/??)+??(??))),(6.54)for ???[-1;0), and let ???????=(??h,(??-1??(??+????(??))??2????)??,??[-1;??)(??)??(??)+??(??[-1;??)(??)-1)??),(6.55)for ???(0;1].Direct verification shows that ???? is a ??-orth.sp.f. with (6.1), (6.2). In the capacity of a basic model space for ????, one can take, first, the space ???2??(C) generated by ??2??(C) and ??(??)=1/??, or, second, the space ???2??(C) generated by ??2??(C) and ???(??)=(1/??)????/??. In the first case, ??(????(??)+??(??))=(0,????,??(??)) and in the second case, ???(?????(??)+??(??))=(0,????,????/????(??)) (?? and ??? are the corresponding operators of similarity). At the same time, the spaces ???2??(C) and ???2??(C) form different vector subsets in ????(C) because |lim???+0?1????(??)??-??/??????|<8 and lim???+0?1?????(??)??-??/??????=8, that is, unbounded elements ??(??) and ???(??) are linearly independent modulo ??2??(C).

Theorem 6.14. Let spaces ???2???(E) and ???2???(E) be the expansions of a space ??2???(E) generated, respectively, by collections {?????(??)}????=1 and {?????(??)}????=1 with (6.16). Then ???2???(E) and ???2???(E) are basic model spaces for a common ??-orth.sp.f. ???? with (6.1) and (6.2) if and only if there is a unitary-valued function ???? of the type (3.23) such that the sets ???2???(E) and {???????(??)}???(??)????2???(E) coincide as vector spaces in ?????(E).Proof. Necessity By virtue of Remark 6.11, one can assume that, for model spaces ???2???(E), ??2???(E), and corresponding operators of similarity ??(1) and ??(2), there exist the same representation ?H=H1?H2 and the same Hilbert structure on H1. In this case, the operator ?????:2??????(E)?2???(E), ??:=(??(2))-1??(1) is well defined. Direct verification gives ??{X??,???2???(E)}*={X??,???2???(E)}*??, which implies ??{X??,???2???(E)}={X??,???2???(E)}??. Since the subspace ??2???(E) is invariant both for X?? and ??, these two operators commute on ??2???(E). Moreover, for every closed interval ??[-1;1]?{0}, the condition ??(?)?????(??)???2???(E) holds for all ?????(??), ??=1,2,??. The rest follows from Proposition 3.15.Sufficiency
By Theorem 6.7, one can construct a Pontryagin space H and a ??-orth.sp.f. ???? such that ???2???(E) is a basic model space for ????. The rest follows from (3.23) and Proposition 6.10.

The results obtained above show that the choice of a basic model space ???2???(E) for ??-orth.sp.f. ???? with (6.1) and (6.2) is reduced (up to a finite number of functions) to the choice of a standard Hilbert space ??2???(E). The last choice is not uniquely defined. The arbitrariness of the choice of ??2???(E) can be diminished if one takes in consideration only the standard Hilbert spaces orderly decomposable on uniform components. In the latter case, the choice is reduced (see [25, Theorem VII.6]) to the choice of scalar measure in the corresponding class of equivalent measures. Note that, if ??2???(E) is orderly decomposable on uniform components, then it is naturally embedded to the space ?????(E) and, therefore, this space is also orderly decomposable on uniform components. Moreover, the space ?????(E) does not depend on ??(??) but on the corresponding class of equivalent measures. This reasoning leads to the following theorem.

Theorem 6.15. Let ???2???(E) be a basic model space for ??-orth.sp.f. ???? with (6.1) and (6.2), and let the space ??2???(E) be orderly decomposable on uniform components. Then every basic model space for ???? constructed as an expansion of a standard Hilbert space orderly decomposable on uniform components has the following form; {1????(??)?????(??)}??????(??)?2???(E),(6.56)where ??(??) is a fixed scalar function satisfying the conditions ??(??)= 0 a.e. on [-1;1], and ?1-1??2(??)????(??)<8, and the operator-valued function ???? is subject to (3.24). Conversely, every functional vector space of the form (6.56) is a basic model space for ????.Remark 6.16. Let us consider an interpretation of Theorem 6.15 for the case of ??-orth.sp.f. ???? with simple nonsingular multiplicity (in particular, ???? can be cyclic although this condition is not necessary). In this case, ??2???(E) converts to the space ??2??(C) of scalar functions, and ???? converts to the multiplication operator by a function ??????(??), where ??(??):[-1;1]?[0;2??) is a ????-measurable function. Next, let {?????(??)}????=1 be a collection of unbounded elements generating the expansion ???2??(C) that is a basic model space for ????. Then every basic model space for ???? constructed as an expansion of a standard Hilbert space orderly decomposable on uniform components has, as a subset of ????(C), the following form:{1??(??)(??(??)+????????(??)???=1?????????(??))}??(??)???2??(C),??1,,?????C.(6.57)Concluding this part, let us consider an estimation of the norm of a ??-orthogonal projection ??(??), where the set ?? satisfies (6.5) and the conventions given above on the choice of the canonical scalar product on H are preserved.Proposition 6.17. If, under the mentioned above conditions, ??(??)?0, then ???(??)?=1+???12(??)?2.Proof. If ??12(??)=0, when the desired formula directly follows from (6.8), (6.9), so we assume that ??12(??)?0. Let??-1???H0,???H2,????2+????2=1.(6.58)Then ???(??)?2=sup??,??{???(??)(??-1??+??)?2}. On the other hand taking into account (6.9), (6.11), we have ???(??)(??-1??+??)?2=???12(??)??*12(??)??+??12(??)???2+???*12(??)??+??22(??)???2=(1+???12(??)?2)·???*12(??)??+??12(??)???2. A first step is an estimation of ???*12(??)??+??22(??)???2. Since ??22(??) is an orthogonal projection, it is clear that it is enough to consider the case ??22(??)??=??. Next, ???*12(??)??+???=???*12(??)?????+????=????*(??)?2?+1·????2+????2=????*(??)?2+1. Thus???(??)(??-1??+??)?2=(1+???12(??)?2)2.(6.59)The proof will be finished if vectors ?? and ??, satisfying (6.58) and converting (6.59) to an equality, can be found.
Since the operator ??*12(??) is finite dimensional, there is a vector ???0, ???H1 such that???*12(??)???=???*12(??)?????.(6.60)Let??=???12(??)???????????*(??)?2??+1,??=*12(??)?????*12?(??)??????*(??)?2.+1(6.61)Since ??22(??)??*12(??)=??*12(??) (see (6.9), ??)is well defined. Then??*12(??)??+??=(???121(??)?+???*12??(??)?)·12(??)??????????*(??)?2=?+1???*(??)?2??+1·12(??)??????·???*12(??)?2.(6.62) Finally (see (6.60)), ???12(??)??*12(??)???=???12(??)????*12(??)???.

Proposition 6.18. Let ???2???(E) be a basic model space for ??-orth.sp.f. ???? with (6.1) and (6.2), and let {?????(??)}????=1 be the corresponding system with (6.16). Then 1??????????=1??????(??)?2E????(??)=???12(??)?2=????????=1??????(??)?2E????(??).(6.63)Proof. Let {????}????=1 be the orthonormalized basis in H1 corresponding to the system {?????(??)}????=1. Then the operator ??*12(??)??12(??) has, with respect to this basis the matrix representation (??????)??×?? with the elements ??????=???(?????(??),?????(??))E????(??). The rest is a usual estimation for the norm of a positive matrix.

6.3. A Functional Model for ???? (The General Case)

In the previous subsection, we studied ??-orth.sp.f. ???? with (6.1), (6.2). Now, we turn to a more general case dropping (6.2). It implies that (6.9) and (6.11) must be substituted by some new ones. Let us conserve (6.3), (6.15). However, it is necessary to take into account that, now, generally speaking, the subspace H2 is indefinite. Recall that ??-orth.sp.f. ???? belongs to the class ??+??, so there is an ????-invariant pair of ??-orthogonal maximal semi-definite pseudoregular subspaces ??+ and ??- with finite-dimensional isotropic part; moreover, due to (3.15)(b), we can assume that, for every closed interval ??[-1;1]?{0}, the subspace (??(?)H)n??+ is positive and the subspace (??(?)H)n??- is negative. Thanks to the hypothesis, the following subspaces are well defined:?H+=CLin??[-1;1]?{0}{??(?)??+?H},-=CLin??[-1;1]?{0}{??(?)??-}.(6.64)SetH+2=H2n?H+,H-2=H2n?H-,(6.65)and assume that a fundamental scalar product on H is simultaneously canonical for the subspace ?H?H0 and, on the last space, compatible (see Definition 3.4) with the given decomposition of the subspacesH1+H+2,H1+H-2.(6.66)Thus??|H0+H1+H2=????0??-10??0000??2????,(6.67)where the operator ?? is the same as in (6.10), and ??2 is a canonical symmetry of the form [·,·] on H2. Then, for ?? satisfying (6.5), the elements of the matrix realization??(??)|H0+H1+H2=??????00010(??)0??12??(??)20(??)0??22????(??)(6.68)satisfy (cf. (6.9)) the following relations??10(??)=??12(??)??2??*12(??)??;??20(??)=??*2??12??(??)??;222(??)=??*22(??)=??#22(??)=??22(??);??12(??)??22(??)=??12(??).(6.69)Here, ??#22(??) is the operator ??-adjoint to the operator ??22(??) (note that now H2 is a Krein space). We note also that (6.11) remains valid.

Now, let ??-??2???(E) be a standard Krein space (see Section 3) and let {?????(??)}????=1 be a system of unbounded elements conformed with the operator-valued function X?? and linearly independent modulo ??-??2???(E) (i.e., {?????(??)}????=1 satisfies (6.16)). Denote, by ?????-2???(E), the linear span generated by the space ??-??2???(E) and the system {?????(??)}????=1. Define, on ?????-2???(E), structures of Hilbert and Krein spaces in the following way: on ??-??2???(E) both structures coincide with the original structures, and functions of the system {?????(??)}????=1 are, by definition, positive (as elements of the Krein space), mutually orthogonal and ??-orthogonal, normalized and ??-normalized, and orthogonal and ??-orthogonal to ??-??2???(E). The space ?????-2???(E) is said to be the expansion of ??-??2???(E) (generated by the collection {?????(??)}????=1).Theorem 6.19. If a ??-orth.sp.f. ???? satisfies (6.1) (but not (6.2)) and a scalar product on H is compatible with (6.66), then there are, first, a subspace ??-??2???(E) and a system {?????(??)}????=1 with (6.16) forming together the space ?????-2???(E), and, second, an isometric ??-isometric operator ??: ?????-2???(E)??H, ????2???(E)=H2, such that, for every ???[-1;1], ?????=??·??#??·(??)-1,???=(??2??????)??,???=???·X??·(???)-1,(6.70)where X??={X?????,??-2???(E)}, ??=dimH0=dimH1.Proof. Since the scalar product (·,·) on H2 is canonical and conformed with the decomposition H2=H+2[+]H-2, the spectral function ??2???? is simultaneously orthogonal and ??-orthogonal. Then for ??2????, by Proposition 4.3 and in concordance with Definition 4.2, there exist a model space ??-??2???(E) and an operator of similarity ??2. The rest of the proof is analogous to the corresponding stage of the proof for Theorem 6.5 taking into account that (6.9) must be substituted by (6.69).

Remark 6.20. Under the conditions of Theorem 6.19, the operator function ????? is similar not only to the operator function {??#?????,??-2???(E)} but also to the operator-function {??*??,???2???(E)}, where the space ???2???(E) is formed by the standard Hilbert space ??2???(E) (it is the same as for ??-???2???(E)) and the system of unbounded elements {?????(??)=???????(??)}????=1. Thus the properties of the operator-valued function ????? (as well as for ??????) do not depend on either (6.2) is fulfilled or not for the operator-valued function ????. However this dependence exists for the ??-orth.sp.f. ????, and this fact is connected with the different structure of the operator ??10(??) in (6.9) and (6.69). Note, in particular, that, if (6.2) is not fulfilled, then the estimation for the norm of operator ??12(??) given in Proposition 6.18 remains true, but at the same time, the equality for ???(??)? from Proposition 6.17 is, generally speaking, incorrect.Example 6.21. Take the space H coinciding with ??2, denote {????}8??=1 the canonical basis of this space, that is, ??1=(1,0,0,), ??2=(0,1,0,),, and define the canonical symmetry ?? by the equalities ????0=??1, ????1=??0, ????2??+1=??2??+1, ????2??=-??2??, ??=1,2,, and the spectral function ???? by the relations(i)????=0 for every ??<0;(ii)if ??>0, then (??-????)??0=?1/???[??;1)(??2(??-1)-??2??-1), (??-????)??1=0, (??-????)??2(??-1)=??2(??-1)+??1, (??-????)??2??-1=??2??-1+??1 for 1/???[??;1), and (??-????)??2(??-1)=(??-????)??2??-1=0 for 1/???[??;1).For ???=[1/??;1], one has ???12(???v)?=2(??-1) and ???(???v)?=2??-1. Note that, here, the values ???12(???)? and ???(???)? have the same order of growth for ???8. Note also that ??10(?)=0 for every closed segment ??[-1;1]?{0}.Definition 6.22. If, for (6.3) and (6.65), a relation between a ??-orth.sp.f. ???? satisfying (6.1) and a space ?????-2???(E) is given by (6.70), then ?????-2???(E) is said to be a basic model space for ???? (compatible with (6.3), (6.15), and (6.66)) and the operator ?? is said to be an operator of similarity corresponding to this space.Note that Definition 6.22 does not contradict Definition 6.6, but amplifies it; if, for ??-orth.sp.f. ????, (6.2) is fulfilled, then ??=??, so the canonical scalar product is uniquely defined on H2 and coincides with [·,·].

Now, we show that every space ?????-2???(E) can be considered as a basic model space for a suitable ??-orth.sp.f. ???????+??.

Theorem 6.23. Let a space ?????-2???(E) be the expansion of a standard Krein space ??-??2???(E) generated by a collection {?????(??)}????=1 satisfying (6.16). Then there exist a Krein space H and a ??-orth.sp.f. ???? on H such that ???????+?? and ?????-2???(E) is a basic model space for ????.Proof. Let H be the set of triples (??,??,??(??)) with ??,???C?? and ??(??)???-??2???(E). For ??1=(??1,??1,??1(??)) and ??2=(??2,??2,??2(??)), put (see (4.3))(??1,??2)=(??1,??2)C??+(??1,??2)C??+(??1(??),??2(??))??2???(E),[??1,??2]=(??1,??2)C??+(??1,??2)C??+[??1(??),??2(??)]??2???(E).(6.71) Next, let {????}????=1 be the canonical basis in C??. For the intervals ?=[??,??), where 0?? and ???0, we put??(?)(????,0,0)=(0,?????=1[???(??)?????(??),???(??)?????(??)]??2???(E)·????,???(??)?????(??))for??=1,2,,??,??(?)(0,??,0)=(0,0,0)forevery???C??,??(?)(0,0,??(??))=(0,?????=1[???(??)??(??),???(??)?????(??)]??2???(E)·????,???(??)??(??)).(6.72) Direct verification shows that ??(?) generates a ??-orth.sp.f. satisfying (6.1). The rest of this proof looks like the corresponding part of the proof of Theorem 6.7 with some evident modifications.Next, the basic model space is constructed not only via the ??-orth.sp.f. ???? itself and via the subspaces ?H and H1 naturally generated by ???? (note that, in this case, it is convenient to consider the mentioned subspaces as linear topological spaces), but also via some other subspaces and via the Hilbert structure introduced on ?H and H1 that can be defined with some ambiguity.Proposition 6.24. Let a space ?????-2???(E) (i.e., the expansion of standard Krein space ??-??2???(E) generated by a collection {?????(??)}????=1 with (6.16)) be a basic model space for a ??-orth.sp.f. ???? compatible with (6.3), (6.15), and (6.66). Then for every different decomposition ?H=H1+H?2,H?2=??+[+]??-,(6.73)where ??+ and ??- are, respectively, uniformly positive and uniformly negative subspace, and H1+??+ and H1+??- are ????-invariant, there is a collection {?????(??)}????=1 with (6.16) such that the expansion ??-???2???(E) of ??-??2???(E) generated by {?????(??)}????=1 is also a basic model space for ???? compatible with (6.3), (6.15), and (6.73).Proof. Note that a collection of unbounded elements {?????(??)}????=1 is uniquely defined by a set composed by the following components: a choice of a normalized basis in H1, a decomposition ?H=H1+H?2, and an isometric ??-isometric map ???2: ??-??2???(E)?H?2. This collection always exists for the mentioned set, so it is enough to show the existence of ???2. Consider two cases.
(1) Let H?2=H2. Thus, on the Krein space H2, there are two different ??2????-invariant canonical decompositions. Then, thanks to Proposition 3.8 and (6.70)??2????|H2=??{H+2,H-2},{??+,??-}??2X????2-1(??{H+2,H-2},{??+,??-})-1,(6.74)so one can take ???2=??{H+2,H-2},{??+,??-}??2.
(2) Let H?2?H2 and let the pairs {H+2,H-2} and {??+,??-} be related by a condition of the type (3.9). Then by Remark 3.6 and Proposition 3.7, one can take ???2=M?H,H2,H'2·??2.
Now, let us pass to the general case. Let ???+:=M?H,H2,H'2H+2 and ???-:=M?H,H2,H'2H-2. Then H?2=???+[+]???-, and one can take???2=??{??'+,??'-},{??+,??-}M?H,H2,H'2·??2.(6.75)
Corollary 6.25. Assume that ???? is a ??-orth.sp.f. satisfying (6.1), (6.3) is fixed, and ??-??2???(E) is a standard Krein space. Then, independently of any realization of (6.73), an expansion of ??-??2???(E), that is a basic model space for ???? compatible with (6.73), exists if and only if there is a ??-isometric operator ??2:??-??2???(E)?H2 such that ??2????|H2=??2X????2-1.(6.76)Remark 6.26 (cf., with Proposition 6.8). Let *H be the factor-space of H generated by H1. Then *H is a Krein space and ????? induces, on this space, the ??-orth.sp.f. *????. Note that the unique peculiarity of *???? is regular and can be removed, so, as a slight abuse of terminology, one can say that *???? has no peculiarities. It is clear that ??2 in (6.76) exists if and only if there exists a ??-isometric operator *??:??-??2???(E)?*H such that *????=*??X??*??-1. Taking this reasoning and Corollary 6.25 into account, one can say that an arbitrariness in the choice of a basic model space for ??-orth.sp.f. ???? satisfying (6.1) does not depend on the choice of ??2 but essentially depends on an arbitrariness in the choice of a basic model space for ??-orth.sp.f. *???? with the empty set of peculiarities. The last problem was considered in Section 4.Proposition 6.27. Assume that spaces ?????-2???(E) and ???-???2???(E) are constructed on the base of the same space ??2???(E) passing by the following way: first, introduce on it two (maybe different) sesquilinear forms by fundamental symmetries ?? and ???; second, expand these two standard Krein spaces using collections of unbounded elements {?????(??)}????=1 and {?????(??)}????=1, respectively. Assume also that, first, ?????-2???(E) and ???-???2???(E) are basic model spaces for a ??-orth.sp.f. ????, second, ??(1) and ??(2) are corresponding operators of similarity, and, third, every function ??(??)???2???(E) satisfies (6.34). Then ??=??? and the spaces ?????-2???(E), and ???-???2???(E) coincide as subsets in ?????(E).Proof. Condition (6.34) implies that [??(1)??(??),??(1)??(??)]=[??(2)??(??),??(2)??(??)] is true for every ??(??)???2???(E), so [??(??),??(??)]?????-2???(E)=[??(??),??(??)]??-???2???(E). Hence ??=???. The rest of the reasoning is similar to that of Proposition 6.9.Comparing the last proposition with Proposition 6.10, note that the fulfilment of (6.34) is essential for the simultaneous coincidence ?????-2???(E) with ???-???2???(E) as subsets in ?????(E), and ??-??2???(E) with ???-??2???(E) as standard Krein spaces, but at the same time is not necessary.Theorem 6.28. Assume that spaces ?????-2???(E) and ???-???2???(E) are constructed on the base of the same space ??2???(E) passing by the following way: first, introduce on it two (maybe different) sesquilinear forms by fundamental symmetries ?? and ???, and second, expand these two standard Krein spaces using collections of unbounded elements {?????(??)}????=1 and {?????(??)}????=1, respectively. Then ?????-2???(E) and ???-???2???(E) are basic model spaces for a common ??-orth.sp.f. ???? satisfying (6.1) if and only if there exist operator functions ???? and ????, ???[-1;1], with (3.24) and (4.7), respectively, such that the sets ???2???(E) and {???????????(??)}?????(??)?2???(E) coincide as subsets of ?????(E).The proof of this theorem is similar to that of Theorem 6.14.

6.4. The Passage to ??-Symmetric Operator Families

Up to this point, we discussed model representations not for a family ?????+?? but for a ??-orth.sp.f. ???? with the unique spectral peculiarity in zero subjected to the conditionThereexistsL+???+(H)nh+suchthatforevery???R?{0}itistrue??????+???+andforeveryclosedinterval??R?{0}thereisthedecomposition??(?)H=??(?)??+[+]??(?)??-.(6.77)Now, let ?????+?? be a ??-symmetric commutative operator family. Then its linear span contains a family (not uniquely defined) ???? of ??-s.a. operators such that the linear span of ???? coincides with the linear span of ??. In [20], it was proved that there is the decomposition H=H????[+]H????, where H???? and H???? are ??-invariant, all operators from ????|H???? have real spectra, dimH????<8, and, at least, one ??-s.a. operator from Alg??|H???? has no real points in its spectrum. Let ???? be an e.s.f. for ????|H????. Extend the action of ???? for all H setting ????|H????=0. This extended function ???? is said to be an e.s.f. of ??. Comparing Theorem 3.11 and Theorem 6.19, it is easy to obtain the following result.Theorem 6.29. If ?????+?? is a commutative ??-symmetric family, its e.s.f. ???? satisfies (6.1), a canonical scalar product on H is compatible with (6.66), ?????-2???(E) is a basic model space for ????, and ?? is a corresponding operator of similarity, then, for every operator ?????, there is a function ??(??) such that ????=???·F·(???)-1,???=??·F#·??-1,(6.78)where ????:=(??0???1)??|?H?, the space ?H? and the operator ??? are defined via (6.15) and (6.70), F={F,??-??2???(E)}, and F is the multiplication operator by ??(??) also acting in the space ?????-2???(E).Remark 6.30. If, under the conditions of Theorem 6.29, ??-orth.sp.f. ???? satisfies (6.2), then the space ?????-2???(E) must be substituted by the space ???2???(E), and, respectively, the operator F# must be substituted by the operator F*.Definition 6.31. If ?????+?? is a commutative ??-symmetric family and ???? (satisfying (6.1)) is its e.s.f., then a basic model space for ???? is said to be also a basic model space for ??.Remark 6.32. Assume that ?????+?? is a commutative ??-symmetric family, its e.s.f. ???? satisfies (6.1), and ?????-2???(E) and ?? are, respectively, a basic model space and a corresponding operator of similarity for ??. If, under these conditions, an operator ????? and a function ??(??) are related by (6.78), then, according to Definition 3.12, the function ??(??) is a portrait of the operator ?? (with respect to ????), and the operator ?? is an original (not unique in the general case) of ??(??) in ??. It is clear that the portrait of an operator does not depend on the choice of the basic model space ?????-2???(E) and can be found via (3.15)(c), but at the same time depends on the choice of ????.Remark 6.33. Theorem 6.29 brings a natural problem concerning a characterization of functions that can be portraits for operators from a given commutative ??-symmetric operator family ?????+?? with a fixed choice of ??-orth.sp.f. ????. A partial answer to the problem is contained by Propositions 5.4 and 5.5. Indeed, under the present conditions, the function ??(??) from (5.5) has the form????????(??)=??-1-???(??)????(??),???[-1;0),1????(??)????(??),???(0;1],where??(??)=1+?????=1??????(??)?2E.(6.79)

7. Closing Remarks

Spectral functions are a traditional source for constructions of model spaces for different classes of normal operators in Hilbert spaces, so it is natural to use the same approach in Krein spaces. The first theorem concerning the existence of spectral functions for ??-s.a. operators was published by Krein and Langer in [28] (see also [6] for detailed proofs). The spectral functions introduced in Section 3.2 are a particular case of generalized spectral functions [1]. Our definition is inspired by spectral measures arising in the operator theory in indefinite metric spaces (see [3, 6, 8, 29]) but formally, independent (see [30]) of this Theory. Another development related with generalized spectral functions can be found in [3134]. There are some works on model representations for self-adjoint operators and algebras in Pontryagin spaces (the majority of them consider the case with the rank of indefiniteness 1) [3540], (see also [41] for more references). In [12], the case of a self-adjoint cyclic operator acting in an arbitrary Pontryagin space was considered. The class ??+?? that is investigated in the present paper differs from the well-known class of definitizable operators (see [42] for discussion) and represents another natural generalization of the class of self-adjoint operators in Pontryagin spaces. The notion of unbounded elements was given by the author in [43], thereupon, this notion was used in [9], where the existence of a basic model space for a single ??-self-adjoint operator was proved. The latter result was applied in [10] (devoted to a description of a broad functional calculus for ??-self-adjoint operators) and [11], where the bicommutant problem for a ??-self-adjoint operator was studied. Some remarks concerning a model representation of ??-unitary operators were given in [44]. A connection between the spaces of the type ??8??n??2?? and operator algebras was pointed out for the first time in [45] (for Pontryagin spaces with the rank of indefiniteness 1) and [46]. On this subject, see also [47, 48]. Although the concept of basic model spaces for commutative families of ??-self-adjoint or ??-self-adjoint operators of the ??+??-class was used by the author in some previous papers, its complete description and corresponding proofs as well as the discussion of the ambiguity of basic model spaces are given here for the first time.

Acknowledgments

This work was completed with the support of Project FONACIT (Venezuela) G-97000668. The author is very grateful to Tom Berry and Luís Mata Lorenzo for their assistance in making this paper more readable. The author would like also to thank the referee of this paper for his/her very useful comments.