International Journal of Mathematics and Mathematical Sciences

Volume 2018, Article ID 4867091, 6 pages

https://doi.org/10.1155/2018/4867091

## Greedy Expansions with Prescribed Coefficients in Hilbert Spaces

Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Russia

Correspondence should be addressed to Albert R. Valiullin; moc.liamg@7991nilluilav.trebla

Received 28 October 2018; Accepted 15 November 2018; Published 9 December 2018

Academic Editor: Brigitte Forster-Heinlein

Copyright © 2018 Artur R. Valiullin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Greedy expansions with prescribed coefficients, which have been studied by V. N. Temlyakov in Banach spaces, are considered here in a narrower case of Hilbert spaces. We show that in this case the positive result on the convergence does not require monotonicity of coefficient sequence . Furthermore, we show that the condition sufficient for the convergence, namely, the inclusion , can not be relaxed at least in the power scale. At the same time, in finite-dimensional spaces, the condition can be replaced by convergence of to zero.

#### 1. Introduction

Expansion in Fourier series [1] is a classical and comprehensively studied tool of theoretical and applied mathematics which takes an expanded function as an input and constructs a sequence of its expansion coefficients. Greedy expansions [2, 3], which are equivalent in the simplest case to Fourier series reordered by decreasing norms of terms and known in statistics and signal processing as Projection Pursuit Regression [4, 5] and Matching Pursuit [6], respectively, perform parallel computation of expansion coefficients and selection of expansion elements from a predefined dictionary. V. N. Temlyakov [3, 7] (see also [8]) proposed a type of a greedy expansion that performs only selection of expansion elements, while coefficients are prescribed in advance. The definition proposed by V. N. Temlyakov for the case of Banach spaces, in the case of Hilbert spaces, takes the following form.

*Definition 1. *Let be a Hilbert space over with a scalar product , be a symmetric unit-normed dictionary in (i.e., , all elements in have a unit norm, and if , then also belongs to ). In addition, let , , and be a sequence of positive numbers. We define inductively a sequence of remainders and a sequence of expanding elements . First, we set . Then, if has already been defined, we select as an (arbitrary) element which satisfies the condition and set .

The series is called a greedy expansion of in the dictionary with the prescribed coefficients and the weakness parameter .

It immediately follows from the definition of a greedy expansion that , and hence the convergence of the expansion to an expanded element is equivalent to the convergence of remainders to zero as .

As a selection of an expanding element is potentially not unique, there may exist different realizations of a greedy expansion for a given dictionary , weakness parameter and sequence of coefficients . Furthermore, for greedy expansion may turn out to be nonrealizable due to the absence of an element which provides .

V. N. Temlyakov showed [3, heorem 2.1] that if a number of conditions hold which are equivalent in the case of Hilbert spaces to the divergence of the series and the convergence of the series , a greedy expansion with prescribed coefficients converges to an expanded element at least for a subsequence of indexes, i.e., . Later V. N. Temlyakov proved the standard convergence (i.e., ) under the additional condition of monotonicity of [7, heorem 4]. Yet, it remained unknown whether the condition and the monotonicity condition could be essentially relaxed without violating the guaranteed convergence to an expanded element.

#### 2. Main Results

We start with a positive result which states that in Hilbert spaces the monotonicity is not required for the standard convergence. Namely, the following theorem holds.

Theorem 2. *Let be a Hilbert space, be a symmetric unit-normed dictionary in , , be a sequence of positive numbers which satisfies the conditions (i.e., ). Then for every element all realizations of its greedy expansion in the dictionary with the prescribed coefficients and the weakness parameter converge to .*

It is clear that if the first condition on is violated, then there is no convergence to an expanded element for all with the norm exceeding the sum . The significance of the second condition on follows from the following theorem.

Theorem 3. *There exist a Hilbert space , a symmetric unit-normed dictionary , an element and a sequence of positive numbers such that but a greedy expansion of in the dictionary with the prescribed coefficients and the weakness parameter does not converge to .*

As for the second condition of Theorem 2 a boundary in the power scale is , Theorem 3 in fact shows that this condition in Theorem 2 can not be relaxed at least in the power scale.

However, the question about a possibility of a more delicate relaxation of the condition remains open. This question can be stated as follows: is it true that for every sequence of positive numbers that converges to zero but does not belong to there exist a Hilbert space , a symmetric unit-normed dictionary and an expanded element such that at least one realization of greedy expansion of in with the prescribed coefficients (and, e.g., the weakness parameter ) does not converge to ?

We note that assertions similar to Theorems 2 and 3 have been announced by O. Rassudova in her conference talk [9], but the proofs have not been published. To the best of our knowledge, in her proof of an analogue of Theorem 3 O. Rassudova used a modification of the construction [10, heorem 3] which is based on analytical estimates and does not have a clear geometric interpretation. The construction presented in our work is geometrically demonstrative.

We also note that at least for for the natural class of monotonic coefficients in case of finite-dimensional Hilbert spaces the condition in Theorem 2 can be replaced by an essentially weaker condition . The proof of this fact is presented in section* The case of finite-dimensional spaces*.

#### 3. Proof of Theorem 2

The theorem can be easily derived from the equality , which holds due to the aforementioned result by V. N. Temlyakov [3, heorem 2.1]. From the definition of the greedy expansion it immediately follows thatAs coefficients are positive and the dictionary is symmetric, . Hence and thusThe condition implies that Due to the equality we have thatFrom two last assertions we obtain that for every there exists such that the following two conditions simultaneously hold: Thus using estimate (6) we get that for all . But according to the definition of the limit it directly means that . The proof of Theorem 2 is complete.

We note that for monotonic coefficients and the weakness parameter the statement of Theorem 2, which is covered in this case by [7, heorem 4], can be also derived as a corollary of the same result by V. N. Temlyakov about the convergence for a subsequence of indexes [3, heorem 2.1] and the following lemma. We find this lemma to be interesting on its own.

Lemma 4. *Let and monotonically converge to zero as . Then for every realization of greedy expansion with the prescribed coefficients the sequence of norms of its remainders converges.*

We begin our proof of this lemma with an estimate of a possible increase of the remainder norms. Let denote the set of all indexes for which . If the set is finite, then starting from a certain index the sequence is monotonic and thus convergent. Hence it remains to consider the case of countably infinite .

For the sake of brevity we denote the scalar products by . It follows from the definition of the greedy expansion and the symmetric property of the dictionary that all are nonnegative.

The Pythagorean theorem implies that for all indexes the equalityholds. If , then , and thusConsequentlyAt the same timeIt means that if the remainder norm increased at the transition from to , then the increase of the norm square does not exceed , for the next expansion step the increase is impossible, and the joint increase of the square of remainder norm for two steps of the expansion does not exceed and hence does not exceed , where can be set to .

Having this estimate, let us complete the proof. We note that the series converges: it can be easily derived either from the Leibniz’s alternating series test or from the inequalityLet us fix an arbitrary positive and find an index such that and simultaneously . Next we find an index such that , where denotes the infimum of the remainder norms . Then for every we have that Hence () and consequently . The proof of Lemma 4 is complete.

#### 4. Proof of Theorem 3

Our proof of Theorem 3 includes the following blocks: construction of a dictionary with simultaneous construction of coefficients ; description of realization of greedy expansion; proof of the absence of convergence to the expanded element; obtaining the required estimate of . As a Hilbert space we take an arbitrary infinite-dimensional separable space, e.g., .

Figure 1 illustrates certain steps of the proof.