Abstract: We reformulate the widths problem in the framework of information-based complexity theory and study the Kolmogorov width and linear width for the generalized Besov classes in the randomized setting. Applying the discretization technique and some properties of pseudo-s-scale, we determine the exact asymptotic orders of these widths on these classes for certain values of the parameters p, q, θ. Our results show that the Monte Carlo methods lead to a better convergence rate than that of the deterministic ones for some parameters p, q. The maximal gain can reach a factor n-1/2 roughly.
INTRODUCTION
In approximation theory, an important problem is to find for a fixed class of functions a system of functions which is well adapted for approximating the functions from the class involved. It is natural to ask how to compare methods of approximation and how to determine an optimal method. This led to the notions of various widths. The idea of width was originally due to A.N. Kolmogorov. Subsequently, V.M. Tikhomirovs work made this direction active. The main task of widths is to construct the best approximations and determine the asymptotic orders of optimal errors for various classes of functions. It is well known that the calculation of widths plays a dominant role in numerical analysis, information-based complexity and approximation theory. Moreover, widths have close relations to many optimal problems such as ε-complexity of approximation and integration, optimal differentiation and optimal approximate solutions of the classes of operator equations. The extensive literature devoted to the calculation of the widths on some important classes of non-periodic or periodic functions, such as the Sobolev classes, the Besov classes and the classes of analytic functions etc., For the details about the history, applications and the results of n-widths on various classes, one can refer to Temlyakov (1994) and Pinkus (1985) and the references therein. While one of most intensively disputed questions of computational mathematics is the following: What is the superiority of Monte Carlo methods compared with deterministic methods, i.e., can it be of help to involve randomness into numerical processes and if yes, in which situations is this advisable? The first results about the analysis of efficiency of randomized (Monte Carlo) methods were due to Bakhvalov , while an intensive wider research started only after the theory of information-based complexity (Traub et al., 1988) was established. The theory of information-based complexity has created notions and tools to understand the efficiency issues both for deterministic and Monte Carlo methods. In this way some comparison between the deterministic and the Monte Carlo settings becomes possible. So, many authors have investigated the complexity of problems on function approximation. In particular, Mathe (1994) and Heinrich (1994) studied the approximation problems on the classical multivariate Sobolev space
Motivated by the above results we consider the approximation on Besov class which is much more general than Sobolev class. It is also well-known that the Besov classes of functions play an important role in the approximation theory and solutions of differential and integral equations and many other fields of applied mathematics. Exploiting the work of Mathe on finite randomized widths, we obtain the exact orders for Kolmogorov and linear widths on these classes in the randomized setting. Comparing our results with the known results on deterministic widths, (Xu, 2005), one can see that the Monte Carlo methods outperform the deterministic ones for some parameters p, q.
NOTIONS OF INFORMATION-BASED COMPLEXITY AND WIDTHS
Let X, Y be Banach spaces and X0 be the unit ball of X. Let S be a continuous operator from X0 to Y. Let Rd be the d-dimensional Euclidean space. We seek to approximate S by mappings of the form μ =
Let Dk(X0, Y), Ak(X0, Y) denote the sets of all Kolmogorov and linear methods which have cardinality equal to k, respectively and put:
such that:
give rise to the respective classes of Kolmogorov and linear methods. Denote by
The worst case error of any method
Minimizing the errors with respect to the choice of methods within the given class, we get the n-th minimal error defined by:
Denote:
Next, we pass to the randomized setting. We assume that both X0 and Y are equipped with their respective Borel σ-algebras
Definition 1: (Mathe, 1994). Given a class of methods
• | [Ω, F, P] is a probability space |
• | |
• | The cardinality function k: Ω→Y is a measurable natural number, for which: |
The error of a Monte Carlo method
with the cardinality:
The n-th Monte Carlo error is defined as:
Denote:
RESULTS
We first recall the definition of generalized Besov class from Xu (2005). Denote by Lp(Td), 1≤p≤∞, the space of p-th powers Lebesgue integrable functions defined on the torus Td = [0, 2π]d, which are 2π-periodic in each variable with the usual norm ||.||p. For k∈N and h∈Rd, define the k-th difference of f as:
The k-th modulus of smoothness Ωk (f, t)p of f is defined by:
Definition 2: Let Ω denote a non-negative function on R+ = {t: t≥0}. We say that Ω(t)∈Φ*k if it satisfies:
• | Ω(0) = 0, Ω(t)>0 for any t>0 |
• | Ω(t) is continuous |
• | Ω(t) is almost increasing, i.e., for any two points t, τ such that 0≤t≤τ, we have Ω(t)≤t≤τ where C>0 is a constant independent of t and τ |
• | For any n∈Z+, Ω(nt)≤CnkΩ(t), where k≥1 is a fixed positive integer, C>0 is a constant independent of n and t |
• | There exists α>0 such that Ω(t)/tα is almost increasing |
• | There exists β, 0<β<k, such that Ω(t)/tβ is almost decreasing, i.e., there exists C>0 such that for any two points t, τ such that 0≤t≤τ it always holds: |
Definition 3: Let, k∈N, Ω(t)∈Φ*k, 1≤θ≤∞ and 1≤p≤∞. We say
• |
• |
where:
The space
When Ω(t) = tα,
Let l denote the identical imbedding operator from the unit ball of
Theorem 1 (Xu, 2005): Suppose that k∈N, Ω(t)∈Φ*k , 1≤θ≤∞, Ω(t)/ta is almost increasing and a>d max(7/12-3/p, 1/2+3/q,1/p-1/q). Then:
Our main result is the following theorem.
Theorem 2: Suppose that k∈N, Ω(t)∈Φ*k, 1≤θ≤∞, Ω(t)/ta is almost increasing and a>d(7/2-3/p, 1/2+3/q,1/p-1/q). Then:
Comparing Theorem 2 with Theorem 1, one can see that the randomized methods lead to considerably better rates than those of the deterministic ones in some cases. Quantitatively, the maximal gain can reach a factor n-1/2 roughly.
PROOF OF MAIN RESULT
Our proof of main result is based on the discretization technique and some properties of pseudo-s-scale. So we first recall the definition of pseudo-s-scale.
Definition 4 (Pietsch, 1978): A map s assigning to every S∈L (X,Y) a sequence {sn(S)}n∈N is called a pseudo-s-scale if the following properties are satisfied:
for all Banach spaces X,Y and operators U∈L(X, X), V∈L(Y, Y).
It is easy to check that the quantities
We recall a representation theorem for
be the one-dimensional de la Vallee Poussin kernel and define the d-dimensional de la Vallee Poussin kernel by:
For
Theorem 3: If
convergencing to it in the norm of
Let
Lemma 1: Let p<q, Ω(t)/ta be almost increasing a>d(1/p-1/q)and sn denote any of quantities:
Then:
where, the nk are non-negative integers with:
Lemma 2: Let Ω(t)/ta be almost increasing and sn denote any of quantities
To proceed the process of the discretization, we need the following results about the randomized widths of the finite-dimension space lnp.
Lemma 3 (Mathe, 1994): For 1≤p≤2 and 1≤n≤m , we have the estimate:
Lemma 4 (Mathe, 1994): For any n∈N, there exist a constant c>0 and r∈Nfor which:
Where:
Lemma 5 (Temlyakov, 1994): Let 1<p<q≤∞ and f∈Lp. Then:
Proof of theorem 2: It is clear that:
So, it suffices to prove the upper bound for
We start with the upper estimate. By the relation
and Theorem 1, we only need to estimate the upper bounds for 2≤p<q<∞ and 1<p<2≤q<∞, p'≤q
First, we consider 2≤q<p<∞. In this case, it suffices to estimate the upper bounds for
By Lemma 1, we have:
(1) |
For a given nεN, we choose mεM such that 2mxnVd and set:
where, 0<β<2α/d-1. Thus, we have:
By lemma 3 and the nk defined above, we can obtain from Eq. 1 at:
We get the required estimates for 2≤p<q<∞.
Second, we consider 1<p<2≤q<∞, p'≤q. By the relation,
Now we pass to the lower estimates. According to lemma 2, we have:
(2) |
For r' in lemma 4, we choose a number m such that 2nmd≥r' n. We continue to estimate the lower bounds. First, let 1<q≤p<∞. Obviously, it suffices to prove the lower bounds for 1<q≤2≤p<∞. By Eq. 2 and Lemma 4, we get:
Next, let 1<p<q<∞. We will divide three cases to estimate the lower bounds. For 1<p<2≤q<∞, we only need to consider the case 1<p<2 and q = 2. Equation 2 and lemma 4 again give that:
(3) |
For 2≤p<q<∞, the relation
(4) |
By lemma 5 and Eq. 4, we obtain:
The proof of theorem 2 is complete.
ACKNOWLEDGMENTS
The authors are grateful to the referees for their valuable suggestions. This work was supported in part by the Natural Science Foundation of China (Grant No. 11201104, 10971251 and 11271199).