Questions tagged [approximation-theory]
Approximation theory is concerned with how functions can best be approximated with simpler functions, and with quantitatively characterizing the errors introduced thereby.
599 questions
-4
votes
2
answers
173
views
Why exactly is Simpson's rule better than the Trapezoidal rule? [closed]
I am reading up on numerical integration and have trouble to really understand why or rather in what sense Simpson's rule is better than the Trapezoidal rule in general. There is a lot of stuff ...
0
votes
0
answers
57
views
Complexity of evaluation of analytic functions
Given an analytic function $f(x)$ (say as combination of elementary functions and operators), is it possible to compute $n$ first bits of the value of the function on the whole interval $[a, b]$ ...
1
vote
0
answers
32
views
Surjectivity of MLP functions
Suppose that $\mathcal{F}(H,L)$ is a function class of all functions implemented by a multilayer perceptron with ReLU activation, width $H$ and depth $L$. Also, there is a set of all possible value ...
5
votes
0
answers
78
views
What is the maximal advantage of randomized over deterministic algorithms for approximation in the worst-case?
Let $X\subset Y$ be Banach spaces and $B_X:=\{x\in X: \|x\|_X\le1\}$ be the unit ball of $X$.
The goal is to find an approximation of every element from $B_X$ with error measured in $Y$ by using at ...
-1
votes
1
answer
167
views
On an equality obtained from analysis of an algorithm
I came across the following equality $$\Big(\frac{c n^b}{x}\Big)^{dx}=n^{n/x}$$ where $b,c,d\geq0$ are fixed and $n$ increases when I was analyzing an algorithm.
What is a good approximation for $O(n^{...
1
vote
0
answers
42
views
Approximation of the function $f(z)=z^2/|z|$ by $C^1$ immersions
Let $D$ denote the unit disk in $\mathbb C=\mathbb R^2$. We consider the function $f:D\rightarrow\mathbb C $ defined by $$f(z):=\frac{z^2}{|z|}.$$ Then as proved in Global invertibility (p324 Remark 4)...
2
votes
0
answers
122
views
On mollifiers acting between $L^2$ and Sobolev spaces
(I'm reposting here this question from MSE as it didn't receive any answer for two weeks.)
Consider a sequence of finite lattices in $\mathbb{R}^n$ defined by
$$L_k= [-k,k]^n \cap 2^{-k}\cdot \mathbb{...
1
vote
0
answers
124
views
Solve coupled ODEs analytically in the limit of a small parameter
I have the following set of coupled second order non-linear ODEs :
$$ x^2 a''(x) + x a'(x) - \Big(\frac{1}{\epsilon^2}\Big)b^2(x) a(x) = 0 \\
x b''(x) - b'(x) - 2x b(x)a^2(x) = 0$$
with boundary ...
3
votes
1
answer
158
views
How can discrete Fourier transform approximation prove the completeness of complex exponentials in $L^2(T)$?
I have a question about the completeness of complex exponentials in function spaces.
For the discrete set $ S = \{1, 2, \ldots, n\} $, it is clear and intuitive that $ e^{2\pi ikx/n} $ for $ k = 0, 1, ...
3
votes
1
answer
298
views
Approximation of smooth real functions with an integer integral by a sum of $\delta$-functions with coefficients $\pm 1$
This question arose from a quantum physics research (my article Entropy 2022, 24(2), 261, where I considered approximation of a smooth charge density (built from a wave function) by a collection of ...
1
vote
0
answers
101
views
Difference of two completely monotonic functions
We know by the Hausdorff-Bernstein-Widder theorem that any completely monotonic function on the positive half line $[0, \infty)$ is given by the Laplace transform of a positive Borel measure on $[0, \...
0
votes
0
answers
83
views
Interpolating points and orthogonal polynomials on varying intervals
In general, a Lebesgue-Stieltjes integral, $\int (\cdot) \, d \alpha(x)$, that defines an inner product on the space of polynomials establishes a notion of orthogonality.
Suppose we have a sequence of ...
0
votes
3
answers
185
views
The approximated function of $\mathbb{E}\left\{ \ln\left(1+X\right)\right\}$, where $X\sim\operatorname{Gamma}\left(\kappa\ge1,\theta>0\right)$
Given $X \sim \operatorname{Gamma}(\kappa, \theta)$ with CDF $F_X(\kappa, \theta)$, where $\kappa \geq 1$ and $\theta > 0$, the expected value of $\mathbb{E} \left\{ \ln(1+X) \right\}$ is ...
3
votes
0
answers
322
views
The curse of dimensionality of the Kolmogorov–Arnold neural network
The Kolmogorov–Arnold neural networks (KAN), Ziming Liu et al., KAN: Kolmogorov–Arnold Networks is inspired by the Kolmogorov–Arnold representation theorem (KA theorem). Though it is not proved in the ...
1
vote
1
answer
85
views
Sufficient condition for uniform convergence of the Stieltjes transform
Let $\mu$ be a probability measure and $\mu_N$ be a sequence of probability measures. For simplicity we may assume them to have compact supports contained in $[-1,1]$. Define
$$G_\mu(z):=\int\frac{\mu(...
0
votes
0
answers
129
views
Lipschitz function approximated by smooth functions with zero a regular value
Consider a Lipschitz function $f:\mathbb{R}^n\to\mathbb{R}$. Then I want a family of smooth functions $f_\epsilon : \mathbb{R}^n\to\mathbb{R}$, such that $f_\epsilon\to f$ uniformly on compact sets, ...
0
votes
1
answer
109
views
Approximation on $H^1_0(B)$ and cut-off functions
Let $u \in H^1_0(B)$, where $B$ is the unit ball in $\mathbb{R}^N$. Given $\epsilon > 0$, I need to show there exists a function $\chi_\epsilon \in C^\infty_0(\mathbb{R}^N)$ such that
$$
\| u - \...
0
votes
0
answers
96
views
Hilbert spaces that include algebraic polynomials
This question is motivated by a phrase I found in several books/papers about approximation theory, for example, M.J.D.Powell's Approximation Theory and Methods: ''Let $\mathcal{H}$ be a Hilbert space ...
1
vote
0
answers
94
views
Multivariate polynomial approximation
Let $f$ be a function on $[-1,1]^d$ with some smoothness property, for example, it is in the Sobolev space $W^{k,p}$.
Let $P_n$ is a space of polynomials with degree $n$. My question is what is the ...
3
votes
1
answer
208
views
Density beyond Stone–Weierstrass
$\DeclareMathOperator\tr{tr}$I need density assertions for spaces of polynomials which are not (that I know of) algebras. One goes like this: Fix $n\in\mathbb N$ let $S$ denote the set of self-adjoint ...
4
votes
1
answer
148
views
Multivariate polynomial approximation of functions in Sobolev space
I found a result of the estimation error of polynomial approximation in page
6 of https://scg.ece.ucsb.edu/publications/theses/ARajagopal_2019_Thesis.pdf
The statement is for $f \in W^{k, p}\left([-1,...
0
votes
0
answers
43
views
Regularization of the Laplacian on $\mathbb{R}^d$ and approximation schemes
this question is somewhat naive, but I am trying to understand the meaning of the regularized resolvant of the Laplacian on $\mathbb{R}^d$, and how it relates to a discrete approximation. Particularly,...
1
vote
1
answer
127
views
approximating differentiable functions with double trigonometric polynomials
Let $Q = [0,1]^2$. For sake of notation, let
$$
f^{(i,j)}(x,\xi) = \frac{\partial^{i+j}}{\partial x^i \partial \xi^j}f(x,\xi).
$$
Fix some non-negative integer $k$. Moreover let $f\in C^k(Q)$ if
$$
\|...
2
votes
0
answers
72
views
Schauder Frames in nuclear vector spaces
In recent years, the definition of frame has been extended to locally convex topological vector spaces (lcs) (1). In particular, let $X$ be a lcs and $X'$ its dual. A sequence $\big((x_n,y_n)\big)_{n\...
0
votes
1
answer
136
views
Numerical integration with integrable singularity
Suppose I have a numerical estimation of discrete samples of a smooth function $C(t)$ at $t = a, \dots, T = Na$ and I want to (numerically) compute the integral of $f(t) = \frac{C(t)}{\sqrt{t}}$. In ...
3
votes
0
answers
283
views
Interchange limit and supremum of functionals over a bounded convex set
Let $(H, \langle\cdot,\cdot\rangle)$ be a separable real Hilbert space and $B\subset H$ be (nonempty) convex and bounded, and suppose that $(\alpha_k)\subset H$ is a sequence for which the limit $\...
0
votes
1
answer
142
views
Approximating a sequence of tempered distributions "uniformly" by Schwartz functions
This question has been motivated by the post making sense of distributions on the diagonal.
Let $T$ be a tempered distribution on $\mathbb{R}^2$ and $\eta$ be a given mollifier on $\mathbb{R}$. For $f ...
0
votes
0
answers
28
views
Metric entropy of mixed norm spaces with exponent-free bounds
Suppose $\mathcal{F}\subset L^p([0,1]^d)$ is a subset with the following property: The $L^q$-covering number of $\mathcal{F}$ is independent of $q$, for all $1\le q\le\infty$. An example of $\mathcal{...
2
votes
0
answers
159
views
Upper bound of a product of sines
Consider the function
$$ f_n(t)= \prod_{1 \leq k \leq n-1,\\ \gcd(k,n)=1} \sin\Big(t-\frac{k \pi}{n}\Big),\quad t \in [0,\pi].$$
I wonder whether it is possible to compute some nontrivial upper ...
0
votes
0
answers
141
views
Multivariate Jackson inequality for Chebyshev approximation
There is an approximation of a multivariate function by a Chebyshev polynomial of degree n. One needs to understand how the approximation error behaves depending on the degree of the polynomial or ...
1
vote
0
answers
44
views
Error bounds for a Romberg-style improvement of a non-linear approximation
I have a (possibly non-linear) functional $F$, which I want to numerically approximate by a (typically non-linear) $\widehat{F}_h$. For a suitable class of functions, I have asymptotic error behaviour
...
-1
votes
1
answer
215
views
Best approximation of the modulus function
While there is extensive study regarding the best approximation of function with polynomial functions in the real domain, the study of approximation of complex variables becomes much sparse. See this ...
4
votes
3
answers
685
views
Approximation for complex variables
Approximation theory, which aims to provide the optimal polynomial function approximating the target function in a given domain such as $x\in[-1,1]$, has been well-developed for real variables. In ...
1
vote
1
answer
74
views
Sum of terms after partial fraction decomposition
I am facing the following problem (all $a_i$ being positive and all different)
$$F=\int_0^1 \,dx\prod_{i=1}^n \frac 1{x+a_i}=\int_0^1\sum_{i=1}^n \frac {A_i}{x+a_i}\,dx=\sum_{i=1}^n A_i \log \left(1+\...
7
votes
1
answer
405
views
Approximating functions on the real line
While it is not possible to approximate any function with polynomials on the entire real line, I am wondering if there are modified conditions under which the approximation is possible. Consider $f \...
1
vote
0
answers
85
views
Approximation of continuous function by multilayer Relu neural network
For continuous/holder function $f$ defined on a compact set K, a fix $L$ and $m_1,m_2,\dots,m_L$, can we find a multilayer Relu fully connected network g with depth $L$ and each $i$-th layer has width ...
0
votes
1
answer
115
views
Can orientation preserving diffeomorphism in $\mathbb{R}^d$ be presented by flowmap of dynamical systems? (time-varying case)
Because flowmaps are homeomorphic maps on a compact domain $\Omega$, I was wondering if there is any literature that proves that diffeomorphism $\Phi(x)$ can be expressed as a flowmap of a certain ...
4
votes
2
answers
320
views
Approximating a fraction with a given denominator
Let $M$, $N$ be large natural numbers (say ~200 bits). Let $L$ be a smaller number, (say ~100 bits).
I want to approximate the fraction:
$$\frac{M}{N} \sim \frac{k}{L+r}$$
where $r$ is at most $L$. In ...
5
votes
2
answers
350
views
How expressive is $e^A$ in the sense of universal approximation?
For any real matrix $B\in\mathbb{R}^{n\times n},n\ge 2$ and precision $\varepsilon$, is there a real matrix $A\in\mathbb{R}^{n\times n}$ such that $\|e^A-B\|_F<\varepsilon$? ($F$ refers to ...
0
votes
1
answer
128
views
Rational approximation for continuous function on curve $\Gamma$
Let $\Gamma \in C^{1,\lambda}$ be an oriented Jordan curve in complex plane $\mathbb{C} $, $\mathrm{R}(\Gamma)$ the set of all rational functions without poles on $\Gamma $. "$\mathrm{R}(\Gamma)$...
1
vote
1
answer
143
views
$L^1$ error between indicator function and smoothed out version
For a large parameter $r>0$, consider the indicator function $1_{[-r,r]}$ and its convolution with the (normalized) Gaussian $\frac{1}{\sqrt{\pi}}e^{-x^2}$, that is,
$$f_r(x) = \frac{1}{\sqrt{\pi}}\...
1
vote
1
answer
188
views
Practical calculation of Canterbury approximants
I'm looking for references on how to compute Canterbury approximants numerically from a practical point of view. The references on Canterbury approximants that I am aware of all appear rather abstract ...
1
vote
1
answer
88
views
Mean values of polynomial and holomorphic matrices
Lemma. Assume $H: \mathbb{R} \to \mathbb{R}^{d \times d}$ is a polynomial of degree $m$, such that for all $x \in \mathbb{R}$, $H(x)$ is a symmetric semidefinite matrix. For all $n \geq 0$ and real ...
1
vote
1
answer
88
views
Approximating a family of measurable functions
Let $X$ be a set of $N>0$ elements (with the counting measure) and consider a family of measurable functions $f_i:X\to [0,1]$, for $i\in \mathbb N$.
Any function $f_i$ can be seen as a point in the ...
0
votes
1
answer
131
views
Solution or approximation to $\int x^{-a} \Gamma\left( b, c x^{-d} + e \right) dx$
I'm looking for a solution or approximation to the following indefinite integral $$\int x^{-a} \Gamma\left( b, c x^{-d} + e \right) dx.$$
I've tried Mathematica, but it does not converge to a solution....
0
votes
0
answers
72
views
Linear approximation of multivariate function of bounded second order partial derivatives
I have a question about linear approximation in the multivariate case.\
Let $f:B^d_r\to \mathbb{R}$ be a real-valued $C^2$-function defined on the $d$-dimensional ball of radius $r$ centered at the ...
2
votes
1
answer
161
views
Smooth approximation of nonnegative, nondecreasing, concave functions
Let $f\colon [0, \infty)\to\mathbb{R}$ be nonnegative, nondecreasing, and concave. Prove the following claim or give a counter example: There is a sequence of functions $f_n\colon [0, \infty)\to\...
2
votes
1
answer
433
views
Stone-Weierstrass theorem: coefficients of approximating sequence bounded?
Let $X$ be a compact Hausdorff space and $\mathcal{A}$ be a subalgebra of $C(X;\mathbb{R})$.
The Stone-Weierstrass theorem asserts that if $\mathcal{A}$ contains the constants and separates the points ...
11
votes
1
answer
1k
views
New method to compute square roots [closed]
In 2011 when I was in school I created a formula to calculate square roots... For $x\in\mathbb{R}$ with $x>0$ the following holds:
$$\sqrt{x} = \sum_{n=0}^{\infty}\frac{\left(\prod_{k=1}^{n}\left(\...
0
votes
0
answers
107
views
$\log$-classes of irrationals
Let $\mathbb{N}$ denote the set of non-negative integers. For $A\subseteq \mathbb{N}$ we let the (upper) density of $A$ be defined by $d^+(A) = \lim\sup_{n\to\infty} \frac {|A\cap \{0,\ldots, n\}|}{n+...