All Questions
53 questions
1
vote
0
answers
144
views
Estimator for the conditional expectation operator with convergence rate in operator norm
Let $X$ and $Z$ be two random variables defined on the same probability space, taking values in euclidian spaces $E_X$ and $E_Z$, with distributions $\pi$ and $\nu$, respectively.
Let $L^2(\pi)$ ...
- 111
5
votes
2
answers
2k
views
Relationship between KL, chi-squared, and Hellinger
There are many well-known relationships between the KL divergence, chi-squared ($\chi^2$) divergence, and the Hellinger metric. In the paper "Assouad, Fano, and Le Cam" by Bin Yu, the author ...
- 63
0
votes
1
answer
327
views
Deduce that a function is zero on interval $[0,M]$
I have been thinking about this for the last few days but I was not able to produce a definitive answer.
Take an integrable function $g$ that maps in $\mathbb{R}$ and with domain contained in $[0,M]$ (...
- 141
2
votes
2
answers
228
views
Minimal conditions on random vector $X \in R^n$ to ensure that $\lim_{t\to 0^+}\sup_{\|w\|_p = 1}\sup_{u \in \mathbb R}\mathbb P(|X'w-u| \le t)=0$
Let $X$ be a random variable on $\mathbb R^n$ and let $S_p^n := \{w \in \mathbb R^n \mid \|w\|_p = 1\}$ be the unit-sphere w.r.t to the $\ell_p$-norm in $\mathbb R^n$. We will be particularly ...
- 6,853
40
votes
5
answers
5k
views
"Entropy" proof of Brunn-Minkowski Inequality?
I read in an information theory textbook the Brunn-Minkowski inequality follows from the Entropy Power inequality.
The first one says that if $A,B$ are convex polygons in $\mathbb{R}^d$, then
$$ m(...
- 22.8k
0
votes
1
answer
59
views
Given positive $\epsilon$ and $c$, find a density $\phi$ such that $t\phi(\epsilon/t) \ge c \|\phi'\|_\infty$ for all positive $t$
A nice density (on $\mathbb R$) is function $\phi:\mathbb R \to \mathbb R$ such that
(1) $\phi(x) \ge 0$ for all $x \in \mathbb R$,
(2) $\int_{-\infty}^\infty \phi(x) \mathrm{d}x = 1$,
(3) $\phi$ is ...
- 6,853
1
vote
0
answers
100
views
$L_1$ convergence rates for multivariate kernel density estimation
Let $X$ be a random variable on $\mathbb R^d$ with probability density function $f$, and let $X_1,\ldots,X_n$ of $X$ be $n$ iid copies of $X$. Given a bandwidth parameter $h=h_n > 0$ and a kernel $...
- 6,853
1
vote
0
answers
417
views
Conditions for equivalence of RKHS norm and $L^2(P)$ norm
Let $K$ be a psd kernel on an abstract space $X$ and let $H_K$ be the induced Reproducing Kernel Hilbert Space (RKHS). Let $P$ be a probability measure on $X$ such that $H_K \subseteq L^2(P_X)$ and ...
- 6,853
1
vote
1
answer
176
views
Tight upper-bounds for the Gaussian width of intersection of intersection of hyper-ellipsoid and unit-ball
Let $\Lambda$ be a positive-definite matrix of size $n$ and let $R \ge 0$, which may depend on $n$. Consider the set $S := \{x \in \mathbb R^n \mid \|x\|_2 \le R,\,\|x\|_{\Lambda^{-1}} \le 1\}$ where $...
- 6,853
6
votes
2
answers
333
views
Is there a way to reconstruct the convolution $(f * g)(x)$ of $f$ with a Gaussian $g$ from sampled values, $(f*g)(a), a \in A$?
Suppose that $f: \mathbb{R} \to \mathbb{C}$ is a function which has support in $[-1,1]$. Let $g = g_\sigma$ be a centered Gaussian with variance $\sigma^2$. Is there a way to reconstruct the ...
- 437
4
votes
0
answers
164
views
Convergence rates for kernel empirical risk minimization, i.e empirical risk minimization (ERM) with kernel density estimation (KDE)
Let $\Theta$ be an open subset of some $\mathbb R^m$ and let $P$ be a probability distribution on $\mathbb R^d$ with density $f$ in a Sobolev space $W_p^s(\mathbb R^d)$, i.e all derivatives of $f$ ...
- 6,853
4
votes
0
answers
656
views
Eigenvalues of Matérn covariance function
Recall that Matérn covariance function $C_\nu(d)$ is defined as
$$
C_\nu(d)=\sigma^2\frac{2^{1-\nu}}{\Gamma(\nu)}\left(\sqrt{2\nu}\frac{d}{\rho}\right)^\nu K_\nu\left(\sqrt{2\nu}\frac{d}{\rho}\right), ...
- 397
2
votes
0
answers
122
views
Consistent approximation of weighted Radon transform of smooth probability density, using kernel density estimation
Let $X$ be a random vector in $\mathbb R^d$, with "sufficiently smooth" probability density function on $\rho$. For unit-vectors $w$ and $u$ in $\mathbb R^d$, and a scalar $b \in \mathbb R$, ...
- 6,853
4
votes
1
answer
114
views
Consistent empirical estimation of Radon transform of a multivariate density function
Let $P$ be a "nice" distribution on $\mathbb R^m$ (e.g., multivariate Gaussian, etc.), with density $p$. Let $H := \{x \in \mathbb R^m \mid x^\top w = b\}$ be a hyperplane in $\mathbb R^m$ ...
- 6,853
5
votes
1
answer
363
views
Inverse marginal property of a collection of $\sigma$-algebras
In my paper "On the inverse best approximation property of systems of subspaces of a Hilbert space"
I introduced the Inverse marginal property (IMP) for a collection of $\sigma$-algebras.
Let $(\...
- 935
1
vote
0
answers
233
views
Variance-based localized Rademacher complexity for RKHS unit-ball
Let $\mathscr X$ be a compact subset of $\mathbb R^d$ (e.g the unit-sphere). Let $K: \mathscr X \times \mathscr X \to \mathbb R$ be a positive kernel function and let $\mathscr H_K$ be the induced ...
- 6,853
0
votes
0
answers
95
views
Empirical estimation of Brenier map from data
Let $f:\mathbb R^d \to \mathbb R$ be a "nice" (say, continuous) function define $A = A_f := \{x \in \mathbb R^d \mid f(x) \ge 0\}$ and $B =B_f:= \{x \in \mathbb R^d \mid f(x) \le 0\}$, and ...
- 6,853
1
vote
0
answers
65
views
Normalizing constants preserve metric entropy
Suppose $\mathcal{F}=\left\{f\in L^2([a,b]): 0<\underline{c}\leq f\leq\overline{c} \right\}$. Consider the following transformation
$$\tilde{\mathcal{F}} := \left\{\frac{f}{\int f d\mu}: f\in \...
- 11
2
votes
1
answer
122
views
How is this bound for a Wasserstein contraction coefficient in this paper obtained?
I'm trying to understand the following conclusion from this paper (see below for the relevant paragraphs):
I'm not sure whether they really mean that it follows from the statements of Lemma 3.2 (...
- 167
10
votes
2
answers
2k
views
When is a space of measures a measurable space?
Let $X$ denote a measurable space, that is, a set equipped with a $\sigma$-algebra $\Sigma(X)$. Let $M(X)$ denote the space of real-valued measures over $X$. This is a vector space over the real ...
- 8,512
1
vote
2
answers
234
views
Find $\inf_{P_{X_1,X_2}}P_{X_1,X_2}(\|X_1-X_2\| > 2\alpha)$ , where $\alpha > 0$ and inf is over couplings
Let $\mathcal X$ be a seperable Banach space with norm $\|\cdot\|$, and let $X_1$ and $X_2$ be random vectors on $\mathcal X$ with finite means.
Question. Given $\alpha > 0$, what is value of, ...
- 6,853
26
votes
3
answers
11k
views
L1 distance between gaussian measures
L1 distance between gaussian measures: Definition
Let $P_1$ and $P_0$ be two gaussian measures on $\mathbb{R}^p$ with respective "mean,Variance" $m_1,C_1$ and $m_0,C_0$ (I assume matrices have full ...
- 833
2
votes
0
answers
173
views
Weak convergence of $\mathcal{L}^2$ valued random variables
Consider two continuous functions $f,g: \mathbb{R}^{2} \rightarrow \mathbb{R}$ with $f(x,\cdot), g(x,\cdot) \in \mathcal{L}^2(\mathbb{R},\mathcal{B},\lambda)$ for all $x \in \mathbb{R}$ and a sequence ...
- 83
0
votes
1
answer
211
views
Relationship between a certain binary optimal transport and total-variation of modified distributions
Let $\mathcal X$ be a Polish space, and let $(N_x)_{x \in \mathcal X}$ be a system of closed neighborhoods in $\mathcal X$. Define $\Omega := \{(x,x') \in \mathcal X^2 \mid N_x \cap N_{x'} = \emptyset\...
- 6,853
1
vote
0
answers
334
views
Strong data-processing inequality ? Upper bound on a certain modified total-variation metric
Let $\mathcal X=(\mathcal X,d)$ be a Polish space equipped with the Borel sigma-algebra. Let $p\ge 1$ and $P_1,P_2$ be probability distributions on $\mathcal X$ such that $\max_{k=1,2}\int d(x,x_0)^...
- 6,853
2
votes
0
answers
109
views
Tightness of Hilbert-space-valued arrays
Let $\mathcal{H}$ be a separable Hilbert space. Assume we have some triangular array $W_{n,j}, j=1, \ldots ,n $ of $\mathcal{H}$-valued random elements with $\mathbb{E} \Vert W_{n,j} \Vert_{\mathcal{H}...
- 83
6
votes
1
answer
2k
views
Kullback Leibler "variance": does that divergence have a name?
If you consider two probability distributions $p$ and $q$, one way to measure the distance between the two is the Kullback-Leibler divergence:
$$KL(p,q)=\int p \log (p/q) = E_p(\log p/q)$$
and this ...
2
votes
1
answer
268
views
Monotonicity of the Hellinger integral/distance
Let $p$ and $q$ be probability densities on $\mathbb R$, with respect to the Lebesgue measure $dx$. The corresponding Hellinger integral and distance are
$H(p,q):=\int_{\mathbb R}\sqrt{pq}\,dx$ and $\...
- 128k
1
vote
0
answers
60
views
A determinantal mixture of probability densities
I came up with this operation after playing with determinantal point processes:
Given two probability densities $f,g$ defined on some measurable space with reference measure $\mu$, set
$$
f\star g(x)...
- 2,135
0
votes
0
answers
58
views
Bounds on $\inf_{x,x' \in \mathbb B_X}TV(P+x,Q+x')$, where $P$ and $Q$ are distributions with density on the space $X=(\mathbb R^n,\ell_p)$
Let $n \ge 1$ be an integer, $p \in [1,\infty]$, and $P$ and $Q$ be two (probability) measures on the metric space space $X=(\mathbb R^n,\ell_p)$ which have densities w.r.t the Lebesgue measure on $X$,...
- 6,853
7
votes
1
answer
624
views
Expectation involving maximum of Gaussian variables
Let $X\sim N(0, I_d)$ be a $d$-dimensional Gaussian random vector. Let $W_1, \ldots, W_k \in \mathbb{R}^d$ be $k$ fixed vectors in general positions. It is clear that $w_i^\top X, \ldots, w_k^\top X$ ...
- 1,127
2
votes
2
answers
351
views
Weak convergence for discrete-time processes using characteristic functions
I am looking for a good reference about the analogues of the Bochner Theorem and the Lévy Continuity Theorem
for probability measures on $\mathbb{R}^{\mathbb{N}}$ with the product topology.
...
1
vote
0
answers
56
views
About a class of expectations
Consider being given a $n-$dimensional random vector with a distribution ${\cal D}$, vectors $a \in \mathbb{R}^k$, $\{ b_i \in \mathbb{R}^n \}_{i=1}^k$ and non-linear Lipschitz functions, $f_1,f_2 : \...
- 2,246
6
votes
0
answers
388
views
Closedness of a set of measures, where conditional marginals are in closed $\varepsilon$-ball w.r.t. Wasserstein distance
Let $(E,d)$ be a bounded polish space (separable, complete metric space satisfying $\sup_{x,y\in E} d(x,y) < \infty$). By $\mathcal{P}(E)$ we denote the space of Borel probability measures on $E$ ...
- 1,095
2
votes
0
answers
169
views
Stochastic Approximation in Reproducing Kernel Hilbert Space
Consider an iterative algorithm with incremental updates
\begin{align}
x_{t+1} = x_t + \alpha_t \cdot [ h(x_t) + M_{t+1}],
\end{align}
where $\{x_t \}_{t \geq 0}$ is in a reproducing kernel Hilbert ...
- 1,127
4
votes
1
answer
225
views
Multivariate Zero-Bias Transform
The zero-bias transform for a univariate random variable $W$ is defined as a random variable $W^*$ satisfying
\begin{align}
\mathbb{E} [ W \cdot f(W )] = \mathbb{E} [ f' (W^*)]
\end{align}
for any ...
- 1,127
3
votes
1
answer
157
views
Bound for expectation of function of 3 normal distributions
Let $X,Y,Z$ be three standard normal distribution. Let $\rho_{XY},\rho_{YZ},\rho_{XZ}$ be the correlation between those random variables.
Let $f()$ be a monotone, odd, bounded, and differentiable ...
- 31
5
votes
1
answer
567
views
Donsker's Theorem for triangular arrays
I should mention that I already posed this question on Math Stack Exchange, but didn't receive much feedback.
Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given ...
- 233
2
votes
0
answers
619
views
Laplace transform of a integral function of CIR/CEV process
The Cox–Ingersoll–Ross model (or CIR model) describes the evolution of interest rates. Constant elasticity of variance model (CEV) is a stochastic volatility model, which attempts to capture ...
- 323
9
votes
1
answer
385
views
A Generalized Version of Maximal Correlation and Hypercontractivity of Conditional Expectation Operator
Given a pair of random variables $(X,Y)$ over a product space $\mathcal{X}\times \mathcal{Y}$, the maximal correlation coefficient is defined as
$$\rho_2(X;Y):=\sup\frac{\mathbb{E}[f(X)g(Y)]}{||f||_2||...
- 1,109
0
votes
0
answers
322
views
Comparison of Parameter estimation using maximum likelihood and Maximum entropy
I am not sure if the question is appropriate but I want to try my luck. One can estimate a parameter using maximum likelihood and we know it is optimal. On the other hand there are methods which uses ...
- 495
5
votes
1
answer
472
views
Measures which exhibit the "uncorrelated implies independent" property
Let $X$ be a topological linear space, and let $X^*$ be its dual space. Suppose that $X$ is complete and Hausdorff, and $X^*$ separates points. Let $Y$ be another such space, and let $f : X \to Y$ be ...
- 8,512
2
votes
1
answer
164
views
Is there any parameter space of Cramér–Rao_bound
It is known that Cramér–Rao_bound is the lower bound of variance of a parameter. A useful link is https://en.wikipedia.org/wiki/Cram%C3%A9r%E2%80%93Rao_bound There is also a term called '...
- 495
0
votes
1
answer
915
views
Can you interpret this divergent integral?
In this ArXiv paper by Wilk and Wlodarczyk (published in Physical Review Letters), equation 16 has essentially the following definition of a function:
$$\text{f(x)=}\frac{c}{2Dx^2}\exp[\int^x_0 \frac{\...
- 33
4
votes
1
answer
234
views
Statistical models in terms of families of random variables
A statistical model is a function $P : \Theta \to \Delta(X)$, where $\Theta$ is a parameter space, and $\Delta(X)$ is the set of probability measures on a state space $X$.
Suppose that $\Theta$ and $...
- 8,512
4
votes
1
answer
189
views
Weak ergodicity of nonhomogenous products of 0-1 matrices
Here is a question which probably has a negative answer, but I couldn't find any literature directly on it.
Let $(A_n)$ be a sequence of rectangular 0-1 matrices (that is, the entries are restricted ...
- 4,679
5
votes
1
answer
219
views
Do there exist (almost surely) $C^{\infty}$-smooth Gaussian random fields?
Let $d \ge 1$. Do there exist Gaussian random fields on $\mathbb R^d$ which are (almost surely) $C^{\infty}$-smooth, but which are not analytic?
If so, what are necessary and sufficient conditions ...
- 8,512
0
votes
1
answer
666
views
A Cauchy–Schwarz Type Inequality Involving Scaled Distributions
I have stumbled upon a rather intriguing inequality involving the product of the scaled distribution and the scaled density of a random variable. The inequality has a very attractive form, and it ...
- 197
9
votes
2
answers
674
views
Small crown probabilities (and infinite dimensional margin assumption)
My question is:
How do I find sharp upper bounds on $P(|q|\leq \epsilon)$ uniformly over a set of gaussian polynomes $q$ of degree two.
Notations and definitions (to make the question rigorous)
Let ...
6
votes
0
answers
189
views
Pettis Integrability and Laws of Large Numbers
Let $(\Omega, \mathcal F, \mathbb P)$ be a probability space, and let $V$ be a topological vector space with a dual space that separates points. Let $v_n : \Omega \to V$ be a sequence of Pettis ...
- 8,512