All Questions
23 questions with no upvoted or accepted answers
6
votes
0
answers
388
views
Closedness of a set of measures, where conditional marginals are in closed $\varepsilon$-ball w.r.t. Wasserstein distance
Let $(E,d)$ be a bounded polish space (separable, complete metric space satisfying $\sup_{x,y\in E} d(x,y) < \infty$). By $\mathcal{P}(E)$ we denote the space of Borel probability measures on $E$ ...
- 1,095
6
votes
0
answers
189
views
Pettis Integrability and Laws of Large Numbers
Let $(\Omega, \mathcal F, \mathbb P)$ be a probability space, and let $V$ be a topological vector space with a dual space that separates points. Let $v_n : \Omega \to V$ be a sequence of Pettis ...
- 8,512
6
votes
0
answers
262
views
Given that a conditional measure is Gaussian, how bad can the original measure be?
Let $X$ and $Y$ be Banach spaces, and let $\varphi : X \to Y$ be a continuous linear map. Suppose that $\mathbb P$ is a probability measure on $X$ which satisfies the continuous disintegration ...
- 8,512
5
votes
1
answer
363
views
Inverse marginal property of a collection of $\sigma$-algebras
In my paper "On the inverse best approximation property of systems of subspaces of a Hilbert space"
I introduced the Inverse marginal property (IMP) for a collection of $\sigma$-algebras.
Let $(\...
- 935
4
votes
0
answers
164
views
Convergence rates for kernel empirical risk minimization, i.e empirical risk minimization (ERM) with kernel density estimation (KDE)
Let $\Theta$ be an open subset of some $\mathbb R^m$ and let $P$ be a probability distribution on $\mathbb R^d$ with density $f$ in a Sobolev space $W_p^s(\mathbb R^d)$, i.e all derivatives of $f$ ...
- 6,853
4
votes
0
answers
656
views
Eigenvalues of Matérn covariance function
Recall that Matérn covariance function $C_\nu(d)$ is defined as
$$
C_\nu(d)=\sigma^2\frac{2^{1-\nu}}{\Gamma(\nu)}\left(\sqrt{2\nu}\frac{d}{\rho}\right)^\nu K_\nu\left(\sqrt{2\nu}\frac{d}{\rho}\right), ...
- 397
2
votes
0
answers
122
views
Consistent approximation of weighted Radon transform of smooth probability density, using kernel density estimation
Let $X$ be a random vector in $\mathbb R^d$, with "sufficiently smooth" probability density function on $\rho$. For unit-vectors $w$ and $u$ in $\mathbb R^d$, and a scalar $b \in \mathbb R$, ...
- 6,853
2
votes
0
answers
109
views
Tightness of Hilbert-space-valued arrays
Let $\mathcal{H}$ be a separable Hilbert space. Assume we have some triangular array $W_{n,j}, j=1, \ldots ,n $ of $\mathcal{H}$-valued random elements with $\mathbb{E} \Vert W_{n,j} \Vert_{\mathcal{H}...
- 83
2
votes
0
answers
173
views
Weak convergence of $\mathcal{L}^2$ valued random variables
Consider two continuous functions $f,g: \mathbb{R}^{2} \rightarrow \mathbb{R}$ with $f(x,\cdot), g(x,\cdot) \in \mathcal{L}^2(\mathbb{R},\mathcal{B},\lambda)$ for all $x \in \mathbb{R}$ and a sequence ...
- 83
2
votes
0
answers
169
views
Stochastic Approximation in Reproducing Kernel Hilbert Space
Consider an iterative algorithm with incremental updates
\begin{align}
x_{t+1} = x_t + \alpha_t \cdot [ h(x_t) + M_{t+1}],
\end{align}
where $\{x_t \}_{t \geq 0}$ is in a reproducing kernel Hilbert ...
- 1,127
2
votes
0
answers
619
views
Laplace transform of a integral function of CIR/CEV process
The Cox–Ingersoll–Ross model (or CIR model) describes the evolution of interest rates. Constant elasticity of variance model (CEV) is a stochastic volatility model, which attempts to capture ...
- 323
1
vote
0
answers
143
views
Estimator for the conditional expectation operator with convergence rate in operator norm
Let $X$ and $Z$ be two random variables defined on the same probability space, taking values in euclidian spaces $E_X$ and $E_Z$, with distributions $\pi$ and $\nu$, respectively.
Let $L^2(\pi)$ ...
- 111
1
vote
0
answers
417
views
Conditions for equivalence of RKHS norm and $L^2(P)$ norm
Let $K$ be a psd kernel on an abstract space $X$ and let $H_K$ be the induced Reproducing Kernel Hilbert Space (RKHS). Let $P$ be a probability measure on $X$ such that $H_K \subseteq L^2(P_X)$ and ...
- 6,853
1
vote
0
answers
100
views
$L_1$ convergence rates for multivariate kernel density estimation
Let $X$ be a random variable on $\mathbb R^d$ with probability density function $f$, and let $X_1,\ldots,X_n$ of $X$ be $n$ iid copies of $X$. Given a bandwidth parameter $h=h_n > 0$ and a kernel $...
- 6,853
1
vote
0
answers
233
views
Variance-based localized Rademacher complexity for RKHS unit-ball
Let $\mathscr X$ be a compact subset of $\mathbb R^d$ (e.g the unit-sphere). Let $K: \mathscr X \times \mathscr X \to \mathbb R$ be a positive kernel function and let $\mathscr H_K$ be the induced ...
- 6,853
1
vote
0
answers
65
views
Normalizing constants preserve metric entropy
Suppose $\mathcal{F}=\left\{f\in L^2([a,b]): 0<\underline{c}\leq f\leq\overline{c} \right\}$. Consider the following transformation
$$\tilde{\mathcal{F}} := \left\{\frac{f}{\int f d\mu}: f\in \...
- 11
1
vote
0
answers
334
views
Strong data-processing inequality ? Upper bound on a certain modified total-variation metric
Let $\mathcal X=(\mathcal X,d)$ be a Polish space equipped with the Borel sigma-algebra. Let $p\ge 1$ and $P_1,P_2$ be probability distributions on $\mathcal X$ such that $\max_{k=1,2}\int d(x,x_0)^...
- 6,853
1
vote
0
answers
60
views
A determinantal mixture of probability densities
I came up with this operation after playing with determinantal point processes:
Given two probability densities $f,g$ defined on some measurable space with reference measure $\mu$, set
$$
f\star g(x)...
- 2,135
1
vote
0
answers
56
views
About a class of expectations
Consider being given a $n-$dimensional random vector with a distribution ${\cal D}$, vectors $a \in \mathbb{R}^k$, $\{ b_i \in \mathbb{R}^n \}_{i=1}^k$ and non-linear Lipschitz functions, $f_1,f_2 : \...
- 2,246
1
vote
0
answers
466
views
Bounding point-wise maximum of the absolute difference of two convex functions
Let $\Delta: R \times R \rightarrow R_{+}$ be a positive and convex function (convex in, say, both the arguments) called the loss function.
Let $x \in R^d$. Moreover, let $H_1,...,H_r$ be sets of ...
- 11
0
votes
0
answers
95
views
Empirical estimation of Brenier map from data
Let $f:\mathbb R^d \to \mathbb R$ be a "nice" (say, continuous) function define $A = A_f := \{x \in \mathbb R^d \mid f(x) \ge 0\}$ and $B =B_f:= \{x \in \mathbb R^d \mid f(x) \le 0\}$, and ...
- 6,853
0
votes
0
answers
58
views
Bounds on $\inf_{x,x' \in \mathbb B_X}TV(P+x,Q+x')$, where $P$ and $Q$ are distributions with density on the space $X=(\mathbb R^n,\ell_p)$
Let $n \ge 1$ be an integer, $p \in [1,\infty]$, and $P$ and $Q$ be two (probability) measures on the metric space space $X=(\mathbb R^n,\ell_p)$ which have densities w.r.t the Lebesgue measure on $X$,...
- 6,853
0
votes
0
answers
322
views
Comparison of Parameter estimation using maximum likelihood and Maximum entropy
I am not sure if the question is appropriate but I want to try my luck. One can estimate a parameter using maximum likelihood and we know it is optimal. On the other hand there are methods which uses ...
- 495