All Questions
33 questions
0
votes
0
answers
73
views
Asymptotic stochastic ordering for weighted sum of i.i.d. random variables
Are you aware of any literature focusing on the conditions such that for two i.i.d. sequences of discrete r.v.'s $\{X_n\}$ and $\{Y_n\}$,
\begin{equation}
a_1X_1+a_2X_2+\ldots+a_nX_n\geq_1 a_1Y_1+...
- 19
4
votes
1
answer
287
views
Local maxima of the sum of Gaussian functions in *multiple dimensions* are always strict local maxima - prove/disprove/prove conditionally?
This is a follow up of the question in one dimension, that asked to show that the all the maxima of the sum of Gaussian
$$f_n(x):= \sum_{i=1}^{n}e^{-(x-x_i)^2}, x_1 < x_2 < \dots < x_n$$
are ...
- 1,467
1
vote
1
answer
191
views
Concentration inequality for square roots
Given a sequence of (not-necessarily-iid) real-valued random variables $X_n$ that converge to $a\in\mathbb{R}$ in probability, suppose we have an exponential concentration inequality of the form
$$
P(|...
- 13
5
votes
2
answers
2k
views
Relationship between KL, chi-squared, and Hellinger
There are many well-known relationships between the KL divergence, chi-squared ($\chi^2$) divergence, and the Hellinger metric. In the paper "Assouad, Fano, and Le Cam" by Bin Yu, the author ...
- 63
0
votes
1
answer
327
views
Deduce that a function is zero on interval $[0,M]$
I have been thinking about this for the last few days but I was not able to produce a definitive answer.
Take an integrable function $g$ that maps in $\mathbb{R}$ and with domain contained in $[0,M]$ (...
- 141
0
votes
1
answer
61
views
What can we say about the order of convergence of a critical point of Gaussian mixture density to its limit when the parameter $h$ goes to $0?$
Density of Gaussian mixture with $n$ components is given by:
$$f(x):=C \sum_{i=1}^{n}e^{-\frac{1}{2}||\frac{x-x_i}{h}||^2}, x_i \in \mathbb{R}^d, h > 0$$
where $C$ is a normalization constant ...
- 1,467
1
vote
1
answer
141
views
How to get the estimator?
They introduce a new correlation. For $\pi\in \Pi(\mu,\nu)$ the set of coupling of two probability measures $\mu$ and $\nu$ on a Polish space $(X,d)$. The author introduces a plugin estimator.
...
- 288
1
vote
1
answer
169
views
How to prove that is a consistent estimator?
Let $\hat{\pi}^N$ be an AW-consistent estimator of $\pi$ (i.e., $\hat{\pi}^N$ is a strongly consistent estimator of $\pi$ under adapted (or called nested) Wasserstein distance $AW(\pi, \hat{\pi}^N)\to ...
- 288
6
votes
2
answers
333
views
Is there a way to reconstruct the convolution $(f * g)(x)$ of $f$ with a Gaussian $g$ from sampled values, $(f*g)(a), a \in A$?
Suppose that $f: \mathbb{R} \to \mathbb{C}$ is a function which has support in $[-1,1]$. Let $g = g_\sigma$ be a centered Gaussian with variance $\sigma^2$. Is there a way to reconstruct the ...
- 437
4
votes
0
answers
656
views
Eigenvalues of Matérn covariance function
Recall that Matérn covariance function $C_\nu(d)$ is defined as
$$
C_\nu(d)=\sigma^2\frac{2^{1-\nu}}{\Gamma(\nu)}\left(\sqrt{2\nu}\frac{d}{\rho}\right)^\nu K_\nu\left(\sqrt{2\nu}\frac{d}{\rho}\right), ...
- 397
0
votes
1
answer
83
views
Functional relationship between two quantities
Let $\mu \in \mathbb R^n$ and let $\Sigma$ be a positive-definite matrix of order $n \ge 2$. Fix $t \ge 0$ and define $\alpha(\mu,\Sigma,t) > 0$ by
$$
\alpha(\mu,\Sigma,t) := \sup_{\|w\| = 1}\frac{...
- 6,853
4
votes
2
answers
175
views
Almost independence of $x^\top a$ and $x^\top b$ for $x$ uniform on the sphere in $\mathbb R^d$ and $a,b \in \mathbb R^d$ with $a^\top b = 0$
Let $d$ be a large positive integer. Let $x$ be uniformly distributed on the unit-sphere in $\mathbb R^d$ and let $a$ and $b$ be perpendicular vectors in $\mathbb R^d$, i.e such that $a^\top b=0$. Let ...
- 6,853
8
votes
2
answers
5k
views
Proof of Karlin-Rubin's theorem
I asked this question on Math Exchange, but as I did not receive a successful answer, maybe you could help me.
Karlin-Rubin's theorem states conditions under which we can find a uniformly most ...
- 141
1
vote
1
answer
266
views
Decomposition of the sum of nonnegative random variables [closed]
Non-necessarily independent random variables $X_1,~X_2,~\cdots,~X_n$ are supported on $[0,a_1],~[0,a_2],~\cdots,[0,a_n]$ and with mean values $\mu_1,~\cdots,~\mu_n$ respectively, where all $a_i$ and $\...
- 550
0
votes
1
answer
179
views
How to show $\max_{1\leq i\leq n}(X_i+Y_1)\preceq \max_{1\leq i\leq n}(X_i+Y_i)$?
Let two collections of random variables $\{X_i\}$ and $\{Y_i\}$ be independent and let $\{Y_i\}$ be i.i.d. Then
$$\max_{1\leq i\leq n}(X_i+Y_1)\preceq \max_{1\leq i\leq n}(X_i+Y_i).$$
where $\...
- 288
2
votes
1
answer
636
views
Sufficient condition for function of conditional probability density to be increasing
Let $Y$ and $W$ be two jointly distributed random variables; $Y$ takes values on $(y_1,y_2)$ and $W$ takes values on $(w_1,w_2)$. The conditional probability density of $W$ given $Y$ is given by $f_{W|...
- 143
1
vote
0
answers
65
views
Normalizing constants preserve metric entropy
Suppose $\mathcal{F}=\left\{f\in L^2([a,b]): 0<\underline{c}\leq f\leq\overline{c} \right\}$. Consider the following transformation
$$\tilde{\mathcal{F}} := \left\{\frac{f}{\int f d\mu}: f\in \...
- 11
8
votes
2
answers
330
views
q-Means and the mode of a distribution
Let $f:\mathbb{R} \rightarrow [0,\infty)$ be a continuous probability density function on $\mathbb{R}$ such that
\begin{equation}
\int_{\mathbb{R}} |x| f(x)\, dx < \infty,
\end{equation}
and ...
- 640
9
votes
4
answers
952
views
What does it mean when we say we have computed a number to a certain accuracy using a probabilistic algorithm?
My intention is to ask a general question about probabilistic (Monte Carlo) algorithms. But to keep things simple, I will focus on a few specific examples.
Let me start the discussion with ...
- 3,245
1
vote
1
answer
143
views
Lower bound for log-Ratios
Can we find a universal constant $c>0$ such that for all $p,q\in\Delta:=\lbrace x\in (0,1)^{n}\ \colon\ x_{1}+\dots+x_{n}=1\rbrace$ it is true that
\begin{equation}
|p_{i}-q_{i}|\le c\left|\ln\frac{...
- 289
2
votes
1
answer
268
views
Monotonicity of the Hellinger integral/distance
Let $p$ and $q$ be probability densities on $\mathbb R$, with respect to the Lebesgue measure $dx$. The corresponding Hellinger integral and distance are
$H(p,q):=\int_{\mathbb R}\sqrt{pq}\,dx$ and $\...
- 128k
7
votes
1
answer
624
views
Expectation involving maximum of Gaussian variables
Let $X\sim N(0, I_d)$ be a $d$-dimensional Gaussian random vector. Let $W_1, \ldots, W_k \in \mathbb{R}^d$ be $k$ fixed vectors in general positions. It is clear that $w_i^\top X, \ldots, w_k^\top X$ ...
- 1,127
3
votes
0
answers
504
views
Continuity of the conditional expectation
Consider the conditional expectation of $x$ given $y$,
$$
\mathbb{E}(x | y)
$$
where $x \in X$ and $y \in Y$ where $X, Y$ are Hilbert spaces (possibly infinite dimensional).
Question :
I am looking ...
- 252
3
votes
1
answer
940
views
What is the mathematical characterization of sufficient statistics of a given $\sigma$-dominated probability model?
Given a probability model $\mathcal{P}=\{P_{\theta},\theta \in \Theta \}$ dominated by a $\sigma$-finite measure $\lambda$ (e.g. Lebesgue measure) on a locally compact space $\cal{X}$ along with $\...
- 8,071
5
votes
1
answer
305
views
Expectation of max of Gaussian multiplied by a functional of Gaussian
Let $X \in \mathbb{R}^{d}$ follows the standard Gaussian distribution $N(0, I_d)$. Let $Y = \max_{j\in[d] } X_j$. It is not hard to see that
\begin{align}
\mathbb{E}\left [ Y \cdot X\right] = \sum_{j=...
- 1,127
3
votes
1
answer
461
views
Bounding the "spikiness" of a probability distribution
Are there any well-known conditions that guarantee that a probability distribution isn't too "spiky"?
I ask this question because I am interested in the families of probability distributions $f(x)$ ...
- 4,049
4
votes
1
answer
225
views
Multivariate Zero-Bias Transform
The zero-bias transform for a univariate random variable $W$ is defined as a random variable $W^*$ satisfying
\begin{align}
\mathbb{E} [ W \cdot f(W )] = \mathbb{E} [ f' (W^*)]
\end{align}
for any ...
- 1,127
4
votes
1
answer
161
views
Hellinger integral for the Student/Cauchy family
Let $p$ and $q$ be probability densities on $\mathbb R$, with respect to the Lebesgue measure $dx$. The corresponding Hellinger integral is
$H(p,q):=\int_{\mathbb R}\sqrt{pq}\,dx$.
Let now $p$ be ...
- 128k
0
votes
1
answer
163
views
$\int_0^t f(s)\,dB_s$ normally distributed, mean and variance
Suppose that $f(t)$ is a (non-random) continuous function on $[0, \infty)$. Let$$Z_t = \int_0^t f(s)\,dB_s.$$
How do I see that $Z_t$ is normally distributed?
What is the mean and variance?
I need ...
- 43
4
votes
2
answers
1k
views
Reducing system of equations involving Erf, Error Function
I have a system of equations:
$$1/2 + {\rm Erf}(x) - {\rm Erf}(\frac{x+y}{2})=0$$
$$-1/2 + {\rm Erf}(y) - {\rm Erf}(\frac{x+y}{2})=0,$$
Where $x \le y$ and ${\rm Erf}$ is the Error Function.
By ...
- 123
4
votes
0
answers
147
views
The asymptotic behavior of the ratio between the largest two of $n$ i.i.d. chi-square random variables
My question is about the asymptotic behavior of the ratio between the largest and second largest values of $n$ independent chi-square random variables.
Let $X_1, \ldots, X_n$ be $n$ independent and ...
- 1,127
2
votes
0
answers
46
views
increasing inter-class distances results in decreasing linear regression error
Let $\{\mathbf{x}_i, y_i \}$ be a set of binary-labeled samples ($\mathbf{x}_i \in \mathbb{R}^d, y_i \in \{a,b\}, a,b\in\mathbb{R}$). Let $\{ \mathbf{x}'_i, y_i \}$ be also such a set.
Define $\mathbf{...
- 183
1
vote
0
answers
69
views
Norm-averaging reference request
(Apology in advance for the broadness of this question) I recently came across a relatively simple application where I needed to "balance" the "spreaded-out-ness" of a function with the "peaked-ness" ...
- 123