All Questions
Tagged with pr.probability gaussian
220 questions
1
vote
0
answers
62
views
Distances between up and down crosses in Gaussian Processes
Given a gaussian process $g := \mathcal{GP}\left(\mu, \Sigma \right)$,
where $\mu$ is the mean and $\Sigma$ is the covariance function, I am interested in estimating the mean value $L_m$ of the ...
- 63.9k
1
vote
1
answer
301
views
Obtaining a lower bound on the expectation using the Sudakov-Fernique inequality
In my work I wish to obtain a lower bound for the term below. Here the expectation is taken over $h$, a standard random Gaussian vector of length $n$. The minimum is taken over all $\{i_1,\dots,i_L\} \...
- 7,514
1
vote
0
answers
79
views
Showing that additive Gaussian noise never increases sparsity
Let $\mathbf{1}\in\mathbb{R}^d$ be the $d$-dimensional all-ones vector and let $n\sim\mathcal{N}(0, \sigma^2 I_{d\times d})$, show that
$$ \frac{\| \mathbf{1} + n \|_1}{\|\mathbf{1} + n \|_2} \ge c \...
CommunityBot
- 1
3
votes
1
answer
694
views
Asymptotic bound on the total variation distance between a standard multivariate normal and a simple mixture
Let $P = N(\vec{0}, I^d)$ be a standard multivariate Gaussian distribution in $d$ dimensions. Let $Q$ be distributed the same as $P$, except that samples from $Q$ have one of their coordinates, chosen ...
- 128k
8
votes
2
answers
849
views
Is the Gaussian Correlation Inequality universal?
T. Royen proved the Gaussian correlation inequality in the context of Gamma distributions back in 2014, which was since popularized by Latala and Matlak. The properties of Gaussian integration seem ...
- 63.9k
0
votes
1
answer
80
views
Expectation of ratio between product of gaussian r.v.'s and generalized gamma r.v
Given
\begin{equation}\label{eq:definition_of_z}
\begin{split}
\textbf{Z} = \left[\begin{array}{cccc}
{z}_{11} & {z}_{12} & \cdots & {z}_{1P} \\
{z}_{21} & {z}_{22} & \cdots & {...
3
votes
0
answers
185
views
Measure change bound for function of subgaussian r.v
Let $X$ be a (sub)gaussian r.v. on $\mathbb{R}^d$; say $X\sim\mathcal{N}(\mathbf{0},\mathbb{1}_d)$; and let $a\colon\mathbb{R}^d\to [0,1]$ be a function with $\mathbb{E}[a(X)] > 0$.
It is not hard ...
- 1,372
6
votes
3
answers
1k
views
Expected determinant of random symmetric matrix with different Gaussian distributions of the diagonal and non-diagonal elements
Consider a random matrix $A \in \mathbb{R}^{N \times N}$ where the elements are random gaussian variables. The mean and variance of the elements are different on the diagonal and the off-diagonal:
$\...
- 355
-2
votes
1
answer
92
views
Existence or impossibility of Gaussian factory
Gaussian factory problem: given an iid sequence $x_i \sim \mathcal{N}(\mu,\sigma^2)$, $i=1,2,\dots$, with $\mu$ and $\sigma^2$ both unknown, construct a realization $y \sim \mathcal{N}(0,1)$.
2
votes
1
answer
334
views
Gaussian sum VS Brownian motion
Given independent Gaussian $d$ dimensional vectors $G_i$,
Let $ \sigma^2_n=\mathbb{E}(\sum_{i \le n} G_i) \cdot (\sum_{i \le n} G_i)^T$. $||\sigma_n^2||$ is norm of $\sigma_n^2$.
Is there a $d$-...
- 128k
13
votes
1
answer
10k
views
KL divergence and mixture of Gaussians
Do we have an exact formula to compute the KL divergence between 2 mixtures of Gaussians (i.e convex combinations of a finite number of Gaussian distributions)?
If not exactly known, are there good ...
- 188k
5
votes
1
answer
959
views
Approximating the mathematical expectation of the argmax of a Gaussian random vector
Let $X = \left( {{X_1},...,{X_n}} \right) \sim \mathcal{N}\left( {{\mathbf{\mu }},{\mathbf{\Sigma }}} \right)$ be a Gaussian random vector and $I = \mathop {\arg \max }\limits_{i = 1,n} {X_i}$.
$I$ ...
- 188k
2
votes
1
answer
64
views
Maximum Number of modes of $V=U+Z$ where $Z$ standard normal and $|U|\le a$
Let $f_V$ be a pdf of random variable $V$ where
\begin{align}
V=U+Z
\end{align}
and where $U$ and $Z$ are independent and $Z$ is Gaussian. Moreover, suppose that $|U| \le A$.
Can we find the upper ...
- 128k
5
votes
1
answer
942
views
Moments of maximum of independent Gaussian random variables
Let $X = (X_1, \ldots, X_d) \in \mathbb{R}^d$ be a mean-zero Gaussian random vector with identity covariance matrix. Are there upper bounds for
$$E \left(\|X\|_{\infty}^k \right)$$ for $k=1, \ldots, ...
- 128k
6
votes
4
answers
3k
views
Calculating the probability of an event defined by a condition on a Gaussian random process
Although the question itself can be expressed succinctly, I couldn't come up with a nice self-explanatory title - suggestions are welcome.
Motivation/Background
I was investigating whether it would ...
- 1,228
3
votes
1
answer
1k
views
Normal approximation to the pointwise/Hadamard/Schur product of two multivariate Gaussian/normal random variables
Let $X \sim \mathcal{N}\left( {{\mu _x},\sigma _x^2} \right)$ and $Y \sim \mathcal{N}\left( {{\mu _y},\sigma _y^2} \right)$ be two univariate and independent Gaussian/normal random variables and let $...
- 1,026
1
vote
1
answer
287
views
Random matrix and spherical spin-glass
The Hamiltonian of the p-spherical spin glass model is
$$H_{N,p}(\sigma)=\frac{1}{N^{\frac{p-1}{2}}} \sum_{i_1,...,i_p=1}^N X_{i_1,...,i_p} \sigma_{i_1}\cdot...\cdot \sigma_{i_p}$$
where $\sigma \in ...
- 188k
3
votes
1
answer
113
views
maximum likelihood estimation of X is better than that of f(X)?
Consider a binary variable $C$ with $\Pr(C=0)=\Pr(C=1)=0.5$. Consider a random vector $X \in \mathbb{R}^d$, characterized by $C$, with PDF $p_m(x)$, $m\in\{0,1\}$. Define a maximum likelihood (ML) ...
- 128k
5
votes
0
answers
857
views
Anti-concentration inequality for Gaussian random vector
I am trying to obtain an explicit expression for $C$ in terms of $b$ in the following inequality.
Suppose that $Y$ is a centred Gaussian random vector in $\mathbb R^p$ such that $\operatorname EY_j^...
- 423
2
votes
2
answers
486
views
The correlation between a Gaussian random variable and its multiplication with another random variable
Suppose $X$ is a multivariate Gaussian random variable $X\sim \mathcal{N}\left(0,H\right)$ and we define a new random variable $\eta$ by its multiplication with some other random variable $Y$, i.e., $...
3
votes
1
answer
113
views
Asymptotic expansion of nonlinear Gaussian transformation in terms of covariance
I'm reading this paper and on page 8 the authors state without proof an asymptotic expansion of a multivariate Gaussian integral in terms of the covariance obtained by applying what they call the "...
- 128k
2
votes
0
answers
247
views
Moments of a Normal-Wishart distribution
Do known expressions exist for the moments of a gaussian-wishart (aka normal wishart) distribution?
$$NW(\mu,K\mid\mu_0,\lambda_0, v, W) =
\frac{|\lambda_0K|^{1/2}}{(2\pi)^{d/2}}e^{-0.5([\mu - \mu_0]...
2
votes
0
answers
207
views
Gaussian integrals and Showing $ \int f({\vec {x}})e^{\left(-{\frac {1}{2}}\sum \limits _{i,j=1}^{n}A_{ij}x_{i}x_{j}\right)}d^{n}x=e^{D}f|_{x=0}$
This is related to my other question on tackling a gaussian integral for $f(w,u)=\frac{1}{w-u}$.
Q1 Suggestions on evaluating gaussian integrals with "nice" functions (not necessarily polynomials)
...
- 5,474
3
votes
1
answer
157
views
Bound for expectation of function of 3 normal distributions
Let $X,Y,Z$ be three standard normal distribution. Let $\rho_{XY},\rho_{YZ},\rho_{XZ}$ be the correlation between those random variables.
Let $f()$ be a monotone, odd, bounded, and differentiable ...
- 2,600
6
votes
1
answer
170
views
Probabilities of small balls with convergent center points under Gaussian measure
I'm in the following situation:
Consider a centred Gaussian measure $\mu_0$ on a separable Hilbert space $X$ with covariance operator $Q \in \mathcal{L}(X)$ (positive definite, self-adjoint, trace ...
- 61
2
votes
0
answers
86
views
when is the average of a function with Gaussian inputs bounded away from zero
Define a function $\phi(x):\mathbb{R}\rightarrow\mathbb{R}$. Consider the expected value function defined as follows
\begin{align*}
\mu(\beta)=E[g\phi
(\beta g)]\quad with \quad g\sim\mathcal{N}(0,1)\...
- 363
1
vote
1
answer
140
views
Reference request: Cover times, Mixing Times and DGFF applied in statistics?
I am trying to find if in active research in statistics, there is interest in mixing times, cover times of graphs, and/or the discrete Gaussian free field?
I haven't found anything so far for the ...
CommunityBot
- 1
5
votes
1
answer
295
views
Constructive Central Limit Theorem
Background: Let $\{a_i\}_{i=1}^n$ be i.i.d. random variables with zero-mean and unit variance, on a probability space $\Omega$. Define $$s_n=\frac{1}{\sqrt{n}}\sum_{i\leq n} a_i$$
Central limit ...
- 24.2k
5
votes
0
answers
204
views
anti-concentration of multi-linear polynomials in Gaussian variables
A Gaussian variable $X_i\sim {\cal N}(0,1)$ is anti-concentrated in the following sense: for any $\epsilon>0$ we have:
$$
\mathbf{P}( |X_i| \leq \epsilon ) = O(\epsilon).
$$
Hence if we consider a ...
- 445
4
votes
1
answer
347
views
Concentration of functional of Gaussian random variable
Suppose I have two Gaussian distributions
$p(x) = \frac{1}{(2\pi)^{d/2}|\Sigma_p|^{1/2}}\exp(-\frac{1}{2}x^\top \Sigma_p^{-1} x)$ and $q(x) = \frac{1}{(2\pi)^{d/2}|\Sigma_q|^{1/2}}\exp(-\frac{1}{2}x^\...
CommunityBot
- 1
4
votes
2
answers
543
views
Gaussian measure on Banach space
Assume we have a Gaussian measure $\mu$ supported on a Banach space $X$. Can we always find a Hilbert space $H$ embedded in $X$ sch that $\mu$ is also supported on $H$?
0
votes
1
answer
151
views
Can an unskewed distribution be expressed as product of a normal and another distribution?
Let $x$ be a continuous random variable with zero mean and zero skew. What are the conditions under which we can say that $x$ can be expressed as the product $z y$ where $z$ is a standard normal and $...
- 54.2k
3
votes
0
answers
75
views
Covariance of censored/clipped Gaussians
I am interested in the covariance of two clipped (or censored) Gaussian variables.
More precisely, let $g_1 \sim N(0,\sigma_1^2)$ and $g_2 \sim N(0,\sigma_2^2)$ be two (dependent) Gaussians with $\...
CommunityBot
- 1
4
votes
0
answers
76
views
How well does an estimator perform on another dataset?
Suppose $X \sim N(0, \Sigma)$ is a $d$-dimensional Gaussian random vector. And we have $2n$ $i.i.d$ sample $X_1, \ldots, X_{n}, \ldots, X_{2n}$.
Let $\hat{\Sigma}_1 = \frac{1}{n}\sum_{i=1}^nX_i X_i^\...
- 515
4
votes
1
answer
681
views
Tail bound for product of normal distribution
Let $U, V$ be two standard normal random variables with covariance $cov(U,V) = \beta \in [0,1)$. Let $W = UV$ be the product of two RV's, and $W_1, W_2, \ldots, W_n$ be n i.i.d copies of $W$, what's ...
- 128k
0
votes
0
answers
81
views
Prokhorov convergence of Gaussian measures
Consider a Hilbert space $\mathcal{H}$ and a sequence of centered Gaussian measures $\mu_n$ on it. The covariance operators of $\mu_n$ are defined via their eigenpair(eigenbasis and eigenvalue)) as ...
- 157
5
votes
0
answers
120
views
L^1 maximal inequalities for the Ornstein-Uhlenbeck semigroup in infinite dimension
For an infinite-dimensional Gaussian random vector $X$ consider the Ornstein-Uhlenbeck maximal operator:
$M f(X) := \sup_{\rho \in [0,1]} \mathsf{E} [f(\rho X + (1-\rho^2)^{1/2} X^\prime) \mid X]$
(...
- 4,010
2
votes
2
answers
492
views
Can I use Birkhoff's Ergodic Theorem for Vector Valued Process?
I have a stationary process $\{u_n\}$ and I have a function $f:\mathbb{R}^L\to \mathbb{R}^+$. I want to evaluate the following limit $$\lim_{n\to \infty}\frac{1}{n}\sum_{k=1}^n g(f(\mathbf{u}_{k}))$$ ...
CommunityBot
- 1
1
vote
1
answer
115
views
Supremum of centered jointly generalized chi-square random variables
Let $\zeta_n$ be a sequence of centered jointly generalized chi-square random variables, i.e. $\zeta_n = \sum_{k=1}^{m_n} a_{k,n}(\xi_{k,n}^2 - E[\xi_{k,n}^2])$, and $\xi_{k,n}$ are centered jointly ...
CommunityBot
- 1
2
votes
1
answer
95
views
Bounding exceedance probabilities for correlated normal variables
Suppose $y\sim N(0,\Sigma)$ is an $n-$dimensional vector. I'm interested in an upper bound for $\Pr(\max_{1\leq i\leq n} y_i > k)$ for $k$ large. I know a little about $\Sigma$: $\sigma_{ii}=\...
- 7,514
10
votes
1
answer
253
views
Approximation via finite rank Cameron-Martin projections
Let $(W, \|\cdot\|_W)$ be a real separable Banach space equipped with
a non-degenerate Gaussian Borel measure $\mu$. Let $H \subset W$ be
the corresponding Cameron-Martin Hilbert space (also known as ...
- 31.5k
6
votes
2
answers
662
views
Infimum of Gaussian process
Consider a Gaussian Process $g\sim GP(\mu,k)$ with mean zero $\mu\equiv0$ and continues covariance $k(t_1,t_2)=k(|t_1-t_2|)$ defined on the interval $A=[0,T]$. I'd like to make no assumptions about g(...
CommunityBot
- 1
1
vote
2
answers
388
views
Average Multivariate Gaussian
Suppose we have a (possibly infinite) collection k-variate gaussian distributions $\{(\mathcal{N}(\mu_{\lambda}, \Sigma_{\lambda}))\}$ ($\lambda$ is just a label), and for each distribution $\mu \in [-...
- 3,085
1
vote
0
answers
100
views
Lower bound for the probability that a certain component of a Gaussian vector dominates all others
Let $X\sim\cal N(\mu,\Sigma)$ be an $n$-dimensional Gaussian vector. I would like to estimate $$P(X_1>\max_{k=2,\dots,n}X_k).$$
While no closed form solution exists (see e.g. MO question on ...
CommunityBot
- 1
6
votes
1
answer
398
views
Does a Gaussian process shrink under a contraction map
Let $T \subset \mathbb R^n$, and assume it's a finite set if that helps. Consider the symmetric Gaussian process $(X_t)_{t\in T}$ defined by $X_t = \langle G, t\rangle$, where $G$ is a standard ...
- 5,005
3
votes
1
answer
460
views
Derive concentration bound for the derivative
It that true to conclude that if a random $f(z)$ is a sub-Gaussian random variable for a constant value of z, its derivative $f'(z)|_{z=k}$ with respect to variable $z$ is also sub-Gaussian?
In ...
CommunityBot
- 1
3
votes
2
answers
287
views
Expectation of Gaussian random vector & arbitrary function thereof?
I saw in a paper (https://www.princeton.edu/~wbialek/rome/refs/bialek+ruyter_05.pdf Eq.37) the following identity:
where the <.> operator refers to a population average.
No source or ...
- 41
1
vote
1
answer
207
views
Computing probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s
This question came up in my research: What is the probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s?
So far I only figured out that I can do Monte ...
CommunityBot
- 1
6
votes
1
answer
713
views
Equivalence of Gaussian measures
Let $H$ be a separable Hilbert space and $N(0, C)$ and $N(0, D)$ be Gaussian measures on it. Further, for each $v \in H$, define $R_v = \frac{\left\langle v,Cv \right\rangle}{\left\langle v,Dv \right\...
- 29.8k
3
votes
0
answers
217
views
Small rectangle probability
Let $H$ be a Hilbert space and $\mu$ be a centered Gaussian measure on it. Also, let the eigenpair corresponding to $\mu$ be $(i^{-\alpha} , e_i)$ with $\alpha > 1$. Assume we have a ball of radius ...
- 3,958