All Questions
Tagged with pr.probability inequalities
91 questions with no upvoted or accepted answers
1
vote
0
answers
45
views
Inequality Involving Concave Monotonic Function
Assume that $ f: \mathbb{R} \to \mathbb{R}_+ $ is a concave, non-decreasing and positive function. Let $\mathbb{X}$ be a finite set consisting of $ 0\leq x_1 \leq x_2 \leq x_3 \leq \ldots \leq x_n$. ...
1
vote
0
answers
43
views
Moments on the Stiefel manifold
Let $S_{n, k} = \{V \in \mathbb{R}^{n \times k} : V^T V = I_k\}$ denote the Stiefel manifold, $1 \leq k \leq n$.
Let $P \in \mathbb{R}^{n \times n}$ denote a symmetric real, positive definite matrix, ...
- 420
1
vote
0
answers
92
views
Multilinear non-commutative Khintchine inequality
Let $g_1,\ldots,g_k$ be independent standard Gaussians and for each index $(i_1,\ldots,i_k)\in [n]^k$ let $A_{i_1,\ldots,i_k}$ be a $d\times d$ symmetric matrix.
Question: Is there a known bound for ...
- 156
1
vote
0
answers
68
views
A one-sided/monotone version of min/max-stable distributions -- does this have a name?
In a couple of papers I am working on (in random graph theory) I have encountered the following property of certain probability distributions, which I will describe shortly, and I am wondering if this ...
- 111
1
vote
0
answers
133
views
Does the Gaussian Poincare inequality hold for infinite dimensional measure metric spaces?
This is a question subsequent to the one:
Does the Gaussian Poincare inequality hold for $p=1$ as well as $p=2$?
There, I received a very helpful answer that the Gaussian poincare inequality for any ...
- 3,477
1
vote
0
answers
370
views
Lower bound on the sum of the product of random variables
Let $X_i$ be the $i$-th element of the vector $X=(X_1, ..., X_m)$ of i.i.d. random variables.
I am looking for a lower bound for the expression
$\mathbb{P}((\sum^n_{i=1}\prod^{m_i}_{j=1}(X_j))^2 \geq ...
- 129
1
vote
0
answers
107
views
$L^p$ inequality for "positively correlated" random variables
Suppose that we have $m$ complex-valued random variables $\xi_1,\ldots,\xi_m$ and assume the following "positive correlation" property: for all non-negative integers $\alpha_1,\ldots,\...
- 7,193
1
vote
0
answers
234
views
"Tails" of a multinomial distribution
Let $X_1,\dots,X_N$ denote a collection of independent samples of a uniform multinomial random variable in $\mathbb{Z}^k$, with the number of trials equal to $n\ll k$. (By "uniform", I mean ...
- 4,049
1
vote
0
answers
77
views
Divergence between random variables after transformation
Let $X$ and $Y$ be random variables with laws $\mu_X$, $\mu_Y$ and $d$ be some $f$-divergence (e.g. KL, total variation, Hellinger). Writing $d(X,Y)$ for the divergence between $\mu_X$ and $\mu_Y$, ...
- 19
1
vote
1
answer
335
views
Finding a connection between two types of convergence
Please, help me find connections between two types of convergence:
Let $\{X_n\}_{n\ge1}: (\Omega,F,P) \rightarrow (\mathbb{R},Bor)$ be a sequence of r.v., there are two convergences:
1) $X_n \...
- 31
1
vote
0
answers
60
views
Maximum value of $\int (aF^2(x)g(x)+G^2(x)f(x))dx$ over all $f,g$ densities satisfying $\int F(x)g(x)dx=1/2$
I want to maximise $$I(f,g):=\int_{-\infty}^\infty (aF^2(x)g(x)+G^2(x)f(x))dx$$ where $a>0$ is a given constant, over all possible probability densities $f,g$ satisfying $$\int_{-\infty}^\infty F(x)...
- 319
1
vote
0
answers
286
views
General Hoeffding inequality with two uncorrelated random vectors
Let $X_1,\ldots, X_n$ be independent sub-Gaussian variables with sub-Gaussian norm $K$. Let $a_1,\ldots,a_n$ be a random vector such that $\mathbb{E}[a_j X_i]=0$ for all $i,j\in \{1,\ldots ,n\}$ and ...
- 31
1
vote
0
answers
98
views
Joint distribution of two weighted sums of IID random variables
Let $X_1, X_2, \dots$ be independently uniformly distributed random variables in $\{-1, +1\}$ and let $a_1, b_1,a_2,b_2, \ldots \in \mathbb{R}$ be fixed, bounded and of non-zero average. Let $Y_n=...
- 341
1
vote
1
answer
701
views
Hanson-Wright inequality (quadratic form concentration inequality) for bounded random vectors
Is there a concentration inequality for quadratic forms of bounded random vectors $X \in [-1, 1]^n$ with zero mean and given covariance matrix $\Sigma \in \mathbb{R}^{n \times n}$ but otherwise ...
user114668
1
vote
0
answers
376
views
Anti-concentration bounds for folded normal and inverse of gaussian variables
Are there any easy to use bounds on sums of the following kind :
$$
\sum_{i = 1}^{i = N} |a_i| \geq P \\
a_i \sim \mathcal{N}(0, 1) \\
$$
and also for sums of the form :
$$
\sum_{i = 1}^{i = M} \...
- 111
1
vote
0
answers
110
views
Tail bound without independence
Suppose $X_i , X_j\in \mathbb{R}^d$ are gaussian vectors and $A$ is an $n\times n$ symmetric PSD matrix where $A_{ij} = f(\|X_i-X_j\|_2), \quad i,j\in 1,\ldots,n\;$ for some non-negative Lipschitz ...
- 195
1
vote
0
answers
282
views
Strict monotonicity of conditional variances
Let $K \geq 2$ be a positive integer and $C$ be any $K \times K$ non-singular matrix (if necessary, can assume that all $K$ rows of $C$ are needed to span the coordinate row vector $e_1'$). For ...
- 765
1
vote
0
answers
93
views
Bounds on the spherical measure of sub-level sets of quadratic forms
I'm wondering if there are any bounds on the spherical measure of sets of the form
$$
\mu_n\left(\{y\in S^{n-1} : \frac{y_1^2}{y_2^2} < \alpha\}\right) \leq f(\alpha)
$$
where $\alpha$ is some ...
- 205
1
vote
0
answers
171
views
An inequality for moments of a random variable
I'm interested in a class C of $R^1$-valued random variables $\xi$ which satisfy
an inequality of the type
$$
(1) \qquad E|\xi|^p \leq F(E|\xi|^2),
$$
where $p>2$, $F$ is a certain non-...
- 195
1
vote
0
answers
181
views
Nonstationary Markov chain maximal inequality
Let $X_i$ be a (finite-state, irreducible, aperiodic) Markov chain, not necessarily stationary. (That is, it doesn't start from the invariant distribution; I'm happy to have it be time-homogeneous if ...
- 1,069
0
votes
0
answers
38
views
Bounding the error of a truncated moment problem
Let $\{x_{i}\}_{i=1}^{\infty}$ be a non-increasing sequence of non-negative real numbers, and let $\{y_{j}\}_{j=1}^{B}$ be a non-increasing sequence of non-negative real numbers, where $B$ is a finite ...
- 433
0
votes
0
answers
58
views
Class of covariance matrices invariant under permutations
I am reading a paper on covariance matrix estimation, and in this paper is introduced a class of covariance matrices:
\begin{equation}
U(q, c_0(p),M)=\{\Sigma: \sigma_{ii}\leq M,\quad \max_j\sum_{j=1}^...
- 1
0
votes
1
answer
158
views
Techniques for bounding the operator norm of the expectation of random matrix?
Let $\mu$ be a distribution on the unit sphere in $\mathbb{R}^n$. Let $u \sim \mu$ and consider the random matrix
$$
A = I_n - uu^T.
$$
Question: What techniques are available to provide (reasonably ...
- 420
0
votes
0
answers
153
views
Inequalities on the distribution of the maximum of the normalized sum $\max_{k = 1,\dots,n} \frac{|S_k|}{\sqrt{k}}$
Let $\{X_i\}_{i\in\mathbb{N}}$ be i.i.d. random variables with $\mathbb{E}(X) = 0$,$\mathbb{E}(X^2) = \sigma^2$ and finite moments. Let $S_k = \sum_{i = 1}^{k} X_i$ and consider the normalized ...
- 63
0
votes
0
answers
87
views
Comparison between the expected values of the inverse of the CDF of binomial-distributed random variables
Let us denote with $F(x;j,\mu)$ the cdf of a Binomial distributed random variable with $j$ trial with success probability $\mu$ considered in $x$, and let $f(x;j,\mu)$ be the pmf. Defining $0\leq \...
0
votes
1
answer
92
views
Does point process ordering ever imply conditional intensity ordering?
Let $N$ and $N'$ be regular/non-explosive point processes on $[0,\infty)$. I will take the view that these are collections of random arrival times: $N=(t_n)_{n\in\mathbb N}$ and $N'=(t_n')_{n\in\...
- 215
0
votes
0
answers
91
views
Some new questions on Rademacher complexity
For $A\subset R^n$,$A=(a_1,a_2,\dots, a_n)$, $\sigma_i$ are Rademacher random variable.
Is $|\mathbb{E}_\sigma \inf_{a\in A}\sum_{i=1}^n\sigma_ia_i| \le |\mathbb{E}_\sigma \sup_{a\in A}\sum_{i=1}^n\...
- 185
0
votes
0
answers
78
views
Kernel density estimation is sub-gaussian
Let $X_1, ..., X_n$ be i.i.d. samples drawn from a pdf $f(x)$ on the real line. The kernel density estimator is defined as follows,
$$\hat{f_n}(x) = \frac{1}{nh}\sum_1^n K(\frac{x-X_k}{h})$$
where $K:\...
- 81
0
votes
0
answers
34
views
Inequalities for generalized variance
Let $(X, \mu)$ be a measured space with $\mu(X) = 1$.
Given $\phi \in L^\infty(X, \mu)$, $\phi > 0$, let me define, for $\alpha \geq 1$, $\beta > 0$, the quantity
$$
I(\alpha, \beta) = \left(\...
- 1,263
0
votes
0
answers
293
views
Can we prove the following anti-concentration inequality of polynomials of square Gaussian variables?
Following this question Anti-concentration of Gaussian quadratic form. We have the following inequality:
Let $X_1,\dots,X_n$ denote i.i.d. standard Gaussian random variables. For every $\epsilon>0$...
- 288
0
votes
0
answers
173
views
Lemma 3.10 of paper 'Periodic nonlinear Schrodinger Equation and Invariant measure' by J.Bourgain
I am reading a paper 'Periodic nonlinear Schrodinger Equation and Invariant measure' by J.Bourgain.
And I have a questions in the proof of lemma 3.10.
Please click the paper title for the link.
The ...
- 239
0
votes
0
answers
106
views
Upper bounding the sum with hypergeometric and binomial probabilities
Could you please help me upper bound this tricky expression:
$$P(A)=\sum_{i=0}^n{\left( 1 - \dfrac{\binom kq \binom {n-k}{i-q}}{\binom {n}{i}} \right)}^I \binom ni p^i {(1-p)}^{n-i}$$.
So far I only ...
- 1
0
votes
0
answers
166
views
Lower bound on probability of sum of independent random variables
I'm interested in estimating the following quantity
\begin{equation}\lim_{k \to \infty} \sum \limits_{i=1}^l \sum \limits_{l_1 = 0}^{i} {{nk-k}\choose{l_1}} \Big( \frac{1}{k}\Big)^{l_1} \Big( \frac{...
- 237
0
votes
0
answers
112
views
On certain integrals of exponential functions with respect to Gaussian measures
I have questions about the integral
$$F(a,b,c)=\sqrt{\frac{a}{\pi}}\int_{0}^{\infty}e^{-bx^4+cx^3-ax^2}dx$$
for $a,b,c>0$.
What is the asymptotic behavior of $F(a,b,c)$ for small $a,b,c$? In ...
- 505
0
votes
0
answers
250
views
Can we make two random variables independent at a low cost?
Let $X$ and $Y$ be two discrete random variables with joint probability mass function $p(x,y)$ such that
$$\|p(x,y)-p(x)p(y)\|_1=\sum_{x\in\mathcal{X},y\in\mathcal{Y}}|p(x,y)-p(x)p(y)|\leq\epsilon$$
...
- 287
0
votes
0
answers
141
views
Effect of partitioning the realizations of random variables on the total variation distance?
Let $X$ and $Y$ be two random variables with joint pmf $p(x,y)=p(x)\cdot p(y|x)$ and $X$ has uniform distribution. Also assume that the following relation is satisfied:
\begin{align}
\lVert p(y|x)-p(y)...
- 287
0
votes
0
answers
124
views
Maximal inequality for Markov process
For a Markov process $\{X_n\}$ is there any inequality available for
$$ E[\sup_{0 \leq n \leq k} X_{n}]$$
in terms of moments of $E[X_n], 0 \leq n \leq k$
- 317
0
votes
0
answers
107
views
Conditional version of martingale difference concentration inequality
Let $M_n$ be a $\mathscr{F}_n=\sigma(\eta_m,\theta_m, m\leq n)$ measurable martingale difference sequence. Then is it possible to find a exponential tail bound for the following
$$P(|M_{n+1}| > u|\...
- 317
-1
votes
1
answer
551
views
Lower bound of an expectation
Suppose a random variable $X$ has unit variance i.e. $\sigma^{2} = 1$. Is there a positive constant $c > 0$ such that
$$\mathbb{E}[\ | X - \mathbb{E}[X] | \ ] \ge c $$
My attempt of a solution is ...
- 643
-1
votes
1
answer
283
views
Lowerbounding expectation value of binomial tail
I'm trying to find a lower bound for the following expression for $q\ge p$:
$$f(q,p,n) := \sum_{v=0}^n \sum_{k=v}^n \binom{n}{v} \binom{n}{k}q^v(1-q)^{n-v}p^k(1-p)^{n-k}.$$
It can be thought of as the ...
- 702
-1
votes
1
answer
76
views
Transforming random variables for having good property?
For arbitrary functions $A$ and $B$ and independent random variables $X$ and $Y$, assume that
\begin{align}
\Omega&\triangleq \{(x,y): A(x,y)=1\},\\
\Lambda&\triangleq \{x: B(x)=1\}.
\end{...
- 287