All Questions
Tagged with inequalities pr.probability
346 questions
3
votes
1
answer
364
views
Can anyone give a reference to the proof of this concentration inequality?
The following concentration inequality for the supremum of a Gaussian process indexed by a separable metric space appears here: http://math.iisc.ac.in/~manju/GP/6-Concentration%20and%20comparison%...
- 123
3
votes
1
answer
208
views
Estimate for Levy metric
In the Encyclopedia of Mathematics there is an inequality for Levy metric ($d_L$):
$$d_L(E,F) \leq \{\beta_r(F)\}^{r/(r+1)},$$
where $E$ is a a distribution that is degenerate at zero, $\beta_r(F)$, $...
- 31
3
votes
2
answers
231
views
Bounds for the fat tail after trimming the mean?
I am interested in the quantity $$f(X,t) = \int_t^\infty\negthinspace x\ p(x)\ dx,$$ where $p$ is a probability distribution for a positive variable $X$.
1) Does this quantity $f(X,t)$ have a name? ...
user44143
3
votes
1
answer
474
views
Analogues of the Golden-Thompson inequality
Are there any analogues of the Golden-Thompson Inequality for moment generating functions? The Golden-Thompson Inequality asserts the following: If $A$ and $B$ are two $n \times n$ Hermitian matrices, ...
- 31
3
votes
0
answers
76
views
Order of $\mathbb{E}[ \max_i |x_i + z_i| - \max_i |z_i|]$
Let $z_1, \dots, z_n$ be iid standard Normal, and let $x \in \mathbb{R}^n$. Put $\|u\|_\infty = \max_i |u_i|$.
Define
$$
F(x) = \mathbb{E}\Big[\|x + z\|_\infty - \|z\|_\infty\Big]
$$
If $\|x\|_\infty \...
- 420
3
votes
0
answers
92
views
Tighter Freedman's inequality for a special martingale difference sequence
Let $X_{1}, \ldots, X_{T} \in \{0, 1\}$ be a sequence of Boolean random variables with
$$
\mathbb{E}[X_{t} | X_{1}, \dots, X_{t - 1}] = p_{t}.
$$
Consider the sequence $Y_{t} := X_{t} - p_{t}$ (which ...
- 41
3
votes
0
answers
80
views
Seeking strong bounds on KL-divergence and martingales for a hypothesis-testing inequality
Let's say we have a finite set $\mathcal{O}$ of observations, and let $\mathcal{C}(\Delta\mathcal{O})$ denote the space of closed convex sets of probability distributions.
We have two hypotheses which ...
- 353
3
votes
0
answers
86
views
Finite dimensional distribution of a stochastic process Lipschitz on every relatively compact set
Let $X_t$ be a Markovian Itô diffusion process, defined by an SDE
\begin{equation}
dX_t = \mu(X_t)\,dt + \sigma(X_t)\,dW_t\,.
\end{equation}
Let $f(x,t|x_0,0)$ denote its transition density function. ...
3
votes
0
answers
169
views
Probabilistic behavior of greedy point selection in the plane
Let $\mathcal{X} = X_1,\dots,X_n$ be a collection of independent, uniform samples in the unit square. Let $\mathcal{S}=\{X_1\}$, and consider the following process: for $i=2,\dots,n$, let $x^*$ be ...
- 4,049
3
votes
0
answers
84
views
Weak sufficient conditions for non-negative correlation between functions of correlated random variables?
Consider real, nonnegative random variables $A$, $B$, and $X$, and define
$Z = \exp(-A X)$ and $W = \exp(-B X)$, and also $U = \exp(-X - A)$ and $V = \exp(-X -B)$.
What sorts of minimal sufficient ...
- 61
3
votes
0
answers
185
views
Measure change bound for function of subgaussian r.v
Let $X$ be a (sub)gaussian r.v. on $\mathbb{R}^d$; say $X\sim\mathcal{N}(\mathbf{0},\mathbb{1}_d)$; and let $a\colon\mathbb{R}^d\to [0,1]$ be a function with $\mathbb{E}[a(X)] > 0$.
It is not hard ...
- 1,372
3
votes
0
answers
77
views
A concentration problem of product of matrices
Let $A$ be an $n \times m$ matrix with non-negative entries and $B \in \mathbb{R^{n\times n}_{\geq 0}}, C \in \mathbb{R^{m\times m}_{\geq 0}}$ be random matrices where B and C are both symmetric and ...
- 195
3
votes
0
answers
125
views
Concentration of sums of random matrices around the mean, in the Loewner order
Recently, I have found myself interested in concentration properties of random matrices.
Specifically I would like to answer questions of the following sort
Let $\{X_i\}_{i=1}^n$ be i.i.d. copies ...
- 393
3
votes
0
answers
451
views
concentration bounds on weighted multinomial sum
Consider i.i.d random vectors $Y_{1},..,Y_{n}$ and they are chosen uniformly at random from $\{e_{1},..,e_{L}\}$ where $e_{i}$ is a $L\times 1$ vector with $i$th component be 1 and the others be 0. ...
- 31
3
votes
1
answer
247
views
Concentration and Correlation for Magnitudes of Gaussian Vectors
Suppose we have a large collection of standard normal random variables $a_i\in\mathbb{R}^n$. We know by standard concentration results that if we take $m \geq C\left(t/\epsilon\right)^2n$ samples, ...
- 205
3
votes
0
answers
158
views
Worst-Case Solution to (Stochastic) Matrix Inequality
EDIT: Some specific conjectures added.
This problem comes with an associated stochastic process, but I phrase everything as linear algebra in case somebody from a non-probability community has seen ...
- 31
3
votes
0
answers
494
views
Maximization of a total variation distance subject to another total variation distance in Markov chain
Suppose two dependent random variables $X$ and $V$ from finite alphabets $\mathcal{V}$ and $\mathcal{X}$ with known joint and marginal distributions are given. Let $P_{XV}$ and $P_X$ and $P_V$ are the ...
- 1,109
3
votes
0
answers
104
views
Minimizing/Maximizing the tail of the convex combinations of Chi Squared i.i.d random variables
Consider $N$ i.i.d random variables, $X_{1}, X_{2}, \ldots, X_{N}$ , that are chi-squared of degree $K \geq 2$. Also consider the following 3 vectors:
\begin{eqnarray*}
\bar{a} &=& (\frac{1}{...
- 51
3
votes
1
answer
330
views
Does this probability distance metric have an official name?
Let us define a distance metric between two joint probability math functions $p(x,y)$ and $q(x,y)$ as in the following
\begin{align}
\sum_{y}\sqrt{\sum_{x}p(x)\left(p(y|x)-q(y|x)\right)^2}.
\end{...
- 287
2
votes
3
answers
1k
views
How can I prove Chebyshev's sum inequality with probabilistic methods?
I would like to prove Chebyshev's sum inequality, which states that:
If $a_1\geq a_2\geq \cdots \geq a_n$ and $b_1\geq b_2\geq \cdots \geq b_n$, then
$$
\frac{1}{n}\sum_{k=1}^n a_kb_k\geq \left(\frac{...
- 39
2
votes
1
answer
138
views
Comparison between $\|X\|_2$ and $\|X\|_{2,1}$
For any real random variable $X$, define
$$\|X\|_{2,1}=\int_0^\infty \sqrt{\Pr(|X|>t)}dt.$$
This quantity (it is not a norm) appears in various problems, e.g. the multiplier central limit theorem (...
- 197
2
votes
2
answers
268
views
An "obvious" probability lemma about random words
Fix some positive integers $p,n,k$. Let $w$ be chosen uniformly at random from $[k]^n$ (the set of $n$ length words/sequences where each entry is in $\{1,\ldots,k\}$). Let $A_i$ be the event that $...
- 470
2
votes
3
answers
222
views
Can we find such $k$ so that the following inequality holds?
I found this question: Chernoff style concentration bound for ratio of variables.
I want to ask if we get similar thing for the ratio of the sum and the one Gaussian variable.
Given i.i.d. Gaussian ...
- 288
2
votes
1
answer
235
views
Kolmogoroff condition for truncated random variables
Question summary. Does the Kolmogoroff condition $\sum_{n=1}^\infty\frac{\mathbb V Y_n}{n^2} < \infty$ hold for truncated random variables $Y_n := X_n \cdot 1_{\{X_n \le n\}}$ (see below for a more ...
- 1,326
2
votes
2
answers
632
views
An alternative proof of Bayesian Cramer-Rao
My question is:
Are there an alternative proof of Cramer-Rao lower bound that does not use
Cauchy-Swartz inequality?
Let me outline the classical proof and explain why I am interested in this ...
- 671
2
votes
3
answers
184
views
Existence and sharpness of Bernstein-type bounds on the moment-generating function
Let $X$ be a centred random variable with variance $\sigma^2$, and whose moment-generating function exists in an open neighbourhood of the origin.
Say that $X$ satisfies a 'Bernstein-type' MGF bound ...
- 801
2
votes
1
answer
138
views
How to lower bound the absolute value of the difference of two Kullback-Leibler divergences given the constrains below?
Given that $\min (D[p_1||p_3],D[p_2||p_4])=a$, how to find a lower bound of the difference $\left \vert D[p_1\parallel p_2]-D[p_3\parallel p_4] \right\vert$ with respect to $a$? If the condition is ...
- 31
2
votes
1
answer
251
views
Log-Sobolev constant
Let $\nu \propto e^{-f}$ be a probability density on $\mathbb{R}^d$ with full support. We say $\nu$ satisfies the log-Sobolev inequality (LSI) with constant $\alpha$ if for every smooth function $g:\...
- 519
2
votes
1
answer
161
views
Trying to bound one functional by another functional
In my little research project, I faced the following problem: Assume that $\rho$ is a probability density function with support $[0,\infty)$ and mean $\mu >0$. Let $$H[\rho] = \iiint_{y,v,w\geq 0} \...
- 730
2
votes
1
answer
629
views
Beyond union bound
I am very curious whether there are some interesting techniques to deal with cases where union bound is not strong enough to give the desired result. I am only aware of the Bonferroni inequalities (...
- 233
2
votes
1
answer
222
views
Does the inequality $\mu F(\mu)^2\geq \int_{\mu}^{b}F(x)\cdot(1-F(x))\,\mathrm dx$ hold for compactly supported continuous random variables?
This question was originally asked on the Mathematics StackExchange by User smcc
Consider a continuous random variable $V$ with cumulative distribution function $F$ and density function $f$. Suppose ...
- 1,326
2
votes
1
answer
78
views
Existence of stationary stochastic processes with very high correlation
A question was recently asked by a new user, SomeoneHAHA, and then deleted by the user, after receiving an answer. I think the question and the answer (QA) to it may be of interest to some users. ...
- 128k
2
votes
1
answer
287
views
Bernstein Inequality for continous local martingale
I'm looking for a simple proof of the following fact, which is somehow Bernstein inequality in continuous time.
Let $(M_t)_{t\geq 0}$ be a continuous local martingale. Then :
$$P\left(\sup_{t\in [0,...
- 245
2
votes
1
answer
563
views
Prove or disprove $ \int_0^\infty \int_{-x}^0 f(x)f(y)\,dy\,dx > \int_0^\infty \int_{-\infty}^{-x} f(x)f(y)\,dy\,dx. $
Consider a symmetric, unimodal distribution $f(x)$ such that $\int_0^\infty f(x)\,dx > 1/2$. I want to prove or disprove the following:
$$
\int_0^\infty \int_{-x}^0 f(x)f(y)\,dy\,dx > \int_0^\...
- 175
2
votes
1
answer
208
views
Proving an exponential sum inequality for symmetric Hamming distance sequences in binary vectors
Background: Let $X = \{0,1\}^k$ represent the set of all binary vectors of length $k$. For two binary vectors $x, y \in X$, the Hamming distance $d_H(x, y)$ is defined as the number of positions where ...
- 349
2
votes
1
answer
144
views
Concentration inequality for double sum
I am looking for a concentration inequality of a double sum….
Let $X_1,\dots, X_n$ be iid r.v. and also let $Y_1,\dots ,Y_n$ be iid such that even $X_i$ and $Y_j$ are independent.
I am looking for a ...
- 51
2
votes
1
answer
106
views
Lower bounds for the expectation of log ratio between the posterior and prior Beta densities
The quantity I'm interested in is expressed as follows:
$$
I = \mathbb{E}_{k\sim \text{Binom}(n,p)} \left[\ln \frac{\text{Beta}(p;a+k,b+n-k)}{\text{Beta}(p;a,b)}\right]
$$
The term inside the ...
- 63
2
votes
1
answer
796
views
Can we get that $ P(N^{2/3}(\lambda_N-\lambda_{N-1})\le c)\ge 1-\epsilon$?
Following this question: Can we apply the continuous mapping theorem for the limiting joint distribution of the Tracy-Widom law?.
We know that
$$
\lim_{N\to\infty}P(N^{2/3}(\lambda_N-2)\le s_1,\dotsc,...
- 288
2
votes
1
answer
136
views
Does higher volatility of SDE imply lower probability of staying positive?
Given two SDEs $X^1$, $X^2$ :
$$X^i_t=1+t+\int_0^t\sigma_i(s)dW_s,\quad \forall t\ge 0,$$
where $\sigma_i:\mathbb R_+\to [1/2,1]$ are non-decreasing s.t. $\sigma_1(t)\le \sigma_2(t)$ for all $t\ge 0$....
- 1,334
2
votes
1
answer
198
views
Bounds for the beta CDF
This question is closely related to a previous question that I asked here:
An inequality involving the beta distribution
Let $a,b$ be strictly positive integers, and let $F_{a,b}(x)$ denote the CDF ...
- 4,049
2
votes
1
answer
286
views
An inequality for abstract Cauchy problem
Consider the following abstract Cauchy problem: $x'(t)=Ax(t)$, in $(0,T)$, with $x(0)=x_0$, where $A$ generates an analytic $C_0$-semigroup on a Banach space $X$. How we can prove an inequality of ...
- 97
2
votes
1
answer
675
views
Moment generating function of random unit vector
Let $X$ be uniformly distributed on the unit sphere $S^{n-1}$. Is there any result concerning the calculation or bound (particularly lower bound) of
$$\mathbb{E}[\exp(X^Tv)]$$
for any $v$?
- 1,495
2
votes
1
answer
280
views
Complicated bound after using Stirling's approximation
I have this inequality $$\frac{1}{a}\exp\bigl\{-\frac{4}{h^2}\bigr\} \geq \frac{1}{f}$$ where $$ a \leq \Bigl(\pi^{d/2}\Gamma(\frac{1}{2}d+1)^{-1} + 1\Bigr) \left(\frac{h^{d+1}}{2} \Gamma \left(\frac{...
- 225
2
votes
1
answer
172
views
Symmetry of concentration bounds on mean
Question summary:
If I have a two-sided bound, can I immediately get a one-sided bound with tighter constants?
Question details:
Let $\mathbf X = X_1,...,X_n$ be $n$ i.i.d. real-valued random ...
- 399
2
votes
1
answer
588
views
maximal inequalities for dependent random variables
I want to know literature about maximal inequalities for dependent random variables i.e. upper bound for $P(\max_{n\ge k\ge 1}\sum_{i=1}^{k}X_i > \delta)$ where $X_i$ are dependent random ...
- 317
2
votes
1
answer
3k
views
Inequality for the tail of normal distribution function
Let $ Ф(x) = \frac{1}{\sqrt{2\pi}} \int_{-\infty}^{x} e^{-t^2/2} \, dt $ be the cumulative distribution function of the standard normal distribution.
Numerical calculations suggest the following ...
- 61
2
votes
1
answer
803
views
Inequality constraints, probability distributions, and integer partitions
I am interested in the possibility of generating probability distributions using inequality constraints. For instance assume that we have three urns with total of a 10 balls. Thus,
$a + b + c = 10$
...
2
votes
1
answer
386
views
A maximal inequality
Let $\{X_i\}_{i\in\mathbb{N}}$ be i.i.d. symmetric random variables, with $-1\leq X_i\leq 1$, $\mathbb{E}(X_i) =0$, $\mathbb{E}(X_i^2) = 1$. We have that:
$$
P\left(\bigcap_{k = 1}^{n}\frac{|\sum_{i = ...
- 63
2
votes
1
answer
119
views
Simultaneous Concentration of $\sum_{i = 1}^{n} X_i^2$ and $\sum_{i = 1}^{n} X_i$ with $X_i$ iid. Poisson
Consider $n$ independent Poisson(1)-distributed random variables $(X_i)_{1 \leq i \leq n}$.
This is a (hopefully more interesting) follow-up question to Super-exponential concentration for $\frac{\...
- 578
2
votes
1
answer
335
views
The lower bound of bivariate normal distribution
Suppose $(Z_1, Z_2)$ is the zero-mean bivariate normal distribution with covariance $\left( \begin{matrix} 1 & \rho; \\ \rho & 1\end{matrix} \right)$ with positive $\rho > 0$. What I want ...
- 331