Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 36721
14 votes
Accepted

What is (approximately) the expected value of $X\log{ X}$ where $X$ is binomial (or Poisson)?

$\newcommand{\ep}{\varepsilon} $ Let $X$ be any nonnegative random variable (r.v.) with finite mean $\mu>0$ and variance $\sigma^2<\infty$. For any real $u>0$, we have $\ln\frac xu\le\frac xu-1$ for a …
Iosif Pinelis's user avatar
9 votes

Adaptive version of the Azuma–Hoeffding inequality

This inequality cannot be true. Let us rewrite it in the more common form $$P(R_n\ge x)\le e^{-x^2/2} \tag{1} $$ for $x\ge0$, where $R_n:=S_n/b_n$, $S_n:=\sum_1^n c_iB_i$, $b_n:=\sqrt{\sum_1^n c_i^2} …
Iosif Pinelis's user avatar
8 votes
Accepted

Can we do better than Azuma-Hoeffding when the variance is small?

Exponential inequalities for sums of independent random variables (r.v.'s) can be extended to martingales in a standard and completely general manner; see Theorem 8.5 or Theorem 8.1 for real-valued ma …
Iosif Pinelis's user avatar
7 votes
Accepted

Concentration inequalities for very rare events on a multiplicative scale

Let $n:=N$. Let us show that for all natural $n$ and all $p\in(0,1)$ $$P(A_n>\sqrt p)\le\frac{\sqrt p+p}{1+p},\tag{1}$$ so that $P(A_n>\sqrt p)\to0$ whenever $p\downarrow0$. Consider first the case wh …
Iosif Pinelis's user avatar
7 votes
Accepted

Is there an i.i.d sequence in the unit cube $[-1,1]^d$ with $\mathbb E \left[ \Big \| \sum_{...

Let $X_i=(X_{i,1},\dots,X_{i,d})$, $S:=(S_1,\dots,S_d)$, $S_j:=\sum_{i=1}^d X_{i,j}/\sqrt n$. Then, by Hoeffding's inequality, for $s\ge0$ $$P(|S_j|\ge s)\le2e^{-s^2/2},$$ whence $$E\|S\|_\infty=\int …
Iosif Pinelis's user avatar
7 votes
Accepted

Weak concentration bounds for averages of independent random variables in Orlicz spaces

In general, the answer is no. Moreover, the answer is no even if \begin{equation} \phi(t)=t\ln(1+t). \tag{1} \end{equation} Indeed, suppose that $P(Z_i=0)=1-2p$ and $P(Z_i=b)=p=P(Z_i=-b)$ for all …
Iosif Pinelis's user avatar
6 votes
Accepted

Tail probability of random projection

$\newcommand{\R}{\mathbb{R}} \renewcommand{\P}{\operatorname{\mathsf P}} \newcommand{\Ga}{\Gamma} \newcommand{\de}{\delta}$ In view of the spherical symmetry of the distribution of the $l$-dimensiona …
Iosif Pinelis's user avatar
6 votes
Accepted

Central limit theorem for resampling

First, we need to fix the notation a bit. Let $X_1,X_2,\dots$ be iid zero-mean unit-variance random variables (r.v.'s). For each natural $n$, let the $n$-tuple $(J_1,\dots,J_n):=(J_{n,1},\dots,J_{n,n} …
Iosif Pinelis's user avatar
6 votes
Accepted

On the 1/2 assumption on concentration of measure for continuous cube

By the Tsirel’son--Ibragimov--Sudakov argument, reviewed on the first page in Bobkov, pushing the measure forward from the cube to the canonical Gaussian on $\mathbb R^n$ and using the Gaussian isope …
Iosif Pinelis's user avatar
6 votes
Accepted

Distribution of the individual coordinates of a uniform random vector on a high-dimensional ...

Without loss of generality, $R=1$. Let $Z_1,\ldots,Z_n$ be iid standard normal random variables (r.v.'s). Then \begin{equation} \sqrt n\, X_1\overset{\text{D}}=\frac{\sqrt n\,Z_1}{\sqrt{Z_1^2+\cdot …
Iosif Pinelis's user avatar
6 votes
Accepted

Concentration Inequality for Bounding Lipschitz Empirical Lass

Your inequality is trivial and useless as written. On its left-hand side we have a probability which is $\le1$ and goes to $0$ as $t\to\infty$, whereas on the right-hand side we have an expression whi …
Iosif Pinelis's user avatar
6 votes
Accepted

Chernoff-type bounds for a stopped sum of independent random variables

The desired statement will not hold. E.g., suppose that $n\ge2$; $X_1,\dots,X_n,Y_1,\dots,Y_n$ are independent; $p=1/2$; $T=1_{X_1\ne Y_1}+n1_{X_1=Y_1}$; and $\delta=1/2$. Then $\mu:=p\,ET>n/4\to\inft …
Iosif Pinelis's user avatar
6 votes

Concentration inequality for the law of iterated logarithm

As was noted in the comments by Yuval and Kevin, even if $X_1$ is bounded, the best upper bound on the probability in question is a negative power of $\ln n$. To get such a bound (and even an asymptot …
Iosif Pinelis's user avatar
5 votes
Accepted

concentration inequality for entropy from sample

Actually, Bernstein's inequality does not really require boundedness of the i.i.d. random summands; a finite exponential moment of the absolute value of a random summand will suffice. However, here we …
Iosif Pinelis's user avatar
5 votes
Accepted

Good upper-bound for $\mathbb E[|X-np|^r]$ where $X \sim \text{Binomial}(n,p)$ and $r \ge 1$

By the main result of the paper Exact Rosenthal-type bounds, we have $$E|X-np|^r\le c^r E|\Pi_\lambda-\lambda|^r $$ for real $r\in(2,\infty)\setminus(3,4)\setminus(4,5)$, where real $c>0$ and $\lambd …
Iosif Pinelis's user avatar

1
2 3 4 5
7
15 30 50 per page