Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
1 answer
108 views

Asymptotic scaling of mean and variance for the norm of random vector (non gaussian components)

The norm of a vector whoose components $X_i$ are normally distributed follows the Non-central chi distribution and it can be shown that, increasing the number of components $k$ (i.e. the dimension of ...
user1172131's user avatar
2 votes
2 answers
269 views

Asymptotic scaling of mean and variance for non-central chi distribution

Define $Y \equiv \sqrt{\sum_{i=1}^k(\frac{ X_i}{\sigma_i})^2}$, with $X_i \sim \mathcal{N}(\mu_i, \sigma_i^2)$ and independents. It is known that $Y$ is distributed as a non-central chi (Noncentral ...
user1172131's user avatar
1 vote
1 answer
234 views

Hypothesis to guarantee Lindeberg's condition

Imagine to have a set of random variables $\{ X_i \}_{i=1}^{n}$ independent (Non identically distributed). In these scenario, if the Lindeberg's condition hold we can extend the result of the CLT, i.e....
user1172131's user avatar
9 votes
1 answer
351 views

Concentration inequalities for very rare events on a multiplicative scale

Let $E_1, \dots, E_N$ be independent events, each of probability $p$, where $p$ is very close to $0$. Let $A_N = \frac{1}{N} ( 1_{E_1} + \dots + 1_{E_N} )$ be the proportion of the events $E_i$ that ...
Adam's user avatar
  • 323
2 votes
1 answer
3k views

Tail bound regime for Binomial distribution in concentration paper

In paper 'Concentration Inequalities and Martingale Inequalities:A Survey' gives the following inequality: My question is whether the inequality holds in regime $\lambda$ being $o(\sqrt n)$ (say $\...
VS.'s user avatar
  • 1,836
9 votes
2 answers
4k views

What is (approximately) the expected value of $X\log{ X}$ where $X$ is binomial (or Poisson)?

Let $X$ follow a binomial distribution with parameters $n$ and $p$. Are there any known bounds for the expected value of $X\log{X}$, for large $n$ and small (but fixed) $p$? A Poisson approximation ...
Chuck Newton's user avatar
3 votes
1 answer
165 views

Non-asymptotic tail bounds for $D_{\text{Hellinger}}(P\|\hat{P}_N)$

Let P be a distribution on a finite set of size $k$ and let $\hat{P}_N=(N_1/N,\ldots,N_k/N)$ be the empirical distribution (frequencies) from a samples of size $N$. Consider the Hellinger distance ...
dohmatob's user avatar
  • 6,853
3 votes
1 answer
179 views

Tail probability of random projection

Suppose $v\in R^n$ is a constant unit vector. $P_l$ is a random projection matrix to an $l$ dimensional subspace of $R^n$ which is uniformly sampled from $G(l,R^n)$ which is the collection of all $l$-...
neverevernever's user avatar
1 vote
1 answer
118 views

What is the order of the left tail of a mixture of non-central chi-square?

Let $\mu\sim N(0,1)$, $Z\sim N(\mu,1)$. Then $Z$ can be viewed as a mixture of Gaussians. It can also be viewed as a Gaussian but there is a prior for the mean. Let $X\sim\exp(\lambda)$ where the ...
neverevernever's user avatar
3 votes
0 answers
268 views

A generalization of coupon collector problem - $\geq1$ pick per experiment

Mix $T\geq1$ coupons numbered $1$ to $T$ with a set of $S\geq0$ number of dummy coupons with no numbers. Select $N\geq1$ coupons at each trial at random and put them back. $N=1$ is standard coupon ...
user avatar
3 votes
0 answers
270 views

Hamming weight probability of projections

Given $s,t\in(0,1)$, $c>1$, $n\in\Bbb N$, pick $2^{n^t}$ random vectors $\{v_i\}_{i=1}^{2^{n^t}}$ such that each $v_i\in\{x\in\{0,1\}^{2^n}:|x|_{hamming}={2^{n-n^s}}\}$. If $v_i^\perp$ is ...
Turbo's user avatar
  • 13.9k
2 votes
2 answers
291 views

How many boxes so that there is $k$ of same of color from $n$ different colors?

Say you have $m$ boxes each of which is colored with one of $n$ colors. What should $m$ be so that the probability that there is atleast $k$ boxes with one same color is strictly greater than $\frac{1}...
Turbo's user avatar
  • 13.9k