All Questions
Tagged with pr.probability probability-distributions
1,385 questions
2
votes
1
answer
675
views
Moment generating function of random unit vector
Let $X$ be uniformly distributed on the unit sphere $S^{n-1}$. Is there any result concerning the calculation or bound (particularly lower bound) of
$$\mathbb{E}[\exp(X^Tv)]$$
for any $v$?
CommunityBot
- 1
4
votes
0
answers
212
views
A lower bound on the expected sum of Bernoulli random variables given a constraint on its distribution
Given a set of Bernoulli random variables $x_1, \dots, x_n$ (not necessarily identical) with $X= \sum_{0<i\leq n} x_i$, I am intrested in finding a lower-bound for $\frac{\mathbb{E} [ \min (X,k) ]...
- 189
1
vote
0
answers
112
views
Hashed coupon collector
The story:
A sport card store manager has $r$ customers, that together wish to assemble a $n$-cards collection.
Every day, a random customer arrives and buys his favorite card (that is, each customer ...
- 11
14
votes
1
answer
813
views
Large-n limit of the distribution of the normalized sum of Cauchy random variables
What is the large-n limit of a distribution of the following sample statistic:$$x\equiv\displaystyle\frac{\sum^{n}X_{i}}{\,\sqrt{\,\sum^{n}X_{i}^{2}\,}\,}$$ when sampling the Cauchy(0,1) distribution? ...
- 188k
5
votes
1
answer
1k
views
Sum of random variables are equal in distribution
Suppose that $X,Y$ are scalar random variables supported on some standard Lebesgue probability space $(\Omega, \mathrm{P})$, such that $X \overset{\mathrm{d}}{=} Y$ in the sense that their pushforward ...
- 14.2k
4
votes
0
answers
261
views
Tight bounds for finite de Finetti's theorem
de Finetti's theorem roughly states that infinite sequence of exchangeable random variables are conditionally independent. I am looking for tight bounds for de Finetti's theorem in the following ...
- 763
5
votes
0
answers
711
views
Concentration inequality for max component of a multivariate Gaussian in the general case
I am looking to bound the variance of the maximum component of a vector distributed multivariate Gaussian in the general case where the Gaussian distribution has arbitrary mean and full covariance ...
- 283
6
votes
1
answer
501
views
Maxima of Brownian motion
It is well-known that Brownian motion attains infinitely many maxima in each time interval $[0,T]$ a.s..
From a physics perspective it seems reasonable that when the disorder of the path of a ...
- 7,514
7
votes
0
answers
179
views
Can one "smooth over" k-wise independence to get actual independence?
I came across the following toy problem and was curious if there was a simple solution or counterexample. Suppose you have a distribution $p$ on $m$ random variables $X_1, \ldots, X_m$, each with ...
1
vote
1
answer
194
views
Is there a 1/poly(n) or 1/polylogn upper-bound for this tail bound?
Is there a good tail bound for $\operatorname{P}\!\Bigg[\bigg\vert\dfrac{\sum_{j=1}^n(\sum_{i=1}^n a_{i,j})^2}{n^2} -1\bigg\vert > \epsilon\Bigg]\,,$ where all $a_{i,j}$'s are iid, with $\...
- 14.2k
4
votes
1
answer
119
views
Expected value of a random variable conditioned on a positively correlated event
I have a random variable $x \in [a, b]$ with PDF $f(x)$ and an event $E$ which satisfies the following property for any $x'<b$.
$$\Pr[E\mid x > x'] \geq \Pr[E]$$
My question is whether or not ...
- 128k
14
votes
4
answers
2k
views
Gaussian distributions as fixed points in Some distribution space
I'm taking a course on topology and probabily. Today, the professor remarked something along the lines of:
If you look at the space of probability distributions with $0$ mean and variance $1$, ...
- 2,600
4
votes
4
answers
4k
views
"Square root" of Beta(a,b) distribution
Under what conditions on a and b is there a distribution $f_{a,b}$ such that the product $XY$ of two independent realizations $X$ and $Y$ from $f_{a,b}$ has a Beta(a,b) distribution?
A standard ...
- 6,367
12
votes
2
answers
1k
views
lower-bound for $Pr[X\geq EX]$
Given n random variables, $X_1, ..., X_n$, each takes value 0 or $a_i \in[0, 1]$. $X = \sum_{i=1}^n X_i$ and $EX \geq 1$ is the expected value of $X$. Can we get a lower-bound for $Pr[X \geq EX]$? It ...
- 544
3
votes
1
answer
226
views
Total offspring of Poisson multitype branching process
A normal branching process $Z_n$ initialized with $Z_0=1$ and offspring generated from $Pois(p),p<1,$ has a total progeny / total off spring distribution
$$X=\sum_{n=0}^\infty Z_n$$
$X\in \mathbb{...
- 61.9k
3
votes
1
answer
456
views
Heavy tail central limit theorem
I am looking for a proof based on characteristic functions for the generalized central limit theorem when the second moment does not exist, in which case one ends up with a power law rather than a ...
- 128k
1
vote
0
answers
72
views
Large Deviation of Triple Poisson Product
Let $X_i$ with $i=1,\ldots,n$ be independent Poisson variables, $X_i$ with parameter $\lambda_i.$
Let $\circ$ be a group operation on a group of size $n.$
I would like to obtain a large deviation ...
- 10.4k
1
vote
1
answer
134
views
Random optimization problem
Let $V$ be a set of $n$-dimensional vectors such that, for each ${\bf v}\in V$ and for each index $i\in [n-1]$, we have $0\le v_{i+1}\le v_i$. Let $P(\cdot)$ be a discrete probability distribution ...
- 128k
4
votes
1
answer
142
views
Linear combination of coordinates of random unit vector
Let $v\in \mathbb{R}^n$ be uniformly distributed on the unit sphere. Let $\lambda_1,...,\lambda_n$ be given real numbers. What is the distribution of
$$X=\sum_{i=1}^n\lambda_iv_i^2\;?$$
Does it happen ...
- 128k
2
votes
1
answer
206
views
Density of random matrix only depends on its spectrum
Suppose a random positive definite matrix $A\in\mathbb{R}^{n\times n}$ has density function (with respect to the lebesgue measure on $\mathbb{R}^{n(n+1)/2}$) $f(A)=g(\lambda_1(A),...,\lambda_n(A))$ ...
- 128k
1
vote
0
answers
98
views
Joint distribution of two weighted sums of IID random variables
Let $X_1, X_2, \dots$ be independently uniformly distributed random variables in $\{-1, +1\}$ and let $a_1, b_1,a_2,b_2, \ldots \in \mathbb{R}$ be fixed, bounded and of non-zero average. Let $Y_n=...
- 341
11
votes
7
answers
29k
views
Resultant probability distribution when taking the cosine of gaussian distributed variable
I am trying to do a measurement uncertainty calculation. I have a gaussian distributed phase angle (theta) with a mean of 0 and standard deviation of 16.6666 micro radians. The variance is the ...
- 1
2
votes
0
answers
57
views
Given a set of marginals, what is the largest support of a distribution satisfying these?
Given a random variable $X$ with support over $\{0,1\}^I$, we can define the marginal distribution on the bits indexed by $A \subseteq I$ by $Pr(X_A = x_A) = \sum_{x \in \{0,1\}^{I - A}} Pr(X = x \cup ...
1
vote
1
answer
3k
views
Correlation between square of normal random variables
Suppose I have $X,Y$ bivariate normal with correlation coefficient $\rho \in (0,1)$ . Then , what is the correlation between $X^2 $ and $Y^2$ ?
I am aware of the fact that the square of the normal ...
- 128k
0
votes
1
answer
681
views
concentration of sums of fourth moment of normals
I was wondering what is the best tail bound for
\begin{equation*}
\mathbb{P}\bigg\{\sum_{k=1}^n X_k^4>(1+t)3n\bigg\}\le ?
\end{equation*}
where $X_k$ are i.i.d. $\mathcal{N}(0,1)$.
- 1,096
5
votes
2
answers
185
views
Density near at $0$ for the integral of the positive part of the Brownian motion
This question was asked recently on MO and then deleted by the owner, user Aalon. I think the question deserves to be answered, which is what I will try to do here. Aalon was reading this paper, where ...
- 66
8
votes
1
answer
355
views
Lower Bound of KL-Divergence Between Two Gibbs Measures
Suppose we have two Gibbs measures with densities
$$
p_f(x) \propto \exp(f(x)),\quad q_g(x)\propto \exp(g(x)).
$$
Consider the KL-divergence between $p_f$ and $q_g$, as a functional of $f$ and $g$, ...
- 128k
1
vote
1
answer
90
views
The weak version of the memoriless property
In our group we are working with a probability distribution $X$ defined on a non-negative domain, satisfying the following property
$$
P\left[X>a\right]\ge P\left[X>a+t \mid X>t\right],
$$
...
- 128k
2
votes
0
answers
70
views
If $X^n$ is a sequence of càdlàg processes whose FDDs converge to a continous process $X$, does $X^n$ converge to $X$ in the Skorohod topology?
Let $(\Omega,\mathcal A,\operatorname P)$ be a probability space, $E$ be a complete locally compact separable metric space, $(X^n_t)_{t\ge0}$ be an $E$-valued càdlàg process on $(\Omega,\mathcal A,\...
- 167
1
vote
0
answers
103
views
A question about pdfs with likelihood ratio order
Suppose $f_1,f_2,\dots$ are pdfs of absolutely continuous random variables with the same support (say an interval). Assume that $\{f_i\}$ are strictly positive in their support. Furthermore, $\frac{...
- 393
1
vote
1
answer
92
views
boundig variation from median [closed]
Given a scalar random variable $X$, suppose that there are positive constants $c_{1}$ and $c_{2}$ such that
$$\forall t\geq 0 : \,\,\,\,\,\,\ \mathbb P\{|X-\mathbb EX|\geq t\}\leq c_{1}e^{-c_{2}t^{2}}...
- 128k
2
votes
1
answer
436
views
Best approximation of a compactly supported density by a single Gaussian
Note: This is a follow-up question inspired by a previous (more difficult) question I asked on MathOverflow.
Let $f:\mathbb{R}\to\mathbb{R}$ be a (sufficiently regular, e.g. smooth) probability ...
- 128k
1
vote
1
answer
89
views
Correlation between r.v.'s following a distribution that is the ration between complex Gaussian and Chi-square r.v.'s
Given the following two R.V.s
$$z_{1} = \frac{x_{1}}{|x_{1}|^2 + |x_{2}|^2 + ... + |x_{M}|^2}$$
and
$$z_{2} = \frac{x_{2}}{|x_{1}|^2 + |x_{2}|^2 + ... + |x_{M}|^2}$$
where $x_{i} \sim \mathcal{CN}(...
- 63.9k
1
vote
1
answer
88
views
Independence of r.v.'s following a distribution that is the ratio between complex Gaussian and Chi-square r.v.'s
Given the following two R.V.s
$$z_1 = \frac{x_1}{|x_1|^2 + |x_2|^2 + \cdots + |x_M|^2}$$
and
$$z_2 = \frac{x_2}{|x_1|^2 + |x_2|^2 + \cdots + |x_M|^2}$$
where $x_i \sim \mathcal{CN}(0,a), \forall i$...
- 63.9k
3
votes
2
answers
2k
views
The norm of isotropic sub-Gaussian random vector may not be sub-Gaussian
Suppose $X$ is a isotropic sub-Gaussian $n$-dimensional random vector (i.e. $EXX^T=I_n$, and for any unit vector $u$,$\|\left<X,u\right>\|_{\psi_2}\le K$). It is said that $\|X\|_2-\sqrt n$ may ...
- 128k
3
votes
2
answers
819
views
Is there a name for "splitting a probability distribution into independent components"?
Suppose I have a random variable $\theta=(\theta_1,\dotsc,\theta_n)$; where the $\theta_i$ might have pairwise correlations. I decompose it into $\theta=\hat\theta(\phi_1,\dotsc,\phi_k)$, where $\hat\...
- 2,791
2
votes
0
answers
100
views
Reference Request: Total Variation Between Dependent and Independent Bernoulli Processes
Let $X$ be a random variable taking values in $\{0,1\}^n$ with the following distribution. For each coordinate $i$, we have $p_i = P(X_i = 1) = c/\sqrt n$, where $c$ is a (very small) constant. ...
- 560
3
votes
1
answer
498
views
Strictly Proper Scoring Rules and f-Divergences
Let $S$ be a scoring rule for probability functions. Define
$EXP_{S}(Q|P) = \sum \limits_{w} P(w)S(Q, w)$.
Say that $S$ is striclty proper if and only if $P$ always minimises $EXP_{S}(Q|P)$ as a ...
- 4,529
3
votes
3
answers
477
views
A clean upper bound for the expectation of a function of a binomial random variable
I wonder if there is a closed-form, or clean upper bound of this quantity: $\mathbb{E}[|X/n-p|]$, where $X\sim B(n,p)$.
- 128k
0
votes
1
answer
101
views
How to find a special random variable? [closed]
Suppose random variables $X_1$ and $X_2$ have the same distribution under P, $Y_1$ is an arbitrary random variable,let $Z_1:=X_1+Y_1$.Can we find a r.v. $Y_2$ which has same distribution as $Y_1$,such ...
3
votes
1
answer
694
views
Asymptotic bound on the total variation distance between a standard multivariate normal and a simple mixture
Let $P = N(\vec{0}, I^d)$ be a standard multivariate Gaussian distribution in $d$ dimensions. Let $Q$ be distributed the same as $P$, except that samples from $Q$ have one of their coordinates, chosen ...
- 128k
1
vote
0
answers
56
views
About a class of expectations
Consider being given a $n-$dimensional random vector with a distribution ${\cal D}$, vectors $a \in \mathbb{R}^k$, $\{ b_i \in \mathbb{R}^n \}_{i=1}^k$ and non-linear Lipschitz functions, $f_1,f_2 : \...
- 2,246
22
votes
3
answers
3k
views
On the sum of uniform independent random variables
Let $X_1,...,X_n$ be independent uniform random variables in [0,1] and assume $c>1/2$. Is it true that $$\mathbb{P}\left[\sum_{i=1}^n X_i \leq n \cdot c\right]$$ is increasing with respect to $n$?
...
- 188k
2
votes
1
answer
111
views
Where does the expected value in the restatement of the pseudoregret come from?
Given stochastic payoff functions $X_{1}(t) \dots X_{K}(t)$, each having a different probability distribution on $[0,1]$, denote the expected value of $X_i(t)$ by $\mu_i$, and define $\mu^* = \max_{i \...
- 24.8k
2
votes
1
answer
847
views
Concentration inequality for quadratic form of Gaussian variables with non-idempotent matrix
Given $y \sim N(0,\sigma^2 I)$, and $M$ that is a symmetric matrix (not necessarily idempotent)
what is the distribution of ${y^T M y}$?
is there a high probability bound on $|{y^T M y}|$?
Most ...
- 128k
1
vote
1
answer
161
views
LLN large number law of Probability
I am studying the Law of large numbers for independent and identically distributed (i.i.d) random variables.
Assume there are i.i.d variables $(\xi_k)_{k\ge 1}$ taking values in $(0,1)$. From the law ...
- 63.9k
4
votes
1
answer
699
views
Rate of decay in the multivariate Central Limit Theorem
The celebrated Berry-Esseen inequality tells us that the rate of convergence in the univariate CLT is of magnitude $\frac{1}{\sqrt{n}}$ for sums $S_n=X_1+\cdots+X_n$ of independent random variables $...
- 128k
5
votes
1
answer
997
views
Variance of sum of $m$ dependent random variables
I originally posted this question in Mathstackexchange, but since I got no answer I'm posting it also here.
Let $X_1,X_2,...$ be a sequence of identically distributed and $m$-dependent random ...
- 3,993
1
vote
0
answers
221
views
Different balls in bins: What is the probability distribution of the sum of the minimum of the two types of balls over all bins?
Assume that there are $N$ different bins and two different kinds of balls, $R$ red balls and $W$ white balls.
The red balls and the white balls are randomly distributed across the bins (that is, for ...
- 63.9k
2
votes
1
answer
106
views
How to efficiently sample uniformly from the set of $p$-equipartitions of an $n$-set?
I have a question related to this one. For $n,p \in \mathbb{N}_+$ such that $p\mid n$, let $\mathcal{P}^{\rm eq}$ be the set of all equipartitions of $n$ in $p$ sets; i.e., in sets of equal size $\...
- 1,372