All Questions
Tagged with pr.probability probability-distributions
1,384 questions
4
votes
2
answers
274
views
Does strong stochastic ordering exist?
For two probability measure $\mu$ and $\nu$ on $\mathbb{R}$, we call $\mu$ is stochastically smaller than $\nu$ (i.e., $\mu\leq\nu$) , if $\int f \, d\mu\leq\int f \, d\nu$ for any nonnegative bounded ...
- 43
7
votes
1
answer
508
views
An order statistics problem with some interesting geometry
Let $a_n$ be a given sequence of positive numbers, and $X_n$ a sequence of independent random variables with each $X_n$ uniformly distributed on $[0, a_n]$.
Question: Let $N \geq 2$ be an arbitrary ...
- 6,195
1
vote
0
answers
170
views
Asymptotic distribution of L infinity norm of Gaussian random vector
Let $\mathbf{X}_n = (X_{n,1}, \ldots, X_{n,n})$ be a $n$-dimensional random vector with $N_n( \mathbf{0}_n, \boldsymbol{\Sigma}_n )$ distribution. The asymptotic distribution of the $L_\infty$-norm of ...
- 119
3
votes
1
answer
561
views
On the convergence in total variation
$\newcommand\R{\mathbb R}$For a probability measure $\mu$ over $\R^2$ and a unit vector $u\in\R^2$, let $\mu^u$ denote the pushforward of $\mu$ under the projection map $\R^2\ni x\mapsto u\cdot x\in\R$...
- 128k
7
votes
0
answers
222
views
Projected polar chessboard measure convergence in total variation?
$\newcommand\R{\mathbb R}\newcommand\C{\mathbb C}\newcommand\ga{\gamma}$For natural $n$, let $E_n$ be the set of all points in $\R^2$ with "polar coordinates" $(r,t)$ in the set
$$F_n:=\...
- 128k
1
vote
1
answer
100
views
Does convergence of Radon transforms of a sequence of probability distributions implies convergence of the distributions themselves?
Let $P_1,P_2,\ldots $ be a sequence of absolutely continuous probability measures on $\mathbb R^n$, and let
$f_j:\mathbb R^n\to\mathbb R$ be their PDFs. Assume that $\operatorname{E}P_j = 0$ and $\...
- 13
7
votes
2
answers
1k
views
Can a non integrable random variable satisfy a strong law of large numbers principle?
Given a random variable $X$, we denote by $X_1, X_2, \dots$ a sequence of iid copies of $X$.
Question: Does there exist a random variable $X$ with $\mathbb E[X^+] = \mathbb E[X^-] = +\infty$, but
$$\...
- 6,195
1
vote
1
answer
187
views
Bound the distance between two vectors on the probability simplex
Let $a,b$ be two vectors with strictly positive elements and $\delta = 1 - \frac{\langle a,b \rangle}{\|a\|\|b\|}$. Bound the following optimization problem as a function of $\delta$
$$\sup_{x>0} \...
- 135
1
vote
0
answers
67
views
Random matrix theory: accounting for mean
Assume a random matrix, denoted as $X$, which is an $n$ by $T$ matrix, $T\geq n$. While I understand the typical scenario where the random variables $X_{ij}$ are sampled from a $\mathcal{N}(0,\sigma_{...
3
votes
0
answers
125
views
Extracting moments of $\max(X_1,\ldots,X_k)$ from asymptotic behavior of $\mathbb{E}[(X_1^n+\cdots+X_k^n)^m]$
For fixed $k$ suppose we have $X_1,\ldots,X_k$ non-negative random variables with density functions.
Setting a): We know $\mathbb{E}[(X_1^n+\cdots+X_k^n)^m]$ exactly for any integers $n,m \in \mathbb{...
- 1,295
4
votes
1
answer
518
views
Probability to return to the origin for a uniform random walk
Consider a uniform random walk on $\mathbb{R}$, with stepsize chosen uniformly from the interval $(-1,1)$. The random walk start at $x=0$. Denote by $\rho_p dx$ the probability that the random walk ...
- 188k
0
votes
2
answers
239
views
Computing the expectation of a quadratic matrix form involving Bernoulli and Gaussian distributed matrices
I am working with two random matrices, $Z$ and $H$:
$Z$ is an $n \times K$ matrix with entries sampled i.i.d. from a Bernoulli distribution: $Z_{ij} \sim \mathrm{Bernoulli}(p)$.
$H$ is a $K \times K$ ...
- 37
0
votes
1
answer
87
views
Is the $2$-point function translation invariant for general Gaussian meaures?
Let us consider the real Hilbert space $H:=L^2\bigl(\mathbb{R}^n, \mathbb{R}^n\bigr)$ and "any" centered Gaussian measure $d\mu$ on it.
Next, denote a generic element of $H$ by the column ...
- 3,477
0
votes
1
answer
154
views
Joint distribution of randomly permuted Poisson random variables
Let $U_1, ..., U_n$ be Poisson random variables with rates $ \lambda_1, ..., \lambda_n$ such that $\lambda =\sum_i \lambda_i = O(1)$ (i.e the sum of the rates is bounded). Suppose we have $n$ buckets. ...
- 662
0
votes
1
answer
112
views
Where does this coupling result use independence when bounding total variational distance?
I am reading this paper, which gives the following coupling result:
Throughout this, I'll assume the dimension $k$ is clear. Let $e_i$ be the $i$-th basis in the $k$ dimensional standard basis.
A $k$ ...
- 662
0
votes
0
answers
46
views
Prove lower collinearity on the tails of Gaussian blob
Let us consider a $n$-dimensional Gaussian blob, i.e. a set of $N$ random vectors $\{\boldsymbol{X}^{(j)}\}_{j=1}^N$, with $n$ independent components, $X_i^{(j)}$, and such that $X_i^{(j)} \sim \...
- 305
3
votes
1
answer
269
views
Trace of product of two Wishart matrices
Let $A,B$ be two independent complex Wishart matrices, $A,B\sim CW_p(\mathbf{I},n)$, that is $A=\frac1n GG^\dagger$& $B=\frac1n QQ^\dagger$ where $G$ and $Q$ are independent $p\times n$ complex ...
- 85
5
votes
1
answer
240
views
Asymptotic distribution of the extreme, standardized order statistics of uniform distribution?
Let $\{U_{k, n}\}_{k=1}^n$, denote the order statistics of a sample of $n$ iid uniform $[0, 1]$ variates.
Note that, marginally $U_{k, n}$ is distributed $\mathrm{Beta}(k, n+1 -k)$.
Therefore, let us ...
- 410
2
votes
1
answer
164
views
Maximal entropy distribution on three variables knowing its marginals on any two
Observation 0: Given a finite set $X$, the probability distribution on $X$ with highest entropy is the uniform one. This is well known.
Observation 1: Given two finite sets $X,Y$ and two probability ...
- 32.5k
2
votes
1
answer
212
views
Gaussian expectation restricted to a convex polytope
Let $X$ be a Gaussian vector in $\mathbb{R}^n$ with $\mathbb{E}[X]=0$ and $\mathbb{E}[X X^\intercal]=I_n$. Let $\mathbf{S}$ be a convex polytope in $\mathbb{R}^n$ defined as the intersection of $m$ $(...
- 21
2
votes
0
answers
306
views
Why is it impossible to create a numerically balanced die with more than 120 sides?
I allow myself to contact you as a mathematics enthusiast. I have recently been intrigued by the concept of balance in dice and the assertion that it would be impossible to create a numerically ...
2
votes
0
answers
56
views
Dirichlet series solution to Poisson Point Process question (repost from math.SE)
Reposting here because the bounty on the original math.SE post expired, with no solutions or comments received.
For any discrete subset $S$ of $\mathbb{R}^d$, consider a digraph formed by placing an ...
- 121
0
votes
0
answers
85
views
Show that $\max_{P_X : X\in (0,1) } \left| \frac{\mathbb{E} [ f'(X) ]}{ \mathbb{E} [ f(X) ] } \right|$ is maximized by at most two mass points
Let $f$ be some given well-behaved function. Consider the following optimization problem overall probability distribution on $[0,1]$
\begin{align}
\max_{P_X : X\in [0,1] } \left| \frac{\mathbb{E} [ ...
- 671
3
votes
1
answer
407
views
Relative entropy equality for a sequence of Bernoulli random variables
We are given two joint probability distributions, $p$ and $q$, of $n$ Bernoulli random variables $X_1, X_2, \ldots, X_n$.
We denote by $p(x_k\mid x^{k-1})$ the probability $\mathbb{P}_p(X_k=x_k\mid ...
- 1,677
4
votes
2
answers
2k
views
Why MLEs are asymptotically efficient whereas method of moment estimators are not?
Under appropriate regularity conditions it is well-known that Maximum Likelihood Estimation (MLE) produces asymptotically efficient estimators in the sense that their asymptotic covariance is given by ...
2
votes
0
answers
115
views
Equivalence of score function expressions in SDE-based generative modeling
I am studying the paper "Score-Based Generative Modeling through Stochastic Differential Equations" (arXiv:2011.13456) by Yang et al. The authors use the following loss function (Equation 7 ...
- 43
1
vote
1
answer
69
views
Expected value of MGIG distribution
I'm currently dealing with a Gibbs sampler of the multivariate generalized inverse Gaussian distribution (MGIG). In order to check the correctness of the sampler, I'd like to know the expected value ...
- 2,560
2
votes
2
answers
297
views
Convergence of the row sums in a triangular null array with zero mean
Let $(X_{jn})_{1\leq j \leq n}$, $n\in \mathbb N$, be a triangular array of random vectors in $\mathbb R^d$ (the $X_{jn}$ are understood to be independent in $j$ for fixed $n$.). We say that the ...
- 13
2
votes
0
answers
185
views
An attempt to define expected value of a Riemannian manifold valued random variable - what'll go wrong?
Let $X:\Omega\to (M,g)$ be a random variable taking values in a Riemannian manifold $(M,g)$ with the Riemannian volume form denoted by $dvol_g(x).$ We know that there's no standard way to generalize ...
- 1,467
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
- 287
4
votes
1
answer
197
views
On a double sum involving binomial coefficients
For natural $n$, let
\begin{equation}
p_n:=2^{1-n}\sum_{v=1}^l \binom l{(v+l)/2}1(v\equiv l)
\sum_{u=1-v}^{v-1}\binom k{(u+k)/2}1(u\equiv k), \tag{1}\label{1}
\end{equation}
where $k:=\lfloor(n+1)/...
- 128k
1
vote
2
answers
137
views
Sum and alternating sum of a series of Bernoullian variates
Consider the random variables
$a_i,i=0,1,\ldots,n$ be random variables which take values from $\{-1,1\}$ independently and randomly with equal probability. Let
\begin{align}
S &= a_1+\cdots+a_n , ...
- 826
1
vote
1
answer
126
views
What is this distributional closeness?
Let $P$ and $Q$ be two distributions over a sample space $\Omega$ which I would like to show are close under some choice of distance function. So far I have managed to show that there exists a subset $...
- 45
4
votes
1
answer
250
views
Does a subset with small cardinality represent the whole set?
Assume that we have heavy-tailed distribution $F(x)$ such that
\begin{align}
F(x)=\mathbb{P}[X\geq x]=x^{-0.5}.
\end{align}
Then, we produce $N$ independent samples $X_1,X_2,\ldots,X_N$ from this ...
- 287
3
votes
2
answers
226
views
Recovering measure support from the sequence of I.I.D random variables
Assume we have a Borel probability measure $\mu$ in $\mathbb{R}^n$ and a sequence of $\mu$ distributed I.I.D. random variables $x_n$. Is there a limit formula for $supp(\mu)$, something like closure ...
- 728
5
votes
1
answer
516
views
Bounding the variance of a truncated Gaussian random variable
Suppose $X_1, X_2, X_3 \sim N(0, 1)$ are three independent standard normal random variables. I am interested in showing that:
$$\text{Var}[X_2\mid X_2 \geq X_1 - a, X_1 \leq X_3 + b] < 1,$$
where ...
- 269
-1
votes
1
answer
169
views
joint density of two relevant random variables
It seems that for most of the examples to derive the joint density of two or more random variables, the random variables themselves need to be independent. Is it possible to get the joint density of ...
2
votes
1
answer
263
views
The best probability distribution for the game of Number Master
In the game of Number Master, the player controls a number starting with $1$ and hits the other numbers one by one on the road.
If the player hits a number smaller or equal to the current controlling ...
- 53
3
votes
1
answer
355
views
Quantitative results (with formal proof) on the median approximation of Chi-squared distribution
It is well-known that Chi-squared distribution $X_n$ with degree-$n$ freedom has an approximate formula for its median as $n\left(1-\frac{2}{9n}\right)^3$. Or $(X_n/n)^{\frac{1}{3}}$ is approximately ...
- 457
4
votes
3
answers
552
views
Gaussian approximation of the characteristic function of Rademacher sum
I am searching an uniform bound for the characteristic function of some Rademacher sum.
Specificaly I want to estimate how much the characteristic function is close to a Gaussian.
We have in general ...
- 41
1
vote
0
answers
68
views
A one-sided/monotone version of min/max-stable distributions -- does this have a name?
In a couple of papers I am working on (in random graph theory) I have encountered the following property of certain probability distributions, which I will describe shortly, and I am wondering if this ...
- 111
3
votes
1
answer
171
views
Variance lower bound for natural exponential family
Let $Q$ be a probability measure on $\mathbb{R}$. Let $$Q_h(dy) = e^{y \cdot h} Q(dy) / M(h) \quad \text{where} \quad M(h) = \int e^{y \cdot h} Q(dy)$$ defined for $h \in (-c,\infty)$ with some $c &...
- 143
-2
votes
1
answer
152
views
Branching process with varying offspring distribution at each step
Consider a simple branching process $Z_0,Z_1,Z_2...$ such that at every discrete step, a particle splits into $k\geq1$ particles where $k$ follows a discrete distribution with probability mass $p(k)$.
...
- 109
4
votes
0
answers
143
views
Projection of log-concave distribution on unit sphere surface
Let $\mathbf X : \Omega \to \mathbb R^d$ be a random vector following a zero mean, identity covariance log-concave distribution.
Is there any known upper bound for the probability density function of $...
- 141
-1
votes
1
answer
77
views
Variance of the logarithm of the mixed Rademacher and complex Gaussian distribution
Consider the scenario where $X$ is a Rademacher random variable taking values $\{−1,+1\}$ with equal probability, and $Z$ is a complex Gaussian random variable with a mean of $0$ and a variance of $\...
- 287
2
votes
1
answer
112
views
Sample integral points in m-Ball
The problem I have is pretty simple, however I cannot find an answer.
I need an efficient algorithm to sample integral points within an m-dimensional ball of radius r around the origin (Euclidean norm)...
- 23
0
votes
1
answer
103
views
Is it reasonable to consider the subgaussian property of the logarithm of the Gaussian pdf?
Let $Y$ denote a Gaussian random variable characterized by a mean $\mu$ and a variance $\sigma^2$. Consider $N$ independent and identically distributed (i.i.d.) copies of $Y$, denoted as $Y_1, Y_2, \...
- 287
2
votes
1
answer
239
views
Hoeffding's Lemma for bounded complex random variables?
If we have a real random variable $X$ such that $a\leq X\leq b$ almost surely, we can establish the following inequality:
\begin{align}
\mathbb{E}\left[\exp\Big(t(X-\mathbb{E}[X])\Big)\right]\leq\exp\...
- 287
5
votes
1
answer
896
views
How can I sample uniformly from a citrus surface?
I want to sample from a Lemon surface uniformly. The equation of this surface is
$$16(x^2+z^2)+(y-2)^3 y^3=0.$$
I have read the paper
Stratified Sampling of 2-Manifolds
. The method described in this ...
- 61
3
votes
1
answer
346
views
Simple anticoncentration bound for binomially distributed variable
The following question, which arose during my research, seems deceivingly simple to me, but I could not find any elegant and formal argument.
For a binomially distributed variable $X \sim \text{Bin} \...
- 85