All Questions
Tagged with pr.probability probability-distributions
1,384 questions
2
votes
2
answers
407
views
How to calculate $P(\sum_{i=1}^{m}(A_i+S_i)\le L)$ with $A_i,L\sim\text{exp}(\lambda),S_i\sim\text{exp}(\mu)$ and positive integers $\lambda\neq\mu$?
Recently I was stumped by the calculation of the probability
$$\mathbb{P} \big(\sum_{i=1}^{m} (A_i + S_i) \le L < \sum_{i=1}^{m+1} (A_i + S_i) \big)$$
where $A_i \sim \text{exp}(\lambda), S_i \sim ...
- 139
2
votes
1
answer
269
views
What are the generalized Gaussian probability laws that are infinitely divisible?
We consider the probability density, often called a generalized Gaussian density, $$p_{\alpha}(t) \propto \exp (- |t|^\alpha),$$
with parameter $0<\alpha<\infty$. For $p = 2$, we recognize a ...
- 2,306
1
vote
1
answer
946
views
Push-forward density as surface integral [closed]
Let $X$ be a random variable taking values in $\mathbb R^n$ with a probability distribution $\mathbb P$ that has a density $p$.
Consider further a linear mapping $\pi: \mathbb R^n \to \mathbb R^m$, i....
user45183
8
votes
1
answer
227
views
Distribution of entries of a doubly-sorted random matrix
Take an $n \times n$ random matrix whose entries are i.i.d. with uniform distribution in $[0,1]$. Look at the sums of the elements of each row and then permute the rows so that these sums form an ...
- 2,479
9
votes
1
answer
886
views
Concentration of sum of powers of normals
Let $Z_1,Z_2,\ldots,Z_n$ be i.i.d. copies of a random variable $Z$ distributed as $\frac{1}{\sqrt{2}}X+i\frac{1}{\sqrt{2}}Y$ with $X$ and $Y$ independent standard Normal random variables i.e.~$X\sim\...
- 859
7
votes
4
answers
2k
views
Singular distributions: Applications and Instances
Singular distributions are special mathematical objects. They have an interesting property of not having a density function, defined on a set with Lebesgue measure zero. Cantor distribution is the ...
- 752
2
votes
1
answer
388
views
Quantiles moments and Convergence
QUESTION:
Let $F$ be an absolutely continuous distribution function with density $f$, and $F_{n}$ be its nth empirical distribution. Suppose that $t\in (0,1)$ is constant. Is true the convergence
$$...
- 67
3
votes
1
answer
460
views
Derive concentration bound for the derivative
It that true to conclude that if a random $f(z)$ is a sub-Gaussian random variable for a constant value of z, its derivative $f'(z)|_{z=k}$ with respect to variable $z$ is also sub-Gaussian?
In ...
1
vote
1
answer
363
views
A calculation involving a uniform random variable quantile
THE PROBLEM:
Let $U$ be a uniform distribution and $U_{n}$ be its nth empirical distribution. Suppose $t\in (0,1)$ and $n\in \mathbb{N}$ are constants. What's the explicit expression to
$$E\{U_{n}^{-}...
- 67
0
votes
1
answer
132
views
Running supremmum of a Levy process
Let X be a cadlag Lévy process with $X_0=0$ and let $p$ be a real number in $[1,\infty)$. Then, the following are equivalent.
1): $X$ is $L^p$-integrable.
2): $X^*_t= \mathop{\sup}_{0\leq s\leq t} |...
- 57
3
votes
2
answers
2k
views
Empirical estimator for total variation distance between two product distributions
Let $X = (X_1, X_2, \ldots , X_n)$ be an $n$-dimensional random variable, where each $X_i$ is a random variable on finite discrete set $S$. In addition, $X_i$ are independent of each other (but not ...
- 35
1
vote
1
answer
446
views
Question about characteristic function with independence assumption
Let $X$ be a random vector taking values in $\mathbb R^2$ with probability density $p(x) = p_1(x_1)p_2(x_2)$, i.e. the components of $X$ are independent.
Let $V$ be an open set in $\mathbb S^1$, the $...
user45183
4
votes
2
answers
380
views
Joint probability distribution as functions
Suppose $X$ and $Y$ are correlated random variables in a finite set ${\mathcal A}$, and let $f, g$ be functions that map elements from ${\mathcal A}$ to ${\mathcal B}$ for some finite set ${\mathcal B}...
- 305
10
votes
3
answers
3k
views
Maximum of the expectation of maximum of Gaussian variables
Suppose $X=(X_1,\ldots,X_n)$ is a Gaussian vector with each entry $X_i$ marginally distributed as $\mathcal{N}(0,1)$. Want to find out the possible maximum of
$$\mathbb{E}\max_{1\le i\le n}|X_i|$$
and
...
- 773
2
votes
0
answers
182
views
Learning resources for Probability Distributions/Models [closed]
I've a good background in basic probability. I need to learn and get a good grip on the probability distributions and stochastic processes, counting processes, and other related topics.
I am already ...
- 137
3
votes
1
answer
723
views
Random weighted selection without replacement
I am using the following procedure to select $m$ different numbers $\{i_1,\ldots,i_m\}$ from the set $\Omega = \{1,\ldots,N\}$, with $m,N\in\mathbb{N}$ such that $m< N$.
Selection procedure
...
- 837
4
votes
1
answer
1k
views
General version of Skorokhod representation of random variables
Let $F: \mathbb{R} \to [0,1]$ be cumulative distribution function (cdf). The standard way to build a random variable $\tau$ on $([0,1],\mathcal{B},\text{Leb})$ with $F$ as its cdf is using the ...
- 941
1
vote
3
answers
293
views
Lipschitz continuous maps from $\mathbb R^n$ to $\mathbb R^n$ that preserve Gaussian measure?
The only ones I can think of are linear maps like rotations and permutations. Is there a more general characterization?
- 41
4
votes
1
answer
637
views
Characterizations of the GOE/GUE family of distributions
This question is somewhat related to this one. Loosely speaking, when should I expect a GOE/GUE distribution? The angle of my approach to this is not through statements such as "there is a natural ...
- 4,952
12
votes
1
answer
2k
views
Mean of i.i.d Random Variables With No Expected Value
Let $X$ be an integer-valued random variable and let $X_n$ be the sum of $n$ independent realizations of $X$. I would like to understand the behavior of $X_n/n$ for large $n$ in some cases where $X$ ...
- 23k
4
votes
1
answer
349
views
Variance of maximum of mixture of gaussians
Let $\{X_i\}$ be an iid collection of standard normal $(N(0,1))$ random variables . Let $X = (X_1,\ldots,X_n)$, and consider a function of the form $f(X) = \max(A\cdot X)$, where $A$ is some symmetric,...
- 941
28
votes
1
answer
6k
views
1-Wasserstein distance between two multivariate normal
The $p$-Wasserstein between two measures $\nu_1$ and $\nu_2$ on $X$ is given by
$$d_p(\nu_{1},\nu_{2})=\left(\underset{\pi\in\Gamma(\nu_{1},\nu_{2})}{\inf}\int_{\mathbf{\mathcal{X}}^{2}}d(x,y)^p\pi(dx,...
- 1,256
9
votes
1
answer
8k
views
Convergence rate of the central limit theorem near the center of the distribution
I'm looking for fast convergence rates for the central limit theorem - when we are not near the tails of the distribution.
Specifically, from the general convergence rates stated in the Berry–Esseen ...
- 968
5
votes
1
answer
2k
views
explicit expressions of the distribution of sums of i.i.d. logistic random variables
Where can I find the explicit expression of the distribution of the sum of n i.i.d. logistic random variables, for n=2,3,4...
The expressions given in "On the convolution of logistic random variables,...
2
votes
3
answers
1k
views
Expected value of swaps
Suppose you have a list of non negative numbers of size N. Now you calculate the maximum element in the list by scanning the list linearly and constantly updating a variable which has initial value of ...
- 123
9
votes
3
answers
7k
views
Are there known expressions for total variation distance between $N(0,\sigma_1^2)$ and $N(0,\sigma^2)$
Are known expressions for total variation distance between $N(0,\sigma^2)$ and $N(0,\sigma^2+\epsilon)$ for small $\epsilon$? The only thing I seem to find is things are expression about the mean but ...
- 383
2
votes
0
answers
258
views
Can truncated/non-smooth distributions be used as priors/posteriors in Variational Bayesian methods?
Variational Bayesian methods can sometimes be a good alternative to Markov Chain Monte Carlo numerical evaluation of probability distributions. They do this, as I understand it, by approximating the ...
- 21
1
vote
0
answers
146
views
approximation of probability distribution
I have a question: Let $\mu$ be a probability distribution defined on $(\mathbb{R}, \mathcal{B}(\mathbb{R}))$ satisfying
$$\int_{\mathbb{R}}|x|d\mu<+\infty$$
Set
$$A_n=\Big\{\frac{i}{n}:~ i\in\...
- 1,835
4
votes
1
answer
174
views
Does second order stochastical domination with increasing likelihood ratio imply first order domination?
This question is coming from the fact that all the counter examples for which second order stochastical domination holds but first oder stochastical domination fails do not accept increasing ...
- 359
4
votes
2
answers
327
views
Estimate on gaussian distribution
Let X be an $\mathbb R^d$-valued random variable with distribution $N_d(0,\Sigma)$. I'm looking for a function $f$ such that
$$P(|X_1|\leq M, |X_2|\leq M,\dots, |X_d|\leq M)\geq f(M),$$
and such that $...
- 293
5
votes
1
answer
346
views
Population dynamics for fish arriving via a Poisson process and living for a time given by some (not necessarily symmetric) general distribution
Imagine we have a hypothetical population of fish in a pond. The fish cannot reproduce, but are introduced by a Poisson process (with some known and fixed rate parameter independent of the total ...
- 51
2
votes
1
answer
114
views
Question about infinite-dimensional BM
Suppose we are given an $L^2(\mathcal{D})$-valued Brownian motion $W_t$ defined by
$$W_t:=\sum_{k=1}^{\infty}\sqrt{\sigma_k}W_t^k\phi_k(x),$$
where $\mathcal{D}$ is bounded domain in $\mathbb{R}^d$, $\...
- 121
5
votes
1
answer
261
views
"Smallest" event such that probability greater than a given value
Very briefly, consider the probability space $(\mathbb R^n, \mathcal{B}(\mathbb R^n),P)$. During a problem I am studying, I came to a point where i need to compute
\begin{equation*}
\begin{aligned}
&...
user45183
3
votes
1
answer
1k
views
Computation complexity of calculating the cdf of an n-th dimensional gaussian random vector
Suppose you have a general $n$-th dimensional random Gaussian vector with probability distribution function $\mathcal{N}\left(\mathbf{x}|\boldsymbol{\mu},\boldsymbol{\Sigma}\right)$.
What is the ...
- 968
4
votes
1
answer
771
views
Maximal component of a multivariate Gaussian distribution
Suppose you have a general random Gaussian vector $\mathbf{X}\sim\mathcal{N}\left(\boldsymbol{\mu},\boldsymbol{\Sigma}\right)$. I'm looking for the simple way to calculate the distribution of the ...
- 968
1
vote
0
answers
132
views
Eigen value distribution of autocorrelated Wishart matrix
Suppose the matrix W is constructed as $W=XX^T$ where $X_i(t) = \phi_i X_i(t-1) + a_i(t)$, and $a_i(t)$ ~ $N(0,1)$. I am interested in knowing the eigen value distribution of W. My google search on ...
- 11
3
votes
3
answers
715
views
Repeated draws from multinomial distribution
(This is a cross-post from Math StackExchange https://math.stackexchange.com/questions/609641/multinomial-distribution-sum-of-squared-probabilities)
Let $\vec X = (X_1, \dots, X_k)$ be a draw from a ...
- 3,475
7
votes
2
answers
2k
views
What is the maximum entropy distribution on the natural numbers?
On the reals $\mathbb{R}$, the maximum entropy distribution with a given mean and variance is the Gaussian distribution.
Let $\mu, \sigma > 0$. What is the maximum entropy distribution on the ...
- 171
2
votes
1
answer
810
views
Set of distributions that minimize KL divergence,
Assuming that $p,q$ are probability distributions defined on the same support $\{x_i\}_{0 \leq i \leq n}$, $\epsilon$ a small real number, and $D_{KL}$ the Kullback-Leibler divergence,
is there a ...
- 167
8
votes
2
answers
3k
views
Expectation of Maximum of Uniform Multinomial Distribution
Suppose we have a uniform multinomial distribution with $k$ buckets, i.e. we put $n$ items uniformly at random in $k$ buckets leading to $n_1, \dots, n_k$ items in each bucket respectively. Let $m = \...
- 733
0
votes
1
answer
681
views
concentration of sums of fourth moment of normals
I was wondering what is the best tail bound for
\begin{equation*}
\mathbb{P}\bigg\{\sum_{k=1}^n X_k^4>(1+t)3n\bigg\}\le ?
\end{equation*}
where $X_k$ are i.i.d. $\mathcal{N}(0,1)$.
- 859
10
votes
1
answer
1k
views
Limit of pushforward measures of random variables is "represented" by a random variable
Suppose we have an arbitrary probability space $(\Omega,\mathcal{F},\mathbb{P})$ and a sequence of real random variables $X_n:\Omega\to\mathbb{R}$ such that the pushforward measures $(X_n)_*(\mathbb{P}...
- 3,146
3
votes
2
answers
166
views
Drawing random variates from a partially described probability distribution
I have a probability distribution over $\{0,1\}^n$ but instead of knowing the full joint distribution $p(x_1,\dots,x_n)$, I only know $p(x_i=x_j)$ for each $i,j$. How could I draw a random binary ...
- 163
4
votes
1
answer
704
views
Central limit theorem for $P(x)\sim 1/x^3$ distribution
I have a random variable $x \in (0,\infty)$ with distribution $P(x)$ falling off slowly $P(x) \sim 1/x^3$ for large $x$. So the expectation value $\bar{x}$ is finite but the second moment $\bar{x^2}$ ...
- 1,150
3
votes
2
answers
2k
views
What's the name of this distribution?
What is the official name of this distribution,
$$k\exp(-\lambda|x|^\alpha),$$
where $\alpha$ is usually less than 1, but greater than 0? More importantly, could anyone tell me what the variance of ...
- 31
4
votes
2
answers
2k
views
Distribution of a product of two discrete i.i.d. variables
The problem is to estimate the distribution of product of two $\textit{discretized Gaussian}$ random variables with zero means. The discretized Gaussian means that the p.m.f. looks like
$D_s(x)=\...
4
votes
0
answers
183
views
Concentration inequality for function of independent Bernoulli r.v.'s (related to random graph)
Consider a random undirected graph on a set of $n$ nodes, say $\{1,2,\ldots,n\}$, such that the probability of edge between nodes $i$ and $j$ is $p_{ij}$ (we may assume $p_{ij}=o(1)$ for all $i,j$, i....
- 163
6
votes
0
answers
486
views
Two sets of independent Bernoulli random variables
There are two sets of random variables $X_1,\ldots,X_n$ and $Y_1,\ldots,Y_n$ satisfying:
Each $X_i$ and each $Y_j$ has a symmetric Bernoulli distribution ($-1$ and $+1$ with probability $\frac12$ ...
- 37.7k
-1
votes
1
answer
2k
views
Variance of euclidean norm of Gaussian vectors
Let $X$ be a Gaussian vector in dimension $n$, with $0$ mean and covariance identity. Let $A$ be a square matrix of size $n$, and $Y = A X$. Let $N$ be the square of $Y$ euclidean norm: $N = \sum Y_i^...
- 11
1
vote
2
answers
151
views
Distribution similar to PPP
According to the definition of Poisson Point Process, I can't define a certain number of nodes which are distributed in an area as PPP. Is there a distribution (a certain number of nodes distributed ...
- 35