All Questions
100 questions
2
votes
1
answer
170
views
Law of large numbers for a continuum of Bernoullis
Suppose I have a family of $n$ independent Bernoulli random variables described by a vector of parameters $(p_i)_{i=1}^n$. As it is well known, the number of successes within this family is a random ...
5
votes
2
answers
730
views
Probabilty measures that are both discrete and continuous
Consider a measure space $\left(S,\Sigma\right)$ where each state $s\in S$ can be expressed as $s=\left(x,c\right)$, where $x\in\mathbb R$ and $c\in\mathbb N$. E.g., suppose $s$ denotes the state of a ...
- 101
2
votes
1
answer
86
views
From convergence of sequences to uniform convergence in probability
For $n=1, 2,\ldots$ consider a sequence of sets of ascending integers $I_n=\{\underline{i}_n,\underline{i}_n+1, \ldots, \overline{i}_n\}$, with $\underline{i}_n \to \infty$ and $\underline{i}_n=o(\...
- 195
4
votes
2
answers
274
views
Does strong stochastic ordering exist?
For two probability measure $\mu$ and $\nu$ on $\mathbb{R}$, we call $\mu$ is stochastically smaller than $\nu$ (i.e., $\mu\leq\nu$) , if $\int f \, d\mu\leq\int f \, d\nu$ for any nonnegative bounded ...
- 43
2
votes
0
answers
54
views
If a probability measure is a mixture of products of its marginals, does it have finite moments?
Let $\mu$ be a Borel probability measure on $\mathbb{R}^n$. For a linear subspace $E\subset \mathbb{R}^n$, let $\mu_E$ denote the marginal of $\mu$ on $E$. The usual orthogonal complement of $E$ is ...
- 716
4
votes
1
answer
2k
views
Examples of convergence in distribution not implying convergence in moments
It is well know that the convergence in distributions does not necessarily imply convergence in expectation, but implies convergence in expectation of bounded continuous functions.
Let $\{X_n\}$ be a ...
- 227
1
vote
1
answer
100
views
Does convergence of Radon transforms of a sequence of probability distributions implies convergence of the distributions themselves?
Let $P_1,P_2,\ldots $ be a sequence of absolutely continuous probability measures on $\mathbb R^n$, and let
$f_j:\mathbb R^n\to\mathbb R$ be their PDFs. Assume that $\operatorname{E}P_j = 0$ and $\...
- 13
16
votes
2
answers
1k
views
How often two iid variables are close?
Is there a constant $c>0$ such that for $X,Y$ two iid variables supported by $[0,1]$,
$$
\liminf_\epsilon \epsilon^{-1}P(|X-Y|<\epsilon)\geqslant c
$$
I can prove the result if they have a ...
- 1,352
4
votes
1
answer
265
views
Bounds on discrepancy metric of product measures
Consider two measurable spaces $X_1 = (\mathbb{R}^m,\mathcal{B}(\mathbb{R}^m),\mu_1)$ and $X_2 = (\mathbb{R}^m,\mathcal{B}(\mathbb{R}^m),\mu_2)$ and the product spaces
$$X_1^{q} = (\times_{i=1}^q\...
- 2,712
0
votes
1
answer
105
views
Transforming two smooth densities to the same density
I am looking for an example of the following:
Find a bijective, differentiable function $f$ and continuous probability density functions $q_1\ne q_2$ such that $f_*q_1=p=f_*q_2$, where $f_*$ is the ...
- 5
8
votes
0
answers
422
views
Non-affine smooth transformation of Gaussian is Gaussian
Suppose $Z\sim N(0,1)$ (standard Gaussian) and $f: \mathbb{R} \to \mathbb{R}$ is a differentiable function such that $f(Z)\sim N(0,1)$. My question is whether there exists any such $f$ other than $f(x)...
- 399
1
vote
1
answer
332
views
Extension of measurable function from dense subset
Let $M$ be a compact riemannian manifold equipped with a geodesic distance and let $\mathcal{B}(M)$ be the borel sigma algebra generated by the geodesic distance. Let $(\Omega,\mathcal{F},\mathbb{P})$...
2
votes
1
answer
297
views
Examples of "almost" Ahlfors regular measures
Let $\mu$ be a Borel probability measure on $\mathbb{R}^n$ such that there are $c,C,d,D>0$ satisfying: for every $x \in \mathbb{R}^n$ and every $r>0$
$$
c r^d \leq \mu(B(x,r)) \leq Cr^D.
$$
Let'...
- 5,405
3
votes
0
answers
179
views
Probability terminology
This is strictly a low-level terminology question. If I have a probability space $\Omega$ and a measurable space $S$, then a random variable $X:\Omega\rightarrow S$ gives rise via pushforward to a ...
- 23k
4
votes
1
answer
206
views
Existence of measures with given 1d marginals
This is a question about marginals of probability measures, which seems unrelated to previous questions.
Let $\mathbb{S}^{d-1}\subset \mathbb{R}^d$ be the unit sphere. Assume that for each $\theta\in \...
5
votes
2
answers
2k
views
Tight sequence of measures
This is probably a very easy question for experts in probability or measure theory.
I have a sequence of finite measures $\mu_{n}$ on a non-compact metric space $X$ such that $\mu_{n}$ converges to $\...
- 38
2
votes
1
answer
1k
views
measure of a degenerate Gaussian distribution
I want to do computations with a degenerate Gaussian measure, but I do not know how to represent it
in a close form.
After starting with a Gaussian random variable and restricting it to a condition, I ...
- 23
1
vote
0
answers
43
views
Does the constrained Wasserstein barycenter admit a blue noise property?
Let $(E,d)$ be a metric space and $\nu$ be a probability measure on $\mathcal B(E)$. In this paper, it is mentioned that sampling from $\mu$ can be described as choosing $n\in\mathbb N$, $x_1,\ldots,...
- 167
2
votes
0
answers
192
views
Convergence of Gibbs distribution to Dirac measure [closed]
Consider the probability density function on $R^d$ for a continuous function $F: R^d \to R$:
$$
q_{\varepsilon}(x) = \frac{1}{Z} \exp\left(-\frac{1}{\varepsilon} F(x)\right).
$$
Denote $x^* = \arg \...
- 31
4
votes
2
answers
855
views
Disintegration, conditional probabilities, and conditional expectation
On the Wikipedia page there is a note that conditional probability measures can be described by disintegration. However, I can seem to find a clear exposée of how this construction is related to ...
- 5,405
2
votes
1
answer
268
views
Union bound probability of random union
Let $(\Omega,\mathcal{F},\mathbb{P})$ be a probability space. Let $\{E_i\}_{i = 1}^N,$ with $E_i \in\mathcal{F}$ be a set of events and let $i(X)$ be a R.V. assuming values in $\{1,...,N\}$
Is there ...
- 245
2
votes
0
answers
302
views
Simplify Kantorovich–Rubinstein duality when distributions share a common marginal
Consider the product of two metric spaces $X\times Y$, and two probability distributions $\mu$ and $\nu$ on this product space. By the Kantorovich-Rubinstein duality, I can write the Wasserstein-1-...
- 53
4
votes
2
answers
267
views
Grand-canonical Gibbs measure for continuous systems
Let's consider a bounded (maybe compact) set $\Lambda \subset \mathbb{R}^{d}$ with particles interacting on it. Suppose, for each $N \in \mathbb{N}$, $U_{N}: (\mathbb{R}^{d})^{N} \to \mathbb{R}\cup \{+...
- 3,515
2
votes
1
answer
241
views
Weak continuity of law
Let $\mathcal{P}_2(\mathbb{R}^n)$ denote the set of all Borel probability measures on $\mathbb{R}^n$ with finite variance and weak topology. Let $X_t$ be a strong solution to the SDE with initial ...
- 5,405
1
vote
1
answer
240
views
Continuity of pushforward operation
Let $X$ and $Y$ be compact metric spaces and let $f,g:X\rightarrow Y$ be $\epsilon$-uniformly close; i.e.:
$$
\sup_{x \in X} d_Y(f(x),g(x))<\epsilon.
$$
Then, are their push-forwards close in ...
- 5,405
6
votes
1
answer
291
views
Comparing $X+Y$ and $X-Y$ for independent random variables with values in an abelian locally compact group
Let $G$ be an abelian locally (separable?) compact group with Haar measure $\mu$. Inspired by the interesting proof of A sum of two binomial random variables :
Let $X$ and $Y$ be $G$-valued ...
- 2,101
8
votes
4
answers
2k
views
Is every probability measure a pushforward of Lebesgue measure?
If $m$ is a probability measure on a measurable space $(X, \Sigma)$, is there necessarily a measurable function $f : [0, 1] \to X$ such that $m(A) = \mu(f^{-1}(A))$ for all $A \in \Sigma$?
($\mu$ is ...
- 83
5
votes
1
answer
1k
views
Sum of random variables are equal in distribution
Suppose that $X,Y$ are scalar random variables supported on some standard Lebesgue probability space $(\Omega, \mathrm{P})$, such that $X \overset{\mathrm{d}}{=} Y$ in the sense that their pushforward ...
- 85
0
votes
1
answer
86
views
Is integration against an indicator Wasserstein-Continuous
Let $\mathcal{P}_p(X)$ denote the Wasserstein space over a compact metric space $X$, and $1\leq p<\infty$. Fix a non-empty closed subset $C\subseteq X$. Then is the map:
$$
\mathbb{P} \mapsto \...
- 5,405
1
vote
1
answer
448
views
Law of large numbers for random Dirac measures
Suppose $\{X_1,...X_n\}:\Omega \to \mathbb{R}^p$ be i.i.d. random vectors with common probability law/measure $p$, i.e. $Prob(X_i^{-1}(E))=p(E) \forall E \subset \mathbb{R}^p $ Borel measurable.
...
- 1,467
0
votes
1
answer
268
views
Tightness on a set $A$ implies tightness on a set $B$ where $A\subset B$?
From the book Billingsley - Convergence of probability measures, 1999, we have the following definitions of tightness and relative compactness and the Prohorov's theorem:
Tightness: Let $\Pi$ be a ...
- 657
1
vote
0
answers
74
views
Measurability of $\mathbb{R}^n$-Random Field
Let $(X_x)_{x\in [0,1]^d}$ be a collection of integrable random variable defined on a (common) probability space $(\Omega,\mathcal{F},\mathbb{P})$. Under what condition is the map:
$$
[0,1]^d\ni x \...
- 5,405
-2
votes
1
answer
108
views
If a sequence of measures is weakly convergent outside each compact ball, the sequence itself is weakly convergent
Let $E$ be a $\mathbb R$-Banach space and $\mathcal M_+(E)$ denote the space of finite nonnegative measures on $\mathcal B(E)$.
If $\lambda\in\mathcal M_+(E)$, let $$\left.\lambda\right|_\delta(B):=\...
- 167
1
vote
1
answer
135
views
KL-divergence and sub-$\sigma$-algebras
I am trying to understand if the following claim is true:
Let $P$, $Q$ be probability measures on $\mathcal{X}$. For any $\sigma$-algebra $\mathcal{G}$, with countably many atoms (sets with $\...
- 13
0
votes
1
answer
133
views
Convoluted Cantor-like measure which has a continuous component [duplicate]
Let $\mu$ be a finite measure on $\mathbb R$ which has no atoms, and no component continuous with respect to Lebesgue measure. An example is the law of the random variable
$$
\sum_{k\ge 1}3^{-k}X_k
$$...
- 1,352
8
votes
1
answer
171
views
On the existence of a particular type of finite measure on $\mathbb N$
Let $\mathbb N$ denote the set of all positive integers. Does there exist a countably additive measure $\mu : \mathcal P(\mathbb N) \to [0,\infty)$ such that $\mu(\mathbb N)<\infty$ and $\mu(\{nk: ...
- 1,209
2
votes
1
answer
101
views
If signed measures $\mu_n$ are such that $\mu_n\to\mu$ and $\|\mu_n\|\to c\in(0,\infty)$, does $\exp^*(\mu_n)/\|\exp^*(\mu_n)\|$ necessarily converge?
$\newcommand{\R}{\mathbb R}$Let $M$ denote the set of all finite signed measures on a separable Banach space $B$. For any $\mu\in M$, let
\begin{equation*}
\exp^*(\mu):=\sum_{k=0}^\infty\frac{\mu^{...
- 128k
2
votes
2
answers
801
views
Weak convergence in Skorohod topology
Let $D([0,T];R^d)$ be the space of càdlàg functions endowed with the usual Skorohod topology. $X_t(\omega):=\omega(t)$ denotes the usual canonical process. Assume that a family of probability ...
- 411
1
vote
1
answer
154
views
If $L_t=\sum_{i=1}^{N_t}Y_i$ is a compound Poisson process, then $\left|\left\{s\in[0,t]:\Delta L_s\in B\right\}\right|=\sum_{i=1}^{N_t}1_B(Y_i)$
Let $H$ be a $\mathbb R$-Hilbert space, $\mu$ be a finite measure on $\mathcal B(H)$ with $\mu(\{0\})=0$ and $(L_t)_{t\ge0}$ be a $H$-valued càdlàg Lévy process on a probability space $(\Omega,\...
- 167
1
vote
2
answers
113
views
If a joint density factorizes on a square, does this imply that the marginal random variables are locally independent?
Let $Z=(X,Y) : \Omega\rightarrow\mathbb{R}^2$ be a Borel-measurable random vector and $U\subset\mathbb{R}$ be open. Suppose that $Z$ is absolutely continuous with Lebesgue density $\zeta$.
I was ...
- 463
2
votes
1
answer
181
views
Conditional entropy - solve example
Given a random variable $X$ that is uniformly distributed on $[-b,b]$ and $Y=g(X)$ with
$$g(x) = \begin{cases} 0, ~~~ x\in [-c,c] \\ x, ~~~ \text{else}\end{cases}$$
Now I want to compute the ...
- 131
4
votes
2
answers
415
views
Effect of perturbing the atoms of a measure on the Wasserstein distance
Let $(X,d)$ be a metric space, $x_1,\ldots,x_N\in X$ and $x_1',\ldots,x_N'\in X$ be atoms, and $G=\sum_{i=1}^Np_i\delta_{x_i}$, $G'=\sum_{i=1}^Np_i'\delta_{x_i}$, and $G''=\sum_{i=1}^Np_i'\delta_{x_i'}...
- 710
7
votes
2
answers
1k
views
Conditional Expectation for $\sigma$-finite measures
Someone knows of some definition or reference of how to define conditional expectation for a measure space with $\sigma$-finite measure.
I think it should be as follows:
Let $(X,\mathcal{B},\nu)$ ...
- 193
4
votes
1
answer
2k
views
wasserstein distance between distributions with bounded ratio
Let $p$ and $q$ be probability distributions on a metric space $X=(X, d)$ with densities $dp$ and $dq$, such that there exists $0 < \alpha < \beta < \infty$ satisfying
$$
\alpha d p \le dq \...
- 6,853
4
votes
0
answers
160
views
Can we show equivalence of two distributions based on their statistics?
Let $p,q$ be two distributions on $\mathbb{R}^d$. Let $f:\mathbb{R}^d\times\mathbb{R}^d\rightarrow\mathbb{R}$. Under what conditions does $\mathbb{E}_{x\sim p}f(x,z)=\mathbb{E}_{x\sim q}f(x,z)\ \...
- 57
0
votes
1
answer
378
views
Concentration of norm of linearly transformed normal random vector as dimension go to infinity
Earlier asked on MSE, but didn't get an answer, so posting here:
Let $X=(X_1 \dots X_n) \in \mathbb{R}^n, X_i\sim N(0,1), iid.$ Let $B: \mathbb{R}^n \to \mathbb{R}^n $ be the diagonal linear map: $...
- 1,467
8
votes
1
answer
355
views
Lower Bound of KL-Divergence Between Two Gibbs Measures
Suppose we have two Gibbs measures with densities
$$
p_f(x) \propto \exp(f(x)),\quad q_g(x)\propto \exp(g(x)).
$$
Consider the KL-divergence between $p_f$ and $q_g$, as a functional of $f$ and $g$, ...
- 1,127
2
votes
2
answers
2k
views
The probability distribution of random variable of random variable
In my understanding, random variable is a measurable function from a probability space to a measurable space. Suppose $X$ is a random variable from $(A, \sigma_{A},P_A)$ to $(B,\sigma_{B})$. And $Y$ ...
- 131
-1
votes
1
answer
138
views
On the concentration of Lipschitz functions near its expectation, where the vector has identical but not independent, components
Consider the random vector $X:=(X_1\dots X_1) \in \mathbb{R}^n, X_1 \sim \mathcal{N}(0,1).$ Notice the identical components, they're identically distributed but not independent.
Now, I was wondering ...
- 1,467
2
votes
1
answer
2k
views
Explicitly representing a random variable in terms of indicator functions
Motivation:
I want to compute $$E[g(X)] := \int_{\Omega} g(X(\omega)) d\mathbb{P}(\omega) \tag{*}$$ without needing change of variable formula.
I want to prove the change of variable formula (you ...
- 247