Search Results
Search type | Search syntax |
---|---|
Tags | [tag] |
Exact | "words here" |
Author |
user:1234 user:me (yours) |
Score |
score:3 (3+) score:0 (none) |
Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
Views | views:250 |
Code | code:"if (foo != bar)" |
Sections |
title:apples body:"apples oranges" |
URL | url:"*.example.com" |
Saves | in:saves |
Status |
closed:yes duplicate:no migrated:no wiki:no |
Types |
is:question is:answer |
Exclude |
-[tag] -apples |
For more details on advanced search visit our help page |
In probability and statistics, a probability distribution assigns a probability to each measurable subset of the possible outcomes of a random experiment, survey, or procedure of statistical inference.
4
votes
$H(p) \le H(q) + KL(p, q)$?
Just a partial answer, but the proposed inequality doesn't hold.
Take $p = [0.2, 0.8], q = [0.1, 0.9]$.
Then $H(p) = 0.2 \log(5) + 0.8 \log(1/0.8) \approx 0.5$,
$H(q) = 0.1 \log(10) + 0.9 \log(1/0. …
1
vote
Upper bound on the $p$-Wasserstein distance $\mathcal{W}_p(\xi,a\,\xi)$ for some constant $a...
There is a bound, the coupling $(\xi, a \xi)$ leads to the upper bound \begin{align*}
W_p(\xi, a \xi)^p &\leq \mathbb{E}[|\xi - a\xi|^p] = |(1-a)|^p \mathbb{E}[|\xi|^p]\\ \Rightarrow ~~~~ W_p(\xi, a\x …
5
votes
1
answer
1k
views
Quantization of normal distribution
For $n\in\mathbb{N}$, denote by $\mathcal{Q}_n$ the set of all probability measures on $\mathbb{R}$ that are supported on at most $n$ points.
Question: Is it known which element in $\mathcal{Q}_n$ is …
11
votes
Accepted
A remarkable identity involving $\chi^2$ random variables
I think I found an elementary proof of Question 2/3 for arbitrary probability distributions. In fact, it is not required that the components in the sums are squares, but general i.i.d. non-negative ra …
3
votes
0
answers
244
views
Metric ($f$-divergence) on space of probability measures that satisfies pythagorean theorem
Let $E$ be a polish space, $\mathcal{P}(E)$ the Borel probability measures on $E$ with the topology of weak convergence and $\mathcal{Q} \subset \mathcal{P}(E)$ a convex and compact set.
First, the m …
1
vote
Accepted
Draw samples from distribitions in the neighborhood of a fixed distribution
Maybe to add to the point of calculating $\max_{P_\varepsilon} \mathbb{E}_{P_\varepsilon}[f]$: I will write this a bit more in line with the literature I will refer to. Let $(X, d)$ be some polish spa …
0
votes
0
answers
57
views
Absolute continuity of probability measures determined by dependence structure
We are on $\mathbb{R}^d$ with Borel $\sigma$-algebra. Let $\mu_1, ..., \mu_d$ be probability measures on $\mathbb{R}$ and $\Pi(\mu_1, \mu_2, ..., \mu_d)$ be the set of probability measures on $\mathbb …
6
votes
0
answers
388
views
Closedness of a set of measures, where conditional marginals are in closed $\varepsilon$-bal...
Let $(E,d)$ be a bounded polish space (separable, complete metric space satisfying $\sup_{x,y\in E} d(x,y) < \infty$). By $\mathcal{P}(E)$ we denote the space of Borel probability measures on $E$ endo …