Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 106046

In probability and statistics, a probability distribution assigns a probability to each measurable subset of the possible outcomes of a random experiment, survey, or procedure of statistical inference.

4 votes

$H(p) \le H(q) + KL(p, q)$?

Just a partial answer, but the proposed inequality doesn't hold. Take $p = [0.2, 0.8], q = [0.1, 0.9]$. Then $H(p) = 0.2 \log(5) + 0.8 \log(1/0.8) \approx 0.5$, $H(q) = 0.1 \log(10) + 0.9 \log(1/0. …
Steve's user avatar
  • 1,095
1 vote

Upper bound on the $p$-Wasserstein distance $\mathcal{W}_p(\xi,a\,\xi)$ for some constant $a...

There is a bound, the coupling $(\xi, a \xi)$ leads to the upper bound \begin{align*} W_p(\xi, a \xi)^p &\leq \mathbb{E}[|\xi - a\xi|^p] = |(1-a)|^p \mathbb{E}[|\xi|^p]\\ \Rightarrow ~~~~ W_p(\xi, a\x …
Steve's user avatar
  • 1,095
5 votes
1 answer
1k views

Quantization of normal distribution

For $n\in\mathbb{N}$, denote by $\mathcal{Q}_n$ the set of all probability measures on $\mathbb{R}$ that are supported on at most $n$ points. Question: Is it known which element in $\mathcal{Q}_n$ is …
Steve's user avatar
  • 1,095
11 votes
Accepted

A remarkable identity involving $\chi^2$ random variables

I think I found an elementary proof of Question 2/3 for arbitrary probability distributions. In fact, it is not required that the components in the sums are squares, but general i.i.d. non-negative ra …
Steve's user avatar
  • 1,095
3 votes
0 answers
244 views

Metric ($f$-divergence) on space of probability measures that satisfies pythagorean theorem

Let $E$ be a polish space, $\mathcal{P}(E)$ the Borel probability measures on $E$ with the topology of weak convergence and $\mathcal{Q} \subset \mathcal{P}(E)$ a convex and compact set. First, the m …
Steve's user avatar
  • 1,095
1 vote
Accepted

Draw samples from distribitions in the neighborhood of a fixed distribution

Maybe to add to the point of calculating $\max_{P_\varepsilon} \mathbb{E}_{P_\varepsilon}[f]$: I will write this a bit more in line with the literature I will refer to. Let $(X, d)$ be some polish spa …
Steve's user avatar
  • 1,095
0 votes
0 answers
57 views

Absolute continuity of probability measures determined by dependence structure

We are on $\mathbb{R}^d$ with Borel $\sigma$-algebra. Let $\mu_1, ..., \mu_d$ be probability measures on $\mathbb{R}$ and $\Pi(\mu_1, \mu_2, ..., \mu_d)$ be the set of probability measures on $\mathbb …
Steve's user avatar
  • 1,095
6 votes
0 answers
388 views

Closedness of a set of measures, where conditional marginals are in closed $\varepsilon$-bal...

Let $(E,d)$ be a bounded polish space (separable, complete metric space satisfying $\sup_{x,y\in E} d(x,y) < \infty$). By $\mathcal{P}(E)$ we denote the space of Borel probability measures on $E$ endo …
Steve's user avatar
  • 1,095