3
$\begingroup$

Let $x_1,\ldots,x_n$ be $n \ge 1$ distinct points in $\mathbb R^d$ and consider two discrete distributions on these points $\mu = (1/n)\sum_{i=1}^n\delta_{x_i}$, and $\nu = \sum_{i=1}^n\nu_i\delta_{x_i}$ with $\nu_1,\ldots,\nu_n \ge 0$ and $\sum_i \nu_i = 1$.

Let $(x_i,x_j) \mapsto c(x_i,x_j)$ be a distance on the $n$ points $x_1,\ldots,x_n$. For example, $c(x_i,x_j) := \|x_i-x_j\|_p$ for some $p \in [1,\infty)$.

Question

What's a closed form formula for the corresponding Wasserstein distance between $\mu$ and $\nu$ ?

$\endgroup$
3
  • 4
    $\begingroup$ there are very few cases where the Wasserstein distance has a closed form result, I don't think this is one of these, but the numerical computation is quick. $\endgroup$ Commented May 23, 2022 at 11:57
  • 2
    $\begingroup$ Just to illustrate how hopeless this is: If $\nu_i$ equals $2/n$ for half the points and $p=1$, then the problem simply reduces to a fully general empirical OT problem with total mass $1/2$. $\endgroup$
    – Steve
    Commented May 23, 2022 at 19:45
  • 1
    $\begingroup$ This does not seem to be a less general question than computing the distance between arbitrary two measures (because one of them may be approximated by an average of delta-measures) $\endgroup$ Commented May 27, 2022 at 20:51

1 Answer 1

1
+50
$\begingroup$

Here is a general upper/lower bound on the Wasserstein distance between $\mu$ and $\nu$ based on a maximal coupling with respect to their total variation distance: $$ (1/2) \min_{x_i \ne x_j} c(x_i, x_j) \sum_{k=1}^n |1/n - \nu_k| \le \mathcal{W}(\mu,\nu) \le (1/2) \max_{x_i \ne x_j} c(x_i, x_j) \sum_{k=1}^n |1/n - \nu_k| \;. $$ More generally, the upper bound realized by a maximal coupling takes the form: $$ \mathcal{W}(\mu,\nu) \le \frac{\sum_{i \ne j} c(x_i, x_j) (\mu_j-\nu_j)^+ (\nu_i-\mu_i)^+}{\sum_k (\mu_k-\nu_k)^+}. $$ For completeness, the maximal coupling itself is explicitly given by: draw the first component $X$ from $\mu$ and then set the second component equal to: $$ Y=\begin{cases} X & \text{with probability $\frac{\nu(X)}{\mu(X)} \wedge 1$} \;, \\ \tilde{Y} & \text{otherwise} \;, \end{cases} $$ where $\tilde{Y}$ is a random variable (independent of all the preceding ones) drawn from the remaining probability suitably normalized $\tilde{\mu}(x) = \frac{(\nu(x) - \mu(x))^+}{\sum_k (\mu_k-\nu_k)^+}$.

$\endgroup$
2
  • $\begingroup$ Can you provide the details as to the appearance of the constant $\frac 12$ ? $\endgroup$
    – Fei Cao
    Commented Dec 22, 2023 at 19:15
  • 1
    $\begingroup$ @FeiCao The $1/2$ stems from the definition of the total variation (TV) metric, which in the special case of a countable state space, reduces to $1/2$ the $L^1$-norm between the two measures. The definition ensures that the TV distance takes values in $[0,1]$. $\endgroup$ Commented Mar 3 at 18:46

You must log in to answer this question.