8
$\begingroup$

Let $\mu$ and $\nu$ be two probability measures on $\mathbb R^n$ with finite first moment. Denote by $d:=W_1(\mu,\nu)$, where $W_1(\cdot,\cdot)$ stands for the Wasserstein distance of order $1$.

My question is the following: Let $X$ be a random variable defined on some probability space (rich enough) with law $\mu$, could we find a measurable function $f:\mathbb R^n\times \mathbb R^n\to\mathbb R^n$ and a random variable $G$ independent of $X$ s.t.

$$Y:=f(X,G)~\sim~\nu~~~~~~ \mbox{ and }~~~~~~ \mathbb E[|X-Y|]~\le ~2d~?$$

Thought 1: Let $d_0:=\rho(\mu,\nu)$, where $\rho(\cdot,\cdot)$ denotes the Prokhorov distance. Then we have a measurable function $f_0:\mathbb R^n\times \mathbb R^n\to\mathbb R^n$ and a random variable $G_0$ independent of $X$ s.t.

$$Y_0:=f_0(X,G)~\sim~\nu~~~~~~ \mbox{ and }~~~~~~ \mathbb P[\{|X-Y_0|\ge2d_0\}]~\le ~2d_0.$$

The above construction is from the paper On a representation of random variables by Skorokhod, but I can't find this paper.

Thought 2: Let $\pi(dx,dy)$ be the optimal transport plan, i.e. $\pi(A\times\mathbb R^n)=\mu(A)$ and $\pi(\mathbb R^n\times A)=\nu(A)$ for all measurable $A\subset\mathbb R^n$. Disintegration w.r.t. the first coordinate $x$, one has $\pi(dx,dy)=\mu(dx)\otimes \lambda_x(dy)$, where $(\lambda_x)_{x\in\mathbb R^n}$ denotes the r.c.p.d. (regular conditional probability distribution). But I've no idea how to recover the function $f$ using $\lambda_x$.

Any answer, help or comment is highly appreciated. Thanks a lot!

$\endgroup$
5
  • $\begingroup$ Or maybe we may find some increasing function $\alpha:\mathbb R_+\to\mathbb R_+$ with $\alpha(0)=0$ s.t. $\mathbb E[|X-Y|]\le \alpha(d)$ $\endgroup$
    – user111097
    Commented Jun 13, 2017 at 15:52
  • $\begingroup$ @user95282 Thanks a lot for pointing out this typo. I've denoted the dimension by $n$. $\endgroup$
    – user111097
    Commented Jun 14, 2017 at 11:12
  • $\begingroup$ What is $\lvert\cdot\rvert$ ? Is it the Euclidian distance in $\mathbb{R}^n$ ? $\endgroup$
    – user95282
    Commented Jun 14, 2017 at 12:14
  • $\begingroup$ @user95282 Yes. Actually we may start by considering the case $n=1$ for the sake of simplicity. $\endgroup$
    – user111097
    Commented Jun 14, 2017 at 12:57
  • $\begingroup$ @user95282 I've found the paper "On a representation of random variables". But I didn't see the construction proof for $\mathbb P[|Y_0-X|\ge 2d_0]\le 2d_0$. $\endgroup$
    – user111097
    Commented Jun 14, 2017 at 12:58

3 Answers 3

3
$\begingroup$

Yes, you can even ensure $\mathbb{E}(|X-Y|)=d$ and all you need for $G$ is that it has an atomless law, $\rho$ say.

Take the disintegration $(\lambda_x)$ of the optimal coupling $\Pi$ with respect to $\mu$ (note your formula has a $dx$ where one should read a $dy$). What you want is that $f(x,\cdot)$ sends the law $\rho$ of $G$ to $\lambda_x$. As soon as $\rho$ has no atom, this can be done. Then you only have to check that you can collect the $f(x,\cdot)$ into a measurable map $f$ (you need to be a bit careful in the construction for this to hold; in dimension $1$ using distribution functions should help, and in higher dimension you can use the fact that all standard space are isomorphic; alternatively you can possibly take advantage of the extra bit of margin you took in the question).

$\endgroup$
5
  • $\begingroup$ Merci pour la réponse et je vais verifier moi-meme. Je vais peut-être retourner vers vous (car je suis ne suis pas très familier avec la théorie de mesure). $\endgroup$
    – user111097
    Commented Jun 14, 2017 at 14:25
  • $\begingroup$ Could you please specify a bit more for the case of dimension $1$? Actually, let $\rho$ be a standard Gaussian with normal distribution $F$, so we are looking for $f_x(\cdot)$ s.t. $\mathbb P[f_x(G)\le y]=\lambda_x((-\infty,y])$ for all $y\in\mathbb R$. Notice that $\lambda_x((-\infty,y])=\mathbb P[f_x(G)\le y]=\mathbb P[G\le f_x^{-1}(y)]=F\circ f_x^{-1}(y)$, so basically we should take $f_x^{-1}(y)=F^{-1}(\lambda_x((-\infty,y]))$. But how to define properly $f_x$? Thank you very much! $\endgroup$
    – user111097
    Commented Jun 15, 2017 at 9:36
  • $\begingroup$ Could you please give more details on this construction of $f_x$? $\endgroup$
    – user111097
    Commented Jun 15, 2017 at 12:08
  • $\begingroup$ @MB2009: there are many possible $f(x,\cdot)$, just don't try to determine it by the constraints you are given. In diemension $1$, increasing rearrangement works (i.e. you add the requirement that $f(x,\cdot)$ be increasing, which then makes it unique). $\endgroup$ Commented Jun 15, 2017 at 12:36
  • $\begingroup$ I've found the increasing rearrangement in Villani's book. Thank you very much! $\endgroup$
    – user111097
    Commented Jun 16, 2017 at 8:56
2
$\begingroup$

$\newcommand{\R}{\mathbb R} \newcommand{\B}{\mathcal B} \newcommand{\la}{\lambda} \newcommand{\Si}{\Sigma} \renewcommand{\c}{\circ} \newcommand{\tr}{\operatorname{tr}}$

The desired function $f$ and random variable (r.v.) $G$ can be built recursively, by induction, using the increasing rearrangement/inverse transformation method: If $F$ is any cumulative distribution function (cdf), \begin{equation} F^{-1}(u):=\inf\{x\in\mathbb R\colon F(x)\ge u\} \end{equation} for $u\in(0,1)$, and $U\sim\mathcal U(0,1)$ (a r.v. uniformly distributed on the interval $(0,1)$), then the cdf of the r.v. $F^{-1}(U)$ is $F$.

Indeed, for $j=0,\dots,n$, let $\pi_j$ be the push-forward image of the probability measure $\pi$ under the projection of $\R^n\times\R^n$ onto $\R^n\times\R^j$, so that $\pi_j(A\times B_j)=\pi(A\times B_j\times\R^{n-j})$ for $A$ in the Borel sigma-algebra $\B(\R^n)$ and $B_j$ in $\B(\R^j)$; naturally, $\R^0=\{0\}$, and we identify $\R^j\times\R^{n-j}$ with $\R^n$. Similarly, let $\nu_j$ be the push-forward image of the probability measure $\nu$ under the projection of $\R^n$ onto $\R^j$, so that $\nu_j(B_j)=\nu( B_j\times\R^{n-j})$ for $B_j$ in $\B(\R^j)$. Then $\pi_0 =\mu$, $\pi_n=\pi$, $\nu_0$ is the only probability measure on $\B(\R^0)=\B(\{0\})$, and $\nu_n=\nu$.

Write $Y=(Y_1,\dots,Y_n)$ and let $Y_{1;j}:=(Y_1,\dots,Y_j)$, with $Y_{1;0}:=0$; the r.v.'s $Y_1,\dots,Y_n$ are to be constructed. Accordingly, for $y=(y_1,\dots,y_n)\in\R^n$ let $y_{1;j}:=(y_1,\dots,y_j)$, with $y_{1;0}:=0$. For $j=0,\dots,n$, let $G_j:=(U_1,\dots,U_j)$, where $U_1,\dots,U_n$ are independent $\mathcal U(0,1)$ r.v.'s. In particular, $G_0=0$.

For $j=1,\dots,n$, we are going to construct, by induction, a function $f_j\colon\R^n\times(0,1)^j\to\R^j$ such that for $Y_{1;j}:=f_j(X,G_j)$ the distribution of $(X,Y_{1;j})$ is $\pi_j$ and hence the distribution of $Y_{1;j}$ is $\nu_j$.

To complete the basis of induction, let $f_0(x,0):=0$ for all $x\in\R^n$, so that $Y_0=f_0(X,G_0)$. Take now any $j=1,\dots,n$. Let $$\R^n\times\R^{j-1}\times\B(\R)\ni(x,y_{1;j-1},C)\longmapsto \la_{x,y_{1;j-1}}(C)$$ be a regular version of the conditional distribution of $Y_j$ given $(X,Y_{1;j-1})$ assuming that the joint distribution of $(X,Y_{1;j})$ is $\pi_j$, so that $$\pi_j(dx\times dy_{1;j-1}\times dy_j)=\pi_{j-1}(dx\times dy_{1;j-1})\la_{x,y_{1;j-1}}(dy_j).$$ For each $(x,y_{1;j-1})\in\R^n\times\R^{j-1}$, let $F_{x,y_{1;j-1}}$ be the cdf of the probability measure $\la_{x,y_{1;j-1}}$ on $\B(\R)$, and define the function $f_j\colon\R^n\times(0,1)^j\to\R^j$ by the formula \begin{equation} f_j(x,u_{1;j}):=\big(y_{1;j-1},F^{-1}_{x,y_{1;j-1}}(u_j)\big)\quad\text{with}\quad y_{1;j-1}=f_{j-1}(x,u_{1;j-1}) \end{equation} for $(x,u_{1;j})\in\R^n\times(0,1)^j$, where the notation $u_{1;j}$ is of course quite similar to $y_{1;j}$. Let now $Y_{1;j}:=f_j(X,U_{1;j})=f_j(X,G_j)$, which is in agreement with the definition $Y_{1;j-1}:=f_{j-1}(X,U_{1;j-1})=f_{j-1}(X,G_{j-1})$ at the previous step of the induction process.

Then the distribution of $(X,Y_{1;j})$ is $\pi_j$ and hence the distribution of $Y_{1;j}$ is $\nu_j$.

In particular, the distribution of $(X,Y)=(X,Y_{1;n})$ is $\pi_n=\pi$ and hence the distribution of $Y=Y_{1;n}$ is $\nu$. Moreover, $Y=Y_{1;n}=f_n(X,G_n)$, as desired.

$\endgroup$
0
$\begingroup$

I've a solution but it's not perfectly satisfying. Assume that

$$V~~~:=~~~\int |x|^pd\mu(x)~+~\int |x|^pd\nu(x)~~~<~~~+\infty$$

for some fixed $p>1$. It follows from Thought 1 that, there exists $f_0$ and $G$ s.t.

$$Y_0~:=~f_0(X,G)~\sim~\nu~~~~\mbox{ and }~~~~\mathbb P[|X-Y_0|\ge 2d_0]~\le~2d_0.$$

It follows that

\begin{eqnarray} \mathbb E[|X-Y_0|]\quad&=&\quad\mathbb E[|X-Y_0|{\bf 1}_{\{|X-Y_0|\ge 2d_0\}}]~+~\mathbb E[|X-Y_0|{\bf 1}_{\{|X-Y_0|< 2d_0\}}] \\ &\le&\quad 2d_0 ~+~ \big(E[|X-Y_0|^p]\big)^{1/p}\cdot \mathbb P[|X-Y_0|\ge 2d_0]^{1/q} \\ &\le&\quad 2d_0 ~+~ \left[\big(E[|X|^p]\big)^{1/p}~+~\big(E[|Y_0|^p]\big)^{1/p}\right]\cdot (2d_0)^{1/q} \\ &\le&\quad 2d_0 ~+~ 2V^{1/p}\cdot (2d_0)^{1/q}, \end{eqnarray} where $q>1$ denotes the conjugate number of $p$, i.e. $1/p+1/q=1$. Let $\alpha(x):=2x ~+~ 2V^{1/p}\cdot (2x)^{1/q}$, then one has

$$\mathbb E[|X-Y_0|]\quad\le\quad \alpha(d_0)\quad\le \quad \alpha(d),$$

as $d_0\le d$.

My question is that could we remove the assumption $V<+\infty$.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .