Polish spaces in probability - MathOverflow most recent 30 from http://mathoverflow.net 2013-05-19T07:36:14Z http://mathoverflow.net/feeds/question/20919 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/20919/polish-spaces-in-probability Polish spaces in probability Thanh 2010-04-10T12:59:23Z 2013-02-20T13:00:31Z <p>Probabilist are very often working with Polish spaces, though this is not always very clear where this assumption is needed.</p> <p><strong>question:</strong> what can go wrong when doing probability on non-Polish spaces ?</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/20934#20934 Answer by fedja for Polish spaces in probability fedja 2010-04-10T16:25:55Z 2010-04-10T16:25:55Z <p>As far as I remember, the projection of a measurable set may fail to be measurable, so something very natural may become not an event. Besides, constructing conditional probabilities as measures on sections becomes problematic. Perhaps, there are more reasons but these two are already good enough.</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/20936#20936 Answer by Gerald Edgar for Polish spaces in probability Gerald Edgar 2010-04-10T16:42:22Z 2010-04-10T16:42:22Z <p>Google "image measure catastrophe" with quotation marks.</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/20937#20937 Answer by Shiva Kaul for Polish spaces in probability Shiva Kaul 2010-04-10T17:05:42Z 2010-04-10T17:05:42Z <p>Separability is a key technical property used to avoid measure-theoretic difficulties for processes with uncountable index sets. The general problem is that measures are only countably additive and $\sigma$-algebras are closed under only countably many primitive set operations. In a variety of scenarios, uncountable collections of measure zero events can bite you; separability ensures you can use a countable sequence as a proxy for the entire process without losing probabilistic content. Here are two examples.</p> <ol> <li><p>Weak convergence: the classical theory of weak convergence utilizes Borel-measurable maps. When dealing with some function-valued random elements, such as cadlag functions endowed with the supremum norm, Borel-measurability fails to hold. See the <a href="http://books.google.com/books?id=OCenCW9qmp4C&amp;lpg=PP1&amp;dq=weak%20convergence%20empirical%20processes&amp;pg=PA3#v=onepage&amp;q&amp;f=false" rel="nofollow">motivation</a> for <i>Weak Convergence and Empirical Processes</i>. The $J1$ topology is basically a hack which ensures the function space is separable and thereby avoids measurability issues. The parallel theory of weak convergence described in the book embraces non-measurability.</p></li> <li><p>Existence of stochastic processes with nice properties: a key property of Brownian motion is continuity of the sample paths. Continuity, however, is a property involving uncountably many indices. The existence of a continuous version of a process can be ensured with separable modifications. See <a href="http://www.stat.cmu.edu/~cshalizi/754/notes/lecture-07.pdf" rel="nofollow">this lecture</a> and the one that follows. </p></li> </ol> <p>Metrizability allows us to introduce concepts such as convergence in probability. Completeness (the Cauchy convergence kind, not the null subsets kind) makes it easier to conduct analysis.</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/20951#20951 Answer by David R. MacIver for Polish spaces in probability David R. MacIver 2010-04-10T19:39:18Z 2010-04-10T20:07:28Z <p>One simple thing that can go wrong is purely related to the size of the space (polish spaces are all size $\leq 2^{\aleph_0}$). When spaces are large enough product measures become surprisingly badly behaved. Consider Nedoma's pathology: Let $X$ be a measure space with $|X| > 2^{\aleph_0}$. The diagonal in $X^2$ is not measurable. </p> <p>We'll prove this by way of a theorem: </p> <p>Let $U \subseteq X^2$ be measurable. $U$ can be written as a union of at most $2^{\aleph_0}$ spaces of the form $A \times B$.</p> <p>Proof: First note that we can find some countable collection $A_i$ such that $U \subseteq \sigma(A_i \times A_j)$ (proof: The set of $V$ such that we can find such $A_i$ is a sigma algebra containing the basis sets). </p> <p>For <code>$x \in \{0, 1\}^\mathbb{N}$</code> define <code>$B_x = \bigcap \{ A_i : x_i = 1 \} \cap \bigcap \{ A_i^c : x_i = 0 \}$</code>. </p> <p>Consider all sets which can be written as a (possibly uncountable) union of $B_x \times B_y$ for some $y$. This is a sigma algebra and obviously contains all the $A_i \times A_j$, so contains $A$.</p> <p>But now we're done. There are at most $2^{\aleph_0}$ of the $B_x$, and each is certainly measurable in $X$, so $U$ can be written as a union of $2^{\aleph_0}$ sets of the form $A \times B$. </p> <p>QED</p> <p>Corollary: The diagonal is not measurable.</p> <p>Evidently the diagonal cannot be written as a union of at most $2^{\aleph_0}$ rectangles, as they would all have to be single points, and the diagonal has size $|X| > 2^{\aleph_0}$.</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/20969#20969 Answer by George Lowther for Polish spaces in probability George Lowther 2010-04-11T00:44:09Z 2010-04-11T00:44:09Z <p>There's already been some good responses, but I think it's worth adding a very simple example showing what can go wrong if you don't use Polish spaces.</p> <p>Consider $\mathbb{R}$ under its usual topology, and let X be a non-Lebesgue measurable set. e.g., a <a href="http://en.wikipedia.org/wiki/Vitali_set" rel="nofollow">Vitali set</a>. Using the subspace topology on X, the diagonal $D\subseteq\mathbb{R}\times X$, $D=\{(x,x)\colon x\in X\}$ is Borel Measurable. However, its projection onto $\mathbb{R}$ is X, which is not Lebesgue measurable. Problems like this are avoided by keeping to Polish spaces. A measurable function between Polish spaces always take Borel sets to analytic sets which are, at least, <a href="http://en.wikipedia.org/wiki/Universally_measurable_set" rel="nofollow">universally measurable</a>.</p> <p>The space X in this example is a separable metrizable metric space, whereas Polish spaces are separable completely metrizable spaces. So things can go badly wrong if just the completeness requirement is dropped.</p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/26879#26879 Answer by Jean-Marie Aubry for Polish spaces in probability Jean-Marie Aubry 2010-06-02T22:45:08Z 2010-06-02T22:45:08Z <p>It can also be useful to have the set of Borel probability measures on $X$ (with weak* convergence, a.k.a. convergence in law) to be metrizable, for instance to be able to treat the convergences sequentially. For this you need the space $X$ to be separable and metrizable (see Lévy-Prohorov metric). </p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/102147#102147 Answer by Stéphane Laurent for Polish spaces in probability Stéphane Laurent 2012-07-13T14:14:19Z 2012-07-13T14:14:19Z <p>Below is a copy of an answer I gave here <a href="http://stats.stackexchange.com/questions/2932/metric-spaces-and-the-support-of-a-random-variable/20769#20769" rel="nofollow">http://stats.stackexchange.com/questions/2932/metric-spaces-and-the-support-of-a-random-variable/20769#20769</a></p> <p>Here are some technical conveniences of separable metric spaces </p> <p>(a) If $X$ and $X'$ take values in a separable metric space $(E,d)$ then the event ${X=X'}$ is measurable, and this allows to define random variables in the elegant way: a random variable is the equivalence class of $X$ for the "almost surely equals" relation (note that the normed vector space $L^p$ is a set of equivalence class)</p> <p>(b) The distance $d(X,X')$ between the two $E$-valued r.v. $X, X'$ is measurable; in passing this allows to define the space $L^0$ of random variables equipped with the topology of convergence in probability </p> <p>(c) Simple r.v. (those taking only finitely many values) are dense in $L^0$</p> <p>And some techical conveniences of complete separable (Polish) metric spaces :</p> <p>(d) Existence of the conditional law of a Polish-valued r.v. </p> <p>(e) Given a morphism between probability spaces, a Polish-valued r.v. on the first probability space always has a copy in the second one </p> http://mathoverflow.net/questions/20919/polish-spaces-in-probability/122393#122393 Answer by Davide Giraudo for Polish spaces in probability Davide Giraudo 2013-02-20T13:00:31Z 2013-02-20T13:00:31Z <p>We know by Ulam's theorem that a Borel measure on a Polish space is necessarily tight. If we just assume that the metric space is separable, we have that each Borel probability measure on $X$ is tight if and only if $X$ is universally measurable (that is, given a probability measure $\mu$ on the metric completion $\widehat X$, there are two measurable subsets $S_1$ and $S_2$ of $\widehat X$ such that $S_1\subset X\subset S_2$ and $\mu(S_1)=\mu(S_2)$. So a probability measure is not necessarily tight (take $S\subset [0,1]$ of inner Lebesgue measure $0$ and outer measure $1$), see Dudley's book <em>Real Analysis and Probability</em>. </p> <p>An other issue related to tightness. We know by Prokhorov theorem that if $(X,d)$ is Polish and if for all sequence of Borel probability measures $(\mu_n)$ we can extract a subsequence which converges in law, then $(\mu_n)$ is necessarily uniformly tight. It may be not true if we remove the assumption of "Polishness". And it may be problematic when we want results as "$\mu_n\to \mu$ in law if and only if there is uniform tightness and convergence of finite dimensional laws."</p>