What structure is needed to define a Gaussian distribution on a given space?

Question

In most textbooks, the normal distribution is defined on $\mathbb{R}^n$ by specifying its probability density function. This works perfectly well, but it isn't really amenable to generalisation.

I'm wondering what the minimal structure is that one must have on a given space $S$ before one can define an analogue of the normal distribution. If $S$ has a Riemannian metric defined on it, then one can define a Brownian motion on $S$ using the Laplace-Beltrami operator. The family of normal distributions on $S$ could then be defined as the one-dimensional marginals of the Brownian motion.

Alternatively, the normal distribution could be characterised as the distribution that maximises entropy when its mean and variance are known. This characterisation only seems to require a notion of "mean" (which suggests that $S$ must be a metric space).

Is there a more general construction of the normal distribution?

Answer 1

Let me assume that you seek for the generalization of Gaussian distribution in order to generalize the Brownian motion.

As far as I know, regarding the heat kernel as the generalization of the Gaussian distribution has long been adopted in many literatures. It comes from the following observation.

In $\mathbb {R}^1$, the following notions coincide:

(1) Gaussian distribution $N(x,t)\sim f(t,x,y)=\frac {1}{\sqrt{2\pi t}}e^{\frac{-(y-x)^2}{2t}}$,

(2) transition function $p(t,x,y)$ of the Brownian motion $B_t$,

(3) (heat kernel) fundamental solution $k_t(x,y)$ of the heat equation $\partial_t k=\Delta_y k$, with initial data $\delta_x$.

Thus, on manifolds, one way to define the Brownian motion is to construct a Markov process on the manifold whose transition function is exactly the heat kernel (let's identify the heat kernel with the Gaussian distribution in this setting). Since we always have the Laplacian-Beltrami $\Delta$ on a manifold, it is justifiable to talk about the heat equation and thus the heat kernel, and the Brownian motion in this sense is known to exist for a large class of manifolds.

But on metric spaces, we no longer have the Laplacian-Beltrami. So, in order to talk about heat kernel/Gaussian distribution, we need to generalize the notion of Laplacian-Beltrami. The key concept on this line the so-called Dirichlet form. A Dirichlet form on metric measure space $(X,d,\mu)$ a closed symmetric form $(\cdot,\cdot)$ defined on $L^2(X,\mu)$. It should further satisfy a couple of conditions so that it behaves like its prototype $(f,g)=\int_{M} {\nabla f\cdot \nabla g \, dx}$ on a manifold $M$. Notice that $(f,g)=(-\Delta f,g)_{L^2(M)}$ on manifolds, in the general case, one obtains the desired "Laplacian" by the same formula. Therefore, every Dirichlet form corresponds to a "Laplacian" and thus a Gaussian distribution (and thus a Brownian motion). What's more, a reasonable Dirichlet form always exists provided the space is suitably good.

In sum, if the space you are considering have both metric and measure structures, then the theory of Dirichlet form may provide you some satisfactory results regarding construction and properties of the Guassian distribution (and thus the Brownian motion). Roughly speaking, if we don't have a presumed measure, we may not be able to construct a reasonable probability space; if we don't have a metric, it would be hard to measure the regularity and decay of the Gaussian distribution. So metric measure structure might be the minimal structure for reasonable construction of Gaussian distribution.

Some reference books could be found in the above link. This paper by Sturm may allow you to have a glance at the whole picture. I am not an expert in this field. I apologize in advance for any mistake and naivety.

Answer 2

There is a standard definition for a Gaussian distribution on a Banach space (see e.g. Probability in Banach Spaces by Ledoux and Talagrand). A random vector $X$ with values in a Banach space $B$ is called Gaussian if it is Radon (a regularity condition which, for simplicity, I won't define here), for every $f \in B^*$, the $\mathbb{R}$-valued random variable $f(X)$ is Gaussian. This is a natural infinite-dimensional extension of the characterization suggested in Michael Hardy's first comment.

An important point here is that in infinite dimensions this gives a way to talk about a Gaussian distribution, but there is no longer any notion of the standard Gaussian distribution.

Answer 3

Let $X$ be a Banach space with its Borel $\sigma$-algebra $\mathcal B(X)$, and let $\mathbb P$ be a Radon measure on $X$. The continuous linear functionals on $X$ are measurable functions, hence random variables. Let's assume that for all $f \in X^*$, $$\mathbb E|f|^2 = \int_X |f(x)|^2 \ \mathrm{d}\mathbb P(x) < \infty.$$ This assumption implies a powerful structure theorem (cf. Theorem III.2.1 of [1]):

Theorem. There exists an element $\mu \in X$ (the mean element) and a continuous, symmetric operator $K : X^* \to X$ (the covariance operator) such that for all $f, g \in X^*$, $$f(\mu) = \mathbb E f \qquad \mathrm{and} \qquad f(Kg) = \mathbb E(fg) - f(\mu)g(\mu).$$

Furthermore, the support of the measure $\mathbb P$ is contained in the affine subspace spanned by the mean and covariance operator: $$\operatorname{supp} \mathbb P \subseteq \mu + \overline{KX^*},$$ and this space is separable.

As Mark Meckes said, we say that the measure $\mathbb P$ is Gaussian if each $f \in X^*$ is a real-valued Gaussian random variable (hence with mean $f(\mu)$ and variance $f(Kf)$. In this case, the support is the full affine subspace $\mu + \overline{KX^*}$. Furthermore, the measure is completely characterized by its characteristic functional $\varphi : X^* \to \mathbb R$: $$\varphi(f) = \int_X \mathrm e^{\mathrm i f(x)} \ \mathrm d\mathbb P(x) = \mathrm e^{\mathrm i f(\mu) - f(Kf)/2}.$$

For more on this topic, I suggest the reference:

[1] Probability Distributions on Banach Spaces by Vakhania, Tarieladze and Chobanyan.

Answer 4

One general construction can be found in Revuz and Yor "Continuous Martingales and Brownian Motion" for instance:

proposition (1.3)

Let $H$ be a separable real Hilbert space. There exist a probability space $\left( \Omega, \mathcal{F}, \mathbb{P} \right)$ and a family $X(h)$, $h \in H$ of random variables on the space such that

i) the map $h \rightarrow X(h)$ is linear

ii) for each $h$ the random variable $X(h)$ is Gaussian centered and $\mathbb{E} [ X(h)^2] = ||h||_{H}^{2}$

Nualarts book "Malliavian Calculus" also starts with the notion of isonormal Gaussian process which is general as well as Adler's books on Gaussian processes.

Alternatively you could look at one of T. Hida's books on White noise analysis for a construction based on the bochner-milnos theorem and Nuclear spaces.

Sorry none of these have a geometric perspective that I am aware of...