Skip to main content
2 of 5
edited title
Henry.L
  • 8.1k
  • 8
  • 48
  • 74

What are some of results in low dimensional statistics that do not hold in high dimensions?

This question is partially inspired by following MO post: What are some of the surprising results of finite sample statistical estimation? and current heated research front of high dimensional statistics.

Instead of asking about surprising results in high dimensions, I will ask what kind of results that holds in low dimensions fails to hold in a higher dimension. And what is its relation with other mathematical branch?

(By high dimensional statistics we usually refer to a high dimension covariate space instead of response space. For example, in a regression setting $Y=f(X)$ we tend to say a problem is of high dimension if $dim\mathcal{X}\gg dim\mathcal{Y}$)

For one simplest example, we know that James-Stein estimator performs better than maximum likelihood estimator in terms of $L^2$ norm when the dimension $dim\mathcal{X}=d\geq 3$; and it turns out to be an equivalent statement that a symmetric random walk in $\mathcal{X}=\mathbb{R}^d$ is transient when $d\geq 3$ via an infinitely divisible stochastic process.

Are there other such examples that can relate high dimensional phenomena in statistics?

Henry.L
  • 8.1k
  • 8
  • 48
  • 74