Questions tagged [limit-theorems]
For questions about limit theorems of probability theory: (functional or not) central limit theorem, law of large numbers, law of iterated logarithm, etc.
106
questions
31
votes
2
answers
11k
views
Intuition of law of iterated logarithm?
Let $X_i$ be iid random variables with $EX_i = 0$ and $Var X_i=1$ and $S_n=X_1+\cdots+X_n$. Then the law of the iterated logarithm says almost everywhere we have
$$\limsup_{n\to\infty}\frac{S_n}{\...
25
votes
4
answers
10k
views
Rate of convergence in the Law of Large Numbers
I'm working on a problem where I need information on the size of $E_n=|S_n-n\mu|$, where $S_n=X_1+\ldots+X_n$ is a sum of i.i.d. random variables and $\mu=\mathbb EX_1$. For this to make sense, the $(...
16
votes
3
answers
1k
views
Is there a rate of convergence for Donsker's theorem?
For the standard CLT, one can easily estimate a rate of convergence if you assume that the random variables have a little more than two moments.
Let $S_n$ be the centered-scaled sum of $n$ iid ...
14
votes
1
answer
798
views
Large-n limit of the distribution of the normalized sum of Cauchy random variables
What is the large-n limit of a distribution of the following sample statistic:$$x\equiv\displaystyle\frac{\sum^{n}X_{i}}{\,\sqrt{\,\sum^{n}X_{i}^{2}\,}\,}$$ when sampling the Cauchy(0,1) distribution? ...
14
votes
1
answer
741
views
Applications of the Central Limit Theorem in dynamical systems
There are very many papers in the area of (possibly non-uniformly) hyperbolic dynamical systems whose aim is to prove the Central Limit Theorem. In a dynamical context, this means that one:
has a ...
12
votes
2
answers
2k
views
Can we do better than Azuma-Hoeffding when the variance is small?
The Azuma-Hoeffding Inequality says that if $X_1,X_2, \ldots$ is a martingale and the differences are bounded by constants, $\|X_i - X_{i-1}\| \le 1$ say, then we should not expect the difference $\|...
11
votes
0
answers
222
views
Functional Weak Convergence of Maximum Likelihood Estimator
Let $\hat{\theta}_n$ be the Maximum Likelihood Estimator of parameter $\theta$, where $n$ is the sample size. It is well-known that under sufficient regularity conditions, we have the asymptotic ...
10
votes
1
answer
2k
views
Generalized central limit theorem
I am looking for a generalized central limit theorem for non-square integrable stationary sequences. More precisely I suspect that when $(X_j)_{j\geqslant 1}$ is a stationary sequence such that $X_i$ ...
9
votes
1
answer
8k
views
Convergence rate of the central limit theorem near the center of the distribution
I'm looking for fast convergence rates for the central limit theorem - when we are not near the tails of the distribution.
Specifically, from the general convergence rates stated in the Berry–Esseen ...
9
votes
1
answer
2k
views
Law of large numbers for martingales
I apologize in advance if this question is too basic, but I've received no response on Math Stack Exchange, so perhaps it is more appropriate here:
Let $X_n$ be a square-integrable martingale with $\...
7
votes
7
answers
2k
views
CLT for stationary sequences with infinite variance
There is a well-known central limit theorem for as a stationary sequences.
If $( X_n )_n$ is a stationary sequence and $E X_n=0$ then under suitable mixing conditions the sequence $S_n := n^{-1/2}\...
7
votes
1
answer
518
views
A variation on the Borel–Cantelli lemma theme
Let $X,X_0,X_1,\dots$ be nonnegative independent identically distributed (i.i.d.) random variables. Let
\begin{equation*}
E:=\bigcap_{n\ge0}B_n,
\end{equation*}
where
\begin{equation*}
B_n:=\...
7
votes
1
answer
489
views
Local limit theorem for random walks on $\mathbb Z^d$
I'm looking for a reference for the following claim.
Let $W(n)$ be a centered random walk on $\mathbb Z^d$ with $W(0)=0$.
Suppose that $W(n)$ has a finite second moment.
Let $n\ge 1 $ and $k \in \...
7
votes
2
answers
433
views
Rate of Convergence of Compound Poisson Laws to Infinitely Divisible Laws
It is known that every infinitely divisible random variable is the limit in law of a sequence of compound Poisson random variables (see for instance Theorem 1.2.18 of Lévy Processes and Stochastic ...
7
votes
0
answers
697
views
Product of two random Gaussian matrices - orthant probability
Let $X \in \mathbb{R}^{m \times n}$ and $Y \in \mathbb{R}^{n \times k} $ be two independent Gaussian random matrices, i.e., with entries independently sampled from $\mathcal{N}(0,1)$ (a normal ...
6
votes
1
answer
145
views
Uniform upper bounds for the return probability of random walks on $ \mathbb{R}$
Let $\mu$ be a probability measure with finite support on integers or the real line with the property that $\mu( 0) \le p$ for a fixed $0<p <1$. Let $S_n$ denote the random walk starting at $0$,...
6
votes
0
answers
1k
views
Interplay between CLT and convergence in Total Variation
Given a random variable $X$ with bounded moments such that $E[X] = 0, E[X^2] = 1$, let $F_n$ denote the distribution $\sum\limits_{i=1}^d\frac{X_i}{\sqrt{n}}$ where each $X_i$ is an independent copy ...
6
votes
0
answers
186
views
Pettis Integrability and Laws of Large Numbers
Let $(\Omega, \mathcal F, \mathbb P)$ be a probability space, and let $V$ be a topological vector space with a dual space that separates points. Let $v_n : \Omega \to V$ be a sequence of Pettis ...
5
votes
2
answers
1k
views
Intuition on Lindeberg condition
I want to know how Lindeberg came up with the condition which is sufficient for CLT to hold ? What is the intuition behind such an expression ?
5
votes
1
answer
951
views
Variance of sum of $m$ dependent random variables
I originally posted this question in Mathstackexchange, but since I got no answer I'm posting it also here.
Let $X_1,X_2,...$ be a sequence of identically distributed and $m$-dependent random ...
5
votes
1
answer
703
views
Donsker Theorem Billingsley
Theorems $16.1$ and $16.3$ in Billingsley Convergence of measures.
$16.1$ reads : Random variables $u_1,\ldots$ on $(\Omega,\mathcal{B},\mathbb P)$
and are i.i.d. with $0$ mean and finite variance $\...
5
votes
2
answers
348
views
Reference to iterated logarithm law and Smirnov law of empirical CDF
I am reading V. Vapnik's "Statistical Learning Theory". The author layouts following two statistical laws related to empirical CDF. I am looking for reference about proofs on these two laws.
Let $...
5
votes
1
answer
235
views
Maximal inequality of iid random variables $\{X_{ij}\}_{1\leqslant i,j \leqslant n}$
Suppose that $\{X_{ij}\}_{1\leqslant i,j\leqslant n}$ are iid random variables with $\mathbb{E}(X_{11})=0$ and $\mathrm{Var}(X_{11})=1$, does the following convergence hold:
$$
\max_{1\leqslant j\...
5
votes
1
answer
527
views
Donsker's Theorem for triangular arrays
I should mention that I already posed this question on Math Stack Exchange, but didn't receive much feedback.
Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given ...
5
votes
1
answer
689
views
Expectation of ratio of functions of i.i.d. Bernoullis: a concentration question
Consider the following $n \times n$ symmetric matrix of i.i.d. Bernoulli random variables, $X_{ij}$. For $i=1,...,n$ and $i<j\le n$. Let $X_{ij} \sim \text{Bernoulli}(p)$ when $i \ne j$ ($p$ fixed)...
5
votes
1
answer
532
views
Law of Iterated Logarithm for autoregressive process
Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by:
$X_{i}= h(i) + \varepsilon_i $,
$h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$
where $\{\varepsilon_i\}$ are i.i.d. ${\cal N}(0,1)$...
5
votes
0
answers
172
views
Central limit theorem versus entropy in dynamical systems context
A dynamical system $(S^1,T, \mu)$, $T_* \mu=\mu$, $T$ ergodic, $S^1$ is circle. Assume it has central limit theorem.
Want to know the relation between its measure-theoretic entropy $h_{\mu}(T)$ and ...
5
votes
0
answers
504
views
How to obtain the probability distribution of a sum of dependent discrete random variables more efficiently
I hope you are well. Here is my problem.
Let $\{s_0,\,s_1,\ldots,\,s_T\}$ be a sequence of discrete random variables and denote $S_t=s_0+s_1+\cdots+s_t$, with $S_0=0$ and $S_T\leq M$, where $M$ and $T$...
5
votes
0
answers
1k
views
Skorokhod' representation theorem: What is (are) possible filtration(s) on the common probability space?
I asked this question on math.stackexchange at
https://math.stackexchange.com/questions/1941142/skorokhods-representation-theorem-what-is-the-filtration-on-the-common-probabi
and haven't received ...
5
votes
1
answer
1k
views
Sum of a random number of identically distributed but dependent random variables?
Background
Let $X_t$ be the continuous time Markov process on the state space {Working, Broken} with failure rate $\alpha$ and repair rate $\beta$. By elementary calculations [1]
$$
\begin{align*}
...
5
votes
0
answers
478
views
Stable local limit theorems
Consider a sequence of integer valued indentically distributed centered independent random variables $X_1, X_2, \ldots$ with the additional condition that the support of $X_1$ is aperiodic. Suppose ...
4
votes
2
answers
302
views
Does the average of correlated Gaussian random variables with mean zero and different variances converge in probability to their mean?
Let $X_i\sim N(0,\sigma_i^2)$ and $\operatorname{Corr}(X_i,X_j)>0$. Is it possible to show that $$\frac{1}{N} \sum_{i=1}^N X_i \overset{p}\rightarrow E[X_i]=0.$$ Do you have a reference to a law of ...
4
votes
1
answer
412
views
Central limit theorem for resampling
This is a cross-post from stats.stackexchange.com. No answer has appeared there. Since this is a theoretical question, mathoverflow.net seems to be a more appropriate venue for it.
What is the analog ...
4
votes
1
answer
329
views
Reference for multivariate generalised CLT
I know that one can generalise the classical CLT in terms of heavy tail distributions, namely, for any i.i.d. random variables $X_i$,
$$\frac{X_1+\cdots+X_n}{n^{1/\alpha}}\rightarrow S(\alpha,\beta,\...
4
votes
1
answer
171
views
A randomized central limit theorem
Let $X_k$, $k = 1, 2, \dots$, be a sequence of i.i.d. random variables with finite second moments. Also, let $N_k \geq 1$, $k = 1, 2, \dots$, be a sequence of random variables taking integral values, ...
4
votes
1
answer
188
views
Local central limit theorem far from the center
Let $X_i$ be a sequence of iid random variables, $E [X] = 0$, $E [X^2] = 1$ and $E [|X|^k] < \infty$ for some $k \ge 3$.
Classical local CLT says that the density function $f_n$ of $\frac1{\sqrt n}...
4
votes
1
answer
339
views
Approximating by independent Poisson random variables
Using the Chen-Stein method, one can bound the total variation distance between a sum of possibly dependent Bernoulli random variables $W=\sum_{i=1}^n X_i$ and a Poisson distribution using only the ...
4
votes
1
answer
182
views
Sign of error in the central limit theorem
Let $X_n$ and $Y_n$ be independent copies of two random variables $X$ and $Y$ with domain $\{-1,0,1\}$ for $n\in \mathbb{N}$. For a given $k\in \mathbb{N}$, I would like to find conditions on $X$ and $...
4
votes
0
answers
172
views
log-concavity and local CLT
If a sequence of 1-dimensional log-concave integer-valued distributions satisfies a Central Limit Theorem (CLT) and has variance going to $\infty$, then it satisfies a Local Central Limit Theorem (...
4
votes
0
answers
227
views
Convergence of the expectation of a random variable when conditioned on its sum with another, independent but not identically distributed
Suppose that for all $n \in \mathbf{N}$, $X_n$ and $Y_n$ are independent random variables with
$$X_n \sim \mathtt{Binomial}(n,1-q),$$
and
$$Y_n \sim \mathtt{Poisson}(n(q+\epsilon_n)),$$
where $q \in (...
4
votes
0
answers
153
views
Concentration Inequality for Score Functions of Exponential Familty
Let $p$ be the density of a continuous one-parameter exponential family distribution on $\mathbb{R}$. We assume that
$$p(x) = c(x)\cdot \exp\bigl [ x \cdot \theta - b(\theta ) \bigr ], $$
where $\...
4
votes
0
answers
332
views
Unusual generalization of the law of large numbers
I have seen in physical literature
an example of application of a very unusual form of the law of large numbers. I would like to understand how legitimate is the use of it, whether there are ...
4
votes
0
answers
411
views
Under what conditions do time averages of ergodic transformations satisfy a central limit theorem?
Let $(X, \mu)$ be a probability space and $T:X\rightarrow X $ an ergodic transformation, i.e. $T$ is measure preserving and the only $T$ invariant subspaces have either measure $0$ or measure $1$ (...
3
votes
3
answers
288
views
A question in central limit theorem
Suppose $\{X_n,n\ge1\}$ are independent r.v., $E(X_n)=0$, $\operatorname{Var} \left(X_n\right)=\sigma_n^2<\infty$. Set $S_n=\sum_{i=1}^nX_i$ and $s_n^2=\sum_{i=1}^n\sigma_i^2$, assume
$$\frac{S_n}{...
3
votes
1
answer
372
views
A convergence problem
I have a math/stat problem where I need to show the convergence of the average of a sequence of experiments to an interval. The sequence of experiments is not i.i.d., hence the standard law of large ...
3
votes
1
answer
60
views
When do Orlicz norms tend to the uniform norm?
It is well known that the $p$-norms tend to the $\infty$-norm, in that if $\lVert f \rVert_q < \infty$ for some $q \ge 1$ then $\lVert f \rVert_p \to \lVert f \rVert_\infty$ as $p \to \infty$. ...
3
votes
1
answer
321
views
Berry-Esseen bound in 2 dimensions for linear combinations
Let us say have a sequence of $n$ 2-$D$ random variables $X_i=(\varepsilon_i/\sqrt{n},i\varepsilon_{i}\sqrt{6}/n^{3/2})$, where $\varepsilon_{i}$ are independent random variables such that $\mathbb{P}(...
3
votes
1
answer
239
views
Lyapunov Exponents for independent-nonidentically distributed matrices?
My question is highlighted in bold at the end.
$\mathrm{\underline{Background}}$
Consider a product of i.i.d. $d\times d$ random matrices $A_{i}$
(with $\mathbb{E}\log\left\Vert A_{i}\right\Vert <...
3
votes
1
answer
110
views
A $t$-test for ordered pairs
Suppose I have random variables
$$
W_i = \begin{cases} w_1 &\text{with prob. } p_1, \\ w_2 &\text{with prob. } p_2, \\ w &\text{with prob. } 1-p_1-p_2,\end{cases} \qquad i = 1, \dots, 2n+1....
3
votes
1
answer
115
views
Convergence of function of stochastic processes
Let $X_t$ be a fixed cadlag semi-martingale and $J_n$ be a fixed sequence of functions from $\mathbb{R}^d$ to $\mathbb{R}$ which are twice continuously differentiable. If $J_n$ converge pointwise to ...