For questions about limit theorems of probability theorem: (functional or not) central limit theorem, law of large numbers, law of iterated logarithm, etc...

learn more… | top users | synonyms

2
votes
1answer
65 views

Version of Donsker-Invariance-Principle

Assume we have a Levy process $(X_t)_{t\geq 0}$ with a finite second moment for all $t>0$. For simplicity, say $\operatorname{Var}\left[X_1\right]=1$. Let $\tilde{X}_t:=X_t-t\cdot E\left[X_1\right]$...
8
votes
2answers
174 views

Is there a rate of convergence for Donsker's theorem?

For the standard CLT, one can easily estimate a rate of convergence if you assume that the random variables have a little more than two moments. Let $S_n$ be the centered-scaled sum of $n$ iid ...
3
votes
0answers
60 views

“Local” functional central limit theorem for the empirical distribution function

This question is a repost from Mathematics Stack Exchange, where it did not receive any answer. Assume $(X_i)_{i=1}^{\infty}$ is a sequence of i.i.d. real-valued random variables such that $\mathbb E[...
8
votes
1answer
271 views

Law of Large Numbers for Martingales

I apologize in advance if this question is too basic, but I've received no response on Math Stack Exchange, so perhaps it is more appropriate here: Let $X_n$ be a square integrable martingale with $\...
12
votes
1answer
155 views

Applications of the Central Limit Theorem in dynamical systems

There are very many papers in the area of (possibly non-uniformly) hyperbolic dynamical systems whose aim is to prove the Central Limit Theorem. In a dynamical context, this means that one: has a ...
0
votes
0answers
57 views

CLT for sums of an infinite sequence of rv with an asymptotic distribution

Excuse me if the question is ill-posed. I'll do my best to explain the problem.I have a vector $(x^{(n)}_1, x^{(n)}_2, \ldots x^{(n)}_n),$ whose individual components can be shown to be asymptotically ...
2
votes
0answers
108 views

Almost independent Bernoulli variables

There is some global parameter $n\to\infty$. And a function $N=N(n)\to\infty$. Let $X^n_1,X^n_2,\ldots,X^n_N$ be independent Bernoulli random variables, where $\delta\le P(X^n_i=1)=1-P(X^n_i=0)\le 1-\...
3
votes
0answers
120 views

Interplay between CLT and convergence in Total Variation

Given a random variable $X$ with bounded moments such that $E[X] = 0, E[X^2] = 1$, let $F_n$ denote the distribution $\sum\limits_{i=1}^d\frac{X_i}{\sqrt{n}}$ where each $X_i$ is an independent copy ...
1
vote
0answers
102 views

Strong law of large number for semimartingale

I just want to know if for semimartingale $X$ we have $\lim_{t \rightarrow \infty} \frac{X_{t}}{\langle X\rangle_{t}}=0$ or when it is possible. I know it is true for Brownian motion. Thanks
5
votes
2answers
152 views

Reference to iterated logarithm law and Smirnov law of empirical CDF

I am reading V. Vapnik's "Statistical Learning Theory". The author layouts following two statistical laws related to empirical CDF. I am looking for reference about proofs on these two laws. Let $...
3
votes
0answers
58 views

Functions whose Laplace transforms have prescribed behavior at minus infinity

Let $f:\mathbb{R}\rightarrow\mathbb{R}$ be a non-negative function with entire Laplace transform $\hat{f}$ (in particular $\lim_{t\to \infty}e^{st}f(t)=0$ for all $s$), and $p_0$ a positive integer. ...
4
votes
0answers
250 views

Unusual generalization of the law of large numbers

I have seen in physical literature an example of application of a very unusual form of the law of large numbers. I would like to understand how legitimate is the use of it, whether there are ...
10
votes
4answers
1k views

Rate of convergence in the Law of Large Numbers

I'm working on a problem where I need information on the size of $E_n=|S_n-n\mu|$, where $S_n=X_1+\ldots+X_n$ is a sum of i.i.d. random variables and $\mu=\mathbb EX_1$. For this to make sense, the $(...
2
votes
1answer
105 views

Berry-Esseen bound in 2 dimensions for linear combinations

Let us say have a sequence of $n$ 2-$D$ random variables $X_i=(\varepsilon_i/\sqrt{n},i\varepsilon_{i}\sqrt{6}/n^{3/2})$, where $\varepsilon_{i}$ are independent random variables such that $\mathbb{P}(...
4
votes
1answer
210 views

Approximating by independent Poisson random variables

Using the Chen-Stein method, one can bound the total variation distance between a sum of possibly dependent Bernoulli random variables $W=\sum_{i=1}^n X_i$ and a Poisson distribution using only the ...
6
votes
0answers
117 views

Rate of Convergence of Compound Poisson Laws to Infinitely Divisible Laws

It is known that every infinitely divisible random variable is the limit in law of a sequence of compound Poisson random variables (see for instance Theorem 1.2.18 of Lévy Processes and Stochastic ...
3
votes
0answers
155 views

On the decay of correlations of an ergodic sequence over the set $X_{0}=0$

The following question arose while I was trying to explore possible further extensions of a CLT by Liverani which I mentioned here already (see this link, I can tell you more details upon request). It ...
3
votes
0answers
116 views

Under what conditions do time averages of ergodic transformations satisfy a central limit theorem?

Let $(X, \mu)$ be a probability space and $T:X\rightarrow X $ an ergodic transformation, i.e. $T$ is measure preserving and the only $T$ invariant subspaces have either measure $0$ or measure $1$ (...
1
vote
0answers
132 views

Is it possible to improve the order of convergence of averages of random variables if they are not identically distributed?

Let $X_n$ be a sequence of independent random variables (but not necessarily identically distributed) taking values in $[-1,1]$ that have the following property: 1) The average $A_n := \frac{(X_1+ \...
1
vote
0answers
178 views

limit distribution of multinomial distribution with increasing categories

If $\bf{X} \sim \text{multi}(n,p)$ with $k$ categories, we know $$ \sqrt{n}\left( \frac{\bf{X}}{n} - \bf{p} \right) \rightarrow^D N(0,\Sigma),$$ where $\bf{X}=(X_1,\ldots,X_k)^T$ and $p=(p_1,\ldots,...
1
vote
0answers
74 views

Local limit theorem for an infinite dimensional integer lattice

Can someone refer me to a local limit theorem for the sum ${\bf S} = \sum_{i=1}^n{\bf X}_i$ of a sequence of independent and identically distributed $d$-dimensional random variables $\{{\bf X}_i\}_{i=...
3
votes
0answers
177 views

Donsker's Theorem for triangular arrays

I should mention that I already posed this question on Math Stack Exchange, but didn't receive much feedback. Assume we have a sequence of smooth i.i.d. random variables $(X_i)_{i=1}^{\infty}$. Given ...
5
votes
1answer
412 views

Expectation of ratio of functions of i.i.d. Bernoullis: a concentration question

Consider the following $n \times n$ symmetric matrix of i.i.d. Bernoulli random variables, $X_{ij}$. For $i=1,...,n$ and $i<j\le n$. Let $X_{ij} \sim \text{Bernoulli}(p)$ when $i \ne j$ ($p$ fixed)...
5
votes
1answer
566 views

Sum of a random number of identically distributed but dependent random variables?

Background Let $X_t$ be the continuous time Markov process on the state space {Working, Broken} with failure rate $\alpha$ and repair rate $\beta$. By elementary calculations [1] $$ \begin{align*} ...
1
vote
1answer
206 views

Central limit theorem and convergence of means [closed]

If $Z_1,Z_2,Z_3,\ldots$ are i.i.d. with $P(Z_i=-1) = P(Z_i=+1) = \frac 12,$ then we have by the Central Limit Theorem that $\frac{\sum_{i=1}^n Z_i}{\sqrt{n}}\stackrel{d}{\to} \mathcal{N}(0,1),$ so ...
2
votes
1answer
218 views

References on law of large numbers, CLT and iterated logarithm laws

Having access to those references, accumulating many results in one domain is always a bless, like Feller's book in probability, Dembo-Zeitouni's large deviation, Grimmett's percolation and recent ...
3
votes
1answer
106 views

Lyapunov Exponents for independent-nonidentically distributed matrices?

My question is highlighted in bold at the end. $\mathrm{\underline{Background}}$ Consider a product of i.i.d. $d\times d$ random matrices $A_{i}$ (with $\mathbb{E}\log\left\Vert A_{i}\right\Vert <...
4
votes
2answers
408 views

Intuition on Lindeberg condition

I want to know how Lindeberg came up with the condition which is sufficient for CLT to hold ? What is the intuition behind such an expression ?
5
votes
1answer
2k views

Convergence rate of the central limit theorem near the center of the distribution

I'm looking for fast convergence rates for the central limit theorem - when we are not near the tails of the distribution. Specifically, from the general convergence rates stated in the Berry–Esseen ...
2
votes
1answer
86 views

Convergence of Symmetric Iterative Proportional Fitting

Let $A$ denote a symmetric matrix of non-negative entries, whose rows (and columns) sum up to the all-positive vector $d := A\mathbf{1}$ with $\mathbf{1}$ the all-one-vector. Denote $D := diag(d)$ by ...
1
vote
0answers
161 views

Uniform Law Of Iterated Logarithm for VC classes

Kenneth Alexander proved a uniform Law Of Iterated logarithm for Vapnik-Chervonenkis classes in the article Probability Inequalities for Empirical Processes and a Law of the Iterated Logarithm (Ann. ...
5
votes
0answers
131 views

Pettis Integrability and Laws of Large Numbers

Let $(\Omega, \mathcal F, \mathbb P)$ be a probability space, and let $V$ be a topological vector space with a dual space that separates points. Let $v_n : \Omega \to V$ be a sequence of Pettis ...
1
vote
1answer
211 views

Asymptotically independent increments random elements: Billingsley Ch:$4$

Let $X_n$ be random elements of $D$ (space of cad lag functions on $[0,1]$ as domain). $X_n$ has asymptotically independents if $0\leq s_1 \leq t_1 \leq s_2 \leq \ldots < s_r \leq t_r \leq 1$, then ...
5
votes
1answer
446 views

Law of Iterated Logarithm for autoregressive process

Suppose that $\{X_i\}$ is an $\mathrm{AR}(r)$, defined by: $X_{i}= h(i) + \varepsilon_i $, $h(i)=\alpha_1 X_{i-1} + \dots + \alpha_{r} X_{i-r}$ where $\{\varepsilon_i\}$ are i.i.d. ${\cal N}(0,1)$...
4
votes
1answer
393 views

Donsker Theorem Billingsley

Theorems $16.1$ and $16.3$ in Billingsley Convergence of measures. $16.1$ reads : Random variables $u_1,\ldots$ on $(\Omega,\mathcal{B},\mathbb P)$ and are i.i.d. with $0$ mean and finite variance $\...
9
votes
1answer
754 views

Generalized central limit theorem

I am looking for a generalized central limit theorem for non-square integrable stationary sequences. More precisely I suspect that when $(X_j)_{j\geqslant 1}$ is a stationary sequence such that $X_i$ ...
19
votes
2answers
3k views

Intuition of law of iterated logarithm?

Let $X_i$ be iid random variables with $EX_i = 0$ and $Var X_i=1$ and $S_n=X_1+\cdots+X_n$. Then the law of the iterated logarithm says almost everywhere we have $$\limsup_{n\to\infty}\frac{S_n}{\...
4
votes
0answers
317 views

Stable local limit theorems

Consider a sequence of integer valued indentically distributed centered independent random variables $X_1, X_2, \ldots$ with the additional condition that the support of $X_1$ is aperiodic. Suppose ...
5
votes
6answers
747 views

CLT for stationary sequences with infinte variance

There is a well-known central limit theorem for as a stationary sequences. If $( X_n )_n$ is a sationary sequence and $E X_n=0$ then under suitable mixing conditions the sequence $S_n := n^{-1/2}\...