Skip to main content
fixed a mistake in the normalized sum of squares formula
Source Link
Bullmoose
  • 917
  • 6
  • 16

I have a sequence of independent but not identically-distributed random variables $X_1, X_2, \ldots, X_n$ where $X_i\sim A_i$, with each $A_i$ having a support over $\mathbb{R}$ and subject to the following properties with known parameters:

  • $\mathbf{E}[X_i]=0$ (zero mean)
  • $\mathbf{var}[X_i]=\sigma^2_i<\infty$ (finite variance)
  • $\mu_3(X_i)=0$ (symmetry)
  • $\mu_4(X_i)<\infty$

I am interested in the convergence properties of the sum of squares of $X_i$: $\sum_{i=1}^n X_i^2$

Specifically, I am interested in the properties of $A_i$ such that

$$\frac{\sum_{i=1}^n X_i^2}{\sqrt{\sum_{i=1}^n (\mu_4(i)-\sigma_i^4)}}\xrightarrow{d}\mathcal{N}(0,1)$$$$\frac{\sum_{i=1}^n (X_i^2-\sigma^2_i)}{\sqrt{\sum_{i=1}^n (\mu_4(i)-\sigma_i^4)}}\xrightarrow{d}\mathcal{N}(0,1)$$

That is, I am interested what additional conditions would $A_i$ have to obey in order for the normalised sum of squares to converge to a standard Gaussian distribution.

I am aware that the Lendeberg-Feller condition specifies if that most of the mass of $X^2_i$ is in the small interval around the mean, then CLT applies. This basically excludes heavy-tailed $A_i$. Unfortunately, it's unwieldy to apply.

I also know about the Lyapunov Condition: one can easily show that if $A_i$'s are Gaussian, then the normalised sum of their squares converges to a standard Gaussian.

I have three specific and one general questions:

  1. If $A_i$'s are platykurtic, does its square obey either Lyapunov and/or Lendeberg-Feller conditions (or any other conditions that ensure convergence to CLT)?
  2. If $A_i$'s belong to the exponential family, what are the least restrictive conditions that one can impose on their parameters so that the sum of squares of random variables drawn from them converges to a Gaussian? (I am looking for a looser condition than parameters yielding Gaussian $A_i$'s)
  3. If I impose constraints on higher central moments (as opposed to absolute moments) of $A_i$'s (but not absolute moments), can that ensure that the CLT applies to the sum of squares? If so, how loose can the constraints be (i.e. can I get away by saying that moments are finite)?

General question: the above three questions relate to specific distribution properties I thought of (and that are relevant to my project). Are there other properties of $A_i$'s that I should look into? Are there classes of $A_i$ for whose sum of squares CLT always applies?

Background: I am working on a variance detection problem and need to analytically characterise the asymptotic performance of a detector.

I have a sequence of independent but not identically-distributed random variables $X_1, X_2, \ldots, X_n$ where $X_i\sim A_i$, with each $A_i$ having a support over $\mathbb{R}$ and subject to the following properties with known parameters:

  • $\mathbf{E}[X_i]=0$ (zero mean)
  • $\mathbf{var}[X_i]=\sigma^2_i<\infty$ (finite variance)
  • $\mu_3(X_i)=0$ (symmetry)
  • $\mu_4(X_i)<\infty$

I am interested in the convergence properties of the sum of squares of $X_i$: $\sum_{i=1}^n X_i^2$

Specifically, I am interested in the properties of $A_i$ such that

$$\frac{\sum_{i=1}^n X_i^2}{\sqrt{\sum_{i=1}^n (\mu_4(i)-\sigma_i^4)}}\xrightarrow{d}\mathcal{N}(0,1)$$

That is, I am interested what additional conditions would $A_i$ have to obey in order for the normalised sum of squares to converge to a standard Gaussian distribution.

I am aware that the Lendeberg-Feller condition specifies if that most of the mass of $X^2_i$ is in the small interval around the mean, then CLT applies. This basically excludes heavy-tailed $A_i$. Unfortunately, it's unwieldy to apply.

I also know about the Lyapunov Condition: one can easily show that if $A_i$'s are Gaussian, then the normalised sum of their squares converges to a standard Gaussian.

I have three specific and one general questions:

  1. If $A_i$'s are platykurtic, does its square obey either Lyapunov and/or Lendeberg-Feller conditions (or any other conditions that ensure convergence to CLT)?
  2. If $A_i$'s belong to the exponential family, what are the least restrictive conditions that one can impose on their parameters so that the sum of squares of random variables drawn from them converges to a Gaussian? (I am looking for a looser condition than parameters yielding Gaussian $A_i$'s)
  3. If I impose constraints on higher central moments (as opposed to absolute moments) of $A_i$'s (but not absolute moments), can that ensure that the CLT applies to the sum of squares? If so, how loose can the constraints be (i.e. can I get away by saying that moments are finite)?

General question: the above three questions relate to specific distribution properties I thought of (and that are relevant to my project). Are there other properties of $A_i$'s that I should look into? Are there classes of $A_i$ for whose sum of squares CLT always applies?

Background: I am working on a variance detection problem and need to analytically characterise the asymptotic performance of a detector.

I have a sequence of independent but not identically-distributed random variables $X_1, X_2, \ldots, X_n$ where $X_i\sim A_i$, with each $A_i$ having a support over $\mathbb{R}$ and subject to the following properties with known parameters:

  • $\mathbf{E}[X_i]=0$ (zero mean)
  • $\mathbf{var}[X_i]=\sigma^2_i<\infty$ (finite variance)
  • $\mu_3(X_i)=0$ (symmetry)
  • $\mu_4(X_i)<\infty$

I am interested in the convergence properties of the sum of squares of $X_i$: $\sum_{i=1}^n X_i^2$

Specifically, I am interested in the properties of $A_i$ such that

$$\frac{\sum_{i=1}^n (X_i^2-\sigma^2_i)}{\sqrt{\sum_{i=1}^n (\mu_4(i)-\sigma_i^4)}}\xrightarrow{d}\mathcal{N}(0,1)$$

That is, I am interested what additional conditions would $A_i$ have to obey in order for the normalised sum of squares to converge to a standard Gaussian distribution.

I am aware that the Lendeberg-Feller condition specifies if that most of the mass of $X^2_i$ is in the small interval around the mean, then CLT applies. This basically excludes heavy-tailed $A_i$. Unfortunately, it's unwieldy to apply.

I also know about the Lyapunov Condition: one can easily show that if $A_i$'s are Gaussian, then the normalised sum of their squares converges to a standard Gaussian.

I have three specific and one general questions:

  1. If $A_i$'s are platykurtic, does its square obey either Lyapunov and/or Lendeberg-Feller conditions (or any other conditions that ensure convergence to CLT)?
  2. If $A_i$'s belong to the exponential family, what are the least restrictive conditions that one can impose on their parameters so that the sum of squares of random variables drawn from them converges to a Gaussian? (I am looking for a looser condition than parameters yielding Gaussian $A_i$'s)
  3. If I impose constraints on higher central moments (as opposed to absolute moments) of $A_i$'s (but not absolute moments), can that ensure that the CLT applies to the sum of squares? If so, how loose can the constraints be (i.e. can I get away by saying that moments are finite)?

General question: the above three questions relate to specific distribution properties I thought of (and that are relevant to my project). Are there other properties of $A_i$'s that I should look into? Are there classes of $A_i$ for whose sum of squares CLT always applies?

Background: I am working on a variance detection problem and need to analytically characterise the asymptotic performance of a detector.

Source Link
Bullmoose
  • 917
  • 6
  • 16

CLT for the squares of unbounded non-identically independently distributed random variables

I have a sequence of independent but not identically-distributed random variables $X_1, X_2, \ldots, X_n$ where $X_i\sim A_i$, with each $A_i$ having a support over $\mathbb{R}$ and subject to the following properties with known parameters:

  • $\mathbf{E}[X_i]=0$ (zero mean)
  • $\mathbf{var}[X_i]=\sigma^2_i<\infty$ (finite variance)
  • $\mu_3(X_i)=0$ (symmetry)
  • $\mu_4(X_i)<\infty$

I am interested in the convergence properties of the sum of squares of $X_i$: $\sum_{i=1}^n X_i^2$

Specifically, I am interested in the properties of $A_i$ such that

$$\frac{\sum_{i=1}^n X_i^2}{\sqrt{\sum_{i=1}^n (\mu_4(i)-\sigma_i^4)}}\xrightarrow{d}\mathcal{N}(0,1)$$

That is, I am interested what additional conditions would $A_i$ have to obey in order for the normalised sum of squares to converge to a standard Gaussian distribution.

I am aware that the Lendeberg-Feller condition specifies if that most of the mass of $X^2_i$ is in the small interval around the mean, then CLT applies. This basically excludes heavy-tailed $A_i$. Unfortunately, it's unwieldy to apply.

I also know about the Lyapunov Condition: one can easily show that if $A_i$'s are Gaussian, then the normalised sum of their squares converges to a standard Gaussian.

I have three specific and one general questions:

  1. If $A_i$'s are platykurtic, does its square obey either Lyapunov and/or Lendeberg-Feller conditions (or any other conditions that ensure convergence to CLT)?
  2. If $A_i$'s belong to the exponential family, what are the least restrictive conditions that one can impose on their parameters so that the sum of squares of random variables drawn from them converges to a Gaussian? (I am looking for a looser condition than parameters yielding Gaussian $A_i$'s)
  3. If I impose constraints on higher central moments (as opposed to absolute moments) of $A_i$'s (but not absolute moments), can that ensure that the CLT applies to the sum of squares? If so, how loose can the constraints be (i.e. can I get away by saying that moments are finite)?

General question: the above three questions relate to specific distribution properties I thought of (and that are relevant to my project). Are there other properties of $A_i$'s that I should look into? Are there classes of $A_i$ for whose sum of squares CLT always applies?

Background: I am working on a variance detection problem and need to analytically characterise the asymptotic performance of a detector.