All Questions
28 questions
11
votes
1
answer
1k
views
What are some of the surprising results of finite sample statistical estimation?
I'm trying to familiarize myself with the latest results in finite sample statistics. It seems to me that these results can be classified into two categories:
Unsurprising results confirm that the ...
- 395
10
votes
2
answers
674
views
Expectation of minimum of correlated Gaussian
What is the order of the following expectation with respect to $n$?:
$$\mathbb{E}(\min_{1\leq i\leq n}|z_i|^2)$$
where
$$(z_1,...,z_n)^T\sim N(0,I+11^T), 1=(1,1,...,1)^T$$
I know that when $z_i$ are ...
- 1,495
9
votes
5
answers
1k
views
estimate the error term in CLT
Let $X_m = \frac{1}{\sqrt{m}}\sum_{k=1}^m Z_k$ where $Z_k$ are iid equally likely on $\{\pm 1\}$. Then $X_m$ convergens to $X \sim \mathcal{N}(0,1)$ in distribution by CLT.
Let $f$ be a smooth ...
- 1,839
4
votes
1
answer
489
views
CLT convergence rate for sum of uniforms (in TV distance)
Suppose $X_1, \cdots, X_n \sim_{\mathrm{iid}} U([-1,1])$, where $U([-1, 1])$ denotes the continuous uniform distribution over the interval $[-1, 1]$ (so $E[X_i] = 0$ and $\text{Var}[X_i]= 1/3$). Let $...
- 43
4
votes
1
answer
478
views
Order statistic - Rate of convergence of a p-quantile to the expectation
Fix some $k\in\mathbb N$ and some probability $p\in[0,1]$. Denote with $F_n$ the cdf of the k-th highest oder statistic (i.e. the distribution of the k-th highest draw) of $n$ draws from a uniform ...
- 43
4
votes
1
answer
156
views
When does a gaussian quadratic form converge (in probability) to a constant?
Let $(h_{ij})_{i,j \in \mathbb N}$ be a sequence of real numbers (deterministic) and let $x_1,\ldots,x_n,\ldots$ be a sequence of iid $N(0,1)$ randm variables. For each positive integer $n$, consider ...
- 6,853
4
votes
1
answer
320
views
The power of chi-square test
Under the null hypothesis, if we have
$$\sqrt{n} \vec{x} \, \rightarrow_d \, N(0, I_p),$$
the test statistic can be construct as:
$$\hat{\Psi} = n \vec{x}^{\top} \vec{x} \, \rightarrow_d \,\chi^2_p.$$
...
- 331
4
votes
1
answer
124
views
The behavior of a uniform order statistic near zero
Let $X_{(k)}$ be the $k$th order statistic out of $n$ uniform $[0,1]$ random variables. Let $q$ be the location of the $p$ quantile of $X_{(k)}$, i.e. $\Pr[X_{(k)}\leq q] = p$. For small $p$, Is it ...
- 43
4
votes
0
answers
147
views
The asymptotic behavior of the ratio between the largest two of $n$ i.i.d. chi-square random variables
My question is about the asymptotic behavior of the ratio between the largest and second largest values of $n$ independent chi-square random variables.
Let $X_1, \ldots, X_n$ be $n$ independent and ...
- 1,127
3
votes
2
answers
505
views
Precise asymptotics for moments of order statistics of normal distribution
Let $X_1, \cdots, X_n \sim N(0,1)$ be i.i.d. normal random variates. I am interested in understanding the first two moments of the quasi-range $X_{(n)}-X_{(n-1)}$ (i.e., the maximum value minus the ...
- 151
3
votes
1
answer
271
views
For a random sequence $X_0, X_1, X_2, \ldots$ and $F_n$ the empirical CDF, does $F_n(X_0)$ converge to a uniform random variable?
Let $X_0, X_1, X_2, \ldots$ be a sequence of i.i.d. real-valued random variables on some probability space $(\Omega, \mathcal{F}, \mathbb{P})$ with continuous CDF $F(x)$ and define a sequence of ...
- 277
3
votes
2
answers
100
views
Left tail of convex combinations of $\chi_1^2$
Suppose $a_1,...,a_n\geq0, \sum_{i=1}^na_i=1$ and $Z_1,...,Z_n$ are i.i.d. standard normal, what is a sharp upper bound of the following probability as $\delta\to0$ and what is the order?
$$\mathbb{P}(...
- 1,495
3
votes
0
answers
82
views
Uniform mean-square-error estimates
Consider a standard statistical estimation problem with iid real observations $\{X_i\}_{i=1}^N$. For a collection of real functions $\mathcal{F}$, I want to get an estimate of the uniform rate of ...
- 111
2
votes
1
answer
99
views
Convergence of estimator given by a fixed point
Let $X$ be a non-negative random variable with cdf $F$ and define
$$G(s) = E[\max(0,u(X)-sX)],$$ where $u$ is some real function.
Let $s_0$ be the unique fixed point of $G$.
Now let $X_1,\dots,X_t$ ...
- 23
2
votes
1
answer
254
views
Asymptotic rate for the expected value of the square root of sample average
I have iid random variables $X_1, \dots, X_n$ with $X_i \geq 0$, $E[X_i]=1$ and $V[X_i] = \sigma^2$.
Let $S_n = \frac{\sum_{i=1}^n X_i}{n}$.
I'd like to say that $E[\sqrt{S_n}] = 1-O(1/n)$.
My first ...
- 167
2
votes
1
answer
79
views
Asymptotic rate of multivariate normal sample mean
I want to establish an asymptotic rate for the quantity $\|\bar{x} - \mu\|_2^2$. Here, $\bar{x} = \frac{1}{n} \sum_{i=1}^n x_i$ where $x_i$ are iid ${\rm N}_p(\mu, \Sigma)$ for $i=1,\dots, n$. Here, I ...
- 133
2
votes
0
answers
61
views
Approximate logarithmic bound on expected maximum via central limit theorem
If $Z_i$ are standard normal, possibly dependent, one can show that
$$E\left[\max_{i=1,...,M} Z_i^2\right]\leq 3\ln M + 1.$$
I'm looking for a similar (asymptotic) bound for asymptotically normal ...
- 203
2
votes
0
answers
60
views
Consistency of M-estimators when the constraint set also has to be estimated
Let $K \subset \mathbb R^n$ compact and convex. Also let $H$, $G_i, \; i \in \{1,\dotsc,m\} $: $K \to \mathbb R$ be convex functions.
Assume we have the following convex optimization problem:
$$
\...
- 123
2
votes
0
answers
71
views
Asymptotic results for functions of order statistics
There are $n$ ($n \ge 3$) iid random variables $\{ {c_i}\} _{i = 1}^n$ on the interval $[\underline c,\bar c]$ ($\underline c>0$). The cdf $F(\cdot)$ and pdf $f(\cdot)$ are unkown to us, but we ...
- 29
1
vote
1
answer
118
views
What is the order of the left tail of a mixture of non-central chi-square?
Let $\mu\sim N(0,1)$, $Z\sim N(\mu,1)$. Then $Z$ can be viewed as a mixture of Gaussians. It can also be viewed as a Gaussian but there is a prior for the mean.
Let $X\sim\exp(\lambda)$ where the ...
- 1,495
1
vote
0
answers
45
views
Is there a local limit theorem for functions of Gaussian random vectors?
Assume that $\sqrt{n} (\boldsymbol{Z}_n - \boldsymbol{\mu}) \stackrel{\mathcal{D}}{\longrightarrow} \mathcal{N}(\boldsymbol{0},\Sigma)$, as $n\to \infty$, for some $\boldsymbol{\mu}\in \mathbb{R}^d$ ...
- 219
1
vote
0
answers
35
views
The asymptotic properties of $V$-statistic for mixing multivariate process
Suppose $\{X_t\}_{t \in \mathbb{Z}} \subseteq \mathbb{R}^d$ is a $\alpha$- or $\rho$-mixing process. Let $h (x, y) : \mathbb{R}^d \times \mathbb{R}^d \rightarrow \mathbb{R}$ be the symmetric kernel ...
- 331
1
vote
0
answers
46
views
How to use the mixed normal distribution to construct a proper statistics?
For a random vector $\xi_n \in \mathbb{R}^p$, if $\xi_n \rightarrow_d N(\mu, \Sigma)$, we can construct
\begin{equation*}
\Psi := \xi_n^{\top} \widehat{\Sigma}^{-1} \xi_n
\end{equation*}
for ...
- 331
0
votes
2
answers
174
views
Asymptotic properties of ANOVA when the number of groups goes to infinity
Suppose
$$X_{ij} = \mu_j + \varepsilon_{ij}, \quad j = 1, \cdots, J, \quad i = 1, \cdots, N_j$$
ANOVA can allow us to test whether $\mu_1 = \cdots = \mu_J$.
In traditional ANOVA, however, the number ...
- 331
0
votes
1
answer
208
views
Local behavior of the Vandermonde convolution
An interesting combinatorial identity is the Vandermonde convolution identity:
$$ \sum_k {n\choose k}{m\choose s-k} = {n+m \choose s},$$
which can be proved by considering the coefficients in $(x+1)^{...
- 5,230
0
votes
1
answer
39
views
The nonparametric estimation in generalized regression model
Let $Y_t \in \mathbb{R}$ be a response variable and $X_t$ a $d$-dimensional explanatory variable. Assume we observe the process that $(X_1, Y_1), \cdots, (X_n, Y_n)$.
\begin{equation}
Y_{t} = \mu(...
- 331
0
votes
0
answers
173
views
The reason why a test is undersized?
Now I have a statistic $T_n$ for testing $H_0 \leftrightarrow H_1$, and I have proved that:
$$n T_n \rightarrow_d \chi_K^2$$
under $H_0$. Then an asymptotic $\chi^2$ test can be used, an asymptotic ...
- 331
0
votes
1
answer
70
views
Deriving asymptotic variance of generalized estimating equation estimator (GEE)
As well known to us, K.Y. Liang and S. Zeger proposed GEE for longitudinal data analysis in their famous paper[1]. At the appendix of the paper, authors show the proof of Theorem 2. I tried to ...
- 41