# Questions tagged [st.statistics]

Applied and theoretical statistics: e.g. statistical inference, regression, time series, multivariate analysis, data analysis, Markov chain Monte Carlo, design of experiments.

68 questions
8k views

2k views

3k views

### Correlation and Causation. When can we believe correlation (reasonably, at least) imply causation

We always hear, when reading on correlation, that "correlation does not imply causation." Still, I have never seen any source that tries to answer the question of when can we reasonably conclude a ...
21k views

### Distance metric between two sample distributions (histograms)

Context: I want to compare the sample probability distributions (PDFs) of two datasets (generated from a dynamical system). These datasets depend on a set of parameters, and I want a concise way to ...
2k views

### James-Stein phenomenon: What does it mean that a James-Stein estimator beats least squares estimator?

Background James-Stein estimator and Stein's phenomenon, as described in Wikipedia are rather counterintuitive and amazing. It is claimed that if one wants to estimate the mean $\Theta$ of Gaussian ...
508 views

### What are some of the surprising results of finite sample statistical estimation?

I'm trying to familiarize myself with the latest results in finite sample statistics. It seems to me that these results can be classified into two categories: Unsurprising results confirm that the ...
666 views

### How fast can extreme eigenvalues of the average of random matrices converge to their expectation?

Suppose that $X_1,X_2,\ldots,X_m$ are independent $d\times d$ random matrices and let $\overline{X} := \frac{1}{m}\sum_{i=1}^m X_i$. One of the questions studied under the theory of random matrices is ...
6k views

### Conjugate prior of the Dirichlet distribution?

What is the conjugate prior distribution of the Dirichlet distribution?
2k views

### randomness in nature [closed]

What is the explanation of the apparent randomness of high-level phenomena in nature? For example the distribution of females vs. males in a population (I am referring to randomness in terms of the ...
2k views

### Concentration inequalities for the maximum of the rescaled/normalized sum of iid random variables

I am interested in concentration inequalities for the maximum of the rescaled/normalized sum of iid random variables. Let $X_1,..., X_n$ be i.i.d random variables, $S_n$ their centered sum and $M_n$ ...
307 views

### Is there a combinatorial/topological treatment of statistical independence?

Is there any reference which studies sets of random variables as independence systems, a type of combinatorial object (see below)? Motivation: In particular, since independence systems are abstract ...
1k views

142 views

### Rate-Distortion theory: What is the distribution of distortion on an optimal Gaussian encoder?

If we wish to encode a gaussian source, $X\sim\mathcal{N}(0,\sigma^2)$ at rate $R$, then decode it to create an estimate $\hat{X}$, rate-distortion theory tells us that the lowest mean-squared-error ...
164 views

### Distributions over permutation groups $\mathcal{S}_n$

Partly inspired by recent developments in enumeration of pattern avoiding permutations, which is known to be connected with Brownian excursions [Hoffman&Rizzolo]. The exciting milestone is the ...
70 views

### Optimal linear measurement operator

Let $x\in R^n$ be an unknown vector. Suppose I am allowed to choose any $A\in R^{m\times n}$, under the constraint that each row of $A$ has $\ell_2$ norm at most $1$. Then I carry out a "measurement", ...
2k views

### Order statistics of independent NOT identically distributed random variables

I want to find the p.d.f of the n-th order statistics from a set of independent, but NOT identically distributed random variables $X_1, \dots, X_n$ (the p.d.f. of the $X_i$'s is at hand)
206 views

### Distribution of the Gram matrix

Let $\mathbf{X}$ be an $m\times k$ random matrix ($m>k$) of rank $k$, having the density function $f_\mathbf{X}(X)$. What is the distribution of $\mathbf{Y}=\mathbf{XX}^T$? Basically my question is ...
72 views

### Why the autoregressive process to generate random time series?

in order to test some forecasting methods, I desire to generate random time series. I'm about to use the AR(1) model: $X_k=\alpha X_{k-1}+ \epsilon_k$ With eventually: $\alpha>1$ How can I ...
369 views

### Mean -> Frechet mean, Standard deviation ->?

Given a finite set $A$ of points of a metric space $(X, d)$, I would like to find its mean. A Frechet mean seems appropriate here: $\arg \min_{x \in X} \sum_{a \in A} d(x, a)^2$. I also would like ...
957 views

### Finding number of independent variables in “statistical” dataset

I would like to know if there are any standard techniques (that I don't know about) to solve the following problem. Suppose we have $n$ variables, $\mathbf{q} = (a_1, a_2, \ldots, a_n)$, but not all ...
270 views

### Rademacher complexity of a Lipschitz class: Are the boundedness constraints necessary?

Consider the following function class: $F={f:R^d\rightarrow [a,b], f(x)=\sigma(w^Tx)}$ where $\sigma(.)$ is Lipschitz, and $w\in R^d$ is a parameter vector. The problem I'm working on is a machine ...