All Questions
74 questions
40
votes
1
answer
5k
views
When should we expect Tracy-Widom?
The Tracy-Widom law describes, among other things, the fluctuations of maximal eigenvalues of many random large matrix models. Because of its universal character, it obtained his position on the ...
- 2,135
15
votes
2
answers
6k
views
Distribution of inverse of a random matrix
I got stuck into a problem and couldn't find its
satisfactory answer anywhere.
My question is simple. Suppose I have a fat random matrix (i,e., $R$ has dimensions $k\times d$ where $k<d$) whose
...
- 151
12
votes
1
answer
628
views
A function with unexpectedly simple Legendre transformation
Let $I(x) = \frac{1}{2\pi} \int_{-2}^2 \sqrt{4-y^2}\ln|x-y|dy$. Then $I(x)$ is a concave function and
\begin{equation}
I(x)=
\begin{cases}
\frac{1}{4}x^2-\frac{1}{2}, &\text{if } |x|\leq2 \\
\...
- 1,608
11
votes
8
answers
2k
views
Semicircle law universality elsewhere
Wigner's semicircle distribution is:
$$f(x)=\frac{1}{2 \pi}\sqrt{4-x^2}, \ \ -2\leq x\leq 2.$$
Under reasonable conditions, the rescaled eigenvalue density of random symmetric matrices $M_n$ follows ...
- 4,952
9
votes
1
answer
886
views
Concentration of sum of powers of normals
Let $Z_1,Z_2,\ldots,Z_n$ be i.i.d. copies of a random variable $Z$ distributed as $\frac{1}{\sqrt{2}}X+i\frac{1}{\sqrt{2}}Y$ with $X$ and $Y$ independent standard Normal random variables i.e.~$X\sim\...
- 859
8
votes
1
answer
227
views
Distribution of entries of a doubly-sorted random matrix
Take an $n \times n$ random matrix whose entries are i.i.d. with uniform distribution in $[0,1]$. Look at the sums of the elements of each row and then permute the rows so that these sums form an ...
- 2,479
8
votes
1
answer
552
views
Frobenius norm of the principal submatrix of a uniformly distributed random orthonormal matrix
Suppose that we have a uniformly distributed $d\times d$ random orthonormal matrix $\mathbf{X}$. Here "uniform" is defined in the sense of Haar measure, i.e., the distribution does not change up to ...
- 1,127
8
votes
1
answer
2k
views
Eigenvalue distributions of finite dimensional Wishart matrices
I am trying to obtain the eigenvalue distribution of a finite dimensional Wishart matrix. Let $A_{n\times n}\sim\mathbb{W}(\Sigma_{n\times n},m)$ where $\mathbb{W}(\Sigma_{n\times n},m)$ denotes the ...
7
votes
0
answers
759
views
Product of two random Gaussian matrices - orthant probability
Let $X \in \mathbb{R}^{m \times n}$ and $Y \in \mathbb{R}^{n \times k} $ be two independent Gaussian random matrices, i.e., with entries independently sampled from $\mathcal{N}(0,1)$ (a normal ...
- 968
7
votes
0
answers
179
views
Can one "smooth over" k-wise independence to get actual independence?
I came across the following toy problem and was curious if there was a simple solution or counterexample. Suppose you have a distribution $p$ on $m$ random variables $X_1, \ldots, X_m$, each with ...
- 91
6
votes
2
answers
3k
views
Weak convergence of random measures
Let $\mu_n,n\in \mathbb N$ be a random probability measures and let $\mu$ be a deterministic probability measure on $\mathbb R$. That is to say, that the $\mu_n$ are measurable maps from a probability ...
- 255
6
votes
1
answer
894
views
Expected value of orthogonal projection $X^{+}X$
Let $X\in\mathbb{R}^{m\times n}$, where $m<n$, be a random matrix where the rows $x_i$ ($i=1,...,m$) are sampled i.i.d. from Gaussian distribution with mean $0$ and covariance $\Sigma$, i.e. $x_i\...
- 161
6
votes
2
answers
2k
views
Marginal distribution of the diagonal of an inverse Wishart distributed matrix
This is a cross-posting of a question I asked at CrossValidated. It hasn't generated much activity so I'm trying here:
Suppose $X\sim \operatorname{InvWishart}(\nu, \Sigma_0)$. I'm interested in the ...
- 269
5
votes
1
answer
3k
views
Eigenvalues and eigenvectors of Gaussian random matrices
Let us assume we have a square matrix $A$ whose entries are sampled from a standard Gaussian distribution of mean $0$. Do we have any information about the distribution of its eigenvalues?
...
- 899
5
votes
2
answers
294
views
Estimate on lowest eigenvalue in GOE
I was wondering if there is an explicit estimate on the probability that the lowest eigenvalue of a $n \times n$ GOE matrix is larger than some number $x \in \mathbb{R}$. I am aware of the fact that ...
- 167
5
votes
1
answer
765
views
Measure concentration for weakly dependent random variables
For an application quite alien to probability theory, I'd like to have a kind of measure concentration estimate, in the following spirit. Suppose that to every $1\le i,j\le n$ there corresponds a zero-...
- 23k
5
votes
0
answers
239
views
Expected value of $X^{\top}(XAX^{\top})^{-1}X$ for large random $X$
Let $X\in \mathbb{R}^{m\times n}$ be a random matrix where the entries are i.i.d. standard normal, and let $A\in \mathbb{R}^{n\times n}$ be a deterministic diagonal matrix with positive entries on the ...
- 161
4
votes
1
answer
637
views
Characterizations of the GOE/GUE family of distributions
This question is somewhat related to this one. Loosely speaking, when should I expect a GOE/GUE distribution? The angle of my approach to this is not through statements such as "there is a natural ...
- 4,952
4
votes
1
answer
214
views
Rates of convergence to Tracy-Widom?
$\renewcommand{\!}{\mathbf}
\renewcommand{\Ai}{\operatorname{Ai}}$
One can define the Tracy-Widom distribution as the Fredholm determinant $F_2(t)=\det(\mathbf I-\mathbf A)$ where
$$\mathbf A(x, y)=\...
- 831
4
votes
0
answers
75
views
Marginalization of Wishart distribution
Consider the following Wishart distribution
$$
f({\bf W}) = \frac{ |{\bf W}|^{(n-p-1)/2} \exp\big[-\frac{1}{2}\text{tr}({\bf V}^{-1}{\bf W} ) \big] }{2^{np/2} |{\bf V}| \Gamma_p(\frac{n}{2})} \tag{1}
$...
3
votes
2
answers
512
views
Fourier transform of eigenvalue distribution of GUE matrices
I am interested in explicit expression or bounds for the Fourier transform (characteristic function) of the joint probability distribution of eigenvalues of random matrices $X\sim \mathrm{GUE} (d)$, ...
- 965
3
votes
1
answer
178
views
Tail probability of random projection
Suppose $v\in R^n$ is a constant unit vector. $P_l$ is a random projection matrix to an $l$ dimensional subspace of $R^n$ which is uniformly sampled from $G(l,R^n)$ which is the collection of all $l$-...
- 1,495
3
votes
1
answer
269
views
Trace of product of two Wishart matrices
Let $A,B$ be two independent complex Wishart matrices, $A,B\sim CW_p(\mathbf{I},n)$, that is $A=\frac1n GG^\dagger$& $B=\frac1n QQ^\dagger$ where $G$ and $Q$ are independent $p\times n$ complex ...
- 85
3
votes
1
answer
711
views
Expectation of Mahalanobis norm
Let $(g_i)_{i=1,...,d}$ sampled i.i.d. from a standard Gaussian, and $(\lambda_i)_{i=1,...,d}$ non-random s.t. $\max_i(\lambda_i)=1$ and $\lambda_i>0, \forall i$.
I am looking for the expectation ...
- 517
3
votes
0
answers
131
views
Matrix-Gaussian distributions
The point of this question is to ask for references on matrix-variate Gaussian distributions. But I will explain what I mean by a matrix-variate Gaussian with an example (the notion I have in mind is ...
- 193
3
votes
0
answers
334
views
Tail bound on trace norm / nuclear norm / Schatten-1 norm of Rademacher matrix
Let $0 < r \leq d$ integers. Let $X$, $Y$ be $d \times r$ matrices of independent Rademacher variables, that is, $X,Y \in \mathbb{R}^{d \times r}$ with entries $\pm1$ with probability $1/2$. I am ...
- 223
3
votes
0
answers
267
views
Conditional distributions of uniformly distributed random orthonormal matrices
Let $U, U'\in R^{d\times k} (d>k)$ be two independent uniformly distributed random orthonormal matrices. In specific, let $S$ be the set of all $d\times k$ orthonormal matrices. Here 'uniform' is ...
- 1,127
2
votes
1
answer
185
views
Limiting distribution of "scatter matrix" $\frac{1}{n}XX^T:=\frac{1}{n}\sum_{i=1}^nx_ix_i^T$ for iid $x_1,\ldots,x_n \in \mathbb R^p$
Let $x_1,\ldots,x_n$ be drawn iid from such "nice" distribution on $\mathbb R^p$ (but possibly very general!), and let $X$ be the $n$-by-$p$ matrix formed by vertically stacking the $x_i$'s.
...
- 6,853
2
votes
1
answer
210
views
Marcenko-Pastur and Tracy-Widom laws for sample covariance and Gram matrices when the "features" are correlated: references
Let us assume we've a rectangular data matrix $X=[x_1 \dots x_n] \in \mathbb{R}^{p \times n}$, where the $x_i \in \mathbb{R}^{p \times 1}$ are iid column vectors. I'm not assuming here that the ...
- 1,467
2
votes
2
answers
854
views
Eigenvalue distribution of a random matrix
Is there any closed form distribution formula for the distribution of the eigenvalues of $\mathbf{X}^\mathrm{H}\mathbf{X}$ where the entries of $\mathbf{X}$ are independent Gaussian random variables ...
- 287
2
votes
1
answer
263
views
Probability distribution of uAv…
Consider the complex domain ℂ. If U and V are 2 unitary random matrices and A is a deterministic matrix.
What is the distribution of $u^HAv$ ( or $||u^HAv||^2$)
where : u is a column vector of U. v ...
- 233
2
votes
2
answers
1k
views
Uniform correlation matrix sampling and not so uniform laws
Hi everyone,
I am looking for a way of simulating correlation matrices of fixed dimension in (at least) two ways.
First, I would like to determine the "uniform" distribution over the "correlation ...
- 1,334
2
votes
1
answer
904
views
Diagonalizability of Gaussian random matrices
Let $X$ be an $n\times n$ matrix whose elements are i.i.d. sampled from a normal distribution of zero mean and unit variance. Is $X$ diagonalizable over $\mathbb{C}$ with probability 1? Is there a ...
- 123
2
votes
1
answer
900
views
Asymptotically tight concentration of norms of subgaussian random vectors with independent coordinates, as the dimension $n \to \infty?$
Let $X=(X_1 \dots X_n)\in \mathbb{R}^n,$ be a subgaussian random vector so that $X_i$'s are independent, $\mathbb{E}X_i = 0, \mathbb{E}X_i^2=1.$ Before we pose our question, let's state the following:
...
- 1,467
2
votes
1
answer
1k
views
Bound on eigenvalues of sample covariance matrices in terms of $d, n$, where $n=$ sample size, $d=$ dimension of data
Let $Z=[z_1, \dots z_n]$ be a $d \times n$ matrix, where the $z_i$'s are iid random vactors with mean $\mu \in \mathbb{R}^d$ and $d \times d$ (population) covariance matrix $\Sigma$, but the entries $...
- 1,467
2
votes
1
answer
206
views
Density of random matrix only depends on its spectrum
Suppose a random positive definite matrix $A\in\mathbb{R}^{n\times n}$ has density function (with respect to the lebesgue measure on $\mathbb{R}^{n(n+1)/2}$) $f(A)=g(\lambda_1(A),...,\lambda_n(A))$ ...
- 1,495
2
votes
2
answers
144
views
Spectrum of finite-band random matrices?
Let
$X_n=(X_{ij})_{1 \leq i,j \leq n}$ such that :
$$ \begin{cases}
&X_{ij} = 0 \quad \text{if}\quad \vert i - j \vert > k\\
& X_{ij} \sim P_X \quad \text{otherwise}
\end{cases}$$
And ...
- 245
2
votes
1
answer
1k
views
Concentration of the norm of subGaussian random vectors
I will use the same notation and definitions in High Dimensional Probability, by Roman Vershynin.
I have a sub-Gaussian vector $y$, in $\mathbb{R}^n$ and sub-Gaussian norm $C$ non dependent on $n$. I ...
- 21
2
votes
1
answer
760
views
Show the coordinate distribution has a very large sub-gaussian norm
Consider a random vector X with the coordinate distribution is uniformly distributed in the set $\{\sqrt{n}e_i : i = 1,..., n\}$, where $e_i$ denotes the n-element set of the canonical basis vectors ...
- 23
2
votes
0
answers
123
views
Modified Wigner semicircle law
The Wigner semicircle law states that for a random GOE-matrix $M^N \in \mathbb{R}^{N \times N}$ in the $N \rightarrow \infty$ limit for any $f \in C^b(\mathbb{R})$
$$\lim_{N \rightarrow \infty}\frac{...
user118408
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
- 287
1
vote
1
answer
122
views
Expectation value of random GUE matrix
Let $A$ be a matrix of the Gaussian unitary ensemble (GUE) and $v_1,v_2$ be two orthonormal vectors.
I wonder if one can compute (or at least get a non-trivial lower bound on) the expectation value
$$\...
- 73
1
vote
1
answer
157
views
Moments of rescaled Bernoulli random matrix
Suppose $X \in \{0,1\}^{n \times m}$ is a matrix generated according to the following generative process:
$$Z_{ij} \sim \text{Bernoulli}(p) \implies X_{ij} = \frac{Z_{ij}}{\sum_{k=1}^m Z_{ik}}.$$
Is ...
- 269
1
vote
1
answer
99
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 33
1
vote
1
answer
226
views
Orthogonal transformation of multivariate Bernoulli-Gaussian distribution
Actually, I have asked this question in https://math.stackexchange.com/questions/4330127/orthogonal-transformation-of-multivariate-bernoulli-gaussian-distribution, but I think mathoverflow might be ...
- 21
1
vote
1
answer
217
views
How to normalize an Inverse Wishart random matrix?
Background:
Let $d\in \mathbb{N}$.
Define the space of (real symmetric) positive definite matrices of size $d\times d$ as follows:
\begin{align}
\mathcal{S}_{++}^d := \big\{\mathbb{M}\in \mathbb{R}^{d\...
- 219
1
vote
1
answer
131
views
Large scale analysis of matrix multiplications
Let $\mathbf{A}_{m\times n}$ and $\mathbf{B}_{m\times n}$ be two random i.i.d matrices with zero mean and unit variance. Then, are the following large-scale analysis true (m,n go to infinity with ...
- 287
1
vote
1
answer
104
views
Limit of normalized sum of Dirac measures at first $\lfloor p/2\rfloor$ eigenvalues of the sample covariance matrix, with Marcenko-Pastur assumptions?
Let $\lfloor{*}\rfloor$ denotes the nearest integer $\le *$. I'm asking myself the question what's the limit of the part of the empirical spectral distribution corresponding to the first $\lfloor{p/2}...
- 1,467
1
vote
1
answer
193
views
Random matrix properties
Let $\mathbf{H}_{N,K}$ be a random matrix whose entries are i.i.d complex Gaussian random variables with variance $1$. Then, we know from the law of large number that if $N,K\rightarrow\infty$, we ...
- 287
1
vote
1
answer
74
views
Joint density of a quadratic function of entries of orthogonal matrix
$U=(U_{ij})_{1\leq i,j\leq m},V=(V_{ij})_{1\leq i,j\leq m}$ are independently and uniformly distributed on the orthogonal group $O(m)$. For any positive integer $k,n$ such that $1\leq k\leq n\leq m$, ...
- 1,495