All Questions
Tagged with pr.probability random-matrices
478 questions
1
vote
0
answers
74
views
Asymptotically small submatrices of random matrices
Consider an ensemble of $N \times N$ random Hermitian matrices distributed according to some unitarily invariant measure
$$P(M) \mathrm{d}M = \frac{1}{Z_{N}} e^{-\mathrm{tr}[ Q(M)]}\mathrm{d}M,$$
for ...
- 131
3
votes
1
answer
98
views
Error bound for MonteCarlo estimate of elements in Gram-Matrix
Suppose I have a $n\times n$-symmetric positive-definite matrix $A$ with elements:
\begin{align}
[A]_{ij}=\int_{\Omega}f_i(x)f_j(x) \, dx, \quad i,j=1,\ldots,n
\end{align}
where $\Omega\subset \mathbb{...
- 93
0
votes
2
answers
135
views
Expectation of supremum of sub gaussians
I am trying to prove Lemma 2.3 of ON THE SPECTRAL NORM OF
GAUSSIAN RANDOM MATRICES, which states that
Let $X_1,\cdots,X_n$ be not necessarily independent random variables with $\mathbb{P}[X_i > x] ...
- 150
1
vote
0
answers
80
views
Moments from characteristic function for matrices
When $x$ is a random variable with the smooth characteristic function $\phi_x(t) = \mathbb{E}e^{itx}$, we can easily compute the moments as $\mathbb{E}[x^k] = i^{-n}\phi_x^{(n)}(0)$. There is no magic ...
- 193
1
vote
0
answers
43
views
Moments on the Stiefel manifold
Let $S_{n, k} = \{V \in \mathbb{R}^{n \times k} : V^T V = I_k\}$ denote the Stiefel manifold, $1 \leq k \leq n$.
Let $P \in \mathbb{R}^{n \times n}$ denote a symmetric real, positive definite matrix, ...
- 420
3
votes
0
answers
131
views
Matrix-Gaussian distributions
The point of this question is to ask for references on matrix-variate Gaussian distributions. But I will explain what I mean by a matrix-variate Gaussian with an example (the notion I have in mind is ...
- 193
8
votes
1
answer
428
views
Wishart matrices: are eigenvalues and eigenvectors independent?
Let $W = X^TX$ denote a standard Wishart matrix, i.e., where $X$ is a Gaussian random matrix with iid standard Normal entries.
In this case we can write $W = U D U^T$, where $U$ is orthogonal and $D$ ...
- 420
1
vote
1
answer
84
views
Limiting value of Stieltjes transform of sum of independent Wishart matrices
Let $n_1$, $n_2$, and $d$ positive integers tending to infinity such that $d/n_k \to \phi_k \in (0,\infty)$ and $n_1/(n_1+n_2) \to p \in (0,1)$. Let $X_k$ be an $n_k \times d$ random matrix with iid ...
- 6,853
2
votes
2
answers
192
views
Behavior of a Wishart quadratic form
Let $X \in \mathbb{R}^{n \times d}$ be a random matrix with iid standard Gaussian entries. Let $e_1$ denote the first canonical basis vector in $\mathbb{R}^d$. Define
$$
P_d(\lambda) = (1-\lambda) e_1 ...
- 420
3
votes
1
answer
146
views
Orthogonal projection $X X^+$ from random Gaussian matrix $X$
Given a standard Gaussian matrix $X\in\mathbb{R}^{n\times d}$, $d<n$, with entries sampled i.i.d. from $\mathcal{N}(0,1)$, is the corresponding orthogonal projection $X X^+ = X (X^\top X)^{-1} X^\...
0
votes
1
answer
159
views
Dot product of a randomly orientated vector and a fixed vector
Let us consider a random variable $Z$ with a probability density function $f$ with respect to the Haar measure on $\mathrm{SO}(3)$. Next, we consider two fixed normal vectors $u,v$ in $\mathbb{R}^3$. ...
user528399
0
votes
1
answer
108
views
RMT for modified Wishard matrix $Y'Y$ (where $i$th row of $Y$ is zero if $|x_i^\top u| \le \theta$; else it equals $x_i$)
Let $n$ and $d$ be positive integers tending to infinity such that $d/n \to \phi \in (0,\infty)$. Let $X$ be an $n \times d$ random matrix with iid rows $x_1,\ldots,x_n$ from $N(0, \Sigma)$, where $\...
- 6,853
-1
votes
1
answer
163
views
Is it true that if a random vector has independent coordinates each bounded by $1$ then $P[ \|X\| \leq \epsilon\sqrt{n}] \leq (C\epsilon)^{n}$?
I'm studying Vershynin's well-written book on "High Dimensional Probability" and the third chapter on concentration of random vectors.
Exercise 3.1.7 from the book is the following.
Let $X =...
- 401
1
vote
1
answer
99
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 33
1
vote
0
answers
92
views
Multilinear non-commutative Khintchine inequality
Let $g_1,\ldots,g_k$ be independent standard Gaussians and for each index $(i_1,\ldots,i_k)\in [n]^k$ let $A_{i_1,\ldots,i_k}$ be a $d\times d$ symmetric matrix.
Question: Is there a known bound for ...
- 156
1
vote
2
answers
66
views
Distribution of the constraint matrix conditioned on the solution of the linear system
Suppose that A is a random matrix in $R^{n\times n}$, with each component independently and identically distributed (iid) according to $\mathcal{N}(0,1)$. Additionally, b is a random vector in $R^n$, ...
- 33
0
votes
0
answers
35
views
Question about the spectrum of a deformed GOE matrix
Consider a fixed real value $\sigma>0$. Let $A,Z$ be two independent $n\times n$ GOE matrices, and define $B=A+\sigma Z$. I am interested in finding a bound (possibly dependent on $n$) for the ...
- 1
0
votes
1
answer
68
views
Convergence of edge eigenvalues for Gaussian matrices
I am reading this lecture note.
I have a difficulty in understanding the third section in chapter 6. Particularly, in Theorem 4.1, they claimed that
Let $X$ be a Gaussian Wigner matrix satisfying ...
- 129
0
votes
0
answers
42
views
Limiting value of trace of resolvent matrix involving two independent Wishart random matrices
Let $n_1$, $n_2$, and $d$ be positive integers tending to infinity such that
$$
d/n_k \to \phi_k \in (0,\infty).
$$
Let $X_1 \in \mathbb R^{n_1 \times d}$ and $X_2^{n_2 \times d}$ be independent ...
- 6,853
1
vote
2
answers
306
views
Joint moments like $\tau(XYXYXY)$ in terms of individual moments of free variables $X,Y$
Terry Tao RMT book has the following formula for joint moment of freely independent random variables $X,Y$ in Section 2.5
$$\tau(XYXY)=\tau(X)^2\tau(Y^2)+\tau(X^2)\tau(Y)^2-\tau(X)^2\tau(Y)^2$$
...
- 2,242
0
votes
0
answers
82
views
Conditional distributions of random orthogonal projection matrix
I have encountered a rather curious question.
Suppose I have a symmetric idempotent orthogonal projection matrix $A\in\mathbb R^{N\times N}$ that projects onto a uniformly random $n$-dimensional ...
- 319
1
vote
0
answers
77
views
Moment method / genus expansion for random matrices with i.i.d. entries
Given a (say real) random matrix $M=(M_{i,j})_{1\leq i, j \leq N}$, the moments method consists in computing (the limits in $N$ of) the quantities $$ \mathbb{E} \left(\mathrm{tr} M^k\right)^{1/k}, $$
...
- 31
1
vote
0
answers
72
views
Dimension-free sample complexity for the inverse of Gaussian sample covariance?
Suppose I have $m$ samples drawn from a Gaussian in $\mathbb{R}^n$, and need the inverse of the sample covariance $\Sigma_m^{-1}$ to be $\varepsilon$-close to true inverse covariance $\Sigma^{-1}$ (in ...
- 517
2
votes
1
answer
237
views
Expected norm of a product of Gaussian matrices
Suppose $C_n$ is a product of $n$ $d\times d$ matrices with IID entries coming from standard normal. The following appears to be true. Is there an elementary proof?
$$E[\|C_n\|_F^2]=d^{n+1}$$
This ...
- 2,242
7
votes
2
answers
347
views
Matrices over $\mathbb{F}_p$ that have nonzero determinant under any element permutation
$\DeclareMathOperator\GL{GL}$A few months ago, the following discussion took place on AoPS, concerning matrices that have nonzero determinant under any permutation of their entries: https://...
- 541
1
vote
0
answers
57
views
Limiting value of expectation of trace of truncated Gram matrix
Let $n$ and $d$ be large positive integers such that $d/n = a \in (0,1)$, fixed. Let $x_1,\ldots,x_n$ be iid random vectors from $N(0,I_d)$. Fix $b \in (0,1]$ and a unit-vector $v \in \mathbb R^d$, ...
- 6,853
9
votes
2
answers
496
views
Is there a determinantal point process proof of the Keating-Snaith formula for the cumulants of the log characteristic polynomial of a random matrix?
For $U$ a unitary $N \times N$ matrix, randomly distributed according to Haar measure, we have the complex-valued random variable $\log (\det (1-U))$. The real part and imaginary parts of $\log (\det (...
- 148k
1
vote
0
answers
67
views
Random matrix theory: accounting for mean
Assume a random matrix, denoted as $X$, which is an $n$ by $T$ matrix, $T\geq n$. While I understand the typical scenario where the random variables $X_{ij}$ are sampled from a $\mathcal{N}(0,\sigma_{...
1
vote
0
answers
94
views
Is there a way to linearize matrix quadratic forms?
Say $x$ is a random vector in $\mathbb{R}^n$. Then, given a (deterministic) symmetric real positive definite matrix $A$, if we want to calculate the expectation of the quadratic form, we can use the ...
- 420
8
votes
3
answers
509
views
Free probability: A unitary group heuristic for the relationship between additive free convolution and free compression
From one perspective, free probability is the study of how the eigenvalues of large random matrices interact under the basic matrix operations. The free probability operations of free additive ...
- 484
3
votes
1
answer
269
views
Trace of product of two Wishart matrices
Let $A,B$ be two independent complex Wishart matrices, $A,B\sim CW_p(\mathbf{I},n)$, that is $A=\frac1n GG^\dagger$& $B=\frac1n QQ^\dagger$ where $G$ and $Q$ are independent $p\times n$ complex ...
- 85
2
votes
0
answers
120
views
Random matrices may be asymptotically free but never free themselves?
It is well known that independent $N\times N$ unitarily-invariant random matrices (or independent families of random matrices) may be asymptotically free as $N\to \infty$ with respect to the ...
- 21
5
votes
1
answer
401
views
Lower tail of random rank one sums?
Let $\{x_i\}_{i\geq 1}$ be iid random elements of the sequence space $\ell^2(\mathbb{N})$;
assume that $\|x_i\|_2 \leq 1$ almost surely. Let $\Sigma = \mathbb{E}[x_1 \otimes x_1]$.
Define
$$
\Sigma_n =...
- 420
19
votes
0
answers
3k
views
+200
What does a product of many Gaussian matrices converge to?
Let $A$ be a product of $n$ $d\times d$ matrices with IID standard Gaussian entries and consider the value of $g(x)=x f(x)$ where $f(x)$ is the density of squared singular values of $A/\|A\|$.
Is ...
- 2,242
2
votes
0
answers
269
views
Singular values of Kronecker product of random matrices
I'm looking for a way to evaluate $\mathbb{E} \| (\mathbf{X} \mathbf{Q})^+ \|$ for a random matrix $\mathbf{X} \in \mathbb{R}^{r \times n}$ and a (fixed) matrix $\mathbf{Q} \in \mathbb{R}^{n \times \...
- 121
1
vote
1
answer
69
views
Expected value of MGIG distribution
I'm currently dealing with a Gibbs sampler of the multivariate generalized inverse Gaussian distribution (MGIG). In order to check the correctness of the sampler, I'd like to know the expected value ...
- 2,560
1
vote
1
answer
207
views
Anti-concentration inequality for the eigenvalue of Gaussian matrix
Let $f(x) = f(x_1, . . . , x_n)$ be a polynomial of degree $d$ and $\text{Var}[f] = 1$. One result by Carbery and Wright shows that for any $t\in\mathbb{R}$ and $ε > 0$,
$$
\text{Pr}_{x\sim N^n}[|f(...
- 91
0
votes
0
answers
112
views
Additivity of purity of random matrix products
Suppose $M$ is an $n\times n$ matrix with IID random entries drawn from $\mathcal{D}$ and $\sigma$ is the vector of its singular values. Define purity of $M$ as
$$\rho(M)=\frac{n \sum_i \sigma_i^4}{\...
- 2,242
6
votes
1
answer
274
views
Spectrum asymptotics for a product of $k$ random matrices?
How does the spectrum of a product of $k$ random matrices behave around 0?
In particular, I'm wondering if the CDF of squared singular values behaves as $x^{\frac{1}{k+1}}$ around 0. The result for $k=...
- 2,242
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
- 287
3
votes
1
answer
307
views
Request for references of random matrices
I need some good books aimed as a detailed and gentle introduction to random matrices, containing good discussion and derivation of Marchenko–Pastur distribution. Also, I request some other references ...
- 826
2
votes
0
answers
96
views
Limiting value of $\dfrac{1}{m}\mathrm{tr}(FAF^\top (FBF^\top)^{-1})$, where $F$ has iide $N(0,1)$ entries and $A,B$ are deterministic
Let $F=F_{m,d}$ be a random $m \times d$ matrix with iid entries from $N(0,1)$. Let $A=A_d$ and $B=B_d$ be deterministic $d \times d$ positive-definite matrices. In case it helps, it may be assumed ...
- 6,853
1
vote
0
answers
68
views
Limiting value of expectation of $\operatorname{tr}(BR(z))$, where $R(z) := (X^\top X - z I_d)^{-1}$ and $X \sim N_{n,d}(0,A)$
Let $A=A(d)$, and $B=B(d)$ be (sequences of) deterministic positive-definite $d \times d$ matrices and let $X$ be an $n \times d$ random matrix with iid rows from $N(0,A)$. Let $R$ be the resolvent of ...
- 6,853
0
votes
1
answer
77
views
Estimation on rotationally-disturbed random vectors
During developing a new statistical estimator, I faced the following problem.
Let $\mathbf{x}_i$ be a sequence of i.i.d. $d$-dimensional random vectors with
\begin{align*}
\mathbf{x}_i = \mathbf{O}...
- 284
2
votes
1
answer
328
views
Matrix Bernstein's inequality: from tail probability to expectation
Let $X_i$ be independent, mean zero, $n\times n$, symmetric random matrices. $\|X_i\|\leq K$ almost sure for $\forall I$.
We have matrix Bernstein's inequality for the tail probability as follows
$$\...
- 49
2
votes
0
answers
52
views
Trouble understanding a Lemma in Pastur's Paper
I'm having trouble understand Eq 3.51 Lemma 3.3 in https://arxiv.org/pdf/2001.06188.pdf
The basic premise is
$$\begin{align}
&\eta _{j}(t)=t^{1/2}\eta _{j}+(1-t)^{1/2}q_{n}^{1/2}\gamma _{j},
\;t \...
- 121
2
votes
0
answers
129
views
Large deviation principle for product of iid bounded symmetric random variables
Let $n$ and $k$ be positive integers. Let $X$ be the empirical mean of $n$ iid Rademacher random variables. Note that the distribution of $X$ is symmetric about 0, and also $|X| \le 1$ w.p 1. Let $X_1,...
- 6,853
1
vote
1
answer
195
views
Concentration of a certain simple / well-structured random multilinear polynomial with growing degree
Let $k$ and $N_1$ be positive integers and set $N=kN_1$. Partition $[N] := \{1,2,\ldots,N\}$ $k$ disjoint from $G_1,\ldots,G_k$ of each of size $N_1$, and let $\mathcal T(k,N_1)$ be a transversal of ...
- 6,853
1
vote
1
answer
91
views
Density of eigenvalues of empirical covariance matrix of vectors uniform on the sphere
Is anyone able to point me to a reference for this?
Let the rows of $X \in \Re^{n\times d}$ be i.i.d. uniform on the sphere of radius $\sqrt{d}$ in $\Re^d$. What is the density of the eigenvalues of $...
- 337
0
votes
0
answers
60
views
Norms of Wigner matrices under power law decay
Suppose $\Sigma=\operatorname{diag}(h)$ where $h=(1^{-p},2^{-p},3^{-p},\ldots,d^{-p})$ and $p> 1$
$X$ is a matrix with $b$ rows sampled independently from $\operatorname{Normal}(0,\Sigma)$
Suppose $...
- 2,242