All Questions
Tagged with pr.probability random-matrices
478 questions
20
votes
0
answers
3k
views
+200
What does a product of many Gaussian matrices converge to?
Let $A$ be a product of $n$ $d\times d$ matrices with IID standard Gaussian entries and consider the value of $g(x)=x f(x)$ where $f(x)$ is the density of squared singular values of $A/\|A\|$.
Is ...
- 2,252
1
vote
1
answer
160
views
Given iid $w_1,\dotsc,w_N \sim N(0,1/d)$ iid, find a simple matrix $A$ s.t $\|aa^T-A\|_\text{op}\to0$, where $a_i := E_{G \sim N(0,1)}[f(\|w_i\| G)]$
Let $d$ and $N$ be two large comparable integers, for example assume
$$
N,d \to \infty, \quad d/N \to \gamma \in (0,\infty).
$$
Let $w_1,\dotsc,w_N$ be iid from $N(0,(1/d)I_d)$ and let $f:\mathbb R \...
- 12.9k
0
votes
1
answer
68
views
Convergence of edge eigenvalues for Gaussian matrices
I am reading this lecture note.
I have a difficulty in understanding the third section in chapter 6. Particularly, in Theorem 4.1, they claimed that
Let $X$ be a Gaussian Wigner matrix satisfying ...
- 63.9k
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
CommunityBot
- 1
2
votes
1
answer
329
views
Matrix Bernstein's inequality: from tail probability to expectation
Let $X_i$ be independent, mean zero, $n\times n$, symmetric random matrices. $\|X_i\|\leq K$ almost sure for $\forall I$.
We have matrix Bernstein's inequality for the tail probability as follows
$$\...
CommunityBot
- 1
12
votes
1
answer
628
views
A function with unexpectedly simple Legendre transformation
Let $I(x) = \frac{1}{2\pi} \int_{-2}^2 \sqrt{4-y^2}\ln|x-y|dy$. Then $I(x)$ is a concave function and
\begin{equation}
I(x)=
\begin{cases}
\frac{1}{4}x^2-\frac{1}{2}, &\text{if } |x|\leq2 \\
\...
CommunityBot
- 1
2
votes
1
answer
415
views
High-probability lower bound for norm of least squares solution when both design matrix $X$ and response vector $y$ are random (and independent)
Let $n,d \to \infty$ with $n/d \to \gamma \in (0,\infty)$. Let $X$ be a random $n \times d$ matrix independent rows uniformly distributed on the the unit-sphere in $\mathbb R^d$ and let $y$ be a ...
CommunityBot
- 1
2
votes
1
answer
1k
views
Concentration of the norm of subGaussian random vectors
I will use the same notation and definitions in High Dimensional Probability, by Roman Vershynin.
I have a sub-Gaussian vector $y$, in $\mathbb{R}^n$ and sub-Gaussian norm $C$ non dependent on $n$. I ...
CommunityBot
- 1
8
votes
2
answers
547
views
Concentration inequality for minimal eigenvalue of sample covariance
I was reading an article of matrix completion and met the following lemma
The concentration inequality for $\sigma_{\max}$ part is a standard result. However, I didn't find any results like the $\...
CommunityBot
- 1
1
vote
1
answer
415
views
Approximate the singular values of a certain random dot-product kernel matrix (in the sense of El Karoui, Cheng-Singer, etc.)
Let $g:\mathbb R \to \mathbb R $ be a continuous function which is
"sufficiently smooth" (e.g $\mathcal C^3$) around $0$, and
"sufficiently integrable" (e.g integrable w.r.t $N(0,...
CommunityBot
- 1
0
votes
1
answer
108
views
RMT for modified Wishard matrix $Y'Y$ (where $i$th row of $Y$ is zero if $|x_i^\top u| \le \theta$; else it equals $x_i$)
Let $n$ and $d$ be positive integers tending to infinity such that $d/n \to \phi \in (0,\infty)$. Let $X$ be an $n \times d$ random matrix with iid rows $x_1,\ldots,x_n$ from $N(0, \Sigma)$, where $\...
CommunityBot
- 1
1
vote
0
answers
74
views
Asymptotically small submatrices of random matrices
Consider an ensemble of $N \times N$ random Hermitian matrices distributed according to some unitarily invariant measure
$$P(M) \mathrm{d}M = \frac{1}{Z_{N}} e^{-\mathrm{tr}[ Q(M)]}\mathrm{d}M,$$
for ...
- 131
4
votes
1
answer
332
views
Asymptotic limit of trace of random matrix $(aI_m + WW^\top)^{-1}$, where $W$ has iid rows from $N(0,\Sigma)$
Let $m$ and $d$ be positive integers with $m,d \to \infty$ such that $m/d \to \rho \in (0,\infty)$. Let $W$ be a random $m \times d$ matrix with iid rows $w_1,\ldots,w_m \sim N(0,\Sigma)$ for a ...
CommunityBot
- 1
22
votes
1
answer
1k
views
Random distance matrices
My question is motivated by the following recent paper:
Gadgil, Siddhartha; Krishnapur, Manjunath, Lipschitz correspondence between metric measure spaces and random distance matrices, Int. Math. Res. ...
- 6,367
3
votes
1
answer
98
views
Error bound for MonteCarlo estimate of elements in Gram-Matrix
Suppose I have a $n\times n$-symmetric positive-definite matrix $A$ with elements:
\begin{align}
[A]_{ij}=\int_{\Omega}f_i(x)f_j(x) \, dx, \quad i,j=1,\ldots,n
\end{align}
where $\Omega\subset \mathbb{...
- 128k
15
votes
2
answers
6k
views
Distribution of inverse of a random matrix
I got stuck into a problem and couldn't find its
satisfactory answer anywhere.
My question is simple. Suppose I have a fat random matrix (i,e., $R$ has dimensions $k\times d$ where $k<d$) whose
...
CommunityBot
- 1
0
votes
2
answers
135
views
Expectation of supremum of sub gaussians
I am trying to prove Lemma 2.3 of ON THE SPECTRAL NORM OF
GAUSSIAN RANDOM MATRICES, which states that
Let $X_1,\cdots,X_n$ be not necessarily independent random variables with $\mathbb{P}[X_i > x] ...
- 128k
8
votes
1
answer
428
views
Wishart matrices: are eigenvalues and eigenvectors independent?
Let $W = X^TX$ denote a standard Wishart matrix, i.e., where $X$ is a Gaussian random matrix with iid standard Normal entries.
In this case we can write $W = U D U^T$, where $U$ is orthogonal and $D$ ...
- 1,295
3
votes
1
answer
379
views
Concentration inequality for norm of solution to nonlinear least-squares problem
Define the piecewise-linear function $\psi(t):=\max(t,0)$ for all $t \in \mathbb R$.
Let $d,n,k \to \infty$ at the same rate (i.e $n \asymp k \asymp d$).
Let $y_1,\ldots,y_n \in \{-1,1\}$ uniformly ...
CommunityBot
- 1
1
vote
1
answer
69
views
Expected value of MGIG distribution
I'm currently dealing with a Gibbs sampler of the multivariate generalized inverse Gaussian distribution (MGIG). In order to check the correctness of the sampler, I'd like to know the expected value ...
CommunityBot
- 1
1
vote
1
answer
245
views
expectation of the function of Wishart matrix eigenvalues
For Given a $N×M$ random complex gaussian matrix $X$ where $M=XX^H$, let $\lambda_1>\lambda_2>\cdots>\lambda_N$ be the ordered eigenvalues of $M$ my objective is to get an estimation of
$$
f =...
1
vote
0
answers
80
views
Moments from characteristic function for matrices
When $x$ is a random variable with the smooth characteristic function $\phi_x(t) = \mathbb{E}e^{itx}$, we can easily compute the moments as $\mathbb{E}[x^k] = i^{-n}\phi_x^{(n)}(0)$. There is no magic ...
CommunityBot
- 1
3
votes
0
answers
131
views
Matrix-Gaussian distributions
The point of this question is to ask for references on matrix-variate Gaussian distributions. But I will explain what I mean by a matrix-variate Gaussian with an example (the notion I have in mind is ...
- 193
1
vote
0
answers
43
views
Moments on the Stiefel manifold
Let $S_{n, k} = \{V \in \mathbb{R}^{n \times k} : V^T V = I_k\}$ denote the Stiefel manifold, $1 \leq k \leq n$.
Let $P \in \mathbb{R}^{n \times n}$ denote a symmetric real, positive definite matrix, ...
- 420
3
votes
2
answers
512
views
Fourier transform of eigenvalue distribution of GUE matrices
I am interested in explicit expression or bounds for the Fourier transform (characteristic function) of the joint probability distribution of eigenvalues of random matrices $X\sim \mathrm{GUE} (d)$, ...
- 188k
1
vote
1
answer
84
views
Limiting value of Stieltjes transform of sum of independent Wishart matrices
Let $n_1$, $n_2$, and $d$ positive integers tending to infinity such that $d/n_k \to \phi_k \in (0,\infty)$ and $n_1/(n_1+n_2) \to p \in (0,1)$. Let $X_k$ be an $n_k \times d$ random matrix with iid ...
- 6,853
2
votes
2
answers
192
views
Behavior of a Wishart quadratic form
Let $X \in \mathbb{R}^{n \times d}$ be a random matrix with iid standard Gaussian entries. Let $e_1$ denote the first canonical basis vector in $\mathbb{R}^d$. Define
$$
P_d(\lambda) = (1-\lambda) e_1 ...
- 420
7
votes
2
answers
1k
views
Why is the spectrum of Erdős–Renyi random graph approximately symmetric?
I am recently self-learning random matrix theory and made some simulations about the spectrum of Erdős–Renyi random graph $G(n,p)$ when $np\to\infty$,
and $np\to c=2,3$.
The plots above are already ...
- 5,405
7
votes
2
answers
604
views
Minimizing the largest eigenvalue of random matrices
Let $A \in \mathbb{R}^{n \times n}$ be a symmetric matrix with entries $A_{ij} \sim \mathcal{N} (0,1)$, all independent except for the symmetry condition.
Consider the following minimization problem:...
CommunityBot
- 1
3
votes
1
answer
146
views
Orthogonal projection $X X^+$ from random Gaussian matrix $X$
Given a standard Gaussian matrix $X\in\mathbb{R}^{n\times d}$, $d<n$, with entries sampled i.i.d. from $\mathcal{N}(0,1)$, is the corresponding orthogonal projection $X X^+ = X (X^\top X)^{-1} X^\...
- 128k
0
votes
1
answer
159
views
Dot product of a randomly orientated vector and a fixed vector
Let us consider a random variable $Z$ with a probability density function $f$ with respect to the Haar measure on $\mathrm{SO}(3)$. Next, we consider two fixed normal vectors $u,v$ in $\mathbb{R}^3$. ...
- 188k
20
votes
6
answers
19k
views
Intuition for Haar measure of random matrix
What is an intuitive way to understand Haar measure as defined for random matrices, say, $N\times N$ orthogonal or unitary matrices?
My understanding for what Haar measure means for $U(1)$ is that it ...
- 12.9k
-1
votes
1
answer
163
views
Is it true that if a random vector has independent coordinates each bounded by $1$ then $P[ \|X\| \leq \epsilon\sqrt{n}] \leq (C\epsilon)^{n}$?
I'm studying Vershynin's well-written book on "High Dimensional Probability" and the third chapter on concentration of random vectors.
Exercise 3.1.7 from the book is the following.
Let $X =...
- 401
1
vote
1
answer
99
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 3,741
1
vote
0
answers
92
views
Multilinear non-commutative Khintchine inequality
Let $g_1,\ldots,g_k$ be independent standard Gaussians and for each index $(i_1,\ldots,i_k)\in [n]^k$ let $A_{i_1,\ldots,i_k}$ be a $d\times d$ symmetric matrix.
Question: Is there a known bound for ...
- 156
1
vote
2
answers
66
views
Distribution of the constraint matrix conditioned on the solution of the linear system
Suppose that A is a random matrix in $R^{n\times n}$, with each component independently and identically distributed (iid) according to $\mathcal{N}(0,1)$. Additionally, b is a random vector in $R^n$, ...
- 128k
0
votes
0
answers
35
views
Question about the spectrum of a deformed GOE matrix
Consider a fixed real value $\sigma>0$. Let $A,Z$ be two independent $n\times n$ GOE matrices, and define $B=A+\sigma Z$. I am interested in finding a bound (possibly dependent on $n$) for the ...
- 1
0
votes
0
answers
42
views
Limiting value of trace of resolvent matrix involving two independent Wishart random matrices
Let $n_1$, $n_2$, and $d$ be positive integers tending to infinity such that
$$
d/n_k \to \phi_k \in (0,\infty).
$$
Let $X_1 \in \mathbb R^{n_1 \times d}$ and $X_2^{n_2 \times d}$ be independent ...
- 6,853
1
vote
2
answers
306
views
Joint moments like $\tau(XYXYXY)$ in terms of individual moments of free variables $X,Y$
Terry Tao RMT book has the following formula for joint moment of freely independent random variables $X,Y$ in Section 2.5
$$\tau(XYXY)=\tau(X)^2\tau(Y^2)+\tau(X^2)\tau(Y)^2-\tau(X)^2\tau(Y)^2$$
...
0
votes
0
answers
82
views
Conditional distributions of random orthogonal projection matrix
I have encountered a rather curious question.
Suppose I have a symmetric idempotent orthogonal projection matrix $A\in\mathbb R^{N\times N}$ that projects onto a uniformly random $n$-dimensional ...
1
vote
0
answers
78
views
Moment method / genus expansion for random matrices with i.i.d. entries
Given a (say real) random matrix $M=(M_{i,j})_{1\leq i, j \leq N}$, the moments method consists in computing (the limits in $N$ of) the quantities $$ \mathbb{E} \left(\mathrm{tr} M^k\right)^{1/k}, $$
...
- 31
4
votes
2
answers
1k
views
Expectation of the trace of inverse of a Gaussian random matrix
Given a $N×M$ random complex gaussian matrix $X$ and $N×K$ random complex gaussian matrix $Y$ I'm interested in approximating the expectation expressed as:
\begin{align}
E[trace({(aX{X^H} + I)^{ - ...
- 6,853
1
vote
0
answers
72
views
Dimension-free sample complexity for the inverse of Gaussian sample covariance?
Suppose I have $m$ samples drawn from a Gaussian in $\mathbb{R}^n$, and need the inverse of the sample covariance $\Sigma_m^{-1}$ to be $\varepsilon$-close to true inverse covariance $\Sigma^{-1}$ (in ...
16
votes
4
answers
597
views
The lattice spanned by $m$ random 0-1 vectors of length $n$
Consider $m$ random 0-1 vectors of length $n$. Let $L$ be the lattice spanned by them. What is the value of $m$ (as a function of $n$) for which it is true with positive probability that $L=Z^n$? More ...
- 4,219
7
votes
2
answers
347
views
Matrices over $\mathbb{F}_p$ that have nonzero determinant under any element permutation
$\DeclareMathOperator\GL{GL}$A few months ago, the following discussion took place on AoPS, concerning matrices that have nonzero determinant under any permutation of their entries: https://...
- 54.2k
2
votes
1
answer
238
views
Expected norm of a product of Gaussian matrices
Suppose $C_n$ is a product of $n$ $d\times d$ matrices with IID entries coming from standard normal. The following appears to be true. Is there an elementary proof?
$$E[\|C_n\|_F^2]=d^{n+1}$$
This ...
- 188k
3
votes
2
answers
2k
views
Expected value of the largest singular value of a random matrix with entries in $N (0,1)$
Given a matrix $A \in \mathbb R^{n \times n}$ whose entries are i.i.d. $N(0,1)$, what is the expected value of its largest singular value? Equivalently, what is the expected value of the largest ...
- 2,252
1
vote
0
answers
57
views
Limiting value of expectation of trace of truncated Gram matrix
Let $n$ and $d$ be large positive integers such that $d/n = a \in (0,1)$, fixed. Let $x_1,\ldots,x_n$ be iid random vectors from $N(0,I_d)$. Fix $b \in (0,1]$ and a unit-vector $v \in \mathbb R^d$, ...
- 6,853
9
votes
2
answers
496
views
Is there a determinantal point process proof of the Keating-Snaith formula for the cumulants of the log characteristic polynomial of a random matrix?
For $U$ a unitary $N \times N$ matrix, randomly distributed according to Haar measure, we have the complex-valued random variable $\log (\det (1-U))$. The real part and imaginary parts of $\log (\det (...
- 2,151
1
vote
0
answers
67
views
Random matrix theory: accounting for mean
Assume a random matrix, denoted as $X$, which is an $n$ by $T$ matrix, $T\geq n$. While I understand the typical scenario where the random variables $X_{ij}$ are sampled from a $\mathcal{N}(0,\sigma_{...
- 6,367