All Questions
81 questions
1
vote
1
answer
99
views
Maximum column norm of random $A^{-1}B$
Suppose that $A$ is an $n$ by $n$ Gaussian matrix (each component i.i.d. normal distributed with mean 0 and variance 1). Let $b$ be a $n$-Gaussian vector. Then it could be easily proven that the ...
- 33
1
vote
2
answers
66
views
Distribution of the constraint matrix conditioned on the solution of the linear system
Suppose that A is a random matrix in $R^{n\times n}$, with each component independently and identically distributed (iid) according to $\mathcal{N}(0,1)$. Additionally, b is a random vector in $R^n$, ...
- 33
7
votes
2
answers
347
views
Matrices over $\mathbb{F}_p$ that have nonzero determinant under any element permutation
$\DeclareMathOperator\GL{GL}$A few months ago, the following discussion took place on AoPS, concerning matrices that have nonzero determinant under any permutation of their entries: https://...
- 541
2
votes
0
answers
269
views
Singular values of Kronecker product of random matrices
I'm looking for a way to evaluate $\mathbb{E} \| (\mathbf{X} \mathbf{Q})^+ \|$ for a random matrix $\mathbf{X} \in \mathbb{R}^{r \times n}$ and a (fixed) matrix $\mathbf{Q} \in \mathbb{R}^{n \times \...
- 121
2
votes
2
answers
215
views
How to analyze the value of convergence of functions of random matrices?
Consider a random i.i.d matrix $\mathbf{A}_{m\times n}$ with entries generated from a complex Gaussian distribution with zero mean and unit variance. I am interested in the large dimension analysis of ...
- 287
6
votes
0
answers
279
views
Estimating $E[\operatorname{Tr}(ABABBA..)]$ for random shuffling of $A,B$?
How can I estimate the following value where $A,B$ are $d\times d$ matrices and expectation is taken over all random permutations of the product?
$$E_\text{shuffle}[\operatorname{Tr}\underbrace{AA\...
- 2,252
1
vote
0
answers
66
views
CLT of the left singular vectors of i.i.d. data matrix
Let $\mathbf{X}$ be $(n \times p)$-dimensional random matrix ($n > p$) whose rows $\mathbf{x}_i$ are i.i.d. with some finite moments:
$$
\mathbf{X}^\top = [\mathbf{x}_1, \ldots \mathbf{x}_n]^\...
- 284
-1
votes
1
answer
68
views
Bound for an expectation of random matrix with quantized random variable
Let random matrix $\mathbf{X} \in \mathbb{C^{\mathrm{m} \times \mathrm{n}}}$ and random vector $\mathbf{y} \in \mathbb{C^{\mathrm{m} \times 1}}$ are unknown distributed, but their covariance and ...
- 25
1
vote
1
answer
165
views
Bound for expectation of random matrix
Let random matrix $\mathbf{X} \in \mathbb{C^{\mathrm{m} \times \mathrm{n}}}$ and random vector $\mathbf{y} \in \mathbb{C^{\mathrm{m} \times 1}}$ are unknown distributed, but their covariance and ...
- 25
1
vote
1
answer
84
views
Asymptotic property of the left singular vectors of i.i.d. data matrix
Let $\mathbf{X}$ be $(n \times p)$-dimensional data matrix ($n > p$) whose rows $\mathbf{x}_i$ are i.i.d. with some finite moments:
$$
\mathbf{X}^\top = [\mathbf{x}_1, \ldots \mathbf{x}_n]^\top.
...
- 284
8
votes
0
answers
232
views
Decay of orthogonal contributions in a random set of vectors
Suppose we sample $k$ vectors $v$ from normal distribution centered at zero and diagonal covariance with diagonal entries $1,\frac{1}{2},\ldots,\frac{1}{d}$ and normalize $v$:
$$\frac{v_1}{\|v_1\|},\...
- 2,252
7
votes
2
answers
1k
views
Why is the spectrum of Erdős–Renyi random graph approximately symmetric?
I am recently self-learning random matrix theory and made some simulations about the spectrum of Erdős–Renyi random graph $G(n,p)$ when $np\to\infty$,
and $np\to c=2,3$.
The plots above are already ...
- 715
1
vote
1
answer
160
views
Estimates of product of eigenvalues gaps for Wigner matrices
Let $W_n$ be an $n\times n$ Wigner matrix$^{1}$, and let $\lambda_1\le \lambda_2\le \cdots \le \lambda_n$ be the eigenvalues of $\frac{W_n}{\sqrt{n}}$.
My question. For any fixed $i\in\{1,\dots,n\}$, ...
- 2,712
3
votes
1
answer
844
views
Top singular value of large random matrices: concentration results
Let $A$ be a $n\times m$ random matrix, whose elements $a_{ij}$ are independent standard Gaussian random variables.
I am interested in the case $n=\alpha N\,$, $\,m=(1-\alpha)N$ for $\alpha\in(0,1)$ ...
- 311
4
votes
1
answer
227
views
Limiting eigenvalue distribution of $(I-A)^T(I-A)$
Let $A\in\mathbb R^{n\times n}$ be a random Gaussian matrix with i.i.d entries from $\mathcal N (0, \frac{a}{\sqrt{n}})$. By Marchenko-Pastur we know the limiting distribution of the eigenvalue of $A^...
- 133
2
votes
0
answers
132
views
Limiting PDF of the eigenvalue of random Gaussian matrix
It has been proven that the CDF of the eigenvalue distribution of random Gaussian matrix converges to a uniform disk circular law. Is it true for the PDF of the limiting eigenvalue distribution? In ...
- 133
1
vote
1
answer
126
views
Probabilistic lower and upper-bounds for a certain random quartic form involving gaussian random matrices
Let $d,m \to \infty$ (integers) with $m/d \to \rho \in (0, \infty)$. Let $C$ be a $d \times d$ psd matrix with $trace(C)=\mathcal O(1)$, and let $w_1,\ldots,w_m$ be iid uniformly distributed on the ...
- 6,853
4
votes
1
answer
269
views
Subspaces with all vectors having large $\|x\|_{\infty}/\|x\|_2$ value
I am able to show that any $k$-dimensional subspace of $\mathbf{R}^{Ck\log(k)}$ must contain a unit vector $x$ such that $\|x\|_{\infty} \ge c\sqrt{1/\log(k)}$ for a small enough constant $c$.
But is ...
2
votes
1
answer
180
views
Random sequence with positive Lyapunov exponent?
Consider the following self-adjoint matrix
$A_X = \begin{pmatrix} 0 & -i \\ i & X \end{pmatrix},$ where $i$ is the imaginary unit and $X$ is a uniformly distributed random variable on some ...
- 192
2
votes
1
answer
236
views
How can I prove a randomly generated matrix has distinct non-zero eigenvalues?
Consider the following $M×M$ matrix
$$
\mathbf A=\sum_{k=1}^K =a_k \mathbf h_k \mathbf h_k^H,(M≥K)
$$
where $a_k$'s are real values and $h_k$'s are $M×1$ randomly generated vectors, e.g., complex ...
- 31
2
votes
1
answer
230
views
Eigenvalues of large symmetric random tensors
I am studying the eigenvalues of large random tensors and realise that very little is known about it. I was wondering what is already known and what could be potential leads to find their limiting ...
- 117
3
votes
1
answer
845
views
Concentration inequality for the sample covariance matrix
I'd like to know if there is a concentration inequality for the sample covariance matrix that don't assume the knowledge of the true mean.
Background.
Given a probability distribution $\mu$ on $\...
- 903
1
vote
1
answer
295
views
How to compute the first moment of the distribution of the convolution of Marcenko-Pastur law with a not iid matrix?
Let $\mathbf{F}$ denote an M × N matrix whose entries are independent zero-mean complex random variables, the limiting eigenvalue distribution is given by the Marchenko Pastur law $MP_{\beta}$, where $...
- 77
0
votes
0
answers
92
views
Linear independence of Wishart matrices
Let $W\sim W_n(I,d)$ be a real Wishart matrix of an identity covariance matrix and $d$ degrees of freedom, i.e., $W=XX^T$ for $X$ being an $n\times d$ matrix whose entries are i.i.d sampled from a ...
- 123
3
votes
0
answers
58
views
Projection onto column space perturbed by Gaussian noise
Suppose we have a matrix $X\in\mathbb{R}^{m\times n}$ (with $n \le m$) with iid standard Gaussian entries, and suppose we have noise matrix $W\in\mathbb{R}^{m\times n}$ with iid Gaussian entries, but ...
- 141
2
votes
1
answer
905
views
Diagonalizability of Gaussian random matrices
Let $X$ be an $n\times n$ matrix whose elements are i.i.d. sampled from a normal distribution of zero mean and unit variance. Is $X$ diagonalizable over $\mathbb{C}$ with probability 1? Is there a ...
- 123
1
vote
2
answers
923
views
Eigenvectors of random unitary matrices
Any unitary matrix $U$ can be diagonalized by another unitary matrix $V$,
$$U=VDV^\dagger,$$
where $D={\rm diag}(z_1,z_2,...,z_N)$ is diagonal.
If $U$ is taken at random uniformly with respect to Haar ...
- 1,549
0
votes
0
answers
45
views
On full rank submatrices of a construction
Take two matrices $T_1$ and $T_2$ in $\mathbb Z^{n\times n}$ with entries uniformly in $[-b,b]\cap\mathbb Z$ at some $b>0$. The matrices will be of rank $n$ each with probability at least $1-\frac1{...
- 1,826
0
votes
0
answers
47
views
"Probability" for a partitioned matrix to be singular
Let $A,B\in\mathbb{R}^{n\times n}$ be two nonsingular matrices with $A\ne B$, and consider the following partitioned matrix
$$
M:=\begin{bmatrix}AA^\top + BB^\top & A^\top \Delta_1 A + B^\top \...
- 2,712
0
votes
0
answers
132
views
Upper bound on the condition number of the product of a random sparse matrix and a semi-orthogonal matrix
Let $G \in \mathbb{R}^{n \times m}$ (m > n, m = O(n)) whose all entries are i.i.d. distributed as $\mathcal{N}(0, 1) * \text{Ber}(p)$. Let $V \in \mathbb{R}^{m \times n}$ be a fixed semi-orthogonal ...
- 109
5
votes
1
answer
3k
views
Eigenvalues and eigenvectors of Gaussian random matrices
Let us assume we have a square matrix $A$ whose entries are sampled from a standard Gaussian distribution of mean $0$. Do we have any information about the distribution of its eigenvalues?
...
- 899
1
vote
1
answer
131
views
Large scale analysis of matrix multiplications
Let $\mathbf{A}_{m\times n}$ and $\mathbf{B}_{m\times n}$ be two random i.i.d matrices with zero mean and unit variance. Then, are the following large-scale analysis true (m,n go to infinity with ...
- 287
3
votes
1
answer
3k
views
Singular value decomposition of random rectangular matrices
Let $A$ be a $m\times n$ real matrix, whose entries are independent, identically distributed random variables, following standard normal distributions (mean zero and unit variance).
What is the ...
- 884
7
votes
2
answers
604
views
Minimizing the largest eigenvalue of random matrices
Let $A \in \mathbb{R}^{n \times n}$ be a symmetric matrix with entries $A_{ij} \sim \mathcal{N} (0,1)$, all independent except for the symmetry condition.
Consider the following minimization problem:...
- 237
1
vote
1
answer
218
views
Is there a bound on the norm of the product of second moment matrix with random vector?
Let $X_1,\dots,X_n$ be vectors in $\mathbb{R^d}$. Assume all of the vectors are inside the unite $\ell_2$ ball, but outside the ball of radius $r$ for some $r \in (0,1)$, i.e. $r \leq \|X_i\| \leq 1$ ....
- 135
3
votes
1
answer
373
views
Matrix positive semi-definite
We construct a non-random matrix using random variables as follows:
We fix the vector $v=(1,1).$
Let $X$ be a $\mathbb R^2$-valued random variable such that $X$ is distributed according to
$$d\mu(...
- 192
2
votes
1
answer
280
views
Properties of eigenvalues and eigenvectors of a particular random matrix
Let $\mathbf{A}$ be a given $n \times m$ matrix with positive entries, and $\mathbf{B}_{n\times m}$ be a random i.i.d complex Gaussian matrix with unit variance. Assume that $\mathbf{C}$ is the ...
- 287
1
vote
1
answer
519
views
How typical are integer isometries on a hypercube? Littlewood-Offord problem for Bernoulli Gram matrices
Let $m\geq 3$ be fixed and $n\to\infty$. Consider $v=(v_j)_{j\leq m}$ with $v_1,\ldots,v_m\in \{-1,+1\}^n$. Let:
$N_I(v)$ be the number of sequences $u_1,\ldots,u_m\in \{-1,+1\}^n$ isometric to $v$ ...
- 175
3
votes
0
answers
78
views
Using Kac-Rice formula to count average number of sub-regions carved out by $n$ random hyper-planes
Context. This is the first in a set of tiny pieces of a problem I've formulated to help me measure the "complexity" of certain piecewise linear functions. Thanks in advance for your help and patience.
...
- 6,853
1
vote
0
answers
1k
views
Linear Independence of random binary vectors
Suppose we have $Y_1, \ldots, Y_n \in \mathbb{R}^m$, $n$ independent random vectors ($m \geq n$), where the entries of each $Y_i$ are i.i.d. Bernoulli random variables taking the values $\{0, 1\}$ ...
- 111
2
votes
0
answers
116
views
Smallest singular value distribution
Let $G_\mathbb{R}\in\mathbb{R}^{n\times n}$ and $G_\mathbb{C}\in\mathbb{C}^{n\times n}$ denote the real and complex Ginibre random matrices, i.e. random matrices with independent real/complex Gaussian ...
- 83
1
vote
0
answers
128
views
expected value of powers of a gaussian matrix
Let $Z$ be a fixed $d \times d$ matrix and let $G$ be a random $d \times d$ matrix with each entry i.i.d. $N(0, 1)$.
Is it true that:
$$\mathrm{Tr}(\mathbb{E}_G[ (Z^T + G^T)^\ell (Z + G)^{\ell-k-1}...
- 199
2
votes
1
answer
280
views
The effect of random projections on matrices
Let $A\in\mathbb{R}^{n\times n}$ be a given normal matrix, i.e. $A^TA=AA^T$. Let $P_s\in\mathbb{R}^n$ be a random projection matrix to an $s$-dimensional subspace in $\mathbb{R}^n$.
Suppose $\frac{A+...
- 1,495
2
votes
0
answers
99
views
Recovering a rank-one matrix from its eigendecomposition after randomized rounding [closed]
Let $A = xy^T$ be a rank-$1$ matrix, and suppose every entry of $A$ is in $[0,1]$. We can create a binary matrix $A_{\rm rounded}$ by setting
$$ [A_{\rm rounded}]_{ij} = \begin{cases} 1 & \mbox{ ...
- 121
6
votes
2
answers
738
views
Probability of a large random integer Matrix to have zero determinant
Suppose we have a matrix $A \in \{0,1\}^{n \times n}$ where
$$A_{ij} = \begin{cases} 1 & \text{with probability} \quad p\\ 0 &\text{with probability} \quad 1-p\end{cases}$$
I would like to ...
- 355
0
votes
0
answers
64
views
Probability of collision of sums of vectors
Let $S_1$ and $S_2$ be sets of vectors from $\mathbb{R}^d$ that are distinct and let $\sigma(\cdot)$ be a non-linearity, e.g., a componentwise sigmoid function.
Does there exist a random matrix $R \...
- 321
1
vote
1
answer
90
views
Probability of collision of sums of vectors multiplied by random matrix
Let $S$ and $T$ be sets of vectors from $\mathbb{R}^d$ such that $S$ and $T$ are at least different in one element.
Does there exist a random matrix $M \in \mathbb{R}^{d \times k}$, e.g., a gaussian ...
- 321
3
votes
0
answers
77
views
A concentration problem of product of matrices
Let $A$ be an $n \times m$ matrix with non-negative entries and $B \in \mathbb{R^{n\times n}_{\geq 0}}, C \in \mathbb{R^{m\times m}_{\geq 0}}$ be random matrices where B and C are both symmetric and ...
- 195
2
votes
0
answers
102
views
Eigenvalue distribution for a real-valued random matrix with correlated Gaussian entries
I'm working on an application where I would greatly benefit from knowing the distributions of the eigenvalues of a real-valued random matrix whose elements can be assumed to be Gaussian, but where I ...
- 121
1
vote
1
answer
83
views
Lower bound $x^TSA^TASx$
Let $A$ be an $n^2\times K$ matrix with $K = \frac{n(n-1)}{2}$. $A$ is not orthonormal but has linearly independent columns. Let $S$ be a diagonal sampling matrix(of zeros and ones). The diagonal ...
- 11