3
$\begingroup$

Let $A$ be a $n\times m$ random matrix, whose elements $a_{ij}$ are independent standard Gaussian random variables. I am interested in the case $n=\alpha N\,$, $\,m=(1-\alpha)N$ for $\alpha\in(0,1)$ fixed and $N\to\infty$.

Denote by $\sigma_\max(N)$ the largest singular value of $\frac{1}{\sqrt{N}}A$, that is the square root of the largest eigenvalue of the symmetric square matrix $\frac{1}{N}AA^T$.

I am looking for a concentration result of type: $$ \mathbb P(\sigma_\max(N)\geq K) \,\leq\, e^{-N F(K)}$$ for constants $K$ in a suitable range, a suitable function $F(K)$, and $N$ sufficiently large. I do not need $F$ to be optimal.

In the square matrix case ($\alpha=\frac{1}{2}$), an analogous result holds true for the top eigenvalue $\lambda_\max(N)$ of the symmetric matrix $\frac{A+A^T}{\sqrt{2N}}$. But I could not find anything about large deviations of the top singular value in the rectangular case. Any reference or suggestion is very welcome.

$\endgroup$
4
  • $\begingroup$ Does the Marchenko-Pastur distribution help? $\endgroup$ Nov 8, 2021 at 8:41
  • $\begingroup$ This is not exactly what you're looking for, but chapter 5.2 in 'Spectral Analysis of Large Dimensional Random Matrices' by Bai and Silverstein gives an almost sure limit of the largest singular value (which is the larges eigenvalue of an empirical covariance matrix). $\endgroup$
    – Tardis
    Nov 8, 2021 at 10:11
  • $\begingroup$ PS. Would you mind giving me a reference for the result for square matrices? $\endgroup$
    – Tardis
    Nov 8, 2021 at 10:16
  • $\begingroup$ @Tardis for $n=m$ the rate function for large deviations of the top eigenvalue is computed here link.springer.com/content/pdf/10.1007/PL00008774.pdf, Theorem 6.2 . But if you do not need the precise rate function I think the concentration result was already known $\endgroup$
    – tituf
    Nov 8, 2021 at 22:17

1 Answer 1

1
$\begingroup$

This largest singular value is the norm of the matrix. You can use a net argument to show that there is a $C$ so that $$\mathbb{P}(\| A \|_{op} \geq C\sqrt{N}(\sqrt{\alpha} + \sqrt{1 - \alpha} + t)) \leq 2 e^{-Nt^2}$$ for all $\alpha, t$. For a reference, this appears as Theorem 4.4.5 in Vershynin's High Dimensional Probability book.

$\endgroup$
3
  • $\begingroup$ thank you, I didn't know the book. It seems to be very useful. $\endgroup$
    – tituf
    Nov 8, 2021 at 22:10
  • 1
    $\begingroup$ I also mention arxiv.org/pdf/1011.3027.pdf , Corollary 5.35 $\endgroup$
    – tituf
    Nov 8, 2021 at 22:11
  • 2
    $\begingroup$ I believe one can also obtain results of this type from the gaussian concentration inequality for Lipschitz functions, in the spirit of e.g., arxiv.org/pdf/math/0211192.pdf $\endgroup$
    – Terry Tao
    Nov 9, 2021 at 16:03

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.