These are two theorems I have heard being referred to in "folklore" but I cant find the proofs for these in any compressed sensing or high-dimensional probability reviews (like, https://www.math.uci.edu/~rvershyn/papers/HDP-book/HDP-book.pdf) that I have looked into.
That the maximum value of the magnitude of the inner-product between two different columns of a $d \times N$ ``dictionary" (with normalized columns?) is at least $\sqrt{\frac{N-d}{d(N-1)}}$
For any 2 randomly picked orthonormal bases in $\mathbb{R}^d$ the ``likely" (Expected? With high probability?) value of the magnitude of the inner-product between 2 vectors, one from each basis, is $O(\sqrt{\frac{\log d}{d}})$
It would be great if someone can type in the proof (if short) or give a reference to look up the proof!