Given $n$ symmetric matrices $A_1, \dots, A_n \in \mathbb{R}^{k\times k}$, such that $\|A_i\| \leq 1$ for all $i$, we consider the matrix $M \in \mathbb{R}^{n\times n}$, where $M_{ij} = \langle A_i, A_j\rangle$.
We are interested in upper bounding the smallest eigenvalue of $M$. In general we have the obvious upper bound of $O(k)$. Also, whenever $n > k^2$, the upper bound is $0$ since $rank(M) \leq k^2$.
Can we say anything interesting whenever $k \leq n \leq k^2$? More precisely, can we show that within this interval the upper bound on the smallest eigenvalue decays like $k / f(n/k)$ for some monotonely increasing $f$ (think for instance $f(x) = \sqrt{x}$)?