(This was This is false in general, but true for matrices with non-negative entries.
For a totally wrong solutioncounterexample, suppose that $n=p$ is prime, and consider the matrix $$ A=\left\|p^{-1/2}\left(\frac{i-j}p\right)\right\|_{i,j=0,\dotsc,p-1} $$ where $(\cdot/p)$ is the Legendre symbol. This is a circulant matrix; its non-zero eigenvalues are normalized Gaussian sums, equal $1$ in absolute value; hence, $\|A\|_2\le 1$. Also, we have $\|A\|_F^2=p-1$. On the other hand, $$ \sum_i \max_j |A_{ij}|^2 = 1. $$
Suppose now that all elements of $A$ are non-negative. Let $u_i\in{\mathbb R}^n$ be the row vectors of $A$, and denote by $\|\cdot\|_p$ the $\ell^p$-norm over ${\mathbb R}^n$; when $p=2$, this is the standard Euclidean norm. The Frobenius norm of $A$ is $\|A\|_F^2=\sum_i\|u_i\|_2^2$. Assuming that $\|A\|_F^2\ge cn$ and $\|A\|_2^2\le C$, we show that $\sum_i\|u_i\|_\infty^2\ge C^{-1}c^2n$.
Denoting by $\vec 1$ the all-$1$ vector, we have $$ C \ge \|A\|_2^2 = \max_x \frac{\|Ax\|_2^2}{\|x\|_2^2} \ge \frac{\|A\vec 1\|_2^2}{\|\vec 1\|_2^2} = \frac1n\sum_i \|u_i\|_1^2. $$ (It is this computation that uses the non-negativeness assumption.) This implies $$ \sum_i \|u_i\|_1^2 \le Cn $$ and, consequently, by Cauchy-Schwartz, $$ cn \le \|A\|_F^2 = \sum_i \|u_i\|_2^2 \le \sum_i \|u_i\|_\infty \|u_i\|_1 \le \left( \sum_i \|u_i\|_\infty^2\right)^{1/2} \left( \sum_i \|u_i\|_1^2\right)^{1/2} \le \left( Cn\sum_i \|u_i\|_\infty^2\right)^{1/2}, $$ which yields the desired estimate $$ \sum_i \|u_i\|_\infty^2 \ge C^{-1}c^2n. $$