As suggested by Igor Rivin's argument, it is the case that if we put the operator norm (with respect to Euclidean norm on vectors) on $M_{n}(\mathbb{C})$ and consider a finite subgroup $G$ of $U_{n}(\mathbb{C})$ such that $\|g^{2}-e \| < 1$ for all $g \in G$, then $G$ is Abelian.
Later edit: I realise that there is a much simpler argument than my original one, with a sharper bound. Note that $M$ is a matrix of finite order in ${\rm GL}(n,\mathbb{C})$ with $\| I - M^{j} \| < 1$ for all $j$, then for any eigenvalue $\lambda$ of $M$, we have $|1-\lambda^{j}| < 1$ for all $j$, so that $\lambda^{j}$ has strictly positive real part for all $j$. But $1$ is the only complex root of unity with the property that all of its powers have positive real part ( since the sum of all powers of any other root of unity is $0$). Hence $M = I$.
Hence if $\|I -g^{2} \| < 1$ for all $g \in G$, where $G$ is a finite subgroup of ${\rm U}_{n}(\mathbb{C})$, then $g^{2} = I$ for all $g \in G$, so that $G$ is Abelian.
The second part of the answer is somewhat tangential to the original question, and follows the direction suggested by Sean Eberhard's comment.
For a finite group $G$, it is the case that if more than $\sqrt{\frac{5}{8}} |G|$ elements $x \in G$ have $x^{2} = e$, then $G$ is Abelian. The dihedral group of order $8$ ( I mean the one with $8$ elements) - and direct products of it with elementary Abelian $2$-groups as large as you like-show that this can't be improved much as a general bound, since a dihedral group $D$ of order $8$ contains $6$ elements which square to the identity and $ 6 < \sqrt{\frac{5}{8}} |D| <7$ in that case.
This is because (as noted in the paper linked to in Sean Eberhard's comment, and also previously noted by Brauer and Fowler), the count of solutions to $x^{2} = e$ given using the Frobenius-Schur indicator leads easily to $\sqrt{\frac{5}{8}} |G| < \sqrt{k(G)}\sqrt{|G|}$ in the case under consideration, where $k(G)$ is the number of conjugacy classes of $G$. Hence $\frac{k(G)}{|G|} > \frac{5}{8}$, so the probability that two elements of $G$ commute is greater than $\frac{5}{8}$, in which case $G$ is Abelian by a Theorem of W.Gustafson. If preferred, this can be seen directly using character theory- in general, if $G$ has $k$ conjugacy classes, we have $[G:G^{\prime}] + 4(k - [G:G^{\prime}]) \leq |G|$ by the orthogonality relations. Hence $\frac{k}{|G|} \leq \frac{1}{4} + \frac{3}{4|G^{\prime}|} \leq \frac{5}{8}$ if $G^{\prime} \neq 1$, ie if $G$ is non-Abelian.