Let $S(m,n)$ be the generalized symmetric group which is a wreath product of the cyclic group of order $m$, denoted here by $\mathbb{Z}_m$, and the symmetric group $S_n$. A standard unitary representation of $S(m,n)$ is given by the semi-direct product of the $n\times n$ permutation matrices and $n \times n$ diagonal matrices with $m$-th roots of unity entries. (These matrices are sometimes called generalized permutation matrices.)
For finite $m$ and $n$ all such unitary matrices form a finite subgroup of $U(n)$ of size $n! m^n$. I'll denote this group of unitary matrices as $M(m,n)$. One way to see that $M(m,n)$ is not a maximal finite subgroup of $U(n)$ is to note that $S(2m,n)$ is a finite group which has $S(m,n)$ as a subgroup. I'm interested in a slightly different question.
Let $U'\in U(n)$ be a unitary matrix which is not in $M(m,n)$ for any $m$ (in other words, $U'$ is not a generalized permutation matrix). Is the group generated by $M(m,n)$ (for some fixed $m$) and $U'$ always infinite?