This is an elaboration on my comment.
Let's start in a more general setting since the comment was not about the groups $U(n)$: Let $G$ be a compact group and $H$ a normalized Haar measure on it. Let $p_m:G\to G$ be defined by $p_m(x)=x^m$, $m\in\mathbb Z$. Now for any continuous function $f:G\to\mathbb R$ we have $$ \int_Gf(p_m(x))dH(x) = \int_Gf(x)d(p_m)_*H(x). $$ Since $p_m$ is a homomorphism, the pushforward $(p_m)_*H$ is a normalized Haar measure on $p_m(G)$. If $p_m$ is surjective, it follows from the uniqueness of Haar measures that $p_{m*}H=H$ and thus $$ \int_Gf(p_m(x))dH(x) = \int_Gf(x)dH(x). $$ This idea made me think that the integral would be independent of $m$.
The problem is that in the OP's situation $p_m$ is not surjective (unless $m=1$ or $n=1$) and the argument fails.