For any interested latecomers who somehow discover this question in the future, I've found a very low-tech answer, bootstrapping from the low-tech answer to Is a Lie group equivariantly formal under conjugation by a maximal torus?.
Anyway, once you believe that the conjugation action upon a compact Lie group $G$ of its maximal torus $T$ is equivariantly formal, it follows that the action of $G$ by conjugation is as well. This argument will actually work for any reasonably good space $M$ on which $G$ acts and the restricted $T$-action is equivariantly formal, because one has $$H_G(M) = H_T(M)^W = (H(M) \otimes H(BT))^W = H(M) \otimes H(BT)^W = H(M) \otimes H(BG)$$ as $H(BT)$-modules, where $W = N_G(T)/T$ is the Weyl group of $G$.
If, say, you don't buy that the action of $W$ on $H(M)$ is trivial, a longer proof goes like this.
$\require{AMScd}$
The homotopy quotient $M_G$ is a further quotient of $M_T$, and the projection $EG \times M \to EG$ then induces a commutative diagram
\begin{CD} M @= M\\ @VVV @VVV\\ M_T @>>> M_G\\ @VVV @VVV\\ BT @>>> BG \end{CD}
where the upper vertical maps are fiber inclusions.
The projection $BT = EG/T \to EG/G = BG$ induces an inclusion $H(BG) \cong H(BT)^W \hookrightarrow H(BT)$ in cohomology, and there are induced maps both in cohomology and on the Serre spectral sequences for the equivariant cohomologies, starting with this $E_2$ page:
\begin{CD} H(M) @= H(M)\\ @AAA @AAA\\ H(M) \otimes H(BT) @<<< H(M) \otimes H(BG)\\ @AAA @AAA\\ H(BT) @<<< H(BG) \end{CD}
Because the top and bottom horizontal maps are injective, so is the middle one, so the differentials for the spectral sequence converging to $H_G(M)$ are restrictions of those for $H_T(M)$. But the differentials for $H_T(M)$ are all zero, by equivariant formality, so the spectral sequence for $H_G(M)$ collapses as well.