$\DeclareMathOperator\tr{tr}\DeclareMathOperator\Int{Int}\DeclareMathOperator\Cent{Cent}$The OP (@ClarkLyons) gave a lovely generalisation of an answer of @diracdeltafunk over on MSE. I believe that the technique can be pushed still further to handle maps to any group $H$, as in the original question. The argument has no new ideas from me.
Suppose that $\phi : G \to H$ is any homomorphism. Write For $\mathscr O_G$$g \in G$, write $G\cdot g$ for the set of conjugacy classes in $G$,-conjugacy class through $g$; and similarly $H\cdot h$ for $h \in H$. Write $f : H \to \mathbb Z_{\ge 0}$ for the function given by $$ f(h) = (\#H\cdot h)^{-1}\sum_{g \in \phi^{-1}(H\cdot h)} (\#G\cdot g)^{-1} $$ for all $f(h) = \#\{\gamma \in \mathscr O_G \mathrel: \text{$\phi(g)$ is conjugate to $h$ for all $g \in \gamma$}\}$$h \in H$.
WriteThe Fourier transform $\mathscr O_H$ for$\hat f : \rho \mapsto (\#H)^{-1}\sum_{h \in H} f(h)\tr \rho(h)$ satisfies $$ (\#H)\hat f(\rho) = \sum_{h \in H} (\#H\cdot h)^{-1}\sum_{g \in \phi^{-1}(H\cdot h)} (\#G\cdot g)^{-1}\tr \rho(h) = \sum_{g \in G} (\#G\cdot g)^{-1}\tr (\rho \circ \phi)(g), $$ which is the setinner product of conjugacy classes in $H$ andthe character of $\hat H$ for$\rho \circ \phi$ with the setcharacter $g \mapsto \#\Cent_G(g)$ of irreducible, complex representationsthe permutation representation of $H$. Define $g : \hat H \to \mathbb C$$G$ acting on itself by $g(\rho) = \sum_{h \in \mathscr O_H} f(h)\tr \rho(h)$ for all $\rho \in \hat H$. Thenconjugation, so that $g(\rho) = \sum_{g \in \mathscr O_G} \tr(\rho \circ \phi)(g)$$\hat f(\rho)$ is non-negative, for all irreducible complex representations $\rho \in \hat H$$\rho$ of $H$.
By column orthogonality of the character table, we have that $f(h) = (\#\Cent_H(h))^{-1}\sum_{\rho \in \hat H} g(\rho)\overline{\tr \rho(h)}$ for $$ f(h) = \sum_{\rho \in \hat H} \hat f(\rho)\overline{\tr \rho(h)} $$ for all $h \in H$, so that $$ f(h) = \lvert f(h)\rvert \le (\#\Cent_H(h))^{-1}\sum_{\rho \in \hat H} \lvert g(\rho)\rvert\cdot\lvert\tr \rho(h)\rvert \le (\#\eta)(\#H)^{-1}\sum_{\rho \in \hat H} g(\rho)\dim(\rho) = (\#\eta)f(1), $$$$ f(h) = \lvert f(h)\rvert \le \sum_{\rho \in \hat H} \lvert\hat f(\rho)\rvert\cdot\lvert\tr \rho(h)\rvert \le \sum_{\rho \in \hat H} \hat f(\rho)\tr \rho(1) = f(1) $$ for all $h \in \eta \in \mathscr O_H$$h \in H$.
In words, upon multiplying both sides of the inequality $f(h) \le f(1)$ by $\#H\cdot h$, we obtain that the number of $G$-conjugacy classes (in $G$) that map into the $H$-conjugacy class of $h$ is bounded by the product of the size of the $H$-conjugacy class of $h$ and the number of $G$-conjugacy classes in the kernel of $\phi$.