Since $P(Z_1Z_2>0)=\frac12-\frac1{\pi}\arcsin(1-2\epsilon)$, indeed $P(Z_1Z_2>0)\geqslant\epsilon$, and the inequality is strict except when $\epsilon=0$, $\epsilon=\frac12$ and $\epsilon=1$.