It is well know that the density of positive square-free integers up to $x$ is asymptotically $x/\zeta(2)$. The error term
$$ E(x)=\sum_{1\leq n \leq x } \mu(n)^2 -\frac{x}{\zeta(2)}
$$ can easily prove $$ E(x)=O(x^{1/2}).$$ Using arguments like those in the proof of the prime number theorem, one can show that $$ E(x)=o(x^{1/2})$$ with an explicit saving.
There are several papers that prove $$ E(x)=O(x^{1/2-c})$$ for some
small positive constant $c$
under the assumption of the Riemann Hypothesis.
My question is whether there is any reference or heuristics for the smallest $a\geq 0 $ such that, for all $\epsilon>0$, we have $$ E(x)=O_\epsilon(x^{a+\epsilon}) ?$$ It is tempting to guess $a=1/4$ motivated by the Gauss circle problem conjecture by Hardy... but the heuristic behind Hardy's conjecture is irrelevant to square-frees.