Let $J(x)$ be Riemann's prime counting function given by $\frac{1}{2}w(x) + \sum_{n < x} w(n)$, where $w(p^k) = \frac{1}{k}$ when $p$ is a prime number and $k$ is a positive integer, and $w$ vanishes everywhere else.
Let the logarithmic integral $\newcommand{\li}{\mathrm{li}} \li(x)$ be some antiderivative of $\frac{1}{\log(x)}$.
I have often seen it asserted that for $x > 1$ or perhaps for $x > 2$, we have $J(x) = \li(x) - \sum_{\rho} \li(x^{\rho})$ or perhaps $J(x) = \li(x) - \sum_{\rho} \li(x^{\rho}) - \log(2)$, or some such variant. Here, the sum is over all zeros (trivial and nontrivial) of the Riemann zeta function, in some suitable order. The contribution over just the trivial zeros is some antiderivative of $\frac{1}{t (1 - t^2) \log(t)}$. I understand how to morally (non-rigorously) derive these formulas up to additive constants, but the additive constant specifics elude me.
I have written this without pinning down $\li$ beyond up to an additive constant. Clearly, adding any nonzero constant to $\li$ will destroy the convergence of any such series with infinitely many terms, so if there is some particular fixed choice of $\li$ to be used for all the terms which makes this converge, there is a unique such choice.
Is it indeed the case, as I often see suggested, that using the particular offset logarithmic integral with $\li(2) = 0$ makes these series converge? If so, I am very curious, what is so special about $2$ here?
If not, is there some other fixed choice of logarithmic integral I should be using for all these terms, or should I be using varying choices of $\li$, or in general, how should I interpret these often seen formulas?