Davis, Matijasevic, and Robinson show that RH is equivalent to the following arithmetic statement:
Let $$\delta(x)=\prod_{n<x}\prod_{j\leq n}\eta(j)$$
where $\eta(j)=1$ unless $j$ is a prime power, and $\eta(p^k)=p$ if $p$ is a prime number. Then
$$\left(\sum_{k\le\delta(n)}\frac{1}{k}-\frac{n^2}{2}\right)^2<36n^3$$ for $n\in\mathbb{N},n>0$.
This problem has also been translated into a halting problem by Matiyasevic, see reference [2] below.
Edit
It is interesting that RH might be independent of the theory that stems from the Peano Arithemtic axioms. Although the theory of the field of complex numbers is complete, and RH is formulated as a problem pertaining to complex numbers, as Emil Jeřábek points in his comment below, the FO theory of $\mathbb{C}$ is extremely weak to allow for even the definition of $\zeta$ in it.
Now, as Emil pointed out, I forgot to give an answer to the actual question in the post, regarding formalization (presumably in a proof assistant). A good amount of the analytic number theory leading to RH is formalized in Isabelle. It would be a nice exercise to complete this effort by adding the formalization of RH itself if it has not been done already; it should not be hard. See reference [3].
References
[1] Davis, M., Matijasevic, Y, and Robinson, J., Hilbert's tenth problem. Diophantine equations: positive aspects of a negative solution, in Proceedings of Symposia in Pure Mathematics: Mathematical developments arising from Hilbert problems, Vol XXVIII, Part 2, American Mathematical Socienty, Providence, Rhode Island, 1976.
The theorem appears on page 335.
[2] Matiyasevich, Y. The Riemann hypothesis in computer science, Theoretical Computer Science 807 (2020) 257-265
[3] Eberl, M. Nine chapters of analytic number theory in Isabelle/HOL, Technical University of Munich, accessed 25 July 2023: http://cl-informatik.uibk.ac.at/users/meberl/pdfs/ant.pdf