The ring $\mathbb{Z}$ is the unique ordered ring which satisfies full second-order induction: $$\forall X(0 \in X \land (\forall n \geq 0)(n \in X \to n+1 \in X) \to (\forall n \geq 0)(n \in X)),$$ where $X$ varies over all subsets of $\mathbb{Z}$ (or even all sets). In the comments, Martin Brandenburg has given yet another characterization of $\mathbb{Z}$ which does not assume the ordering.
A dual characterization is that every nonempty subset of $\mathbb{Z}$ which is bounded below has a minimal element. This is closer to the characterization of $\mathbb{R}$. Note that all of these characterizations only make sense in standard second-order logic, but the proposed characterization of $\mathbb{R}$ has the same problem.
The ring of integers also has categorical characterizations. For example, as proposed in the comments, $\mathbb{Z}$ is initial object in the category of (ordered) rings. See this questionthis question for related information.