Note that there is some small ambiguity here, as to talk about the reduction of $X/\mathbb{Q}$ modulo a prime $p$, one needs to choose a model $X$. i.e., a scheme $\mathcal{X} \to \mathbb{Z}$ whose generic fibre is isomorphic to $X$.
Anyway, if $X/\mathbb{Q}$ is geometrically integral, then the same holds over $\mathbb{F}_p$ for all but finitely many primes $p$. This follows from fact that being geometrically integral is a constructible property (see Section 9 of EGAIV). One applies this to the morphism $\mathcal{X} \to \mathbb{Z}$.