The finiteness is known for any scheme $Y$ which is regular, flat and proper over Spec Z. This is due to the work of Bloch, Kato-Saito among others;known; see Szamuely's Seminaire Bourbaki expose for a modern accountand Remarque 3. Your $X$ may be an open subscheme of a $Y$; since the fibers of $X$4 (and $Y$5) over Spec Z are one-dimensional, the finiteness for $Y$ implies that for $X$on page 11 is a precise reference.