I essentially follow Igor Rivin's approach here. There are two possibilities for
how the polynomial can factor: (degree 1)$\times$(degree 3) or
(degree 2)$\times$(degree 2). Writing
$$ (y + a)(y^3 + by^2 + cy + d) = f $$ or
$$ (y^2 + ay + b)(y^2 + cy + d) = f, $$
where $f$ is your polynomial, and equating coefficents, we obtain two curves
$C_1$ and $C_2$
in the 5-dimensional affine space with coordinates $a,b,c,d,z$, and what you
want is the $z$-coordinates of their rational points.
EDIT: Actually, there is a somewhat simpler approach. $C_1$ classifies
linear factors of $f$, which is equivalent to roots of $f$, so $C_1$
is simply the affine plane curve $f(y,z) = 0$. Its projective closure
is a smooth quartic curve, so the genus of $C_1$ is 3. Alternatively,
since the discriminant of $f$ as a polynomial in $y$ is a degree 12
polynomial in $z$ without multiple roots, it follows from Riemann-Hurwitz
that the genus of $C_1$ is 3.
One finds 16 rational points on it; their $z$-coordinates
are those you also found (three of them ($z = -2, 1, 4$) give a factorization
into four linear factors, so they each give rise to four points on $C_1$,
the other four give only one linear factor).
EDIT:
$C_2$ classifies unordered pairs of (distinct) roots, so it can be obtained
as a degree 6 cover of the affine $z$-line by expressing the coefficients
of the polynomial whose roots are the products (or sums, or any other
symmetric expression) of pairs of roots in terms of those of the original
polynomial. This ramifies in 24 points (two above each branch point
of $C_1 \to \mathbb P^1$), so by Riemann-Hurwitz its genus is 7.
One finds 18 rational points on it; they all come from $z = -2, 1, 4$
by writing the product of four linear factors as a product of two quadratics
(which can be done in six different ways).
Since both curves have genus $\ge 2$, they have only finitely many rational
points by Faltings's Theorem. So there are only finitely many $z \in \mathbb Q$
such that your polynomial factors. It is also very likely that there are no
further rational points on the curves than those mentioned above (points on such
curves are usually fairly small, so one is likely to find them all by search),
but this is also very likely very hard to prove. But for all practical
purposes, you can safely assume that the values you found constitute the
complete list.