Here's another type of counterexample not (as I write) ruled out by the hypotheses of the question: consider an inclusion of fields $K\to L$, with $K$ and $L$ finite extensions of $k$. Now take the spec. Integral schemes, reduced fibres, bijective on points.