Addendum: The examples above are (I think) correct, but I am kind of embarrasssed by how unnecessarily complicated they are. My compulsion to put the blowup of $\mathbf P^2$ in 9 points in every answer I write led me to overlook much simpler examples that fit the bill just as well. So let me add those in now. (And then I will leave this answer alone.)
For the first version, now let $X$ just be $\mathbf P^2$ blown up in a single point, and $f:X \rightarrow \mathbf P^1$ the projective bundle map. Again let $D$ be the exceptional divisor of $X \rightarrow \mathbf P^2$. Then everything in the previous answer works the same way. In this case the fibre $F$ is $\mathbf P^1$, so $D_{|F}$ is already basepoint-free, even very ample.
For the second version, where the stable base locus of $D$ is meant to have codimension 2, we can take $X$ to be the projective bundle $$X = \mathbf P_{\mathbf P^1} \left( O \oplus O(-1) \oplus O(-1) \right) $$ and our morphism is again the bundle map $X \rightarrow \mathbf P^1$.
The point is that $X$ is a compactification of the total space of the bundle $O(-1)\oplus O(-1)$ on $\mathbf P^1$. So it contains a curve $C$ which is a copy of $\mathbf P^1$ with normal bundle $O(-1) \oplus O(-1)$. I claim this curve can be flopped to give a pseudoisomorphism $X \dashrightarrow W$, and taking a very ample divisor on $W$ and its proper transform on $X$ we again get a divisor class $D$ on $X$ whose base locus is precisely $C$, but whose restriction to any fibre $F \cong \mathbf P^2$ is basepoint-free, even very ample.
These examples have the virtue of being much simpler than the first set, but also showing that this behaviour is probably very common --- you don't need special conditions like having a fibration with fibres which are abelian varieties, for example.