Here's a counterexample for unbounded derived categories.
Suppose $\mathcal{A}$ is a Grothendieck category with enough projectives, where projectives and injectives coincide: for example, the module category of $k[x]/(x^2)$ for a field $k$.Let $F$ be the left derived functor of a right exact, but not exact, functor.