I would disagree that the hypotheses of the adjoint functor theorem are much stronger than exactness. Left exactness is equivalent to preserving all finite limits, and the hypotheses of the adjoint functor theorem are existence of all limits, preserving all limits, and a smallness condition that usually is easy to verify. Furthermore, to know that a left exact functor preserves all limits, it suffices to know that it preserves arbitrary products (since any limit can be expressed as a kernel of an appropriate map between products). So in most typical applications, the only difference between being left exact and having a left adjoint is whether a functor preserves infinite products.

This also shows how to find a counterexample: find a left exact functor that does not preserve infinite products. For instance, if $M$ is any flat module over a commutative ring $R$, tensoring with $M$ is left exact, but will not preserve infinite products unless $M$ has nice finiteness properties (if $R$ is Noetherian, the condition is that $M$ is finitely generated). In particular, if $R=\mathbb{Z}$ you could take $M=\mathbb{Q}$, or if $R$ is a field you could take $M$ to be any infinite-dimensional vector space.

As Todd notes in his comment, you can similarly get an example for right exactness instead of left exactness by Homming out of a projective module that is not finitely generated.

You can get a more artificial sort of counterexample by taking abelian categories with a size restriction on their objects that prevents the adjoint from existing (because you don't have all (co)limits). For instance, take the category of countable-dimensional vector spaces over some field, and consider the endofunctor given by tensoring with a countably infinite dimensional space $V$. This is right exact, and it ought to have a right adjoint given by $\mathrm{Hom}(V,-)$ (and it is easy to show that if the right adjoint exists, it must be given by $\mathrm{Hom}(V,-)$). But this right adjoint is undefined because (for instance) $\mathrm{Hom}(V,V)$ is uncountable-dimensional and so it doesn't exist in our category.