Are there any useful characterisation of categories whose auto-equivalences are all naturally isomorphic to the identity? For example, I read in this thread, What are the auto-equivalences of the category of groups? , that the category of groups is one such category. Is there some nice general property that I can use to check whether or not a category admits of auto-equivalences that are not naturally isomorphic to the identity? If not, it'd be useful just to find some more interesting examples of categories with this property.

More specifically, what examples (if any) are there of auto-equivalences that send every object to an isomorphic object but are not naturally isomorphic to the identity? For instance, I know that any auto-equivalence of SETS must send every object to an isomorphic object, but is it true that any such equivalence is naturally isomorphic to the identity? If so, is this a general property of toposes or just a special case?