In my opinion, category theory is to mathematics what garlic is to cooking. It is a widespread ingredient that adds a very important flavor. But, usually, it should be minced and mixed in, and used with restraint.
(So, my answer to your question of early vs late is, a little of both.)
