(Remark: I've edited the original answer to match the change in terminology, and I added some new comments.)
This is a theorem of Rosenstein from the paper $\aleph_0$-categoricity of groups. But note that he uses the terminology bounded order rather than finite exponent.
Theorem. (Rosenstein 1971)
An infinite abelian group is $\aleph_0$-categorical if and only if it has finite exponentsexponent.
Theorem 1. An $\aleph_0$-categorical group has finite exponentsexponent.
Theorem 2. An infinite abelian group of finite exponentsexponent is $\aleph_0$-categorical.
See Rosenstein's paper. The main tool is a structure theorem for an abelian groupgroups of finite exponentsexponent as direct sums of cyclic groups. This is apparently called Prufer's First Theorem.
By YCor's comment about $\mathbb{Q}^{(\omega)}$, one cannot prove Theorem 1 by considering only orbits of singletons. ($\mathbb{Q}$ works also.)
It is easier to prove that an $\aleph_0$-categorical torsion group $G$ has finite exponentsexponent. Indeed, if not then by compactness/DLS there is a countable model of $\operatorname{Th}(G)$ with an element of infinite order, which cannot be $G$. But if $G$ is not a torsion group, I don't see a quick way to avoid Ryll-Nardzewski or Omitting Types of some kind (although one can substitute other facts that use these results, e.g., in an $\aleph_0$-categorical structure, the algebraic closure of a finite set is finite).
An $\aleph_0$-categorical group need not be abelian. An example is the countably infinite extraspecial $p$-group (see Definition 5.15 here). On the other hand, there are many results in model theory along the lines of "$\aleph_0$-categorical plus some model-theoretic property" implies some abelian-like structure. For example, Bauer, Cherlin, and Macintyre showed that an $\aleph_0$-categorical superstable group is abelian-by-finite.
An infinite group of finite exponent need not be $\aleph_0$-categorical. For example, take an infinite finitely generated group of finite exponentsexponent (like a Tarski monster). Indeed, by the more general result about algebraic closure stated above, if $G$ is $\aleph_0$-categorical then any finite subset of $G$ generates a finite subgroup.