A weaker question replaces "homology class of an embedded submanifold" with $f_{\ast}([M])$ for some compact smooth manifold $M$ and an arbitrary continuous map $f:M \rightarrow X$. Once you give up looking at embedded submanifolds, there is also no reason to restrict yourself to $X$ being a manifold.
A lot was proven about this by Thom in his classic paper "Quelques propriétés globales des variétés différentiables", which is more famous for containing his work on cobordism theory. A few of the results contained in that paper are as follows.
Every mod $2$ homology class can be so represented.
Integrally, it is true for every class in $H_k$ for $k \leq 6$.
For every $k \geq 7$, there exist polyhedra $X$ and classes in $H_k(X)$ that cannot be so represented.
EDIT : One should also remark that the above is germane to the original question too in many cases. Namely, if $X$ is a smooth $n$-manifold and $M$ is a compact smooth $k$-manifold and $f:M \rightarrow X$ is arbitrary, then $f$ is homotopic to an embedding as long as $k < n/2$.