In general this can fail for all points: let $\{q_i\}$ be a countable dense set in the plane, and let
$$X= \bigcup_i S(q_i,2^{-i}),$$
where $S(q,r)$ is the circle of center $q$ and radius $r$. Then $X$ is $1$-rectifiable, yet for all $x\in X$ and all $\delta>0$ you can find points in the ball $B(x,\delta)$ with tangent lines very different from $T_x X$ (in fact, you can find a dense set of tangent lines inside any such ball).

You can create a similar example with $X$ made up of a dense set of segments pointing in a dense set of directions inside any ball, and you can easily replicate this construction for any $n,m$.

Since stability under countable unions is a key feature of the notion of rectifiability, I doubt you can find a useful setting under which your statement holds.