So I feel like there are many questions and also many sources on what I am asking, but I still don't understand what I think is a very basic thing in my head:
It is known, that for a Lie group $G$ (for both, infinite and finite dimensional), its tangent bundle is isomorphic
$$TG \cong G \times T_\mathrm{Id}G. $$
Also, it is known that $T_\mathrm{Id}G $ is isomorphic to the Lie algebra, i.e. the set of left invariant vector spaces on the Lie group.
Now let's consider the diffeomorphism group. I am interested in diffeomorphims on $\mathbb{R}^2$ that differ from the identity only on a compact set, but let's consider the diffeomorphism group on a compact manifolds (I don't understand the explanations that I found for this space either) $\operatorname{Diff}(M)$.
Now, I have read in different sources, that the Lie algebra of $\operatorname{Diff}(M)$ is given by vector fields on $M$, but I don't really understand why. Is it so trivial that there is no explanation for this anywhere? How do we go from left invariant vector fields on the diffeomorphism group to vector field on $M$ itself?
EDIT: I'm sorry if I'm just dense now but I fail to understand your answers concerning my question. As far as I see, you mostly explain why tangent vectors at the identity correspond to left invariant vector fields on the diffeomorphism group. But what I fail to understand is: Why does the the following hold:
$\mathfrak{X}(M)= $ left invariant vector fields on diff. group $\subset \mathfrak{X}(\operatorname{Diff}(M))$