In the trivial case the abelianization comes from the short exact sequence

$0\to J\to \mathbb{Z}G\to \mathbb{Z}\to 0$

where $J$ is the augmentation ideal. The homology $H_*(G,-)$ are just derived functors and give a long exact sequence in homology, which since $H_1(\mathbb{Z}G,\mathbb{Z})$ is always trivial, gives a four term exact sequence which looks like

$0\to H_1(G,\mathbb{Z})\to J_G\to (\mathbb{Z}G)_G\to\mathbb{Z}\to 0$

Here the subscript $-_G$ just means the coinvariant functor from which the homology is derived: $M_G$ is the quotient of $M$ by the submodule generated by $gm - m$ for all $m\in M$. It is not hard to verify that $(\mathbb{Z}G)_G\to\mathbb{Z}$ is an isomorphism so that $H_1(G,\mathbb{Z})$ is isormorphic to $J_G$, which is in turn the abelianization. All of this is classical and in Brown, Weibel, or probably even Mac Lane, which you can consult for more details.

Alternatively, topologically it isn't hard to prove that $H_1(G,\mathbb{Z})$ is just the homology of a topological classifying space with $G$ as its fundamental group and whose higher homotopy groups are trivial, and from algebraic topology we know that $H_1$ of that space is $G/[G,G]$.

If $M$ is not a trivial $G$ module then you probably won't get as nice a description as for cohomology because the tensor product is not as nice as this case as the Hom set. Andy's comment on derivations/principal derivations comes from (or at least morally) from the bar resolution, which for any group $G$ is a free $\mathbb{Z}G$ resolution of $\mathbb{Z}$. This is great because homology is just the derived functor of $\mathbb{Z}\otimes_{\mathbb{Z} G}-$, which makes sense because $-_G$ is right exact and commutes with arbitrary direct sums.

So you can still work out a kind of analogue to the description for cohomology. If you actually use the bar resolution, you get that $H_1(G,M)$ for an arbitrary right $G$-module $M$ is just the homology $\mathrm{ker} (d)/\mathrm{im} (d)$ (abuse of notation, using the same $d$) of the complex

$M\otimes B_2\xrightarrow{1\otimes d} M\otimes B_1\xrightarrow{1\otimes d} M\otimes \mathbb{Z}G$

where the tensor is taken over $\mathbb{Z}G$. The module $B_1$ is the free $G$ module on the symbols $[g_1]$ for $g_1\in G$ and $g_1\not=1$. If we let $[]\in\mathbb{Z}G$ be the identity, then $d([g_1]) = g_1[] - []$. Similarly, $B_2$ is the free $G$ module on $[g_1|g_2]$ where neither are the identity, and $d([g_1|g_2]) = g_1[g_2] - [g_1g_2] + [g_1]$. Here $[g_1g_2] = 0$ if $g_1g_2 = 1$ in the group. You can do the same for left-$G$ modules by forming the analogous right free $G$-module resolution of $\mathbb{Z}$.

We could also have used the unnormalized bar resolution; regardless, it is now true that this is just a complex with each term a direct sum of copies of $M$, but the difficulty is determining what exactly the boundary formulas turn out to be. For a specific $M$ often it is not too hard to make a computation. For cyclic groups you can use the usual period resolution of $\mathbb{Z}$ to get that

$H_1(\mathbb{Z}/k,M)\cong M^{\mathbb{Z}/k}/NM$

where $N$ is the norm element, defined for a general group to be $\sum_{g\in G}g$.

In the trivial case the abelianization comes from the short exact sequence

$0\to J\to \mathbb{Z}G\to \mathbb{Z}\to 0$

where $J$ is the augmentation ideal. The homology $H_*(G,-)$ are just derived functors and give a long exact sequence in homology, which since $H_1(\mathbb{Z}G,\mathbb{Z})$ is always trivial, gives a four term exact sequence which looks like

$0\to H_1(G,\mathbb{Z})\to J_G\to (\mathbb{Z}G)_G\to\mathbb{Z}\to 0$

Here the subscript $-_G$ just means the coinvariant functor from which the homology is derived: $M_G$ is the quotient of $M$ by the submodule generated by $gm - m$ for all $m\in M$. It is not hard to verify that $(\mathbb{Z}G)_G\to\mathbb{Z}$ is an isomorphism so that $H_1(G,\mathbb{Z})$ is isormorphic to $J_G$, which is in turn the abelianization. All of this is classical and in Brown, Weibel, or probably even Mac Lane, which you can consult for more details.

Alternatively, topologically it isn't hard to prove that $H_1(G,\mathbb{Z})$ is just the homology of a topological classifying space with $G$ as its fundamental group and whose higher homotopy groups are trivial, and from algebraic topology we know that $H_1$ of that space is $G/[G,G]$.

If $M$ is not a trivial $G$ module then you probably won't get as nice a description as for cohomology because the tensor product is not as nice as this case as the Hom set. Andy's comment on derivations/principal derivations comes from (or at least morally) from the bar resolution, which for any group $G$ is a free $\mathbb{Z}G$ resolution of $\mathbb{Z}$. This is great because homology is just the derived functor of $\mathbb{Z}\otimes_{\mathbb{Z} G}-$, which makes sense because $-_G$ is right exact and commutes with arbitrary direct sums.

So you can still work out a kind of analogue to the description for cohomology. If you actually use the bar resolution, you get that $H_1(G,M)$ for an arbitrary right $G$-module $M$ is just the homology $\mathrm{ker} (d)/\mathrm{im} (d)$ (abuse of notation, using the same $d$) of the complex

$M\otimes B_2\xrightarrow{1\otimes d} M\otimes B_1\xrightarrow{1\otimes d} M\otimes \mathbb{Z}G$

where the tensor is taken over $\mathbb{Z}G$. The module $B_1$ is the free $G$ module on the symbols $[g_1]$ for $g_1\in G$ and $g_1\not=1$. If we let $[]\in\mathbb{Z}G$ be the identity, then $d([g_1]) = g_1[] - []$. Similarly, $B_2$ is the free $G$ module on $[g_1|g_2]$ where neither are the identity, and $d([g_1|g_2]) = g_1[g_2] - [g_1g_2] + [g_1]$. Here $[g_1g_2] = 0$ if $g_1g_2 = 1$ in the group. You can do the same for left-$G$ modules by forming the analogous right free $G$-module resolution of $\mathbb{Z}$.

We could also have used the unnormalized bar resolution; regardless, it is now true that this is just a complex with each term a direct sum of copies of $M$, but the difficulty is determining what exactly the boundary formulas turn out to be. For a specific $M$ often it is not too hard to make a computation. For cyclic groups you can use the usual period resolution of $\mathbb{Z}$ to get that

$H_1(\mathbb{Z}/k,M)\cong M^{\mathbb{Z}/k}/NM$

where $N$ is the norm element, defined for a general (finite!) group to be $\sum_{g\in G}g$.