For elliptic curves over $\mathbb{Q}$ the Mumford-Tate group is either $\mathrm{GL}_2$ or $\mathrm{Res}_\mathbb{Q}^F (\mathbb{G}_m)$ if it has CM with the imaginary quadratic field $F$. In this case the $\mathbb{Q}$-endomorphism algebra completely determines the Mumford-Tate group. On the automorphic side, having CM can be seen as the associated modular form $f$ satisfying $f=f\otimes \chi$ for some quadratic character $\chi$.
For a simple abelian surface $A/\mathbb{Q}$, again the endomorphism algebra determines the Mumford-Tate group. Here one can find the classification of the Hodge group (special Mumford-Tate group) for low dimensional abelian varieties. In particular there are four cases for abelian surfaces. One expects to be able to associate an automorphic representation $\pi$ of $\mathrm{GSp}_4$ to the abelian surface $A$.
My question is that if the four cases of Mumford-Tate groups (or the endomorphism algebra if you like) can be translated to properties (hopefully some kind of symmetries) of the automorphic representation $\pi$. For instance, I think the CM case (Type IV(2,1) here) should be similar to the case of elliptic curves, namely $\pi=\pi \otimes \chi$ for some character.
My main concern is the two dimensional case but any comments on the higher dimensional cases where the Mumford-Tate group is not determined by the endomorphism algebra is also highly appreciated.