I'm asking this question because I've been told by some people that Fourier analysis is "just representation theory of $S^1$."

I've been introduced to the idea that Fourier analysis is related to representation theory. Specifically, when considering the representations of a finite abelian group $A$, these representations are all $1$-dimensional, hence correspond to characters $A \to \mathbb{R}/\mathbb{Z} \cong S^1 \subseteq \mathbb{C}$. On the other side, finite Fourier analysis is, in a simplistic sense, the study of characters of finite abelian groups. Classical Fourier analysis is, then, the study of continuous characters of locally compact abelian groups like $\mathbb{R}$ (classical Fourier transform) or $S^1$ (Fourier series). However, in the case of Fourier analysis, we have something beyond characters/representations: We have the Fourier series / transform. In the finite case, this is a sum which looks like $\frac{1}{n} \sum_{0 \le r < n} \omega^r \rho(r)$ for some character $\rho$, and in the infinite case, we have the standard Fourier series and integrals (or, more generally, the abstract Fourier transform). So it seems like there is something more you're studying in Fourier analysis, beyond the representation theory of abelian groups. To phrase this as a question (or two):

(1) What is the general Fourier transform which applies to abelian and non-abelian groups?

(2) What is the category of group representations we consider (and attempt to classify) in Fourier analysis? That is, it seems like Fourier analysis is more than just the special case of representation theory for abelian groups. It seems like Fourier analysis is trying to do more than classify the category of representations of a locally compact abelian group $G$ on vector spaces over some fixed field. Am I right? Or can everything we do in Fourier analysis (including the Fourier transform) be seen as one piece in the general goal of classifying representations?

Let me illustrate this in another way. The basic result of Fourier series is that every function in $L^2(S^1)$ has a Fourier series, or in other words that $L^2$ decomposes as a (Hilbert space) direct sum of one dimensional subspaces corresponding to $e^{2 \pi i n x}$ for $n \in \mathbb{Z}$. If we encode this in a purely representation-theoretic fact, this says that $L^2(S^1)$ decomposes into a direct sum of the representations corresponding to the unitary characters of $S^1$ (which correspond to $\mathbb{Z}$). But this fact is not why Fourier analysis is interesting (at least in the sense of $L^2$-convergence; I'm not even worrying about pointwise convergence). Fourier analysis states furthermore an *explicit* formula for the function in $L^2$ giving this representation. Though I guess by knowing the character corresponding to the representation would tell you what the function is.

So is Fourier analysis merely similar to representation theory, or is it none other than the abelian case of representation theory?

(Aside: This leads into a more general question of mine about the use of representation theory as a generalization of modular forms. My question is the following: I understand that a classical Hecke eigenform (of some level $N$) can be viewed as an element of $L^2(GL_2(\mathbb{Q})\ GL_2(\mathbb{A}_{\mathbb{Q}})$ which corresponds to a subrepresentation. But what I don't get is why the representation tells you everything you would have wanted to know about the classical modular form. A representation is nothing more than a vector space with an action of a group! So how does this encode the information about the modular form?)