It's true (as the answer below and some of the commenters note) that it's easy to interpret this question in a way that makes it seem trivial and uninteresting. I'm quite sure, however, that pursuing typographical similarity between $e^{x^2}$ and $\zeta^{m^2}$ leads to interesting mathematics, and so here's a more serious attempt at propoganda for some of Ivan Cherednik's work.

Pages 6,7,8 and 9 of Cherednik's paper "Double affine Hecke algebras and difference Fourier transforms" explain how to ``interpolate'' between integral formulas relating the Gaussian to the Gamma function and (a certain generalization of) Gauss sums.

More explicitly, he shows that the formula (for many people, it's really just the definition of the Gamma function)

$$\int_{-\infty}^{\infty} e^{-x^2} x^{2k} dx=\Gamma \left( k+\frac{1}{2} \right)$$

(for $k \in \mathbb{C}$ with real part $>-1/2$) and the Gauss-Selberg sum

$$\sum_{j=0}^{N-2k} \zeta^{(k-j)^2/4} \frac{1-\zeta^{j+k}}{1-\zeta^k} \prod_{l=1}^j \frac{1-\zeta^{l+2k-1}}{1-\zeta^l}=\prod_{j=1}^k (1-\zeta^j)^{-1} \sum_{m=0}^{2N-1} \zeta^{m^2/4}$$

(where $N$ is a positive integer, $\zeta=e^{2\pi i/N}$ is a prim. $N$th root of $1$, and $k$ is a positive integer at most $N/2$) can both be obtained as limiting cases of the same $q$-series identity. The common generalization of the Gaussian and the function $k \mapsto \zeta^{k^2}$ is the function $x \mapsto q^{x^2}$, and the measures weighting the integral and sum get replaced by Macdonald's measure---essentially the same one that shows up in the constant term conjecture for $A_1$, and that produces the Macdonald polynomials and kick-started the DAHA. The Fourier transform is deformed along with everything else to produce the "Cherednik-Fourier" transform.

I don't know how much of the roots of unity story generalizes to higher rank root systems.

Note: In the Gauss-Selberg sum, replacing $k$ by the integer part of $N/2$ and manipulating a little (as in the nice exposition by David Speyer linked to in the question above) gives the usual formula for the Gauss sum.

Fourier Analysis on Finite Abelian Groups and Applications(I am currently away from my copy). Finally...what do you mean by a theory of self-dual locally compact abelian groups? You mean other than Pontrjagin duality? Do want a classification of the self-dual ones, or what? $\endgroup$ – Pete L. Clark Jan 7 '10 at 19:22