This response is in answer to David's further question about whether it is possible to bound the rate at which $S_N/N$ SN/N tends to zero, as he was wanting to use Weyl's inequality to do.
I don't think that it This is not possible, even in the case d=2 and $f(n)=\theta n^2$f(n)=θn2. (for d=1 it is not hard to show that $S_N$ SN is bounded so $S_N/N=O(N^{-1})$).[It took a few edits, but hopefully this answer is free of major errors now]in the following. Then, I'll try to show that, for Given anygiven h(N)->0 function h: ℕ → ℝ+ with liminfnh(n) = 0, it is not true I show that there are irrational θ with$S_N(\theta)/N$ always tends to zero at rate O(h(N))$\begin{array}{}\displaystyle\sup_N\vert S_N(\theta)/(h(N)N)\vert=\infty.
(1) Let &&(*)\end{array}$h\colon\mathbb{N}\to\mathbb{R}_+$ satisfy $\lim_nh(n)=0$. Then
[Note: The following is a much simpler argument than the original version]. I'll use the Baire category theorem to find counterexamples
For any countable collection An of open dense subsets of ℝ, the intersection A = ∩nAn is dense in ℝ.
In particular, there exists an irrational $\theta$ any such that A is nonempty. We can say more than this; if S is a countable subset of the reals then $\sup_N\vert S_N(\theta)/(h(N)N)\vert=\infty$
I'll A\setminus S=\left(\bigcap_nA_n\right)\cap\left(\bigcap_{s\in S}\mathbb{R}\setminus\{s\}\right)$ is an intersection of dense open sets, so is dense. In particular, A will contain a dense set of irrational values.
To construct this by choosing counterexamples then, it is only necessary to show that the set of all θ as at which the limit sequence diverges to infinity is an intersection of countably many open sets, and show that it contains a very quickly converging sequence dense set of rational numbers. Let's break up the constructionThe Baire category theorem implies that it will also diverge at a dense set of irrationals.
In fact, starting with for any sequence xn(θ) depending continuously on a real parameter θ, the case where set of values of θ for which it diverges to infinity is actually rationalan intersection of countably many open sets\{\theta\colon\sup_n\vert x_n(\theta)\vert=\infty\}=\bigcap_n\bigcup_m\{\theta\colon\vert x_m(\theta)\vert>n\}.$$
So, we only need to find a dense set of rational numbers at which (2) *) holds.
If m ≡ n (mod b) then m2 ≡ n2 (mod b), so θm2 - θn2 is an integer, and $e^{2\pi i\theta m^2}=e^{2\pi i \theta n^2}$. This shows that So $n\mapsto e^{2\pi i\theta n^2}$ has period b.As |SN(3) Let θ = a/b for integers a,b with b a product of distinct odd primes. Then $x=S_b(\theta)/b$ θ)/(h(N)N)| ∼ |x|/h(N) → ∞ whenever x is nonzeroand, by (2), $S_N(\theta)/N$ tends to a nonzero limit.
Proof:If c,d are coprime positive integers then, by the Chinese remainder theorem, every 0≤n<cd can be written as n≡vc+wd (mod cd) for integers 0≤v<d and 0≤w<c. If, furthermore, θ is such that cdθ is an integer then,S_{cd}(\theta)&=\sum_{w=0}^{c-1}\sum_{v=0}^{d-1}e^{2\pi i\theta(vc+wd)^2}\\&=\sum_{w=0}^{c-1}e^{2\pi i\theta d^2 w^2}\sum_{v=0}^{d-1}e^{2\pi i\theta c^2 v^2}\\&=S_c(\theta d^2)S_d(\theta c^2) We want to show following shows that $S_b(\theta)\not=0$ (*) holds whenever bθ is an integer and b is a product of distinct odd primes. By breaking b down into its prime factors and using the identity above, we reduce the problem to that where b is form a/p for an odd prime p not dividing a.
SoSuch rationals are dense, suppose that b is so the existence of irrational θ for which (*) holds follows from the Baire category theorem.
Let θ = a/p for integers a,p with p an odd prime , and set $u=e^{2\pi i a/b}$. We suppose that b does not divide dividing a(otherwise . Then $S_b(\theta)$ x=S_p(\theta)/p$ is strictly positive), so u nonzero.
Proof:Note that $u=e^{2\pi i a/p}$ is a primitive b'th p'th root of unity with minimal polynomial $X^{b-1}+X^{b-2}+\cdots+X+1$ X^{p-1}+X^{p-2}+\cdots+X+1$ over the rationals. Then, all proper subsets of $\{1,u,u^2,\ldots,u^{b-1}\}$ \{1,u,u^2,\ldots,u^{p-1}\}$ are linearly independent over the rationals andS_b(\theta)=\sum_{k=1}^{b}u^{k^2}=1+2\sum_{k=1}^{(b-1)/2}u^{k^2S_p(\theta)=\sum_{k=1}^{p}u^{k^2}=1+2\sum_{k=1}^{(p-1)/2}u^{k^2}is nonzero.
Using this, a θ can be constructed proving (1) above.
Let $h\colon\mathbb{N}\to\mathbb{R}$ satisfy $\lim_nh(n)=0$. Then, there exists a sequence $p_k$ of prime numbers, tending to infinity, such that the sum $$ \begin{array} {}\displaystyle\theta=\sum_{n=1}^\infty\frac{1}{p_n}&&(*) \end{array} $$ converge to an irrational number, and $\sup_NS_N(\theta)/(h(N)N)=\infty$.
Proof:
In order for the sum in (*) to converge, we have to require that pn grows quickly, such as pn ≥ 2n.Now, let us choose p1,p2,... inductively. Suppose that odd primes p1,...,pm have already been chosen, and set $\theta_m=1/p_1+\cdots+1/p_m$. We can write θm=am/bm where bm=p1...pm.If we make sure that $p_n>2^{n-m}b_m^m$ for all n>m, this will give the following rational approximations\vert\theta-a_m/b_m\vert=\sum_{k=m+1}^\infty \frac{1}{p_k}\le\frac{1}{b_m^m}and, by Liouville's theorem, θ will be irrational (transcendental, in fact).
By (3) above, $S_N(\theta_m)/N$ converges to a nonzero limit fact as N goes to infinity, so we can choose an $N_m$ with $\vert S_{N_m}(\theta_m)/(h(N_m)N_m)\vert>m$.By continuity, there is an $\epsilon>0$ such that $\vert S_{N_m}(\theta)/{N_m}\vert>m$ whenever $\vert\theta-\theta_m\vert\le\epsilon$. To guarantee that our value of θ defined pointed out by (*) satisfies thisDavid below, it Sp is only necessary to choose $p_n>2^{n-m}/\epsilon$ for all n > m.
Proceeding in this way, we can choose a quickly increasing sequence of prime numbers, where each choice of prime number imposes a lower bound on the following terms in the sequence. It also provides us with a sequence N1,N2,... of integers such that $\vert S_{N_m}(\theta)/{(h(N_m)N_m)}\vert\ge m$, so $\sup_N\vert S_N(\theta)/(h(N)N)\vert=\infty$.Gauss sum and has size √p.

