Monic polynomial with integer coefficients with roots on unit circle, not roots of unity? There are certainly non-monic polynomials of degree 4 with all roots on the unit circle, but no roots are roots of unity; $5 - 6 x^2 + 5 x^4$ for example.
Now, for a monic polynomial of degree $n$, this is impossible (I think).
So, my question is, given a monic polynomial with integer coefficients of degree $n$,
what is the maximal number of roots that can lie on the unit circle, and not be roots of unity?
For example, $1 + 3 x + 3 x^2 + 3 x^3 + x^4$ has two roots on the unit circle, and two real roots.
 A: For a class of concrete examples with at least asymptotically more than $n/2$ zeros on the unit circle, the Fekete polynomials, which were just mentioned recently by Franz Lemmermeyer at this question on class numbers, might be fruitful in this regard.
Defining them by
$$
f_p(x)=\sum_{a=0}^{p-1}\left(\frac{a}{p}\right)x^a,
$$
it seems that 
$$
\frac{f_p(x)}{x(x-1)}
$$
when $p\equiv 3 \bmod 4$
and
$$
\frac{f_p(x)}{x(x-1)^2(x+1)}
$$
when $p \equiv 1 \bmod 4$ are thought to be irreducible. (See another question here.) (I'd appreciate being corrected if I'm wrong on this.)
Now it has been proven in 
B. Conrey, A. Granville, B. Poonen, K. Soundararajan, Zeros of Fekete Polynomials
that asymptotically more than half of the zeros lie on the unit circle.
A: Just a couple of minor top-ups to Dmitri's nice answer. 


*

*For each even $n\ge2$ the polynomial $p_n(x)=x^n-x^{n-1}-\dots-x+1$ is a Salem polynomial.

*It is not known whether for any $\delta>0$ there exists a Salem polynomial such that $\theta<1+\delta$ for its largest root $\theta$ (which is a Salem number). Lehmer's  conjecture suggests that the answer is no. 

A: First, you are right: if a monic polynomial's roots are all on the unit circle, then every root is a root of unity. This follows from a result of Kronecker's (see: Zwei Sätze über Gleichungen mit ganzzahligen Coefficienten).
Secondly, what are you looking for is Salem Polynomials. See, for example, Definition 2.1 here. There can be arbitrarily many roots on the unit circle (none of which is a root of unity) with just two other roots located off of $S^1$.
A: This is an adelic comment based on algebraic dynamics. Each such polynomial $f(x)\in\mathbb{Z}[x]$ induces an algebraic dynamical system (i.e. an automorphism of a compact abelian group). If $f(x)$ has no roots that are roots of unity, then the system is known to have strictly positive entropy. The entropy is calculated by adding up the logs of the absolute values of the eigenvalues. If they are all on the unit circle then you'd get zero, which is wrong. So where is positive entropy coming from? It's from the $p$-adic eigenvalues of $f(x)$ (see Automorphisms of solenoids and p-adic entropy, Lind and Ward, Ergodic Th. & Dynam. Syst. 8 (1988), 411-419).
In other words, if $f(x)$ has all of its (complex) roots on the unit circle (and they are not roots of unity), then it must have $p$-adic roots having $p$-adic norm strictly greater than one. For the polynomial mentioned in the first sentence, there is a 5-adic root with norm > 1. In some sense, this is the correct (adelic) formulation of Kronecker's theorem mentioned above.
A: There exist irreducible monic polynomials such that all their roots apart from two lie on the unique circle (and are not roots of unity). Such polynomials can be chosen among Salem polynomials and they exit in arbitrary high degree. By definition a Salem polynomial $S(x)\in \mathbb Z[x]$ is a monic irreducible reciprocal polynomial with exactly two roots off the unit circle, both real and positive. Of course non of the roots of these polynomials are roots of unity, since these polynomials are irreducible.
See for example theorem 1.6 in the article
Automorphisms of even unimodular lattices and unramified Salem numbers of Gross and Mcmullen: 
http://www.math.harvard.edu/~ctm/home/text/papers/unim/unim.pdf
Theorem. For any odd integer $n\ge 3$ there exist infinitely many  unramified Salem polynomials of degree $2n$.
