I think $\big\{-1, 0, \frac{1+\sqrt{5}}{2}\big\}$ is a counterexample.
**THIS IS WRONG**, see comments, but I'll leave it up as a warning.