Following up Charles Matthews' idea, Maclaurin's inequality gives
$$\frac{x_1 + x_2 + x_3}{3} \ge \sqrt{ \frac{3n^2 - 2n + a}{3} } \ge \sqrt[3]{ n^3 + an - b}.$$
The second inequality in particular expands out to an inequality of the form $-54n^5 + \text{lower order terms} \ge 0$, so does in fact provide an upper bound for $n$ in terms of $a$ and $b$. If you don't expect the statement to be true, from here it is possible to search for counterexamples.