It is not a rigorous argument but just a thought.
Let $y:=Ax_A$ be a non-negative integer vector, then $x_A = A^{-1}y$ and thus $$|\lambda_1|\leq |\lambda_1||y| \leq |x_A|\leq |\lambda_j||y|,$$ where $\lambda_1$ and $\lambda_j$ are the smallest and the largest (by absolute value) eigenvalues of $A^{-1}$, which are reciprocals of the largest and smallest eigenvalues of $A$. I did not check carefully, but it seems that for $A$ with entries in $[-n,n]$, eigenvalues of $A^{-1}$ may be exponential be in $n$.