Stack Exchange network consists of 183 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
My guess is that this is impossible if the polarization of $J(X)$ is also defined over $K$, due to Torelli. So I would look for an abelian surface over $K$ with a principal polarization defined over $L$ that does not descend to $K$ (I think that any p.p. abelian surface is a Jacobian of a genus 2 curve).
I think the right way to think about this is to take the trivial $l$-adic sheaf $\mathbb{Q}_l$ on $A$ and compute $G:=R^1\pi_* \mathbb{Q}_l$ -- a constructible $l$-adic sheaf on $C$. Then at every point $x$ of $C$ the action of the Frobenius on $G_x$ has characteristic polynomial whose roots are the Weil numbers corresponding to the fiber at $x$.
I think your "polynomial" should at least have characteristic zero coefficients, while $\mathcal{O}_C$ has characteristic $p$. But maybe there is such a polynomial in $W(\mathcal{O}_C)[T]$, over the Witt vectors of $\mathcal{O}_C$?