The following is an example: take a two state Markov chain with jump rates $\lambda_{0,1}=1$ and $\lambda_{1,0}=0$, and start it at state $0$. The initial variance is $0$, then increases,  but as $t\to\infty$ the variance decreases.