The canonical lifting $\mathcal{A}$ of $A$ has a canonical lift of the relative  Frobenius $F_{\mathcal{A}/W}:\mathcal{A}\to \mathcal{A}'$, where $\mathcal{A}'=F_W^* \mathcal{A}$ (=the canonical lift of the Frobenius twist $A'=F_k^*(A)$). Moreover, any line bundle $L$ on $A$ has a canonical `Teichmueller' lift $\mathcal{L}$ to $\mathcal{A}$ such that $F_{\mathcal{A}/W}^* (\mathcal{L}) \cong \mathcal{L}'^p$,  $\mathcal{L}' = w^* \mathcal{L}$ where $w$ is the ($W$-Frobenius-linear) projection $\mathcal{A}'=F_W^*\mathcal{A}\cong \mathcal{A}$. 

Let $T(L)$ be the total space of $L$ (treated as a $\mathbb{G}_m$-torsor), in other words, $T(L) = {\rm Spec}_A \bigoplus_{n\in \mathbb{Z}} L^n$. Then $F_{A/k}^* (T(L)) = T(L^p)$, and the relative Frobenius $F_{T(L)/A} : T(L)\to T(L^p)$ is simply ${\rm Spec}_A$ of the inclusion $\bigoplus_{n\in p\mathbb{Z}} L^{n}\subseteq \bigoplus_{n\in\mathbb{Z}} L^n$.

The upshot is that the relative Frobenius $F_{T(L)/A}$ naturally lifts to an $F_{T(\mathcal{L})/\mathcal{A}}: T(\mathcal{L})\to T((\mathcal{L}')^p) = T(F_{\mathcal{A}/W}^* \mathcal{L})$. Then we get a lift of the relative Frobenius $F_{T(L)/k}$ by composition with the natural projection $T(F_{\mathcal{A}/W}^* \mathcal{L})\to T(\mathcal{L}')$.