$\newcommand\Q{\mathbf{Q}}$
$\newcommand\Z{\mathbf{Z}}$
$\newcommand\Zbar{\overline{\Z}}$
$\newcommand\F{\mathbf{F}}$
$\newcommand\Gal{\mathrm{Gal}}$
A lift always exists, even with coefficients in $\Z$. If suffices to consider the case when $p > 2$ is prime. (Added Note: there is a second elementary argument at the end of this post.)
Let $p$ be prime, and let $\chi$ be an odd character of $(\Z/p\Z)^{\times}$ of order $2^m$ for some $m$. This character is valued in the field $E = \Q(\zeta_{2^m})$, and is unique up to Galois conjugacy (this follows from the oddness assumption, which implies that $2^m$ is the largest power of $2$ dividing $p-1$). The fixed field of $\chi$ considered as a Galois character is the unique field $K \subset \Q(\zeta_p)$ which has degree $2^m$; it is totally complex.
Claim: The $L$ value $L(\chi,0)$ has $2$-adic valuation at most $(2^{m-1} - 1)/2^{m-1} < 1$.
In particular, $L(\chi,0)/2$ has negative valuation, and, as in the previous answer, this shows that the Eisenstein series $E_{1,\chi}$, suitably normalized, provides a lift of Hasse to $\Z[\zeta_{2^m}]$. Hence there is a multiple of $E_{1,\chi}$ with coefficients in $\Z[\zeta_{2^m}]$ which is congruent modulo $\pi = 1 - \zeta_{2^m}$ to $1$. Write this form as follows:
$$\sum_{k=1}^{2^{m-1} - 1} \zeta^k_{2^m} f_k \in \Z[\zeta_{2^m}][[q]],$$
where $f_k \in \Z[[q]]$. Since the Galois group preserves $M_1(\Gamma_1(p))$, all the forms $f_k$ lies in $_1(\Gamma_1(p))$, and thus so does the form
$$\sum_{k=0}^{2^{m-1} - 1} f_k \in \Z[[q]].$$
Yet this form is congruent modulo $\pi = 1 - \zeta_{2^m}$ to the multiple of $E_{1,\chi}$ above, which in turn is congruent modulo $1 - \zeta_{2^m}$ to $1$. Hence it yields an integral lift of the Hasse invariant.
Proof: It suffices to show that the norm of $L(\chi,0)$ to $\Q$ has valuation at most $2^{m-1} - 1$. We may identify this norm with the product
$$\prod_{\chi \text{ odd}} L(\chi,0)$$
Yet this is equal to the limit of $\zeta_K(s)/\zeta_{K^+}(s)$ at $s = 0$ where $K^{+}$ is the maximal totally real subfield of $K$. By the class number formula, this limit thus evaluates to:
$$\frac{w(K^{+})}{w(K)} \cdot \frac{h(K)}{h(K^+)} \cdot \frac{R(K)}{R(K^{+})}.$$
Now $w(K^{+}) = 2$, and $w(K) = 2$ or $2p$ depending on whether $p$ is a Fermat prime or not. Hence this factor can be ignored when computing the $2$-adic valuation. I claim that the $2$-parts of $h(K^{+})$ and $h(K)$ are both $1$. To see this, let $H$ be the $2$-part of the Hilbert class field of $K^{+}$ or $K$. Then $H/\Q$ is Galois and of $2$-power order. By class field theory (over $\Q$), $\Gal(H/\Q)^{\mathrm{ab}}$ is cyclic, because it is ramified only at $p$ and $p \ne 2$. Yet this implies that $\Gal(H/\Q)$ is cyclic, because it is a $2$-group with cyclic abelianization. But then $H$ is abelian, and so from the theory of cyclotomic fields we easily see that $H = K^{+}$ or $K$. Hence the factor from the class number is also prime to $2$. Finally, the ratio of regulators is equal to the index
of the units $[U_K:U_{K^{+}}]$. Let $u \in U_K$. If $c \in \Gal(K/\Q)$ is complex conjugation, then a standard argument shows that $cu/u$ is a root of unity. Now $w(K) = |\mu_K|$ has either order $2$ or $2p$. In particular, after replacing $u$ by an odd power, we deduce that $cu = \pm u$. It follows that $u^2 \in K^{+}$, and that $V_K:=U_K/U_{K^{+}} \otimes \Z_2$ is an abelian group of exponent $2$. The power of $2$ dividing the index is $|V_K|$, so it suffices to show that the dimension of $V_K$ over $\F_2$ is at most $2^{m-1} - 1$. Since $-1 \in K^{+}$, there is a surjection:
$$U_K/(\pm 1,U^2_K) \rightarrow V_K.$$
By Dirichlet's unit theorem, we have
$$U_K \simeq \Z^{[K^{+}:\Q] - 1} \oplus \mu_K.$$
Since $\mu_K/{\pm 1} \otimes \Z_2$ is trivial, it follows that $\dim_{\F_2} V_K \le 2^{m-1} - 1$. This proves the claim.
In fact, using circular units, one can show that $\dim_{\F_2} V_K = 2^{m-1} - 1$, so the upper bound is actually an equality.
In the special case when $p \equiv 3 \mod 4$, then $2^{m-1} - 1 = 0$ so $L(\chi,0)$ is a unit; this is the case considered by wrigley.
Remark:
This argument is probably more complicated than necessary. There may well be an elementary way to prove directly that
$$\sum_{n=1}^{p-1} n \chi(n)$$
is not divisible by $2$ directly for the odd character $\chi$ of $2$-power order, but since the argument above was immediately apparent, I didn't try to look for such an argument.
Oh, actually, now that I make this comment, I see it is actually obvious. The character $\chi$ is valued in $E = \Q(\zeta_{2^{m}})$ which is a field of degree $2^{m-1}$, and the ring of integers has a basis $\zeta^i$ for $i = 0$ to $2^{m-1} - 1$. Moreover, $\chi$ exactly takes values in this basis. So it simply suffices to sum over the integers $n$ with $\chi(n) = 1$ or $\chi(n) = -1$ and show that this sum is not divisible by $2$, because then $L(\chi,0)$ will not be divisible by $2$. Yet these integers come in pairs $(n,p-n)$ whose difference is odd (so $n \chi(n) + (p-n) \chi(p-n) = \pm n - \pm (p-n) \equiv 1 \mod 2$), so it suffices to show that the total number of integers with $\chi(n) \in \{\pm 1\}$ is divisible by $2$ and not by $4$. Yet these integers are precisely the kernel of $\chi^2$, whose order has this property by definition. Oops! Well, I guess I may as well leave the class field theory argument here as well.
Added: I guess this last argument also shows that the coefficient of $\zeta^i$ is odd for any $i$, and hence
$$L(\chi,0) \equiv 1 + \zeta + \zeta^2 + \ldots + \zeta^{2^{m-1} -1} \mod 2.$$
Yet then
$$(1 - \zeta) L(\chi,0) \equiv 1 - \zeta^{2^{m-1}} = 1 + 1 \equiv 2 \mod 2(1 - \zeta),$$
and hence one sees directly that the valuation of $L(\chi,0)$ is $(2^{m-1} - 1)/2^{m-1}$.
$\quad$