Yes, this can be done.
One can realise the universal character $\epsilon^{\mathrm{univ}}$ as an $R$-linear representation $G_{\mathbf{Q}} \to R^\times$, where $R$ is isomorphic to a direct product of finitely many copies of $\mathbf{Z}_p[[T]]$. Thus $R$ is Noetherian semilocal, and if $S$ is the finite set of primes dividing $Np$, then the groups $H^i(G_{\mathbf{Q}, S}, R(\psi \epsilon^{\mathrm{univ}}))$ are finitely-generated $R$-modules, zero in degrees $\ge 3$. (This is e.g. a consequence of the theory in Nekovar "Selmer Complexes", but this special case can be easily verified directly using Nakayama's lemma and Tate's finiteness theorems for finite modules.) The support of the torsion submodule of $H^2$ is a finite subset of $Spec R$, and away from this support, the formation of $H^1$ commutes with base change. Consider the set of integers $\ell \ge 2$ congruent to $k$ modulo $p-1$; this is dense in the component of $Spec R$ containing $k$, and for each such point, the rank of the speicalisation of $H^1$ is 1. Hence its generic rank is 1 and you can pick a non-torsion element, and if you rig things sensibly this will be non-vanishing under specialisation at $k$ and thus will give the deformation you seek.
Of course, the specialisation of the resulting extension at integers $\ell \le 0$ will never be in $H^1_f$, away from the finite (possibly empty) set where it is zero.
(PS: This kind of cohomology group -- cohomology of the universal cyclotomic twist of a a fixed $\mathbf{Z}_p$-linear representation -- is rather well-studied under the name of "Iwasawa cohomology"; somehow I failed to notice this initially, despite having spent a large chunk of my career thinking about Iwasawa cohomology, which goes to show that one should maybe not write MO answers at 10pm after a long day. Anyway, the above answer would work for any family over a Noetherian semilocal ring, it doesn't have to be the universal cyclotomic twist of a fixed representation.)