Let $C$ be a 2-category and $Mnd(C)$ the 2-category of monads in $C$. As explained by Street in the formal theory of monads, the Eilenberg-Moore construction is right adjoint2-adjoint to the forgetful functorinclusion 2-functor $Mnd(C) \to C$$C \to Mnd(C)$ sending an object to the identity monad on it. Therefore it preserves 2-limits.
A fibration in a 2-category may be defined in terms of certain 2-limits (namely slice categories) and adjoints, and so is preserved by any 2-functor preserving 2-limits, and in particular by the Eilenberg-Moore construction.
Thus it's sufficient for $p$ to be a fibration object in the 2-category $Mnd(C)$.