Fields are the simple objects in $\text{CRing}$.
Edit: Some philosophical remarks. Elements having inverses is a property and not a structure, so in some sense it's not obviously a good idea to treat the inverse as extra structure. Talking about group objects instead of just monoid objects can really only be done in cartesian monoidal categories; in general you instead want to talk about monoid objects with some extra property. For example, Poisson-Lie groups are not group objects in the category of Poisson manifolds (which is not cartesian monoidal). Similarly, Hopf algebras are not group objects in the category of coalgebras (which is again not cartesian monoidal).
For commutative rings "$x$ is invertible" should be thought of as "the ideal generated by $x$ is the unit ideal," and of course this holds for all nonzero $x$ if and only if there are no nontrivial quotients. This suggests that if we want to generalize the definition of a field to other categories similar to $\text{CRing}$ then we should try to generalize this condition.
Example. For graded rings the natural generalization is "the homogeneous ideal generated by $x$ is the unit ideal." This is true precisely for graded rings such that every nonzero homogeneous element is invertible, such as the ring of Laurent polynomials over a field.