Regularity (aka Foundation) can be seen philosophically as an axiom of *restriction*.  It is not necessarily saying “all the things you consider as sets must be well-founded”.  It can be read saying “for the purposes of this set theory, we restrict our universe of discourse to just the well-founded objects”.  It’s clarifying what we mean by *sets*, in a similar way as the extensionality axiom does.

You may find this explanation unsatisfying, since it’s fairly similar to what Maddy gives.  But the point is that if you are philosophically unsure about it, the question to ask is not “Are all sets really well-founded?” but “Is it really convenient/harmless/natural to restrict attention to the well-founded sets?”

A precise statement which can be seen as justifying this is the fact that within (ZF – Regularity), one can prove that the class of well-founded objects is a model of ZF.

Edit: see [this followup question](https://mathoverflow.net/q/300046/) and [its answer](https://mathoverflow.net/a/300055/) for:

- a rather stronger sense in which regularity is harmless, in the presence of choice: ‘Over (ZFC – regularity), regularity has no new *purely structural* consequences’

- a counter-observation that in the absence of choice, over (ZF – regularity), it’s not so clearly harmless; it has consequences that can be stated in purely structural terms, such as ‘every set is isomorphic to the set of the children of some element in some well-founded extensional relation’.