I would be surprised if the purported Grothendieck quote is really his.  It sounds more like another thing Deligne says in "Quelques idées maitresses de l'oeuvre de Grothendieck" (p. 13): "if the decision to let every commutative ring define a scheme gives standing to bizarre *schemes*, allowing it gives a *category of schemes* with nice properties."