The customary formulation of the Axiom of Infinity within Zermelo-Fraenkel set theory asserts the existence of an inductive set: a  set  $ I$ with  $\varnothing\in  I$  such  that $x\in I$ implies $x\cup\{x\}\in I$.  Since the intersection of any nonempty set of inductive sets is itself inductive, an instance of  the Axiom Schema of Separation implies the existence of  a smallest inductive set, namely the set of von Neumann naturals $\mathbb{N}_{\bf  vN} = \{\varnothing, \{\varnothing\},\{\varnothing,\{\varnothing\}\},\ldots\}.$
Any inductive set is infinite (in fact, Dedekind infinite) but this formulation of the axiom  asserts more, namely the existence of a specific countably infinite set.  Given one such set, the existence of others, for example  the set of  {\em  Zermelo naturals} $$\mathbb{N}_{\bf Zer}=\{\varnothing,\{\varnothing\},\{\{\varnothing\}\},\ldots\}$$  follows from appropriate instances of the Axiom Schema of Replacement. 

Consider the subsystem of  Zermelo-Fraenkel set  theory  with axioms Extensionality, Separation Schema, Union, Power Set, Pair.  Augment  this  Basic System with  an  Axiom of Infinity which asserts the existence of an infinite set, but not any particular one. Such a  formulation requires that the notion of `finite' be defined prior to that of  'natural number',  following Kuratowski for example.  Any infinite set $ I$ determines a Dedekind-infinite  set of {\em  local naturals} $$\mathbb{N}_I=\{\mbox{equinumerosity classes of finite  subsets of }  I\}$$ which (duly equipped with initial element and  successorship) yields a  Lawvere natural  number  object, as  in  the Recursion  Theorem. The  existence of  $\mathbb{N}_{\bf vN}$ and $\mathbb{N}_{\bf Zer}$ then follow from  appropriate instances of Replacement.

 One might wonder  if  there is some clever way to specify an infinite  set without  recourse to Replacement. That is, does there exist (in the  language of set  theory)   a formula ${{\mbox{\boldmath$\phi$}}}$
with one  free variable  $x$ such  that  
$$ \mbox{Basic+Infinity+Foundation } \vdash\; \exists y ( \forall  x (x\in y \leftrightarrow {{\mbox{\boldmath$\phi$}}})\,\wedge \, y \mbox{ is  infinite})\;\;?$$

I'm inclined  to  guess no, on the following circumstantial  grounds:

\begin{itemize}
\item For  $\mathbb{N}_{\bf vN}$ and $\mathbb{N}_{\bf Zer}$  the  use of Replacement  is  essential: Mathias has shown (Theorem 5.6 of {\em Slim  Models of Zermelo Set Theory}  that there exist transitive models ${\mathfrak  M}_{\bf  vN}$ and ${\mathfrak M}_{\bf Zer}$  of Basic+Infinity+Foundation with   ${\mathbb  N}_{\bf vN}\in {\mathfrak M}_{\bf vN}$  and ${\mathbb  N}_{\bf Zer}\in{ \mathfrak M}_{\bf Zer}$, but  such  that every  element  of ${\mathfrak M}_{\bf  vN}\cap {\mathfrak M}_{\bf Zer}$  is hereditarily finite.
\item The usual  definitions  of  $\mathbb{N}_{\bf vN}$ and $\mathbb{N}_{\bf Zer}$  involve unstratified formulas. Coret has shown (Corollary 9 of  {\em Sur les cas stratifi\'es du sch\'ema du replacement}) that this is unavoidable:
 $$ \mbox{Basic+Infinity } \vdash\; \forall y ( \forall  x (x\in y \leftrightarrow {{\mbox{\boldmath$\phi$}}})\,\rightarrow \, y \mbox{ is  hereditarily finite})$$
for any stratified  {{\mbox{\boldmath$\phi$}}}. Using  the  same technique he has shown  (Corollary 10) that  Basic+Infinity proves  every stratified instance of Replacement.
\end{itemize}