In Higher Algebra Proposition 5.4.4.10 1, Lurie proves that for a coCartesian fibration of $\infty$-operads $q:\mathscr{C}^\otimes\to\mathscr{O}^\otimes$, where $\mathscr{O}^\otimes$, when viewed as an $\infty$-category, is pointed and $\mathscr{C}$ is a stable $\mathscr{O}$-monoidal $\infty$-category under the coCartesian fibration $q$. There is an equivalence of $\infty$-categories $\mathrm{Alg^{nu}}_\mathscr{O}(\mathscr{C})\to\mathrm{Alg^{aug}_{\mathscr{O}}(\mathscr{C})}$.
Let $\mathscr{O}^\otimes=\mathrm{N}(\mathscr{F}\mathrm{in}_{*})$, where $\mathscr{F}\mathrm{in}_{*}$ is Segal's category of pointed finite sets (the $n$lab denotes it as $\Gamma$, if I'm not wrong). A $\mathbb{E}_\infty$-ring is a commutative monoidal object, hence $\mathbb{E}_\infty$-monoidal object, of $\mathrm{Sp}$, and the sphere spectrum $S$ is naturally a $\mathbb{E}_\infty$-ring, so we can let $\mathscr{C}$ to be $\mathrm{Mod}_S$. Then, the $\infty$-category of nonunital $\mathbb{E}_\infty$-rings is equivalent to the $\infty$-category of augmented $\mathbb{E}_\infty$-rings over the sphere spectrum.
1 This is an expansion of Haugseng's
comment above.