Here is the problem with the notion of naive complex. Suppose we have a naive complex
$$ \require{AMScd} \begin{CD}
A @>f>> B @>g>> C @>h>> D \end{CD} $$
If we propose to compute the realization iteratively, the first step would be to produce the sequence
$$ \require{AMScd} \begin{CD}
\mathrm{cofib}(f) @>>> C @>h>> D \end{CD} $$
However, this need not be a naive complex! So everything falls apart.

A more elaborate explanation is to look at the big diagram of pushout squares one can construct from the complex:

$$ \require{AMScd} \begin{CD}
A  @>f>> B @>>> 0
\\ @VVV @VVV @VVV
\\ 0 @>>> \mathrm{cofib}(f) @>>> \Sigma A @>>> 0
\\  & & @VVV @VVV @VVV
\\  & & C @>>> \mathrm{cofib}(g) @>>> \mathrm{cofib}(\mathrm{cofib}(f) \to C)
\\ & & & & @VVV
\\ & & & & D
\end{CD} $$
There is no direct way to produce the expected map $\mathrm{cofib}(\mathrm{cofib}(f) \to C) \to D$. In fact, by the rightmost square, one can only possibly exist if $(\Sigma A \to D) \simeq 0$.

The map $\Sigma A \to D$ is the Toda bracket mentioned in the comments. ([wikipedia][1] [nlab][2])

---

We can give an explicit counterexample. In the $\infty$-category of chain complexes, suppose our naive complex is given by:

$$ \require{AMScd} \begin{CD}
0  @>>> 0 @>>> \mathbb{Z}/4 @>1>> \mathbb{Z}/4
\\ @VVV @VVV @VV4V @VVV
\\ \mathbb{Z} @>2>> \mathbb{Z}/4 @>2>> \mathbb{Z}/8 @>>> 0
\end{CD} $$

That this is a naive complex can be checked on the homology groups. This isn't a bicomplex as is, and the point is that it cannot be improved to become one! One can show that after replacing $A \xrightarrow{f} B$ with $\mathrm{cofib}(f)$, the diagram becomes

$$ \require{AMScd} \begin{CD}
\mathbb{Z} @>1>> \mathbb{Z}/4 @>1>> \mathbb{Z}/4
\\ @VV2V @VV4V @VVV
\\ \mathbb{Z}/4 @>2>> \mathbb{Z}/8 @>>> 0
\end{CD} $$

and on homology groups, the top row does not compose to zero.

---

The fix is to redefine "naive complex" to include the parallel zeroes: i.e. so that the index 1-category is a sequence of parallel pairs of arrows such that each arrow coequalizes the pair before it.

(the second arrow in each pair is still required to be zero!)

I interpret Pavlov's comment above as saying that this redefinition of "naive complex" results in a category of complexes that is equivalent to simplicial objects, although I have not proved that myself.


  [1]: https://en.wikipedia.org/wiki/Toda_bracket
  [2]: https://ncatlab.org/nlab/show/Toda+bracket