If $C$ is small, $C[W^{-1}]$ is again small, even without a calculus of fractions.  The problem in general is that when $C$ is a locally small large category, the zig-zag sequences can range over finite sequences of objects of $C$, which form a large set.