The main obstruction to this kind of duality is not so much that not every $C^*$-algebra is a convolution algebra (though, at least if we don't use twisted convolution algebra, there are known obstruction as mentioned in the comment), but rather that the construction that attach a groupoid to aconvolution $C^*$-algebra to a groupoid is not 'injective' at all.
This is mostly due to what I want to call "Fourier isomorphisms" between $C^*$-algebras, that exists at the analytic level without having a clear geometric origin (well, I'm sure one can find a geometric explanation for Fourier duality, but what I mean is that it cannot be interpreted as a morphisms or bibundle between the groupoids).
A typical example: $C(B \mathbb{Z}) \simeq C(\mathbb{U})$$C^*(B \mathbb{Z}) \simeq C(\mathbb{U})$
Take the groupoid $B\mathbb{Z}$ with a single object $*$ and the additive groupe $\mathbb{Z}$ as its automorphism group. We see it as a topological groupoid for the discrete topology.
The associated $C^*$-algebra (both maximal and reduced) $C^*(B\mathbb{Z})$ is simply the group $C^*$-algebra of $\mathbb{Z}$. Its a commutative $C^*$-algebra, by Gelfand duality it is isomorphic to continuous fonction on its spectrum. Here it is the algebra of continuous function on $\mathbb{U}$ the unit circle (the elements $n \in \mathbb{Z}$ corresponds to the function $z \mapsto z^n$).
But I can also considered the groupoid with $\mathbb{U}$ as set of objects and no non-identity morphisms, that I topologize with the topology of $\mathbb{U}$. The $C^*$-algebra attached to this groupoid are simply continuous function on $\mathbb{U}$, hence the same $C^*$-algebra as before.
So, if you want to recover the $C^*$-algebra you need some additional structure on it, not just a property. For example the notion of "Cartan subalgebra", which represent the subalgebra of the convolution algebra of continuous function on $G_0$ does the trick in some cases. Have a look at Cartan Subalgebras in $C^*$-Algebras by Jean Renault for example, the paper also cite other similar result in different context.