At a recent conference in Paris on Philosophy and Model Theory (at which I also spoke), Philip Ehrlich gave a fascinating talk on the surreal numbers and new developments, showcasing it as unifying many disparate paths in mathematics. The abstract is available here, on page 8, and here his draft article on the Absolute Arithmetic Continuum. The principal new technical development is a focus on the underlying tree.
Philip expressed his frustration that Conway often treated his creation of surreal numbers as a kind of game or just-for-fun project---an attitude reinforced by the excellent Knuth book---whereas they are in fact a profound mathematical development unifying disparate threads of mathematical investigation into a single unifying structure. And he made a very strong case for this position at the conference.
Meanwhile, perhaps exhibiting Philip's point, at a conference on logic and games here at CUNY, I once heard Conway describe the surreal numbers as one of the great disappointments of his life, that they did not seem after all to have the profound unifying nature that he (and many others) thought they might. Philip Ehrlich strove to make the case that Conway was his own worst enemy in promoting the surreals, and that they actually do have the unifying nature Conway thought they did, but that Conway scared people away from this perspective by treating them as a toy. I encourage you to read Philip's articles.
So my answer, supporting Philip, is that nothing is wrong with the surreals---please have at them! Of course they have their own issues, which will need to be surmounted, but we shall all benefit from a greater investigation of them.

