Bharvag's
Bhargav's example is really an example of a non-algebraic formal subscheme of the affine plane. Such examples are ubiquitous in foliation theory : a differential equation and, more generally, a foliation on a (smooth) algebraic variety has local leaves which are smooth formal schemes. This follows from the formal Frobenius theorem (in positive characteristic, the foliation needs to have p-curvature zero). Sometimes, these leaves are the formal completions of an algebraic subvariety, but often not. However, these leaves are isomorphic, at formal schemes, to the formal completion at the origin of an affine space; from the intrinsic point of view, they thus are algebraizable.
The theorems of Hironaka, Matsumura, Hartshorne to which Francesco Polizzi refers are in the same spirit, but concern formal subschemes along an algebraic subvariety. They don't apply to formal subschemes based at a point.
Actually, Arakelov geometry allows to establish analogs of these theorems and algebraize some formal subschemes based at a point (eg leaves of a foliation). See papers of Bost (Pub. Math IHES, vol. 93, 2001), and of Bost and myself (Manin Festschrift, 2010).

