Mark Levi's book The Mathematical Mechanic is full of elementary and beautiful examples of this kind. Some examples are also given in this blog post by Yan Zhang.
A classic example is a "proof" that there exist non-constant meromorphic functions on a compact Riemann surface, which I think is due to Klein: see this MO questionthis MO question.
