(Note: the following argument uses the fact that an isogeny of elliptic curves is inseparable iff it factors through the Frobenius isogeny. This is a result in Silverman's book, for instance.)
An elliptic curve $E$ over an algebraically closed field $k$ is supersingular iff $E[p](k) = 0$ iff the Frobenius isogeny $F: E \rightarrow E^p$ is purely inseparable its dual isogeny (called "Verschiebung") $V: E^p \rightarrow E$ is inseparable. This means that the dual isogeny $V$ factors through the Frobenius isogeny for $E^p$ -- i.e., $E^p \rightarrow E^{p^2}$ -- and since both have degree $p$ this means that $E$ is isomorphic to $E^{p^2}$. Thus on $j$-invaraiants we have $j(E)^{p^2} = j(E)$, done.