You seem to use that every isogeny is uniquely determined by its kernel, but I can multiply any isogeny with a degree 1 endomorphism to get an isogeny with the same kernel, but maybe different eigenvalues. For example replace $ \phi $ by $ - \phi $.