Let me just add that your background in EE can, in a way, be an advantage while pursuing career in mathematics, since you have experience in looking at things from a different angle - through practical aspects. Personally I am in a similar situation, but due to some reasons, can't do graduate studies in mathematics, but hoping for a PhD in (Applied?) Mathematics.