Whenever I've heard the term "elementary number theory", the speaker seems to mean "analytic number theory"
I would imagine that the reason for not using complex numbers is at least partially related to the idea that they're going over old results, that were essentially developed before the development of complex analysis.
Hope that helps