You might have a look at Chapter VI of Borel's "Seminar on transformation groups". This is the chapter on "Isotropy groups of toral actions" by E. E. Floyd.

In particular Theorem VI.1.2 seems to be saying that the fixed point sets eventually stabilize. (I can give more details if you don't have the reference to hand.)