Indeed, the number of fixed points is divisible by $2^{\dim X}$. This is actually an old result of Conner and Floyd, Periodic maps which preserve a complex structure, Bull. Amer. Math. Soc. 70, no. 4 (1964), 574-579. As @SashaP mentions, Atiyah and Bott observed that it is also a consequence of the holomorphic Lefschetz formula (Notes on the Lefschetz fixed point theorem for elliptic complexes, Matematika 10, no. 4 (1966), 101-139).