Let $X$ be an infinite set and let $\text{End}(X)$ be the set of all functions $f:X\to X$. For $f\in\text{End}(X)$ let $$\text{fix}(f) = \{x\in X: x = f(x)\},$$ and $$\text{Com}(f) = \{g\in\text{End}(X): g\circ f = f \circ g\}.$$ It is not hard to prove that if $2^{|\text{fix}(f)|} > |X|$ then $|\text{Com}(f)|> |X|$. Does the converse hold?
EDIT: I forgot to include the condtion that $X$ is an infinite set - apologies.