I have seen that if $G$ is a finite group and $H$ is a proper subgroup of $G$ with finite index then $ G \neq \bigcup\limits_{g \in G} gHg^{-1}$. Does this remain true for the infinite case also?