No, it is not true. For example, let $\mathbf{Z}/2$ act on $\mathbf{Z}$ by inversion, and $G$ be the semidirect product. Then $\mathbf{Z}$ is a torsion-free finite index normal subgroup of $G$, but one easily computes that the rational cohomology of $G$ is trivial, by the Hochschild-Leray-Serre spectral sequence for the extension.