@Ryan answers the question in three dimensions (and such a result cannot hold without the Poincare conjecture, since otherwise you could take a connected sum with a fake $S^3.)$ In general, this is a special case of the Borel Conjecture, which is known to hold in dimension four for groups of subexponential growth, such as $\mathbb{Z}^4$ (in the topological category). For more, see @Igor Belegradek's answer to this question, and references therein.
Igor Rivin
- 96.4k
- 11
- 153
- 366