No. Any local system (vector bundle with constant coefficient transition matrices) admits a flat connection. Equivalently, local systems are given by representations of the fundamental group of the base. In your example, the Möbius bundle over $S^1$ admits a flat connection, since it arises from the sign representation of $\mathbb{Z}$ into $GL_1(\mathbb{R})$.