Suppose $X$ is a path connected space such that every connected covering space of $X$ is trivial (1-fold.) Must $X$ be simply connected?

Intuitively, the answer seems to be no (imagine taking a disk, cutting out a square, and gluing in $T\times T$ where $T$ is the topologist's sine curve.) But this is a rather weak intuition.