There are a few ways to look at this, but let me give a synopsis of Peter Scott's discussion in Section 6 of his 8 geometries paper, because it seems to directly address the question:

*Scott, Peter*, **The geometries of 3-manifolds**, Bull. Lond. Math. Soc. 15, 401-487 (1983). ZBL0561.57001.

(Note: there is also an errata for this reference: http://www.math.lsa.umich.edu/~pscott/errata8geoms.pdf. The corrections mentioned there do not affect this summary. )

Let's set up some standard 3-manifold terminology (anything left out is clearly defined in the reference).

A compact orientable 3-manifold is *irreducible* if is either $S^1 \times S^2$ or every embedded $S^2$ bounds a 3-ball. From now on, assume $M$ is a compact, orientable, irreducible 3-manifold (unless otherwise specified).

A surface $S$ (smoothly) embedded in $M$ is *incompressible* if every embedded curve $\gamma$ in $S$ which bounds a disk in $M$ also bounds a disk in $S$. A compact, orientable, irreducible 3-manifold is *toroidal* if it contains an incompressible torus.

The most natural thing to say is that the affirmative solution to the Geometrization Conjecture implies that a compact, irreducible 3-manifold is either toroidal or is homeomorphic to a quotient of the form $X/\Gamma$ where $X$ is one of the following geometric spaces: $S^3,S^1 \times \mathbb{R},E^3,Nil,Sol, H^2 \times \mathbb{R}, \widetilde{PSL(2,\mathbb{R})}$ or $H^3$ and $\Gamma \subset Isom^+(X)$ acting properly and discontinuously.

If a space admits a Sol geometry it is Haken. In fact, it is both toroidal and has positive first Betti number, (see [Scott, Theorem 4.17]).

The remaining geometries are either $H^3$ or Seifert fibered. Of course, some Seifert fibered manifolds like $T^3 \cong S^1 \times S^1 \times S^1$ are both toroidal and Seifert fibered and there are other minor pathologies: for example, $RP^3 \# RP^3$ is Seifert fibered and reducible and in the wake of Geometrization manifolds with $S^3$ geometry are exactly those with finite fundamental group.

Happily, Scott gives a clean statement of what you want in the conjecture on page 484 (of course the affirmative solution to the Geometrization Conjecture implies this conjecture is now known to be true):

**Conjecture (now theorem)**: Let $M$ be a closed, irreducible, non-Haken 3-manifold with infinite fundamental group. Then $M$ is either a Seifert fibered space or admits a hyperbolic structure.

To connect this statement to the comments mentioned above, if we assume $M$ is Seifert fibered, non-Haken, irreducible, and has infinite fundamental group, then it is *small Seifert fibered*, which implies $M$ that the base orbifold of $M$ is $S^2(a_1,a_2,a_3)$ with $1/a_1 + 1/a_2 + 1/a_3 \leq 1$.