Yes, this can hold for non-normal extensions, for example $F=\mathbb Q(2^{1/3})$. We can always map $\alpha\mapsto\beta$ by a $\mathbb Q$-automorphism $\sigma: \mathbb Q(\alpha)\to \mathbb Q(\beta)$, and there are no intermediate fields here since $[F:\mathbb Q]=3$. (So in the example, if $\alpha\notin\mathbb Q$, its minimal polynomial will have no other zeros in $F$.)