Here's an answer for the special case when the base field is Q$\mathbb{Q}$. It involves a large bit of class field theory over Q$\mathbb{Q}$, so I'll be terse.
We start with the lemma which Buzzard mentioned.
Lemma - Let K$K$, L$L$ be finite Galois extensions of Q$\mathbb{Q}$. Then K$K$ is contained in L$L$ if and only if sp(L)$\operatorname{sp}(L)$ is contained in sp(K)$\operatorname{sp}(K)$ (with at most finitely many exceptions).
The proof of the lemma follows from the Chebotarev Density Theorem.
We now show that if the rational primes splitting in K$K$ can be described by congruences, then K/k$K/k$ is abelian.
Proof. Assume that the rational primes splitting in K$K$ can be described by congruences modulo an integer a$a$. This allows us to assume that Sp(K)$\operatorname{Sp}(K)$ contains the ray group P_a$P_a$. The next step is to show that the rational primes lying in P_a$P_a$ are precisely the primes of sp($\Phi_a(x)$)$\operatorname{sp}(\Phi_a(x))$. By the above lemma, this means that K$K$ is contained in a cyclotomic field, hence is abelian.