No. In fact, given a finite set of primes $S=\lbrace p_1,p_2,\ldots,p_n\rbrace$, we can find a finite extension $K$ of $\mathbb{Q}$ in which elements of $S$ decompose in any way that we like. That is, for any numbers $r_i\ge1$ and $e_{i1},e_{i2},\ldots,e_{ir_i}\ge1$, we can find an extension $K$ in which $p_i$ decomposes as $$ p_i\mathcal{O}\_K=\mathfrak{p}\_{i1}^{e\_{i1}}\mathfrak{p}\_{i2}^{e\_{i2}}\cdots\mathfrak{p}\_{ir_i}^{e\_{ir_i}} $$ for all $i=1,\ldots,n$, with $\mathfrak{p}\_{ij}$ being distinct primes of $\mathcal{O}\_K$. Furthermore, if $f_{ij}$ are positive integers with $d=\sum_{j=1}^{r_i}e_{ij}f_{ij}$ independent of $i$ then this can always be done such that $[K\colon\mathbb{Q}]=d$ and $[\mathcal{O}\_K/\mathfrak{p}\_{ij}\colon\mathbb{Z}/p_i\mathbb{Z}]=f_{ij}$. For $p_i$ to split completely, this just means that we use $e_{ij}=f_{ij}=1$ and $r_i=d$.
Here's a construction I came up with: Let $k_{ij}$ be an extension of the $p_i$-adic numbers $\mathbb{Q}\_{p_i}$ in which $p_i$ has ramification index $e_{ij}$ and such that the extension of residue fields is of degree $f_i$. We can do this by adding an $e_{ij}$'th root of $p_i$ to the splitting field of $X^{p_i^{f_i}}-X$ over $\mathbb{Q}_{p_i}$. Letting $R_{ij}$ be the elements of $k_{ij}$ which are integral over $\mathbb{Z}\_{p_i}$, the primitive element theorem implies that $k_{ij}=\mathbb{Q}_{p_i}(x_{ij})$ for some $x_{ij}\in R_{ij}$. Let $f_{ij}\in\mathbb{Z}\_{p_i}[X]$ be the minimal (monic) polynomial of $x_{ij}$. This will have degree $[k_{ij}\colon \mathbb{Q}\_{p_i}]=e_{ij}f_{ij}$. Also, $f_{ij}$ will be irreducible in $\mathbb{Z}/p_i^r\mathbb{Z}$ for sufficiently large $r$. Set $f_i=\prod_{j}f_{ij}$ which is monic of degree $d$.
Now, using the chinese remainder theorem, there will be a monic degree $d$ polynomial $f\in\mathbb{Z}[X]$ such that $f=f_i$ mod $p_i^r$ for each $i$, and $f=X^d+p$ mod $p^2$, for some prime $p\not\in S$. Eisenstein's criterion implies that $f$ is irreducible in $\mathbb{Q}[X]$, and Hensel's lemma implies that in $\mathbb{Q}\_{p_i}[X]$, $f$ splits into a product of irreducible terms equal to $f_{ij}$ mod $p_i^r$. Taking $K=\mathbb{Q}(x)$ for a root $x$ of $f$ gives the claimed extension.