<strike>Pick some $\gamma_1\in L\setminus\mathbb Q$ which is not a square.</strike>  Pick some $\gamma\in L^\times/(L^\times)^2$ which is not fixed by $\operatorname{Gal}(L/\mathbb Q)$ and fix a lift $\gamma_1\in L$.  Let $\gamma_1,\ldots,\gamma_n$ be the orbit of $\gamma_1$ under $\operatorname{Gal}(L/\mathbb Q)$.  Then it is an easy exercise in Galois theory to show that:

1. $L(\sqrt{\gamma_1},\ldots,\sqrt{\gamma_n})/L$ is Galois with abelian Galois group $\subseteq(\mathbb Z/2\mathbb Z)^n$.
1. $L(\sqrt{\gamma_1},\ldots,\sqrt{\gamma_n})/\mathbb Q$ is Galois with nonabelian Galois group $\subseteq\operatorname{Gal}(L/\mathbb Q)\ltimes(\mathbb Z/2\mathbb Z)^n$.