Let $K$ be a number field, and let $X_K$ be a $K$-variety.

The etale fundamental group of $X_K$, as defined in SGA1, classifies the automorphisms of finite etale covers of $X_K$. Some of these etale covers are not geometric. For example, if $L$ is a finite field extension of $K$, then $X_L\rightarrow X_K$ is a finite etale cover. A cover $Y$ of $X_K$ is called regular (think: geometric) if it doesn't have an extension of scalars (to be precise, if $K$ is algebraically closed in the function field of every connected component of $Y$).

I know, however, that there is no "regular etale fundamental group" for $X_K$, that classifies the automorphisms of just the regular finite etale covers of $X_K$. I vaguely recall hearing in a conference that this is because the regular etale covers don't form a Galois category. Is that correct? What fails for them to form a Galois category? This question has been in the back of my mind ever since I started working with the etale fundamental group.