Let $X$ be an $n \times n$ invertible square matrix over some field $\mathbb{F}$, and let $Y = XX^T$ be the product of the matrix with its transpose.
When $\mathbb{F} = \mathbb{R}$, $Y$ is positive-definite, so it is easy to see that for any subset $S \subseteq \{ 1, 2, \dots, n \}$, the matrix $Y_{S,S}$ obtained by considering only the elements with indices in $S$ is also invertible (as it is positive-definite). Moreover, this holds whenever $\mathbb{F}$ is a subfield of a real-closed field.
Now, when $\mathbb{F} = \mathbb{F}_p$, we lack the notion of positive-definiteness. Is is still the case that $Y_{S, S}$ is invertible?
Context: The reason I ask is because I would like to be able to invert a matrix $X$ using blockwise inversion (it has asymptotic complexity proportional to matrix multiplication, compared with $O(n^3)$ for Gaussian elimination), and that relies on certain minors being invertible. So for an invertible matrix $X$, we can express:
$X^{-1} = X^T(XX^T)^{-1}$
and invert the positive-definite matrix $XX^T$ by blockwise inversion (which is guaranteed to work if we're operating over $\mathbb{R}$).