As you point out, there are some general matrix facts in here. Consider the eigendecomposition of a matrix: $A = S \Lambda S^{-1}$, where $S$ and $S^{-1}$ are orthonormal (implying their determinant is 1), so we have $|A| = |\Lambda|$. Since $\Lambda$ is a diagonal matrix (with entries equal to eigenvalues), the determinant is the product of the eigenvalues. In the two dimensional case: $|A| = \lambda_1 \lambda_2$.
How does this connect with minimum and maximum directional derivatives? Any matrix is a linear transformation, which if we stick to the direction of the eigenvectors $v_i$, it just means applying some stretching; think of the definition of eigenvalues: $Av_i = \lambda_i v_i, \; \lVert Av_i\rVert = |\lambda_i|$ (where we are considering unitary vectors $\lVert v_i \rVert = 1$). Any other direction can be expressed as an average of eigenvectors (again we are working with unitary vectors here), and it will also be strectched by an average of the eigenvalues:
$$x = av_1 + (1-a)v_2 \; \rightarrow \; Ax = A(av_1 + (1-a)v_2) = a\lambda_1 v_1 + (1-a)\lambda_2 v_2 \; \rightarrow \\
\rightarrow \lVert Ax \rVert = |A| \lVert av_1 + (1-a)v_2 \rVert = a|\lambda_1| + (1-a)|\lambda_2|, \; a \in (0,1).
$$
(We can pull the vectors $v_i$ out of the norm $\lVert \cdot \rVert$ preserving equality because they are orthogonal).
This means the amount of stretching will be something in between $\lambda_1$ and $\lambda_2$, or in other words, that $\lambda_1$ and $\lambda_2$ represent the extreme (maximal and minimal) amounts of stretching.
So in summary, the determinant equals the product of the eigenvalues, which represent (in 2D) the maximal and minimal amounts of stretching of a linear transformation and in the case of the Jacobian these are maximal and minimal directional derivatives.