We use [Von Neumann's trace inequality][1] to prove the proposition.
\begin{align}
\|UV^T\|_\sigma&=\text{tr}\sqrt{VU^TUV^T}=\text{tr}\big(\sqrt{U^TU}\sqrt{V^TV}\big)\\
&\le \sum_{i=1}^n\sigma_i\big(\sqrt{U^TU}\big)\sigma_i\big(\sqrt{V^TV}\big) \quad \text{(Von Neumann's trace inequality)}\\
&=\sum_{i=1}^n\sigma_i(U)\,\sigma_i(V) \\
&\le\Big(\sum_{i=1}^n \sigma_i(U)^2\Big)^\frac12
\Big(\sum_{i=1}^n \sigma_i(V)^2\Big)^\frac12 \quad\text{(Cauchy-Schwartz inequality)} \\
&= \|U\|\|V\| \le \frac12\big(\|U\|^2+\|V\|^2\big), \quad\text{(arithmetic-geometric mean inequality)}
\end{align}
where $\sigma_1(M)\ge\sigma_2(M)\ge\cdots\sigma_n(M)$ are the singular values of the matrix $M$.

Now take the singular value decomposition of $X=ASB^T$ where $S$ is the diagonal matrix of the singular values of $X$ and $A$ and $B$ are the associated orthogonal matrices. For $U=A\sqrt S$ and $V=B\sqrt S$, 
$$\|U\| = \sqrt{\text{tr}(ASA^T)}=\sqrt{\text{tr}\,S}$$
and the same for $V$. We also have
$$\|UV\|_\sigma=\text{tr}\,S$$
So both $\|U\|\|V\|$ and $\frac12\big(\|U\|^2+\|V\|^2\big)$  achieve its minimum at $U=A\sqrt S$ and $V=B\sqrt S$.

We obtain the desired result.


  [1]: https://en.wikipedia.org/wiki/Trace_inequalities#Von_Neumann's_trace_inequality