The initial motivation for this question is a very practical problem: I need to find the absolute minimum of a function on a very large symmetric group $\Sigma_N$ (with $N$ 10000 or more). So if anyone knows some method to do this which is unrelated to the question, please tell.
What I thought to try is this: embed the group (which I will denote by $\Sigma$) into a compact Riemannian manifold $M$, extend the function to a smooth function on $M$ (my function is such that I am confident I can do it in a satisfactory way), find its minima using analytic methods, and then find group elements closest to these minima.
For this to work, the embedding $\Sigma\hookrightarrow M$ must be uniform in some sense. There are several versions, and in each case I want to find $M$ of dimension as small as possible.
Version "$1$": each faithful orthogonal representation $V$ of $\Sigma$ gives an embedding $\Sigma\hookrightarrow O(V)$ into the compact Lie group $O(V)$. Let $m_1(\Sigma)$ be the smallest among the dimensions of the $O(V)$;
Version "$1'$": given a representation as above, there might be subgroups $H$ of $O(V)$ which do not intersect the image of $\Sigma\hookrightarrow O(V)$. Then the composite $\Sigma\hookrightarrow O(V)\twoheadrightarrow O(V)/H$ will give an embedding of $\Sigma$ into a homogeneous space. Let $m_{1'}(\Sigma)$ be the smallest among the dimensions of the $O(V)/H$;
Version "$2$": consider embeddings $i:\Sigma\hookrightarrow M$ into compact Riemannian manifolds which have the property $$ d(i(\sigma\sigma'),i(\sigma'))=d(i(\sigma),i(1)) $$ for any $\sigma,\sigma'\in\Sigma$, where $d$ is distance in $M$, and furthermore there exists a group $G$ of isometries of $M$ which sends $i(\Sigma)$ to itself and the resulting action of $G$ on $\Sigma$ is transitive. Let $m_2(\Sigma)$ be the smallest among the dimensions of such $M$.
Version "$2'$": same as "$2$" except that we fix a generating set $\Gamma\subseteq\Sigma$ and only require the above distance equality in the case when $\sigma\in\Gamma$ (whereas $\sigma'$ is still arbitrary). Let $m_{2'}(\Sigma)$ be the corresponding smallest dimension.
I think it is easy to show that $m_1\geqslant m_{1'}\geqslant m_2\geqslant m_{2'}$. Of these, $m_1$ is easy to find as soon as one knows representations of $\Sigma$. The question is
Do any of the other modifications give any advantage, or are all these numbers actually equal? In case they are not, how could one find minimal embeddings with dimension smallest in all of the above senses?
Concerning $2'$ - it can be viewed as a task of isometrically embedding a Cayley graph of $\Sigma$; I found a related question on MO, isometric embeddings of Cayley graphs in "nice" spaces, but that focuses on infinite groups...
In case the question for general finite groups seems to you hopeless, - as I said I only need to deal with very large symmetric groups.
(Later edit)
In view of the comment by YCor below, it seems that I have to restrict the manifolds I mention in $2$ and $2'$.
Version "$3/2$": same as in "$2$" but $M$ restricted to be of constant positive curvature; thus it is either a(n exotic) sphere, or its quotient by a finite discontinuous group action. The corresponding minimal numbers thus sit between cases $1$ and $2$.