The celebrated Chevalley–Shephard–Todd theorem says that $\mathbb C[V]^{S_n}$ is a polynomial algebra and gives the generators of this algebra, where $V$ is the standard (or natural) representation of the symmetric group $S_n$. I am just curious to know for what other representations of $S_n$ the generators of this algebra is known ? When is this algebra a polynomial algebra ?

5$\begingroup$ It is a polynomial algebra exactly for the groups generated by pseudoreflections (this in particular tells you the precise representation) This is the full content of the CST theorem. $\endgroup$– Mariano SuárezÁlvarezMar 17, 2012 at 16:12

$\begingroup$ (See mathoverflow.net/questions/52457/…, which is relevant here) $\endgroup$– Mariano SuárezÁlvarezMar 17, 2012 at 16:12

4$\begingroup$ I know the theorem you state as the fundamental theorem of symmetric functions. ChevalleyShephardTodd is a more general theorem. $\endgroup$– Qiaochu YuanMar 17, 2012 at 16:44

5$\begingroup$ @Mariano: This doesn't quite cover the question of whether $S_n$ acts as a reflection group is some other representation though, and in fact the realisation of $S_6$ as a reflection group in a nonstandard way in $5$dimension shows that there is something to check. $\endgroup$– Geoff RobinsonMar 17, 2012 at 21:50

1$\begingroup$ @Mariano: It's what was intended by the bracketed "this in particular tells you the precise representation" that was unclear to me. $\endgroup$– Geoff RobinsonMar 18, 2012 at 22:52
2 Answers
Let $n \ge 7$. If $V$ is an irreducible representation of $S_n$ such that $\mathbb{C}[V]^{S_n}$ is a polynomial algebra then either $V$ is the trivial representation, the sign representation or the $(n1)$dimensional standard representation.
Outline Proof: Let $\rho : S_n \rightarrow \mathrm{GL}(V)$ be an irreducible representation affording the irreducible character $\chi^\lambda$ where $\lambda$ is a partition of $n$. Suppose that $V$ is $d$dimensional. By the ChevalleyShephardTodd theorem, $\mathbb{C}[V]^{S_n}$ is a polynomial algebra if and only if $\rho(S_n)$ is generated by pseudoreflections. If $\rho(g)$ is a pseudoreflection then $\rho(g)$ is similar to a diagonal matrix $\mathrm{diag}(1,1,\ldots,1,\zeta)$ where $\zeta$ is a root of unity. Hence $\chi(g) = d1 + \zeta$. However, the irreducible characters of symmetric groups are real valued, so if $g \not= 1_{S_n}$ then $g$ is an involution and $\chi^\lambda(g) = d2$.
It therefore suffices to show that if $n \ge 7$ and $g \in S_n$ is an involution such that $\chi^\lambda(g) = \chi^\lambda(1)2$ then $g$ is a transposition and either $\lambda = (1^n)$ or $\lambda = (n1,1)$. This follows by induction using the MurnaghanNakayama rule. (The details are fiddly but routine.)
Edit: Geoff Robinson shows in his answer (posted at the same time as mine) that $g$ is a product of at most $3$ transpositions. This leads to a quick inductive proof: suppose that $\lambda$ has two removable boxes, whose removal gives partitions $\mu$ and $\nu$ of $n1$. If $\mu \not= (n1)$ and $\nu \not= (n1)$ then, by induction, we have $\chi^\lambda(g) \le \chi^\lambda(1)4$. Hence $\lambda = (n1,1)$. In the remaining case $\lambda$ is a rectangular partition, and provided $n\ge 8$, we can repeat this argument after removing two boxes from $\lambda$ in two different ways.
For smaller $n$ there are two exceptional cases, corresponding to the partitions $(2,2)$ of $4$ and $(2,2,2)$ of $6$. The former representation is $2$dimensional and is obtained from the standard representation of $S_3$ via the quotient map $S_4 \rightarrow S_3$. The latter is $5$dimensional, and can be obtained by applying the outer automorphism of $S_6$ to the standard $5$dimensional representation of $S_6$; the relevant character value is $\chi^{(2,2,2)}(g) = 3$ where $g = (12)(34)(56) \in S_6$.
I only concern myself with faithful representations of $S_n$ and for $n >4$. The only way to get a polynomial algebra of invariants is to represent $S_n$ as a complex reflection group (so generated by pseudoreflections, that is elements wih a fixedpoint space of codimension $1$). A complex relfection group is easily checked to always be a direct product of ireducible complex reflection groups, so from now on I consider only irreducible representations. The question then becomes: is there an irreducible representation of $S_n$ other than the usual $n1$dimensional irreducible constituent of the natural permutation character, where $S_n$ is represented as a complex reflection group? Note that tensoring with the sign representation of the stated $n1$dimensional representation does not produce a representation of $S_n$ as a complex reflection group. There is still some content to this question. It can probably be easily addressed by the MurnaghanNakayama rule, or from a more detailed knowledge of the character table of $S_n,$ but I attempt a direct argument here. Since the characters of $S_n$ are rationalvalued, any element represented as a pseudo reflection in the given representation must be represented as a genuine (or "real") reflection, since its trace must be rational. The generating reflections for $S_n$ in the given representation act with determinant $1,$ so lie outside the derived group $A_n.$ Hence they are odd permutations, and expressible as a product of an odd number of (disjoint) transpositions, since they have order $2$. Since $A_n$ is simple ( as $n \geq 5$,) any single conjugacy class of these reflections generates the whole of $S_n,$ so we assume that all the generating reflections are conjugate. Note that we are not yet entitled to assume that the generating reflections are transpositions. Now we note that the product of two generating reflections has order $1,2,3,4$ or $6.$ For such a product has a fixed point space of codimension $0$ or $2,$ has determinant $1$, and has a rational trace. Now if $k >1$ is odd, a product of $k$ transpositions inverts a $2k+1$cycle in $S_{2k+1}.$ Hence if $k > 3,$ and $n \geq 2k+1,$ then $S_{n}$ contains a pair of conjugate permutations, each a product of $k$ disjoint transpositions, whose product has order $2k+1.$ When $n = 2k$ we may express a $2k$cycle as a product of two permutations, one a product of $k$ disjoint transpositions, the other a product of $k1$ disjoint transpositions. Since $k > 3,$ if we adjoin a transposition interchanging the fixed points of the second permutation, we get a product of two permutations, each a product of $k$ disjoint transpositions, where the product is a product of two disjoint cycles of lengths (allowing a $1$cycle) whose sum adds to $n.$ Since $n \geq 10,$ such a product never has order $1,2,3,4,5$ or $6.$ Hence we can assume that our generating reflections are products of at most three transpositions. Furthermore, if $n \geq 8,$ we can express a $5$cycle in $S_n$ as a product of permutations, each a product of three disjoint transpositions. For we may express a $5$cycle in $S_5$ as a product of two permutatons, each a product of two disjoint twocycles. Affix a transposition commuting with the $5$cycle to each of them, and this does not change the product. Hence if our reflections are products of $3$ disjoint $2$cycles, we are left with the case $n =6.$ In fact, this case does occur. "Twist" the natural (nonunimodular) irreducible $5$dimensional representation of $S_6$ by the exceptional outer automorphism of $S_6,$ and we obtain a reflection representation of $S_6$ in which products of $3$ disjoint $2$cycles act as reflections. It remains to deal with reflection representations of $S_n$ in which transposition act as reflections. I presume that the MurnaghnNakayama rule or the character table of $S_n$ then shows that only the expected representation arises, but I leave that issue open here. (Later Edit: This now seems to be covered by Mark Wildon's answer).

$\begingroup$ Thanks Robinson and Wildon for the beautiful answers. Now come to the 1st part of the question. Is there any reference for the generators of the ring of invariants of the reflection representation of $S_6$ ? Any references for the generators and relations for other representations of $S_n$ ? $\endgroup$– markMar 18, 2012 at 16:10

3$\begingroup$ @mark: The ring of nvariants of the nonstandard $5$dimensional reflection representation of $S_6$ is the same as the ring of invariants for the standard one. The matrices whih are acting are the same, it's just that bacuase of teh action of the outer automorphism, in the twisted version they are associated to different group elements. If you like, the outer automorphism of $S_6$ induces an automorphism of the ring of invariants. There may be a question of knowing explicitly what the action of that automorphism is. Other question: try DJ Benson's book. $\endgroup$ Mar 19, 2012 at 8:22

$\begingroup$ @mark: Thanks for the accept, but I think Mark Wildon's answer is more complete and definitive. $\endgroup$ Mar 19, 2012 at 10:20