# Lie groups vs. algebraic groups and deformations

I am interested in deformations of (discrete subgroups of) Lie groups. But, as I understand it, deformation theory, as a theory, prefers to speak schemes.

At least the classical Lie groups can be turned into group schemes, allowing for a standard treatment with deformation theory.

Are there any results from (the deformation theory of) algebraic groups/group schemes, which can not be translated back to the language of Lie groups?

Does studying groups like $\mathrm{SO}_n$ or $\mathrm{U}_n$ as algebraic groups yield equivalent results for $\mathrm{SO}_n$ or $\mathrm{U}_n$ as Lie groups? Can one translate results between differential geometry and algebraic geometry, or are there major stumbling blocks that prevent algebraic results from having any meaning for the differential side?

In particular, in the case of moduli spaces/stacks, the topology is of some interest. But the groups (Lie vs. algebraic) have quite different topologies; the Zariski topology is not Hausdorff and I have no idea what the fppf topology would look like...

If you take, say, set of real points of the group-scheme $O(n)$, i.e., $O(n, {\mathbb R})$, then you recover the usual orthogonal (real Lie) group, which you know as $O(n)$. Same applies to $SL(n)$, etc. There is one case when this does not work well, namely when you deal with character varieties. For instance, take $\pi$, say, the free group on two generators, and try to form the quotient $Q=Hom(\pi, SU(2))/SU(2)$. The standard way to do this is to consider the corresponding character variety (or, rather, affine scheme) $X$ and take its set of real points. However, the result will contain both equivalence classes of representations of $\pi$ to $SU(2)$ (as you expected), but also equivalence classes of representations to $SL(2, {\mathbb R})$! The easiest way to see this is to realize that the coordinate ring of $X$ is generated by traces of the elements $A, B, C=AB$ of $\pi$ (where $A, B$ are the free generators). To get the set of real points, you need to use points with real traces, so you end up with the elements of both real Lie groups $SU(2)$ and $SL(2, {\mathbb R})$. This is rather annoying, but one can learn to live with this problem. Namely, in order to isolate $Q=Hom(\pi, SU(2))/SU(2)$ inside $X({\mathbb R})$, you impose also some inequalities, so $Q$ becomes a real semi-algebraic subset. Same problem appears if you consider $Hom(\pi, SL(2, {\mathbb R}))$: Character variety will give you unitary representations as well. The standard way to deal with this problem (in Teichmuller theory) is to consider not all representations to $SL(2, {\mathbb R})$, but only discrete and faithful ones, so that the commutator $[A,B]$ maps to elements of the fixed trace. Then you can form the (topological) quotient by $SL(2, {\mathbb R})$ by taking slice, i.e., restricting to representations $\rho$ so that the (attractive, repulsive) fixed points of $\rho(A)$ are $0, \infty$ and the attractive fixed point of $\rho(B)$ is $1$.

Addendum: More generally, in all "interesting" case I know, the desired quotient can be constructed without algebraic geometry. Suppose you are interested in $R:=Hom(\pi, O(n,1))$ and the group $\pi$ is "nonelementary", i.e., is not virtually abelian. Then, in $R$ consider the open subset $R'$ consisting of representations $\rho$ so that $\rho(\pi)$ does not fix a point in $S^{n-1}$. For instance, $R'$ will contain all discrete and faithful representations. Then you can just take the "naive" quotient $Q=R'/O(n,1)$ instead of the (set of real points of) character variety $X({\mathbb R})$. Then $Q$ will embed in $X({\mathbb R})$.

Concerning existence of a slice: The same argument I described works for representations to $SL(2, {\mathbb C})$. However, if you consider representations to $O(n,1), n\ge 4$, there is no (in general) global slice. However, locally, it does exist, see e.g. Slice Theorem for the general information about slices for group actions.

Recommended reading: D. Johnson and J. Millson, Deformation spaces, associated to compact hyperbolic manifolds, in "Discrete Groups in Geometry and Analysis" (Papers in honor of G. D. Mostow on his sixtieth birthday), 1984. I read this paper as a graduate student and still find it useful.

By the way, here is where algebraic viewpoint is definitely superior to the Lie theoretic. Suppose that you are interested in understanding local structure of the analytic variety $Hom(\pi, G)$, where $G$ is a real Lie group, i.e., what singularity it has at a representation $\rho: \pi\to G$. In general it is a rather difficult problem as singularities could be "arbitrarily complicated." See M.Kapovich, J.Millson, "On representation varieties of Artin groups, projective arrangements and the fundamental groups of smooth complex-algebraic varieties", Math. Publications of IHES, vol. 88 (1999), p. 5-95, one of the main results there is that singularities of character varieties could be arbitrary (defined over ${\mathbb Q}$).

So, assume that $G=\underline{G}({\mathbb R})$, where $\underline{G}$ is an algebraic group (scheme) over reals. Let $A$ be an Artin local ${\mathbb R}$-ring with the projection to the residue field $\nu: A\to {\mathbb R}$. Then the set of $A$-points $G_A:=\underline{G}(A)$ is a certain nilponent extension of the Lie group $G$ with the quotient $\nu_G: G_A\to G$ induced by $\nu$. Then, instead of analyzing the scheme $Hom(\pi, \underline{G})$ at $\rho$, you consider the collection of real-algebraic sets $Hom_{\rho}(\pi, G_A)\cong Hom_{\rho}(\pi, \underline{G})(A)$, consisting or representations $\tilde\rho: \pi\to G_A$ which project to $\rho$ under $\nu_G$. The point is that the collection of real-algebraic sets $Hom_{\rho}(\pi, G_A)$ "knows everything" (and even more!) about the singularity of $Hom(\pi, G)$. For instance, to recover the (Zariski) tangent space $T_\rho Hom(\pi, G)$, you just take $A$ to be the "dual numbers", which is the quotient ${\mathbb R}[t]/(t^2)$. Then $$T_\rho Hom(\pi, G)\cong Hom_{\rho}(\pi, G_A)$$ for this choice of $A$.

This staff is explained in the paper W.Goldman, J.Millson, The Deformation Theory of Representations of Fundamental Groups of Compact Kahler Manifolds, Publ. Math. I.H.E.S.; 67 (1988).

• Great, that is really interesting. Are there any references for these character varieties $\mathrm{Hom}(\Gamma,G)$ and their quotients? I'm not quite following your point near the end. Are you saying that for discrete and faithful representations the right quotient can always be isolated? Or is that a particular feature of Teichmüller theory, which uses particularly nice features of $\mathrm{SL}_2\,\mathbb{R}$? I would be really grateful for a reference for this process of taking slices as well. May 12, 2012 at 13:41
• See "Addendum." May 12, 2012 at 16:23
• Maybe this should be a new question, but I had a look at the paper of Goldman & Millson. It seems like they end up studying differential graded Lie algebras. How exactly does this tie in with the example you give? I guess $\mathrm{Hom}_\rho(\pi,\underline{G})$ as a functor is somehow equivalent to a deformation functor of the DGLA? May 13, 2012 at 0:53
• Oh, and why do we know that singularities can be arbitrarily complicated? May 13, 2012 at 0:59
• Yes, this functor is equivalent to the functor defined by DGLAs. The origin of this result is very simple: $Hom(\pi, G)$ can be identified with the space of (normalized) flat connections on the base-manifold. Flat connections lead to DGLAs, since a connection can be locally written as $d +A$: The exterior differential $d$ (with values in an appropriate Lie algebra) is responsible for differential in DGLA, while Lie comes from the fact that everything is taking values in a Lie algebra, so you have the Lie bracket, graded comes from natural grading on differential forms. May 13, 2012 at 2:58