Reference request for manifold learning - MathOverflow

Reference request for manifold learning

2011-03-09T17:59:24Z

I am interested in learning about manifold learning (no pun intended) and would like to know of some references that discuss the subject from a more geometric perspective. By manifold learning I mean the idea of studying high dimensional data using techniques from geometry. I'm interested in knowing how topics from differential geometry and topology such as Hodge theory and Morse theory can be used to study questions in manifold learning. I thought I would ask if people have any recommendations for papers or books that explain these topics more from a more geometric perspective.

Update: I expect that there is no mythical survey paper that explains all aspects of manifold learning to someone that knows about geometry and topology. Specifically, I would be interested in knowing of some survey papers which explain how tools from Riemannian geometry would be useful in manifold learning. Perhaps how such tools can be used for nonlinear dimensionality reduction.

Answer by Stefan Waldmann for Reference request for manifold learning

2011-03-09T18:09:05Z

There are of course many interesting and good textbooks on differential geometry around. Personally, I like very much the one of Michor (published in the AMS, but there are chances that he has some pdf on his homepage). However, this is a rather generic differential geometry textbook. Also the books of Lang and of Lee (both GTM Springer) are usefull and cover a lot of material.

For Hodge theory on compact Riemannian manifolds, I think the still valid standard textbook is Warner's book (in GTM Springer), though this books is in some aspects (notation...) not quite what I personally like.

Answer by JSE for Reference request for manifold learning

2011-03-24T15:54:31Z

Here's the web page for a seminar on this stuff we ran at Wisconsin, featuring a list of references at the top. I think Gunnar Carlsson's expose is very well-written and interesting, though it's certainly more about algebraic topology than differential geometry (i.e. the goal is to compute homology, not differential invariants like curvature.) The work of Smale, Niyogi, and Weinberger (for instance, this paper) approaches the same problem from a slightly different point of view and is also really interesting.

Answer by Chirag Lakhani for Reference request for manifold learning

2011-04-10T01:17:07Z

I came across a nice video lecture by Niyogi that gives a nice survey of manifold learning. I thought I would share in case anyone else was interested.

http://videolectures.net/mlss09us_niyogi_belkin_gmml/

Answer by Tarun Chitra for Reference request for manifold learning

2011-04-10T05:26:12Z

This is not exactly what you're looking for, but on the subject of Topology in Computer Science, here are two recommendations I can make:

Topology and its Applications, William F. Basener, Wiley-Interscience, 2006
Topology for Computing, Afra Zomorodian, Cambridge University Press, 2006

They both give some inkling into the Differential Topology aspects of Machine Learning. Also, not sure if you've already seen this, but here are some lectures from the likes of Smale on Machine Learning.