MathOverflow will be down for maintenance for approximately 3 hours, starting Monday evening (06/24/2013) at approximately 9:00 PM Eastern time (UTC-4).

## OCR for handwritten mathematics

I am in the process of scanning a large collection of handwritten notes. They consist of diagrams and formulae with a relatively small proportion of actual words. Of course it would be hopeless to get an OCR program to digest the diagrams or formulae, but it would be useful if I could get one to find and transcribe enough of the words to build an index. Has anyone tried this kind of thing?

-
Tangentially related: meta.math.stackexchange.com/questions/3731/… (It is not entirely hopeless to get OCR to digest formulae.) – Willie Wong Apr 30 2012 at 8:08
Use wetware. It needn't even be grad students: ordinary MSc students work fine for this. They will transcribe most of the formulas too, though usually not the diagrams. – Zsbán Ambrus Apr 30 2012 at 9:21
I thought MSc students are also grad students, by definition. Anyway, if you do opt for "wetware", be sparing... :) – Felix Goldberg Apr 30 2012 at 11:29
The question is specific to mathematics because OCR systems use heuristics that may well break if the words are interspersed between non-words. If many people had used many different systems then they would probably have information about which systems were more or less affected by this issue. But perhaps the relevant experiments have not been done yet. – Neil Strickland Apr 30 2012 at 13:47
This is much more suited to stack overflow, voting to close. – Igor Rivin Apr 30 2012 at 17:49

I recommend www.inftyreader.org. They have a trial version, with long enough trial period to do a big project. I've used InftyReader on a flakey old laptop and it did a pretty good job for a math book reissue. It took about half an hour or so to do each 40 page bundle of the disassembled book. It made systematic errors in the tex, many of which I was able to correct with some awk commands, but of course I still had to go through the whole thing tediously. I was not going for perfection, but just for something editable, and I think it came out better than required for this purpose.

-
The notes are handwritten I assume the book was not. – quid May 1 2012 at 1:09
While I am very happy to have learned about the existence of InftyReader, I can confirm that it was not able to digest my handwritten notes. – Neil Strickland May 1 2012 at 7:43

To supplement Bob Terrell's post, here is an example from InftyReader.

Snippet from an input image, scanned at 600dpi:

Snippet from output of the corresponding LaTeX produced by InftyReader:

It's not perfect—$\partial z \partial \bar{z}$ becomes $\partial z k$—but it's pretty impressive!

-
Did you try it with something handwritten, too? This iw what the question seems to be about. – quid May 1 2012 at 1:11
@quid: No. I am less interested in the question Neil posed than I am in learning what this neat software can do. InftyReader is designed to work on scanned images of printed mathematics, not handwriting. – Joseph O'Rourke May 1 2012 at 1:44

I am searching for an OCR too to save my handwritten M.Sc notes. So far I have come to realize that I might have to learn LaTeX or a TeX software to write and compile notes into postscript or pdfs of all my notes. But learning LaTeX is a big challenge. Its like learning a big programming language to master it will take time.

-
It's really not that bad. You use the basics 90% of the time, and they don't take more than an hour to learn. – Charles Nov 15 at 17:47
This is not an answer to the original question – Yemon Choi Nov 15 at 19:57
Read question again. I dont think there are OCR software out there that will actually extract text from image files of handwritten text. Tried a couple of online OCR's and tesseract software. No Success so far. They are all designed to extract text from either Typewritten/Printed material or handwritten characters entered directly into a computer interface using a digital pen or a mouse. – Fazal Karim Nov 21 at 10:02
Some that are there like SimpleOCR need to learn your handwritting before converting. The results in my case were highly discouraging. – Fazal Karim Nov 21 at 11:56