This concept is usually called biorderability (there is also left- and right-orderability). There are many examples, such as free groups and surface groups. Most spectacularly, the pure braid groups are biorderable, while the full braid groups are left orderable but not biorderable. The left ordering on the braid groups is usually attributed to Dehornoy, though it was discovered even earlier by Thurston (but not published).
Dale Rolfsen has several nice surveys of material related to this on his webpage here. In particular, there is the complete text of a nice book called "Why are braids orderable?" that he wrote with Patrick Dehornoy, Ivan Dynnikov, and Bert Wiest. I believe that a new and much expanded edition of this book was just published.
EDIT 1 : I just found the website for the much-expanded version of Rolfsen et al's book here.
EDIT 2 : Thurston's construction of a left-ordering on the braid groups (which, of course, uses hyperbolic geometry) is very beautiful. It is explained very nicely in the first few pages of the paper "Orderings of mapping class groups after Thurston" by Short and Wiest, which is available on the arXiv here. The intro sections of this paper also contain a brief but enlightening account of the general theory of group orderings.
Also, I have not read it, but there is a book entitled "Orderable Groups" by Rehmtulla and Mura. However, it is from 1977 and will thus omit a lot of recent work.
