Finding this subset of columns is a non-trivial task, but some approximate answers are known. For details and pointers, please refer [to my answer here.][1] [1]: https://mathoverflow.net/questions/104803/optimizing-the-condition-number/104858#104858