I also try to avoid starting sentences with a mathematical symbol.  I feel strongly about it, but I can't quite articulate why.

One trick I use that you haven't mentioned yet is something like, "The space $X$ ..." or "The function $f$...".