I also try to avoid starting sentences with a mathematical symbol. I feel strongly about it, but I can't quite articulate why.

One trick I use that you haven't mentioned yet is something like, "The space $X$ ..." or "The function $f$...".