One often hears in popular explanations of the failure to find a "Grand Unified Theory" that "Gravity goes off to infinity, but cutting off the edges gives us wrong answers", and other similar mathematically vague statements. Clearly, this issue has some kind of mathematical explanation, but I'm not really qualified to read the corresponding physics work, so I'm wondering what actually fails mathematically.