I'm sure this is well known to people experienced with manifolds, but do you know of a text book mention that this fact?

Thanks for this example. It seems that you can use the same argument for the identity matrix, and then you can conclude that $P(\|A\| = \|B\|)$ is going to be high for other matrix norms which specialize to the the largest absolute element on diagonal matrices.