Question

For one take, see Feynman's lectures at Cornell. Among other things, he talks about how there are many equivalent axiomatizations for physics. Although the different axiomatizations are mathematically equivalent, they suggest different understandings of the world, and hence different experiments on the one hand and different metaphysics on the other.