I am a Masters student of math interested in physics. When I was an undergraduate, I took the introductory course of physics, but it is just slightly harder than high school physics course. To be precise, it just taught us how to use calculus in physics, without involving the higher knowledge of math such as manifold, PDE, abstract algebra and etc. By the way, the knowledge in that course is "discrete", the connections between fields of physics is omited.
My question is, what I should do to learn "real physics" by myself? What books or materials should I read?