I've been told that it's important to know modern physics, Differential Geometry and Algebraic Topology for understanding higher structures. Is there any other prerequisite for understanding Lurie's work? Since the title of the book indicates, I guess Algebraic Geometry is also important. Please tell me if I'm wrong. Moreover how deep should I known on those subjects and others I do not mention?