In PDEs, various values of p arise as degrees of regularity. The Sobolev embedding theorems let you "trade in" generalized derivatives for classical derivatives. You might need the exponent p to be above a certain threshold to get a desired regularity result.

Still, I agree with your observation that much of the time the values of p that matter are 1, 2, and infinity.