No, consider the Petersen graph and another with no star in the middle but just a simple pentagon. The former has no 4-cycle, but the latter has one.