For a homogeneous metric there is no reason for a geodesic loop at a point to be necessarily a closed geodesic. Counterexamples can probably be constructed already using metrics on the 3-sphere constructed by rescaling the round metric along the fiber of the Hopf fibration.