The geodesics are straight lines, in geodesic normal coordinates, just when the associated projective connection is flat, i.e. the Weyl tensor vanishes. See Kobayashi and Nagano, *On projective connections*, **Journal of Mathematics and Mechanics**, vol. 13, no. 2, 1964.