The geodesics are straight lines, in geodesic normal coordinates, just when the associated projective connection is flat, i.e. the [Weyl tensor](https://en.wikipedia.org/wiki/Weyl_tensor) vanishes. See Kobayashi and Nagano, *On projective connections*, **Journal of Mathematics and Mechanics**, vol. 13, no. 2, 1964.