This is a crosspost from math.stackexchange
Given a Riemannian manifold $M$, let $c(t) = \exp_p(tX)$ be the geodesic emanating from $p \in M$ with initial value $X$. Let $t_0$ be small enough, then we have to ways to map $T_pM$ to $T_{c(t_0)} M$ isomorphically. One is the parallel transport along $c$, let's call it $P_{c, 0, t_0}$ and the other is given by $$ d \exp_p|_{tX}: T_{tX}T_pM \cong T_p M \longrightarrow T_{\exp_p(tX)}M = T_{c(t_0)}.$$
My question is: What is the relation between those two? Are there formulas which relate the two concepts with curvature terms?
The parallel transport is a linear isometry, and the derivative of the exponential map is a radial isometry by the Gauss lemma, meaning $$ \langle d \exp_p|_{tX} \cdot Y, \dot{c}(t) \rangle = \langle Y, X \rangle $$ for all $Y \in T_pM$.
In two dimensions, this means that the two mappings coincide up to scaling, as there is only on orthogonal direction to the radial one. However, in higher dimensions, this is not true, i guess. However, on $S^3$, I computed that the derivative of the exponential map conincides with the parallel transport except that vectors orthogonal to the direction of parallel transport are multiplied by $\frac{\sin r}{r}$.