We consider the following function $\psi$ on an open subset $V\subset M,$ a Riemannian manifold of dimension $m,$ so that $\exp_p:U\to V$ is a diffeomorphism with its inverse $\log_p: V\to U$. Let $v\in T_pM$ be a fixed vector and define the function $\psi$ by:
$$\psi:V\to \mathbb{R}:=\psi(x):=\langle v,\log_p x\rangle_{T_pM}$$
We'd like to calculate its gradient $\nabla{\psi}(x).$ So I attempted this:
Let $\gamma:(-\epsilon,\epsilon)\to V \subset M$ be a smooth curve (not necessarily a geodesic) so that $\gamma(0)=x,\gamma'(0)=w\in T_xM.$ We calculate $D\psi_x(w)$ next and based on what we get, we'll then use: $D\psi_x(w)=\langle\nabla{\psi}(x),w\rangle_{T_xM},$ and perhaps use a normal chart that contains both $p,x.$ But I'm getting stuck here - any help, hint or solutions greatly appreciated!
So we go:
$$D\psi_x(w)=\frac{d}{dt}|_{t=0}\psi(\gamma(t))=\underbrace{\frac{d}{dt}|_{t=0}\langle v,\log_p{\gamma(t)}\rangle_{T_pM} }$$
This is where (see the underbrace) I'm getting stuck - I know that I can write the last quantity above as $\langle v,\frac{d}{dt}|_{t=0}\log_p{\gamma(t)}\rangle_{T_pM}.$ But I'm having trouble at calculating $,\frac{d}{dt}|_{t=0}\log_p{\gamma(t)}.$ Here I'd like to use the fact that $\gamma'(0)=w\in T_xM,$ and maybe some normal neighborhood that contains both $p,x$. But I've no idea how — any help, hint or solutions greatly appreciated!