I'll keep the question specific to the scenario I'm working with, which is the Lie group SO(3) and its Lie algebra so(3).
Consider two rotation matrices $R_0$ and $R_1$, and define $R_t = \exp_{R_1} ((1-t) \log_{R_1} (R_0))$, for $t \in (0, 1)$. This interpolates between $R_0$ and $R_1$. If I'm not mistaken, this can be expressed as $R_t = R_1 \exp ((1-t) \log (R_1^\top R_0))$. Computing the time derivative yields $\dot{R_t} = -R_1 \exp ((1-t) \log (R_1^\top R_0)) \log(R_1^\top R_0) = -R_t \log(R_1^\top R_0)$.
Here's my first question. If $R_t$ is a curve defined on SO(3), then $\dot{R_t}$ should lie on $so(3)$. However, the expression above, $\dot{R_t} = -R_t \log(R_1^\top R_0)$, does not necessarily lie on so(3). Where is my mistake? I'm guessing my reasoning is wrong somewhere related to the frame of reference, whether $\dot{R_t}$ actually lies on so(3) or in the tangent space of SO(3) at $R_t$.
As a follow-up, and related question related to simulating ODEs in SO(3). In general, given an ODE $\dot{R_t} = v(R_t, t)$, where $v(R_t, t)$ lies on so(3), one can simulate it using the recurrence $R_{t+\delta} = R(t) \exp(\delta v(R_t, t))$. Let's now say that I want to define an ODE whose solution traces the path $R_t = \exp_{R_1} ((1-t) \log_{R_1} (R_0))$. I happen to know that the vector field $v(R_t, t)$ that achieves this is given by $v(R_t, t) = -\log (R_1^\top R_0)$, which is the expression I gave above for $\dot{R_t}$ without the pre-multiplication by $R_t$. How can we derive this? Why is the pre-multiplication by $R_t$ not included?
I suppose both questions are very related, as in both cases the problematic bit is the multiplication by $R_t$. Any clarifications are extremely welcome, and pointers and recommendations to study and understand these things are also appreciated (hopefully introductory material, I'm a computer scientist not a mathematician, but somewhat advanced could also work). (Is any of this related to the adjoint operator to move between tangent spaces at different points?)
(For the interested reader, I'm trying to derive things in this paper, specifically trying to go from equation 4 to equation 5, the expression for $\dot r_t$)
Update The first question I believe is solved by noting that the tangent space of SO(3) at some arbitrary rotation matrix $R$ is given by $R S$, where $S$ is skew-symmetric. This is exactly the form given above. So that appears to be correct.
The question that remains for me then is: Why, if I want to update $R(t)$ in the direction of $\dot R(t)$ (like simulating the dynamics using Euler discretization), we get the update $R(t + \delta) = R(t) \exp(\delta S)$, where $S=-\log(R_1^\top R_0)$.
Update #2 I think I solved my doubts. I was confused by the $\exp$ and $\log$ maps when applied at the tangent space at some rotation $R \neq I$ (denote them by $\exp_R$ and $\log_R$). $\exp_R$ takes as inputs elements in the tangent space at $R$ (which are given by $R v$ with $v$ skew symmetric), and $\log_R$ takes as input rotations relative to $R$, and outputs elements of the form $R w$, with $w$ skew symmetric.
Now it all adds up. The ODE would be given by $\dot{R_t} = R_t v(R_t, t)$, with $v$ skew symmetric, and the Euler step looks like $$R_{t+\delta} = R_t \exp_{R_t}(\delta R_t v(R_t, t)) = R_t \exp(\delta v(R_t, t)).$$
Overall, using $v_R$ to denote an element of the tangent space of SO(3) at $R$ (i.e. $v_R = R v$ for some skew symmetric v) and $M$ a rotation matrix (expressed as $M = R M_\Delta$), the $\exp_R$ map can be computed as (expressing the result in an absolute way and not relative to $R$) $$\exp_R(v_R) = R\exp(R^\top v_R) = R \exp(v) = M \rightarrow \exp(v) = M_\Delta.$$
Then $\log_R$ can be computed as $$\log_R(M) = v_R = R \log (R^\top M) = R \log(M_\Delta).$$