Let $f : \mathbb{R} \to \mathbb{R}$ be a smooth function and $A,B$ be $n \times n$ self-adjoint matrices that commute.
Then, I see that $f(A+tB)$ is a well-defined matrix-valued function for real variable $t$ by means of fuctional calculus.
Now, I would like to expand $f(A+tB)$ around $t=0$, which must yield \begin{equation} f(A+tB)=f(A)+f'(A)(tB)+\frac{f''(A)}{2}(tB)^2+R_2(A,B) \end{equation}
However, I cannot figure out how I can get an explicit formula for the remainder $R_2(A,B)$ as in the ordinary Taylor Theorem.
I think $R_2(A,B)$ should take the form \begin{equation} R_2(A,B)=\frac{f'''(A)}{6} (t^*B)^3 \end{equation} for some $t^*$ but how can we determine the range in which $t^*$ is?
This might look like a trivial question but seems trickier than expected for me. Could anyone help me?