$\textbf{Update with some corrections}$:
Unfortunately, my original answer had a serious gap. Sorry for the mix-up. The argument I gave only works when we have estimates on $A_T f(x)$ that are uniform in $T$. However, all the hard work was not useless as it made clear the properties that a counterexample would have. Without further ado, here is an example for which $A_T f(x)$ is smooth while $f(x)$ is not.
Let $M= \mathbb{R^2} =(t,x)$ with the flow $\phi_s (t, x) := (t+s, x)$.
Let $\Psi$ be the following function
$$\Psi(x) = \begin{cases} 0 & x\leq 0 \\ e^{\frac{-1}{x^2}} & x > 0 \\ \end{cases}$$
In particular, we want $\Psi$ to be a smooth function which vanishes to all orders at $0$. Let $f$ be the following function:
$$f(t,x)= \begin{cases} e^{\frac{-t^2}{(\Psi(x))^2}} & x >0 \\ 0 & x \leq 0 \end{cases} $$
The function $f$ is not smooth. In fact, it is not even continuous at $(0,0)$. To show that $A_T f(x)$ is smooth for any $T$, we must only show that it depends smoothly on $x$ near $(0,0)$. For fixed $T$>0, we have the following:
$$A_T(f(t_1,x))= \frac{1}{T} \int_{t_1}^{t_1+T} f(t,x) dt < \frac{\sqrt{ \pi}}{T} \Psi(x) = o(x^k) ~ \forall k >0 $$
From this, it follows that $\frac{\partial^k A_T f}{\partial x^k}(t,0) \equiv 0$, so the derivative of $A_T f$ exists to all orders at $(0,0)$ for $T>0$. The smoothness of $A_T f(x)$ elsewhere is immediate because $f$ is smooth away from the origin.
For an example where $f(x)$ is continuous but not smooth, we can consider the function $\hat f(t,x) = x \cdot f(t,x)$. Here, the same analysis holds except that $f$ is continuous but not differentiable at $(0,0)$.
$\textbf{Original answer with the some corrections}$
This is not a full answer, but I believe that your colleague's result does all the heavy lifting away from the fixed points of the flow, at least once you have good estimates on $A_T f(x)$. The case near a fixed point of a flow seems more difficult. I'm not sure how that works exactly, but if one can understand it in the $1$-dimensional case (i.e. when the flow has a limit point), this might give some good insight. I broke the answer into several sections to help make it more readable.
In this case, the smooth flow locally foliates your manifold, so around any point $p$ one can use the inverse function theorem to choose local coordinates $\{ x_0, x_1, \ldots, x_{n-1} \}$ for which the flow acts as $\phi_t(x_0) = x_0+t$ and $\phi_t(x_i) = x_i$ otherwise. By Professor Burnhol'sBurnol's argument (which I'm black-boxing for this argument) $f( x_0, x_1, \ldots, x_{n-1})$ depends smoothly on $x_0$ when all the other coordinates are fixed.
For fixed $\mathbf{x}^1$ and $\mathbf{x}^2$In order for the rest of the argument to work, we must assume that this estimate is uniform for small $T$ byin the smoothnesschoice of $f$ in the$T$, $t$ variable$\mathbf{x}^1$ and $\mathbf{x}^2$. This uniformity is crucial. We nowallows us to pick $T>0$ small enough so that that for our fixed $\mathbf{x}^1$ and $\mathbf{x}^2$, we have the following:
$$ \| f(t, \mathbf{x}^i) -f(s, \mathbf{x}^i) \|_{C^2} < \epsilon$$ for $0<t,s < T$. This estimate
The choice of $T$ may depend on $\mathbf{x}^1$ and $\mathbf{x}^2$. In particular, we don't expect to be able to do this uniformly in $\mathbf{x}$, but that's okay because we are only doing it for two points.