Let $\epsilon > 0$ be a small parameter and consider the following lemma.

Lemma. Let $B(t)$ be a bounded, continuous, $R^{n \times n}$-valued function defined on a time interval $[0,T]$ such that all real parts of the eigenvalues of $B(t)$ are bounded from above by $-2\kappa$, where $\kappa$ is a positive constant. Let $\Phi^\epsilon(t,s)$ be the fundamental matrix that solves the initial value problem (IVP): \begin{equation} \label{ivp} \frac{\partial \Phi^\epsilon(t,s)}{\partial t} = \frac{B(t)}{\epsilon} \Phi^\epsilon(t,s), \ \ \Phi^\epsilon(s,s)=I, \ \ 0 \leq s \leq t \leq T. \end{equation} Then there exists a constant $C$ and a constant $\epsilon_{0} > 0$ such that \begin{equation}\|\Phi^\epsilon(t,s)\| \leq C e^{-\kappa(t-s)/\epsilon} \end{equation} for all $\epsilon \leq \epsilon_{0}$ and for all $s,t \in [0,T]$.

Let us work with the probability space $(\Omega, \mathcal{F}, \mathbb{P})$ and let $E$ denotes expectation with respect to $\mathbb{P}$. If $B(t)$ is bounded random process the constant $\epsilon_0$ (related to the modulus of continuity of the function $B$) depends, in general, on $\omega \in \Omega$, i.e. $\epsilon_0 = \epsilon_0(\omega)$.

Now consider $$A^\epsilon(t) = \int_0^t \Phi^\epsilon(t,s) F(s) ds,$$ where $F(s)$ is a bounded continuous stochastic process and $\Phi^\epsilon(t,s)$ solves the IVP above (with $B(t)$ satisfying the assumptions in the lemma but is random).

I would like to derive an estimate for $A^\epsilon(t)$ in the limit as $\epsilon \to 0$, in particular, a bound on $$E\sup_{t \in [0,T]} |A^\epsilon(t)|^p$$ for $p>0$. Here is what I have so far (setting $p =1$ for simplicity for now). For $\epsilon < \epsilon_0(\omega)$,

$$\left|\int_0^t \Phi^\epsilon(t,s) F(s) ds \right| \leq \sup_{s \in [0,t]}|F(s)| C \int_0^t e^{-\kappa (t-s)/\epsilon} ds =: D \frac{\epsilon}{\kappa }(1-e^{-\kappa t/\epsilon}).$$ The above is a $\mathbb{P}$-a.s. bound. Now, $$E \sup_{t \in [0,T]} \left|\int_0^t \Phi^\epsilon(t,s) F(s) ds \right| \leq \frac{2D}{\kappa } E \epsilon_0(\omega).$$ This estimate is not helpful as I would like to obtain its asymptotic behavior as $\epsilon \to 0$. Moreover, $\epsilon_0(\omega)$ is a random variable whose expectation is generally not known. I am aiming for the above quantity to be of $O(\epsilon)$ in the limit $\epsilon \to 0$ but I am not sure how I could get this (had the $\epsilon_0$ been a constant rather than a random variable, it would be easy to get the asymptotic behavior).