It is true. You can reduce to the case of simplicial sets by using the fact that $\mathbf{R} \mathrm{Hom} (T, -)$ preserves homotopy limits and (allowing $T$ to vary) is jointly conservative. Finding where this is written down is another matter altogether...
I'll just sketch something more concrete for the case of a simplicial model category $\mathcal{M}$. Let $X : \mathcal{I} \to \mathcal{M}$ be any diagram such that each $X i$ is fibrant. Using the cobar construction of homotopy limits (see e.g. Chapter 18 in [Hirschhorn]), it is immediate that
$$\underline{\mathcal{M}} (T, \operatorname{holim} X) \cong \operatorname{holim} \underline{\mathcal{M}} (T, X)$$
for all cofibrant $T$ in $\mathcal{M}$. On the other hand, $\underline{\mathcal{M}} (T, Z)$ is a model of $\mathbf{R} \mathrm{Hom} (T, Z)$ when $T$ is cofibrant and $Z$ is fibrant. Thus, $\operatorname{holim} X \to X i$ is a weak equivalence in $\mathcal{M}$ if and only if
$$\operatorname{holim} \underline{\mathcal{M}} (T, X) \to \underline{\mathcal{M}} (T, X i)$$
is a weak homotopy equivalence for every cofibrant object $T$ in $\mathcal{M}$. Hence, the claim reduces to the case where $\mathcal{M} = \mathbf{sSet}$.
The same strategy can be used for many other questions about homotopy (co)limits.