Yes. You can compute $RHom_A(G,X)$ as Hom-complex from a projective resolution $P^\cdot$ of $G$ to $X$.  You have a natural map $Hom_A(G,X) \to RHom_A(G,X)$ induced by thinking of a map $G\to X_k$ as a map of the projective resolution.  You know this map is an quasi-isomorphism (apply the spectral sequence to the double complex of Homs, taking homology with respect to the complex $P^\cdot$ first; the next page of the sequence is $Hom_A(G,X)$), so you just need to show that it's a B-module map. But that's clear from the construction.