Let $X$ be a smooth variety (over $\mathbb{C}$) and $\Delta: X \rightarrow X \times X$ be the diagonal embedding and $p_1: X\times X\rightarrow X, ~p_2: X\times X\rightarrow X$ be the projections to the first and second components. Let $E$ be a finite dimensional vector bundle on $X$. We define $$ E_{\Delta}:=\Delta_*E $$ to be a sheaf on $X\times X$. In particular we have $\mathcal{O}_{\Delta}:=\Delta_*\mathcal{O}$. We have the sheaf Ext functor $\mathcal{Ext}$ on $X\times X$.
$\bf{My~question}$ is: do we have the isomorphism $$ {Rp_1}_*\mathcal{Ext}_{X\times X}^{\bullet}(E_{\Delta},E_{\Delta})\cong {Rp_1}_*\mathcal{Ext}_{X\times X}^{\bullet}(\mathcal{O}_{\Delta},\mathcal{O}_{\Delta})\otimes \mathcal{End}(E) ? $$
I know that when $X$ is affine, they are isomorphic since $E$ is then free. But does it also hold in the general case?