A necessary condition is that, for every word $w(x,y)$ in two letters, we have $${\rm Tr}w(A_i',A_i)={\rm Tr}(B_i',B_i).$$ If $r=1$ (one pair only), this condition is also sufficient; this is Specht's Theorem. Notice that the symmetry assumption is not important here.
In the present case, a necessary condition is that for every word $w$ in $2r$ letters, one has $$w(A_1,A_1',\ldots,A_r,A_r')=w(B_1,B_1',\ldots,B_r,B_r').$$ Whether it is also a sufficient condition is unclear to me.