Fix a cardinal $\lambda$$\newcommand{\cU}{\mathcal U}\newcommand{\cV}{\mathcal V}$. Consider the equivalence relation on $\beta\lambda$ given by $\cU\sim \cV$ when for all first-order structures $M$ we have $M^{\cU}\cong M^{\cV}$.

By considering the structure $(\lambda,A)_{A\subseteq \lambda}$, one can show that the $\sim$-classes have at most $2^\lambda$ elements (arguing as here).

If we consider the action of the symmetric group $S(\lambda)$ on $\beta\lambda$, it is easy to see that for each $\cU\in \beta\lambda$ and $f\in S(\lambda)$, we have $\cU\sim f(\cU)$.

Is the converse also true, namely, if $\cU\sim \cV$, are they necessarily conjugate by a permutation of $\lambda$? If not, is it true for $\lambda=\aleph_0$ (or any $\lambda$)?