Let $F$ be a $p$-adic field. Let $(G_{F}, W_{F}, I_{F})$ denote the (absolute Galois group, Weil group, inertia group) of $F$. Let $X/F$ be a proper smooth variety. Let $\ell$ be a prime number $\ne p$. The $\ell$-adic cohomology $H_{\ell}^{i} = H_{\text{ét}}^{i}(X_{\bar{F}}, \mathbb{Q}_{\ell})$ is naturally endowed with a continuous Galois representation $\rho$.
The Weil–Deligne representation
By the $\ell$-adic monodromy theorem of Grothendieck, one associates a Weil–Deligne representation with $H_{\ell}^{i}$: It gives a nilpotent “monodromy” operator $N$. One restricts the representation $\rho$ to $W_{F}$, and changes it to $$ \sigma (\Phi^{a}x) = \rho(\Phi^{a}x) \exp(-t(x)N), \qquad a \in \mathbb{Z}, x \in I_{F} $$ where $\Phi \in W_{F}$ is a Frobenius element, and $t \colon I_{F} \to \mathbb{Z}_{\ell}$ a projection onto the $\ell$-adic component of $I_{F}$.
The Weil–Deligne representation associated with $H_{\ell}^{i}$ is $(\sigma, H_{\ell}^{i}, N)$. It is an object in $\mathrm{WDRep}_{\mathbb{Q}_{\ell}}(W_{F})$.
Question
Choose an (non-canonical, non-continuous!) embedding $i_{\ell} \colon \mathbb{Q}_{\ell} \to \mathbb{C}$. By extending scalars, we obtain an object $(\sigma, H_{\ell}^{i}, N) \otimes_{i_{\ell}} \mathbb{C}$ in $\mathrm{WDRep}_{\mathbb{C}}(W_{F})$.
Let $\ell' \ne p$ be another prime. Let $i_{\ell'} \colon \mathbb{Q}_{\ell'} \to \mathbb{C}$ be an embedding. We can repeat the entire process to obtain an object $(\sigma, H_{\ell'}^{i}, N) \otimes_{i_{\ell'}} \mathbb{C}$ in $\mathrm{WDRep}_{\mathbb{C}}(W_{F})$.
Q. Are $(\sigma, H_{\ell}^{i}, N) \otimes_{i_{\ell}} \mathbb{C}$ and $(\sigma, H_{\ell'}^{i}, N) \otimes_{i_{\ell'}} \mathbb{C}$ isomorphic in $\mathrm{WDRep}_{\mathbb{C}}(W_{F})$?
From a motivic viewpoint this should certainly be true, but on the other hand maybe this is one of the strongest forms of $\ell$ independence that one can ask for.
If there is no answer in general, I would be very happy to learn about partial cases, where this is known.