I am looking for the largest Wasserstein distance to the uniform distribution among all probability distributions with uniform marginals.

More specifically, let $\Xi=\{1,2,\ldots,N\}^2$, and let $\nu$ be a uniform distribution on $\Xi$, namely, $\nu_{ij}:=\nu(\{(i,j)\})=\frac{1}{N^2}$, for all $1\leq i,j\leq N$. Consider the problem \begin{equation} \max_{\mu\geq0} \bigg \{ W(\mu,\nu):\ \sum_{i}\mu_{ij} = \frac{1}{N}, \forall j,\ \sum_{j} \mu_{ij}=\frac{1}{N}, \forall i \bigg\}, \tag{1} \end{equation} where $W_1(\mu,\nu)$ is the Wasserstein distance between probability distribution $\mu:=\{\mu_{ij}\}_{1\leq i,j\leq N}$ and $\nu$, defined as $$ W_1(\mu,\nu) := \min_{\pi\geq0} \bigg\{\sum_{1\leq i,j,i',j' \leq N} ||(i,j)-(i',j')||_1 \pi_{(i,j),(i',j')}:\ \sum_{i,j} \pi_{(i,j),(i',j')} = \nu_{i'j'},\forall i',j',\ \sum_{i',j'} \pi_{(i,j),(i',j')} = \mu_{ij},\ \forall i,j\bigg\}. $$

My conjecture is that the maximizer of problem $(1)$ is given by $\mu_{ij}=\frac{1}{N}{1}_{\{i=j\}}$, or $\mu_{ij}=\frac{1}{N}{1}_{\{i+j=N+1\}}$, namely, the comonotonic/countermonotonic distribution. But how to prove/disprove it? Also, if it is true, could the result be extended to the multivariate case, namely, $\Xi=\{1,2,\ldots,N\}^K$ for $K>2$, or be extended for norms other than $\ell_1$-norm, or other $W_p$ distance ($p>1$)?

Update: Steve provides an affirmative answer for $\ell_1$-norm with $W_1$ distance in the case of $K=2$, and I provide a proof for $\ell_2$ norm with $W_2$ distance for all $K\geq2$. I am wondering if we can get some other result, such as $\ell_1$-norm with $K>2$, or $\ell_\infty$-norm.