To read this paper, or the Landsberg book, or any other papers in this field, one must deal with certain notation for tensors representing matrix multiplication. Here is my attempt at an explanation of this. Let us fix dimensions $a,b,c \geq 0$ and suppose we are interested in multiplying $a \times b$ with $b \times c$ matrices. This is a bilinear map $$\operatorname{Mat}_F(a,b) \otimes \operatorname{Mat}_F(b,c) \to \operatorname{Mat}_F(a,c)$$ (I'm writing $\operatorname{Mat}_F(a,b)$ for the space of $a \times b$ matrices over a field $F$) or in other words $$F^{a \times b} \otimes F^{b \times c} \to F^{a \times c},$$ hopefully the notation there is clear enough. As a bilinear map this corresponds to a tensor in $$ F^{a \times b} \otimes F^{b \times c} \otimes (F^{a \times c})^* .$$$$ (F^{a \times b})^* \otimes (F^{b \times c})^* \otimes F^{a \times c} .$$ Recall that matrices are linear maps, so $F^{a \times b} \cong (F^a)^* \otimes F^b$, and similarly for the other factors. The above tensor product factors as: $$ (F^{a*} \otimes F^b) \otimes (F^{b*} \otimes F^c) \otimes (F^{c*} \otimes F^a) $$$$ (F^a \otimes F^{b*}) \otimes (F^b \otimes F^{c*}) \otimes (F^c \otimes F^{a*}) $$ (up to the isomorphismisomorphisms like $(A^* \otimes C)^* \equiv A \otimes C^*$$(V^* \otimes W)^* \equiv V \otimes W^*$, commutativity of tensor product, etc).
Well, by properties of trace, $$ \operatorname{tr}(ABC^t) = \operatorname{tr}(BC^tA) $$ and this translates into $M_{\langle a,b,c \rangle} = M_{\langle b,c,a \rangle}$, equivalence of multiplying $a\times b$ times $b \times c$, with multiplying $b \times c$ times $c \times a$. (There is some fiddling because we use $c \times a$ matrix $C^t$ instead of $a \times c$ matrix $C$, and likewise $b \times a$ matrix $A^t$ instead of $a \times b$ matrix $A$.) Likewise, by transposition, $$ \operatorname{tr}(ABC^t) = \operatorname{tr}(CB^tA^t) $$ which translates into $M_{\langle a,b,c \rangle} = M_{\langle c,b,a \rangle}$. Using these we can get all the permutations of $a,b,c$.
I am writing literal equality of tensors because they are all tensors in "the same" space $$ F^{a*} \otimes F^b \otimes F^{b*} \otimes F^c \otimes F^{c*} \otimes F^a , $$$$ F^a \otimes F^{b*} \otimes F^b \otimes F^{c*} \otimes F^c \otimes F^{a*} , $$ well, "the same" space up to isomorphismscommutativity and associativity of tensor products by permuting the order of the factors.
With all of this, the original question is about multiplication of $2 \times k$ by $k \times 2$ matrices. I personally would have chosen to denote the tensor for this as $M_{\langle 2,k,2\rangle}$, for whatever reason it seems instead to be denoted $M_{\langle k,2,2\rangle}$, but in the end it doesn't matter, they are all the same, and all the same as $M_{\langle 2,2,k\rangle}$. And this tensor has border rank at least $3k$, conjecturally at most $3k+1$.
Finally to list out a few explicit identifications:
- $(2 \times k) \times (k \times 2)$ is $M_{\langle 2,k,2 \rangle}$
- $(2 \times 2) \times (2 \times k)$ is $M_{\langle 2,2,k \rangle}$
- $(k \times 2) \times (2 \times 2)$ is $M_{\langle k,2,2 \rangle}$
The above are all "the same" (up to commutativity and associativity of tensor products). In contrast,
- $(k \times 2) \times (2 \times k)$ is $M_{\langle k,2,k \rangle}$
- $(2 \times k) \times (k \times k)$ is $M_{\langle 2,k,k \rangle}$
and so on. The Conner-Harper-Landsberg paper discusses both of these (among many other cases). The multiplication in this MathOverflow question is $M_{\langle 2,2,k \rangle}$.