Take the 2-minute tour ×
MathOverflow is a question and answer site for professional mathematicians. It's 100% free, no registration required.

This is a question about decomposition of order-3 tensors. The survey Tensor Decompositions and Applications give a good account of recent developments in this area.

Let $T$ be an order-3 tensor, i.e., the number of indices for each entry is 3. For instance, an order-3 tensor can be defined as an operator $T:[n_1]\times [n_2] \times [n_3]\to \mathbb{C}$, where $[n_i]=\{1,\dots,n_i\}$. I'm particularly interested in tensors with entries defined over the complex numbers.

There are several ways to decompose a tensor. Two of the most popular are the CP decomposition and Tucker decomposition (see sections 3 and 4 in the paper above).

My questions are:

  1. The paper above define its tensors with entries in $\mathbb{R}$. Does the CP and Tucker decompositions work the same for tensors with entries in $\mathbb{C}$?

  2. In the paper above, page 475 about the Tucker decomposition, it reads "Most fitting algorithms assume that the factor matrices are columwise orthonormal....". Orthonormal in what sense? $\ell_1$ norm, $\ell_2$ norm? If the entries of the tensor are in $\mathbb{C}$, is it correct to assume that the Tucker decomposition always decomposes in 3 unitary matrices?

  3. The same as in question 2, but with the CP decomposition. If your tensor decomposes in matrices $A,B,C$, in page 464 in the paper above, reads "It is often useful to assume that the columns of $A,B,C$ are normalized to length 1 with the weights absorbed in the vector $\lambda\in\mathbb{R}^R$ so that $T=\sum_{r=1}^R \lambda_r (a_r \otimes b_r \otimes c_r)$, where $R$ is the rank of $T$, $\otimes$ is the outer product, and $a_r,b_r,c_r$ are the $r$-th columns of $A,B,C$ respectively. Can we assume w.l.o.g. that $A,B,C$ are always unitary?2.

One important thing to note is that the rank can be different if the tensor is over $\mathbb{R}$ or $\mathbb{C}$. Also, if the number of terms in the summation of both decompositions is the rank, then the decompositions are exact.

share|improve this question
1. I don't see why the decompositions wouldn't work if your tensor had complex entries. 2. Orthonormal must mean using $\ell_2$-norm 3. The columns are normalized to have $\ell_2$-norm equal to 1---why should that allow you have unitary matrices? –  Suvrit Oct 8 '11 at 13:08
@suvrit, regarding 3, that's exactly my question. –  Marcos Villagra Oct 8 '11 at 13:22
I think you cannot do the wlog; having column norms smaller than 1, or with some additional scaling, you can assume each of $A$, $B$, and $C$ to be contractions, and then write them as "sums of unitary" matrices, not just consider only unitary matrices instead. –  Suvrit Oct 8 '11 at 13:28
I see, the "w.l.o.g." is the important part for me right now. –  Marcos Villagra Oct 8 '11 at 13:43
add comment

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.