MathOverflow will be down for maintenance for approximately 3 hours, starting Monday evening (06/24/2013) at approximately 9:00 PM Eastern time (UTC-4).
show/hide this revision's text 8 added 278 characters in body

I have been thinking about this question for quite some time but now this question by Denis Serre revived some hope.

Question. Let $x,y$ be invertible matrices (say, over $\mathbb C$) and $[x,y,y]=x$ where $[a,b]=a^{-1}b^{-1}ab$, $[a,b,c]=[[a,b],c]$. Does it follow that some power of $x$ is unipotent?

The motivation is this. Consider the one-relator group $\langle x,y \mid [x,y,y]=x\rangle$. It is hyperbolic (proved by A. Minasyan) and residually finite (that is proved in my paper with A. Borisov). If the answer to the above question is "yes", then that group would be non-linear which would provide an explicit example of non-linear hyperbolic group.

Update 1. Can $x$ in the above be a diagonal matrix and not a root of 1?

Update 2. The group is residually finite(proved by A. Borisov and myself), so it has many representations by matrices such that $x, y$ have finite orders (hence their powers are unipotents).

Update 3. The group has presentation as an ascending HNN extension of the free group: $\langle a,b,t \mid a^t=ab, b^t=ba\rangle$. So it is related to the Morse-Thue map. Properties of that map may have something to do with the question. See two quasi-motivations of the question as my comments below.

show/hide this revision's text 7 Added update 2

I have been thinking about this question for quite some time but now this question by Denis Serre revived some hope.

Question. Let $x,y$ be invertible matrices (say, over $\mathbb C$) and $[x,y,y]=x$ where $[a,b]=a^{-1}b^{-1}ab$, $[a,b,c]=[[a,b],c]$. Does it follow that some power of $x$ is unipotent?

The motivation is this. Consider the one-relator group $\langle x,y \mid [x,y,y]=x\rangle$. It is hyperbolic (proved by A. Minasyan) and residually finite (that is proved in my paper with A. Borisov). If the answer to the above question is "yes", then that group would be non-linear which would provide an explicit example of non-linear hyperbolic group.

Update 1. Can $x$ in the above be a diagonal matrix and not a root of 1?

Update 2. The group is residually finite (proved by A. Borisov and myself), so it has many representations by matrices such that $x, y$ have finite orders (hence their powers are unipotents).

show/hide this revision's text 6 deleted 337 characters in body

I have been thinking about this question for quite some time but now this question by Denis Serre revived some hope.

Question. Let $x,y$ be invertible matrices (say, over $\mathbb C$) and $[x,y,y]=x$ where $[a,b]=a^{-1}b^{-1}ab$, $[a,b,c]=[[a,b],c]$. Does it follow that some power of $x$ is unipotent?

The motivation is this. Consider the one-relator group $\langle x,y \mid [x,y,y]=x\rangle$. It is hyperbolic (proved by A. Minasyan) and residually finite (that is proved in my paper with A. Borisov). If the answer to the above question is "yes", then that group would be non-linear which would provide an explicit example of non-linear hyperbolic group.

Update1. Can $x$ in the above be a diagonal matrix and not a root of 1?

Update 2. Can $x=\left(\begin{array}{lll} 2 & 0 & 0\\ 0& 1 & 0\\ 0 & 0 & \frac12\end{array}\right)$ and the matrices of size $3$ with $\det=1$? In other word let $x$ be this matrix. Is there a $3\times 3$ matrix $y$ with $\det(y)=1$ such that $[x,y,y]=x$? Perhaps somebody with a good Groebner basis software can check it.

show/hide this revision's text 5 added 251 characters in body
show/hide this revision's text 4 added 79 characters in body; added 11 characters in body
show/hide this revision's text 3 added 83 characters in body
show/hide this revision's text 2 edited tags
show/hide this revision's text 1