All Questions
Tagged with orthogonal-matrices matrices
46 questions
3
votes
1
answer
234
views
Is there a matrix that has the completely opposite effect of a Hadamard matrix?
First, let me provide some background on the problem:
In the field of Large Language Model quantization/compressions, outliers (abs of outliers are much larger than the mean of abs of all elements in ...
- 31
3
votes
1
answer
190
views
Eigenvalues of certain matrices
We write $R(\theta)=\left(\begin{smallmatrix}\cos(2\pi\theta)&\sin(2\pi\theta)\\ -\sin(2\pi\theta)&\cos(2\pi\theta)\end{smallmatrix}\right)$ for any $\theta\in\mathbb R$.
Let $d,m,n,r$ be a ...
- 2,446
7
votes
2
answers
202
views
When is a linear isomorphism of $M_n(\mathbb{C})$ given by unitary conjugation?
Let $M_n(\mathbb{C})$ represent the space of $n \times n$ matrices over $\mathbb{C}$. We will think of it as a $\mathbb{C}$-vector space.
Notice that if $A \in M_n(\mathbb{C})$ is invertible, then the ...
- 431
1
vote
1
answer
214
views
Conditions of P for existence of orthogonal matrix Q and permutation matrix U satisfying QP = PU
Question: Let $P\in \mathbb{R}^{d\times n}$ be a $d$-rank real matrix and $PP^T = c I_d$ with a certain constant $c > 0$. Under what additional conditions of $P$ does there exist an orthogonal ...
- 187
14
votes
4
answers
2k
views
Measuring the "distance" of a matrix from a diagonal matrix
Let $A$ be a $N \times N$ symmetric positive semi-definite matrix with $N \geq 2$. Let $D$ be a diagonal matrix of dimension $N$. I would like to measure how much $A$ "is far" from $D$, i.e. ...
- 251
8
votes
2
answers
519
views
Orthogonal basis of ${\bf Sym}_n(\mathbb R)$, made of orthogonal matrices
My question is motivated by this one, but within real matrices instead of complex ones.
${\bf Sym}_n(\mathbb R)$ is a vector space of dimension $N=\frac{n(n+1)}2$. Equipped with the scalar product $\...
- 52.4k
2
votes
1
answer
98
views
One question about nega-cyclic Hadamard matrices
Let $n$ be a multiple of $4$, is there any $n \times n$ negacyclic Hadamard matrix? If yes - how to construct it? If no - why?
Here an $n \times n$ nega-cyclic matrix is a square matrix of the form:
\...
- 696
1
vote
1
answer
112
views
Orthonormal matrices with columns that switch signs
Consider an orthonormal matrix $W\in\mathbb{R}^{2n\times 2n}$ that satisfies the "abs property" $$|w_i|^T |w_{i+n}|=1$$ for all $i \in \{1,2,\ldots,n\}$, where $w_i \in \mathbb{R}^{2n}$ is ...
- 13
2
votes
1
answer
207
views
A subgroup of $\mathrm{SL}_n(\mathbb{Z}/p\mathbb{Z})$
Let $p$ be an odd prime, and consider the group
$$\{U\in \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}) : U^{t}U=I \bmod p \}\subseteq \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}).$$
I wonder what is the ...
- 253
8
votes
3
answers
1k
views
Conjecture on the existence of centrosymmetric Hadamard matrices
I work with centrosymmetric matrices and recently have started exploring the question of the existence of centrosymmetric Hadamard matrices.
Definition: An $n \times m$ matrix $A = (a_{i,j})$ is ...
- 539
1
vote
3
answers
347
views
How to optimize for the best fit nonuniform-scale-rotation to a given 3×3 matrix?
Given a matrix $L\in \mathbb{R}^{3 \times 3}$, I'm looking for a method to find the closest (in a least squares sense) product of a non-uniform scaling matrix and a rotation matrix:
$$
\min_{s\in\...
- 723
2
votes
2
answers
185
views
Orthonormal solution of overdetermined linear equations
I have a two matrices $A$ and $B$ in $\mathbb{R}^{m \times n }$ ($m \gg $ n) such that there exists an orthonormal matrix $X \in \mathbb{R}^{n \times n }$, such that:
$$AX = B$$
Given that $X$ is ...
- 123
3
votes
1
answer
255
views
Minimizing quadratic objective under orthogonality constraints
The following problem is motivated from Generalized Procrustes Analysis. I am wondering if it is possible to obtain a closed form minimizer (which may involve SVD or some other decomposition of a ...
- 161
7
votes
2
answers
375
views
Proving a lemma for a decomposition of orthogonal matrices
Setting
Consider two independent orthogonal matrices, which are decomposed into 4 blocks:
\begin{align}
Q_{1}
=
\left[\begin{array}{cc}
A_{1} & B_{1}\\
C_{1} & D_{1}
\end{array}\right]
,
\,Q_{...
- 673
3
votes
1
answer
321
views
The invertible matrices $S$ that satisfy $A=SDS^T$
Any real symmetric matrix $A$ can be written as $A=SDS^T$ for some diagonal matrix $D$ and invertible matrix $S$. Let's fix $D$ to be the (diagonal) inertia matrix of $A$, which has an entry $1, -1, 0$...
- 980
2
votes
1
answer
843
views
Matrix derivative w.r.t. a general inverse form: $(A^TA)^{-1/2}D(A^TA)^{-1/2}$
I want to find derivative of matrix $(A^TA)^{-1/2}D(A^TA)^{-1/2}$ w.r.t. $A_{ij}$ where D is a diagonal matrix. Alternatively, it is okay too to have
$$\frac{\partial}{\partial A_{ij}} a^T(A^TA)^{-1/2}...
- 519
1
vote
1
answer
455
views
About the Hadamard conjecture
On the wikipedia article about Hadamard Matrix it says that "The smallest order that cannot be constructed by a combination of Sylvester's and Paley's methods is $92$"
But it also says that ...
- 27
4
votes
0
answers
1k
views
Can an orthogonal matrix move monotonically toward a signed permutation matrix?
The question is motivated by this question on Mathematics SE.
Let $A \in O(n)$ be an orthogonal matrix that is not a signed permutation matrix, and let $P$ be the nearest signed permutation matrix to $...
- 209
1
vote
5
answers
639
views
Solution for $Xa + X^Tb = c$ where $X^TX = I$? [closed]
There are three known $n\times1$ vectors: $a, b, c$, along with one unknown $n\times n$ matrix: $X$. I am only interested in the $n={2,3}$ cases.
$X$ is $2\times 2$ or $3\times 3$ rotation matrix ...
- 35
0
votes
1
answer
144
views
Maximize function on rotation matrices [closed]
Let $A$ be a fixed 3-by-3 matrix and $Q$ be a rotation matrix whose yaw, pitch, and roll angles are $\phi\in[0,\pi]$, $\theta\in[0,\pi]$, and $\psi\in[0,\pi/2]$, respectively:
\begin{equation}
Q=
\...
6
votes
1
answer
986
views
LU decomposition for orthogonal or unitary matrices?
Is there any references on LU decomposition for orthogonal or unitary matrices?
It seems to me that the diagonal entries of $U$ has some nice structure regarding to the Euler angles of the original ...
- 380
2
votes
1
answer
536
views
Minimize matrix norm over the unitary matrices
Suppose $C_1$ and $C_2$ are some fixed $n \times n$ matrices. Define the norm $\| M \| = \sum_{i = 1}^n \max_j |M_{ij}|$. What is $\min_U \|C_1 U C_2 \|$? Here $U$ ranges over the $n \times n$ unitary ...
- 1,703
3
votes
2
answers
677
views
Parametrising a sparse orthogonal matrix
I need to find a way to parametrise a matrix that is both sparse (to some degree) and orthogonal, i.e., I am looking for a parametrisation that describes $A \in \mathbb{R}^{n\times m}$ such that $AA^𝑇...
- 123
5
votes
1
answer
826
views
Generalization of Jordan's Lemma $A^2=B^2=I$ can be 2-block diagonalized
One of Jordan's lemma states that if two orthogonal matrices $A,B$ are such that $A^2=B^2=I$, then they can be co-diagonalized by block of size 2.
(the proof is easy, consider $x$ an eigenvector of $A+...
- 583
8
votes
1
answer
485
views
A question about special linear group
Is there any way to find all matrices $G \in SL(n,\mathbb Z)$ such that there exists a matrix $A \in GL(n,\mathbb R)$ satisfying
$$
AGA^{-1} \in SO(n,\mathbb R)?
$$
- 2,535
2
votes
0
answers
98
views
Orthogonal Matrices and Cosets (translates) of Linear Subspaces
Let $M_n(F_2)$ be the vector space of all $n\times n$ matrices over the finite field $F_2$. Let $O(n)\subset M_n(F_2)$ be the set of all orthogonal matrices and $W\subseteq O(n)$ be an affine subspace ...
- 205
16
votes
7
answers
2k
views
Is the linear span of special orthogonal matrices equal to the whole space of $N\times N$ matrices?
(Disclaimer : I know very well that $SO(N)$ has a Lie algebra of dimension $N(N-1)/2$ etc. This absolutely not the point of my question.)
To make my problem more understandable, I start with the ...
- 355
2
votes
3
answers
550
views
Inverse of matrix $D + ADA^T$
Let $D$ be an arbitrary diagonal matrix and let $A$ be an orthogonal matrix ($A'A = AA' = I$). How to compute the following matrix inverse efficiently?
$$(D + ADA^T)^{-1}$$
Hints or references are ...
- 89
2
votes
0
answers
79
views
Characterizing a subclass of row-orthogonal matrices
Let $O\in\mathbb{R}^{n\times m}$, $m>n$, be such that $O O^\top =I_n$. (Here $\bullet^\top$ denotes transposition and $I_n$ the $n\times n$ identity matrix.) Consider the following partition of $O$,...
- 2,712
5
votes
1
answer
3k
views
Positive definite matrices diagonalised by orthogonal matrices that are also involutions
Let $A$ be a positive definite matrix. Then, $A$ is diagonalized by an orthogonal matrix $P$.
I want to know when this matrix is also an involution, i.e., $P^2 = I$.
If there is any ...
- 1,269
3
votes
1
answer
416
views
What's the best orthonormal matrix to align two matrices in the operator norm sense?
Let $A,B \in R^{n\times r}$ with $A^\top B $ invertible. It is known that
\begin{equation}
UV^\top :=\arg\min_{R \in \mathcal{O}^{r\times r}}\|AR-B\|_\mathrm{F},
\end{equation}
where $USV^\top$ is ...
- 515
6
votes
1
answer
193
views
What is the term for this type of matrix?
Is there an established term for the following type of square matrices?
$\begin{pmatrix}
c & c & c & c & \cdots & c & c \\
c & a & b & b & \cdots & b & ...
- 202
3
votes
1
answer
412
views
What is the term for a matrix whose columns are orthogonal?
What is the term for a matrix whose columns are mutually orthogonal, but not necessarily othonormal?
I can't name such a matrix "orthogonal" because that would imply that all columns are unit vectors....
- 202
3
votes
0
answers
298
views
Singular value decomposition of a low rank weak diagonally dominant M-matrix. When is the unitary polar matrix positive semi-definite?
Let $A$ be an $n \times n$, non-symmetric, real, weak diagonally dominant M-Matrix. Its diagonal is strictly positive, its off-diagonal is negative or zero and all its columns sum to zero. $A$ has ...
- 323
15
votes
2
answers
480
views
matrix inequality with orthogonal matrices
I would like to know if for $A,B\in SO(3)$ the inequality
$$
\|AB-BA\|_F\leq \|A-I\|_F\|B-I\|_F
$$
holds, where $\|\cdot\|_F$ denotes the Frobenius norm and $I$ the identity matrix. Using the identity
...
- 883
6
votes
2
answers
236
views
Bounding the non-multiplicativity of isometric projection
Every $A \in \text{GL}_n(\mathbb{R})$ has a unique Polar decomposition:
$A=O_AP_A$, $O \in \operatorname{O}_n, P \in \operatorname{Psym}_n$.
In particular the orthogonal factor is given by $$O_A=A(\...
- 6,741
5
votes
1
answer
214
views
When does isometric projection respect multiplication?
Every $A \in \text{GL}_n(\mathbb{R})$ has a unique orthogonal polar factor $O_A=A(\sqrt{A^TA})^{-1}$,
( $A=O_AP_A$, $O \in \operatorname{O}_n, P \in \operatorname{Psym}_n$see Polar decomposition).
...
- 6,741
0
votes
1
answer
460
views
A question on orthogonal matrix [closed]
Let $P\in R^{n\times n}$ be an orthogonal matrix. I want to ask whether or not there exists some vector $x\in R^n$ containing no zero entries such that $Px$ also contains no zero entries.
- 377
0
votes
2
answers
234
views
Functions with scalar times orthogonal Jacobian [duplicate]
I am interested in understanding functions $f:\mathbb{R}^d \rightarrow \mathbb{R}^d $ whose Jacobian at every point $x \in \mathbb{R}^d$ is a scalar times an orthogonal matrix.
I've seen a similar ...
- 3
6
votes
3
answers
3k
views
functions with orthogonal Jacobian
I'm working on a model that would require to use vectorial functions of $\mathbb{R}^n \rightarrow \mathbb{R}^n$, such that $\forall x, y \in \mathbb{R}^n$, $\lVert \frac{df(x)}{dx}(y) \lVert_2 = \...
- 163
2
votes
1
answer
191
views
Heuristics for counting degrees of freedom
I have recently learned about the representation theorem for isotropic,
linear operators, which says the following:
Defintion:
Let $M_n$ be the vector space of $n \times n$ real matrices. We say a ...
- 6,741
1
vote
1
answer
276
views
Dense symmetric unitary integer matrix?
Can someone give me a nontrivial example of a symmetric unitary integer matrix? I'm looking for something as dense as possible (i.e., not too many 0's); 5 <= size <= 8 would be ideal.
1
vote
0
answers
108
views
MInors related problem [closed]
A matrix $A$ has $m$ rows and $n$ colums, such that $m \leq n$. We know that each row of $A$ has the norm $1$ (the norm of an element $x=(x_1,x_2,...,x_n) \in \mathbb{R}^n$ is $||x||=\sqrt{x_1^2+x_2^2+...
- 11
5
votes
2
answers
495
views
Existence of parametrizations of rational orthogonal matrices
I suppose that there are formulas which parametrize all the orthogonal matrices with rational coefficients. Does anyone know anything about it? And what are some publications that discuss this?
Thanks....
0
votes
2
answers
1k
views
Is it possible to obtain the vectors orthogonal to a given one by orthogonal transformations?
Hello, everyone!
Supposing that there is a unit vector in $n$-dimensional real space $\mathbf{x}_1\in\mathbb{R}^n$, I want to get a group of $n-1$ vectors to form an orthogonal basis with $\mathbf{x}...
- 607
5
votes
4
answers
3k
views
Parametrization of O(3)
Is there a simple way to parametrize the orthogonal group O(3) of 3 by 3 orthogonal matrices?
- 95