Questions tagged [orthogonal-matrices]
An orthogonal matrix is an invertible real matrix whose inverse is equal to its transpose.
115 questions
3
votes
1
answer
321
views
The invertible matrices $S$ that satisfy $A=SDS^T$
Any real symmetric matrix $A$ can be written as $A=SDS^T$ for some diagonal matrix $D$ and invertible matrix $S$. Let's fix $D$ to be the (diagonal) inertia matrix of $A$, which has an entry $1, -1, 0$...
- 980
3
votes
1
answer
464
views
Bounding the Frobenius norm of orthogonalised matrices
Context: I am trying to show the convergence of an optimization method which includes orthogonalization in the update step.
Problem: Let's say I have real matrices $A, B \in \mathcal{R}^{n xm}$. If ...
- 33
3
votes
1
answer
412
views
What is the term for a matrix whose columns are orthogonal?
What is the term for a matrix whose columns are mutually orthogonal, but not necessarily othonormal?
I can't name such a matrix "orthogonal" because that would imply that all columns are unit vectors....
- 202
3
votes
1
answer
191
views
Eigenvalues of certain matrices
We write $R(\theta)=\left(\begin{smallmatrix}\cos(2\pi\theta)&\sin(2\pi\theta)\\ -\sin(2\pi\theta)&\cos(2\pi\theta)\end{smallmatrix}\right)$ for any $\theta\in\mathbb R$.
Let $d,m,n,r$ be a ...
- 2,446
3
votes
1
answer
234
views
Is there a matrix that has the completely opposite effect of a Hadamard matrix?
First, let me provide some background on the problem:
In the field of Large Language Model quantization/compressions, outliers (abs of outliers are much larger than the mean of abs of all elements in ...
- 31
3
votes
1
answer
331
views
Variant of Wahba's problem
Wahba's problem is the following:
$$\min_R \sum_{k=1}^K \|v_k - Rw_k\|^2$$
where $v_k$ and $w_k$ are arbitrary $3\times 1$ vectors, and $R$ is a rotation matrix (i.e., orthogonal with $\det(R)=1$).
A ...
3
votes
1
answer
255
views
Minimizing quadratic objective under orthogonality constraints
The following problem is motivated from Generalized Procrustes Analysis. I am wondering if it is possible to obtain a closed form minimizer (which may involve SVD or some other decomposition of a ...
- 161
3
votes
1
answer
275
views
Is the Cayley distance on permutation (matrices) equivalent to the Riemannian metric on $O(n)$?
Denote by $d_C(\sigma,\mu)$ the minimal number of transpositions needed to go from a permutation $\sigma$ to a permutation $\mu$. E.g. if $d_C(\sigma,\mu)=0$, then $\sigma=\mu$, if $d_C(\sigma,\mu)=1$,...
- 131
3
votes
0
answers
46
views
Evaluate $\int_\phi e^{tr(RM)} dR$ where $\phi$ is a set of all real orthonormal matrices of a certain size
I am trying to evaluate $\int_\phi e^{tr(RM)} dR$ where $\phi$ is a set of all real orthogonal matrices of a certain size. $M$ is an arbitrary real matrix (of a certain size).
This is equivalent to
$$\...
- 433
3
votes
0
answers
185
views
Differentiable functions on $\mathbb{R}^n$ whose derivative is everywhere a scalar multiple of a special orthogonal matrix
The Cauchy–Riemann equations say that if $u : \mathbb{C} \rightarrow \mathbb{C}$ is holomorphic then, regarded as a linear transformation of $\mathbb{R}^2$, its derivative is either zero or, up to a ...
- 11.2k
3
votes
0
answers
156
views
Matrix equation and spherical harmonics
I have a set of functions expanded in a finite number of spherical harmonics (up to degree $L$),
$$
\eta_k^n(\theta,\phi) = \sum_{l=0}^L \sum_{m=-l}^l d_{kl}^{nm} Y_l^m(\theta,\phi)
$$
Similar to the ...
- 69
3
votes
0
answers
298
views
Singular value decomposition of a low rank weak diagonally dominant M-matrix. When is the unitary polar matrix positive semi-definite?
Let $A$ be an $n \times n$, non-symmetric, real, weak diagonally dominant M-Matrix. Its diagonal is strictly positive, its off-diagonal is negative or zero and all its columns sum to zero. $A$ has ...
- 323
2
votes
2
answers
664
views
On $XX'=I$ such that $AX=XB$ is true when $A,B\in\{0,1\}^{n\times n}$
Given real symmetric matrices $A,B\in\{0,1\}^{n\times n}$ is it true that $$AX=XB$$ has a solution of form $X$ a permutation matrix iff a solution with $XX'=I$ exists? We are over reals.
It is clear ...
- 13.9k
2
votes
3
answers
550
views
Inverse of matrix $D + ADA^T$
Let $D$ be an arbitrary diagonal matrix and let $A$ be an orthogonal matrix ($A'A = AA' = I$). How to compute the following matrix inverse efficiently?
$$(D + ADA^T)^{-1}$$
Hints or references are ...
- 89
2
votes
1
answer
207
views
A subgroup of $\mathrm{SL}_n(\mathbb{Z}/p\mathbb{Z})$
Let $p$ be an odd prime, and consider the group
$$\{U\in \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}) : U^{t}U=I \bmod p \}\subseteq \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}).$$
I wonder what is the ...
- 253
2
votes
1
answer
78
views
Reference for irreducible representations of $\mathcal{O}(n)\ni O\mapsto O^{\otimes k}$
This MO answer cites the Goodman-Wallach book to affirm that:
$$\mathrm{Sym}^k\left(\mathbb{R}^n\right)=\mathcal{H}^k\oplus q\mathcal{H}^{k-2}\oplus q^2\mathcal{H}^{k-4}\oplus\cdots$$
with $\mathrm{...
- 167
2
votes
2
answers
185
views
Orthonormal solution of overdetermined linear equations
I have a two matrices $A$ and $B$ in $\mathbb{R}^{m \times n }$ ($m \gg $ n) such that there exists an orthonormal matrix $X \in \mathbb{R}^{n \times n }$, such that:
$$AX = B$$
Given that $X$ is ...
- 123
2
votes
1
answer
3k
views
Number of 5x5 matrix permutations without repetitions in rows or columns
Context
In the boardgame Azul, your goal is to complete as much as possible of a $5\times5$ board by placing 25 tiles of 5 different colours (5 tiles of each colour) so that no colour appears twice in ...
- 123
2
votes
1
answer
1k
views
maximum of orthogonal vectors
$$v_1=(x_1,x_2,x_3\cdot\cdot\cdot,x_n)$$is such a vector. By changing its signs and positions of each component $x_i$, we can get different vectors. When n is odd, it's impossible for any of ...
- 167
2
votes
1
answer
99
views
One question about nega-cyclic Hadamard matrices
Let $n$ be a multiple of $4$, is there any $n \times n$ negacyclic Hadamard matrix? If yes - how to construct it? If no - why?
Here an $n \times n$ nega-cyclic matrix is a square matrix of the form:
\...
- 696
2
votes
1
answer
164
views
The only rotation fields satisfying this PDE are constant
$\newcommand{\div}{\operatorname{div}}$$\newcommand{\SO}{\operatorname{SO(2)}}$$\newcommand{\R}{\operatorname{\mathbb{R}}}$$\newcommand{\bdx}{\partial_x}$$\newcommand{\bdy}{\partial_y}$$\newcommand{\...
- 6,741
2
votes
1
answer
191
views
Heuristics for counting degrees of freedom
I have recently learned about the representation theorem for isotropic,
linear operators, which says the following:
Defintion:
Let $M_n$ be the vector space of $n \times n$ real matrices. We say a ...
- 6,741
2
votes
1
answer
261
views
Non-Fourier complete orthogonal basis?
The Fourier Transform (FT)
Is orthogonal: inner product of one basis, $e^{j\omega_0}$, with any other basis, $e^{j\omega_1}$, is zero
Is invertible: info-preserving, has inverse function
Is energy-...
2
votes
1
answer
167
views
Subgroups of $\mathrm{SO}(A_0, \mathbb{F}_p)$
Let $n \geq 3$. Let $A_0$ denote the $n \times n$ symmetric matrix with $1$'s on the antidiagonal and $0$'s everywhere else. We can define the associated special orthogonal group
$$ \mathrm{SO}(A_0, \...
- 1,570
2
votes
1
answer
101
views
Characterization of extrinsic distance prevserving embedding (see the definition given!) from low dimensional Euclidean spaces to high dimensions
P.S. I asked the question on MSE more than a week ago, but didn't get any desired answer, so asking here.
Let $m < n \in \mathbb{N}$. Let us equip $\mathbb{R}^m, \mathbb{R}^n $ with their ...
- 1,467
2
votes
1
answer
536
views
Minimize matrix norm over the unitary matrices
Suppose $C_1$ and $C_2$ are some fixed $n \times n$ matrices. Define the norm $\| M \| = \sum_{i = 1}^n \max_j |M_{ij}|$. What is $\min_U \|C_1 U C_2 \|$? Here $U$ ranges over the $n \times n$ unitary ...
- 1,703
2
votes
1
answer
843
views
Matrix derivative w.r.t. a general inverse form: $(A^TA)^{-1/2}D(A^TA)^{-1/2}$
I want to find derivative of matrix $(A^TA)^{-1/2}D(A^TA)^{-1/2}$ w.r.t. $A_{ij}$ where D is a diagonal matrix. Alternatively, it is okay too to have
$$\frac{\partial}{\partial A_{ij}} a^T(A^TA)^{-1/2}...
- 519
2
votes
1
answer
154
views
Finding a similarities and differences of sent of matrices
Suppose we have a set of rank deficient covariance matrices. How can I know the similarities and differences between those set of matrices?
Regards,
- 21
2
votes
0
answers
80
views
Inequality involving minors of an orthogonal matrix
Fix $n \geq 3$ and take any orthonormal vectors $x,y,z \in \mathbb{R}^n$. Let also $A \in M_n(\mathbb{R})$ be a symmetric matrix with positive entries ($A_{ij} = A_{ji} > 0$). Is the following ...
- 21
2
votes
0
answers
285
views
Proving that a product of reflections and an orthogonal matrix is in $\mathrm{SO}_*(V)$
Let $V=(V,b)$ be a finite-dimensional vector space equipped with $b$ a symmetric and positive definite bilinear form. And let $\{e_1,\dotsc,e_n\}$ be a orthonormal basis for the subspace $\ker((P_A)^t)...
2
votes
0
answers
104
views
Decomposition of a 4D rotation into a particular sequence of simple rotations
I asked this question in math.stackexchange two days ago, but no one has answered yet. I suspect it is "hard enough" that it is appropriate to post it here as well. I am new to stackexchage, ...
- 21
2
votes
0
answers
196
views
Maximize the product of Hadamard matrix and a vector
Let $X$ be an $n \times n$ Hadamard matrix (i.e. entries are in $\{-1,1\}$ and rows are orthogonal). For my application, we can assume $n=2^k$.
Given a vector $\bf{w} \in R^n$, I want to find the $X^*$...
- 21
2
votes
0
answers
170
views
Infinitesimal matrix rotation towards orthogonality
TLDR; I am trying to prove the existence of an infinitesimal rotation which always moves a matrix "closer" to being orthogonal.
Setting
In this setting, we have a matrix $W \in \mathbb{R}^{n \times ...
- 181
2
votes
0
answers
98
views
Orthogonal Matrices and Cosets (translates) of Linear Subspaces
Let $M_n(F_2)$ be the vector space of all $n\times n$ matrices over the finite field $F_2$. Let $O(n)\subset M_n(F_2)$ be the set of all orthogonal matrices and $W\subseteq O(n)$ be an affine subspace ...
- 205
2
votes
0
answers
79
views
Characterizing a subclass of row-orthogonal matrices
Let $O\in\mathbb{R}^{n\times m}$, $m>n$, be such that $O O^\top =I_n$. (Here $\bullet^\top$ denotes transposition and $I_n$ the $n\times n$ identity matrix.) Consider the following partition of $O$,...
- 2,712
1
vote
1
answer
151
views
How to prove that each element of $A(A^TA)^{-1}A^Ty$ is greater than 0, if $A(i,j)>0$ and $y=[1, 1, 1, ..., 1]^T$
Let $A\in \mathbb{R}^{m\times n}$, $m>n$, $rank(A)=n$, and $\forall 1 \leq i \leq m, 1 \leq j \leq n, A(i, j)>0$, $y=[1, 1, 1, ..., 1]^T$. Let $\beta=A(A^TA)^{-1}A^Ty$, how to prove that each ...
- 27
1
vote
1
answer
455
views
About the Hadamard conjecture
On the wikipedia article about Hadamard Matrix it says that "The smallest order that cannot be constructed by a combination of Sylvester's and Paley's methods is $92$"
But it also says that ...
- 27
1
vote
3
answers
347
views
How to optimize for the best fit nonuniform-scale-rotation to a given 3×3 matrix?
Given a matrix $L\in \mathbb{R}^{3 \times 3}$, I'm looking for a method to find the closest (in a least squares sense) product of a non-uniform scaling matrix and a rotation matrix:
$$
\min_{s\in\...
- 723
1
vote
1
answer
138
views
Orthogonal vectors translation using standard vectors
When $n=2m$, let us consider the following vectors $\mathbf{v}_1,\ldots, \mathbf{v}_n$ in $\mathbb{R}^n$
$$\mathbf{v}_q=(v_{1q},\ldots,v_{n,q})$$
$$v_{p,q}=\sin\Big(\frac{pq}{n+1}\pi\Big)$$
It is ...
- 4,058
1
vote
1
answer
214
views
Conditions of P for existence of orthogonal matrix Q and permutation matrix U satisfying QP = PU
Question: Let $P\in \mathbb{R}^{d\times n}$ be a $d$-rank real matrix and $PP^T = c I_d$ with a certain constant $c > 0$. Under what additional conditions of $P$ does there exist an orthogonal ...
- 187
1
vote
1
answer
158
views
How many householder matrices do I need for constructing a given unitary matrix?
As we know we can construct unitary matrix as $H=H_1H_2\dots,H_k$, by stacking householder matrices $H_i\in \mathbb{R}^{d\times d}$. The number of householder matrices we use, i.e., $k$, determines ...
- 113
1
vote
1
answer
112
views
Orthonormal matrices with columns that switch signs
Consider an orthonormal matrix $W\in\mathbb{R}^{2n\times 2n}$ that satisfies the "abs property" $$|w_i|^T |w_{i+n}|=1$$ for all $i \in \{1,2,\ldots,n\}$, where $w_i \in \mathbb{R}^{2n}$ is ...
- 13
1
vote
1
answer
99
views
Orthogonal invariance of (weighted) Laplacian
It is well-known that if $O$ is an orthogonal map, then $\Delta u(Ox) = \Delta u$ where $\Delta$ is the Laplacian.
Now, let $A$ be a constant invertible matrix, then we define the weighted Laplacian
$$...
- 124
1
vote
1
answer
276
views
Dense symmetric unitary integer matrix?
Can someone give me a nontrivial example of a symmetric unitary integer matrix? I'm looking for something as dense as possible (i.e., not too many 0's); 5 <= size <= 8 would be ideal.
1
vote
0
answers
43
views
Moments on the Stiefel manifold
Let $S_{n, k} = \{V \in \mathbb{R}^{n \times k} : V^T V = I_k\}$ denote the Stiefel manifold, $1 \leq k \leq n$.
Let $P \in \mathbb{R}^{n \times n}$ denote a symmetric real, positive definite matrix, ...
- 380
1
vote
1
answer
114
views
Sum of squares of $k\times k$ cofactors is $1$ for an orthonormal matrix [closed]
Let $n,k\in \mathbb N$ with $k\leq n$. Let $A$ be an $n\times n$ real orthonormal matrix. Fix any $k$ rows of $A$ and from there consider every possible $k\times k$ cofactors and there will be exactly ...
- 49
1
vote
0
answers
61
views
Cardinal of finite orthogonal groups
Let $p \neq 2$ and let $F$ be a $p$-adic field with ring of integers $\mathcal{O}$ and maximal ideal $\mathfrak{p}$.
By a quadratic space $V_{\mathcal{O}}$ of dimension $d$ over $\mathcal{O}$, I mean ...
- 81
1
vote
0
answers
238
views
Construct a permutation matrix from some eigenvectors and eigenvalues
Given $n$ orthonormal vectors $v_1, \dots, v_n \in \mathbb R^d$, where $d > n$, we can show that there are many orthogonal matrices $X$ of size $d$ such that $v_1, \dots, v_n$ are eigenvectors of $...
- 111
1
vote
0
answers
188
views
Is the group law for SO(2n, R) encoded in so(2n,R)?
Note that this is a partial duplicate of my math.stackexchange question here. In this post I am asking something slightly broader. Note that I am a mathematical physicist and not a representation ...
- 201
1
vote
0
answers
72
views
Minimize smooth function $(x,y) \to f(x,y)$ subject to $x \perp y$
Let $V$ be a finite-dimensional real vector space (e.g space of $m \times n$ real matrices equiped with Hilbert-Schmidt inner product $(A,B) \to \mathrm{tr}(AB^\top)$, and let $f:V^2 \to \mathbb R$, $(...
- 6,853