Skip to main content

All Questions

Filter by
Sorted by
Tagged with
3 votes
1 answer
190 views

Eigenvalues of certain matrices

We write $R(\theta)=\left(\begin{smallmatrix}\cos(2\pi\theta)&\sin(2\pi\theta)\\ -\sin(2\pi\theta)&\cos(2\pi\theta)\end{smallmatrix}\right)$ for any $\theta\in\mathbb R$. Let $d,m,n,r$ be a ...
3 votes
1 answer
234 views

Is there a matrix that has the completely opposite effect of a Hadamard matrix?

First, let me provide some background on the problem: In the field of Large Language Model quantization/compressions, outliers (abs of outliers are much larger than the mean of abs of all elements in ...
4 votes
4 answers
2k views

I want a smooth orthogonalization process

The following question is related to research I am doing on reinforcement learning on manifolds. I have a set of basis vectors $\boldsymbol{B} = \{\boldsymbol{b}_1,\dots,\boldsymbol{b}_k\}$ that span ...
3 votes
1 answer
255 views

Minimizing quadratic objective under orthogonality constraints

The following problem is motivated from Generalized Procrustes Analysis. I am wondering if it is possible to obtain a closed form minimizer (which may involve SVD or some other decomposition of a ...
1 vote
1 answer
151 views

How to prove that each element of $A(A^TA)^{-1}A^Ty$ is greater than 0, if $A(i,j)>0$ and $y=[1, 1, 1, ..., 1]^T$

Let $A\in \mathbb{R}^{m\times n}$, $m>n$, $rank(A)=n$, and $\forall 1 \leq i \leq m, 1 \leq j \leq n, A(i, j)>0$, $y=[1, 1, 1, ..., 1]^T$. Let $\beta=A(A^TA)^{-1}A^Ty$, how to prove that each ...
8 votes
2 answers
754 views

Computing Haar measure of matrices sampled from SO(n)

I am looking to sample uniform matrices from SO(n). I know that uniform matrices can be sampled from O(n) by taking the QR decomposition of Gaussian random square matrices and adjusting the sign of ...
0 votes
0 answers
96 views

When can a point be reconstructed from relative angle measurements?

Given a set of points $p_1,\dots,p_n$ in $\mathbb{R}^d$ and a target point $x\in\mathbb{R}^d$, I measure all the angles between all pairs of points and the target point. In other words, I have the ...
2 votes
1 answer
78 views

Reference for irreducible representations of $\mathcal{O}(n)\ni O\mapsto O^{\otimes k}$

This MO answer cites the Goodman-Wallach book to affirm that: $$\mathrm{Sym}^k\left(\mathbb{R}^n\right)=\mathcal{H}^k\oplus q\mathcal{H}^{k-2}\oplus q^2\mathcal{H}^{k-4}\oplus\cdots$$ with $\mathrm{...
1 vote
0 answers
43 views

Moments on the Stiefel manifold

Let $S_{n, k} = \{V \in \mathbb{R}^{n \times k} : V^T V = I_k\}$ denote the Stiefel manifold, $1 \leq k \leq n$. Let $P \in \mathbb{R}^{n \times n}$ denote a symmetric real, positive definite matrix, ...
7 votes
2 answers
201 views

When is a linear isomorphism of $M_n(\mathbb{C})$ given by unitary conjugation?

Let $M_n(\mathbb{C})$ represent the space of $n \times n$ matrices over $\mathbb{C}$. We will think of it as a $\mathbb{C}$-vector space. Notice that if $A \in M_n(\mathbb{C})$ is invertible, then the ...
1 vote
1 answer
114 views

Sum of squares of $k\times k$ cofactors is $1$ for an orthonormal matrix [closed]

Let $n,k\in \mathbb N$ with $k\leq n$. Let $A$ be an $n\times n$ real orthonormal matrix. Fix any $k$ rows of $A$ and from there consider every possible $k\times k$ cofactors and there will be exactly ...
1 vote
1 answer
452 views

About the Hadamard conjecture

On the wikipedia article about Hadamard Matrix it says that "The smallest order that cannot be constructed by a combination of Sylvester's and Paley's methods is $92$" But it also says that ...
1 vote
0 answers
61 views

Cardinal of finite orthogonal groups

Let $p \neq 2$ and let $F$ be a $p$-adic field with ring of integers $\mathcal{O}$ and maximal ideal $\mathfrak{p}$. By a quadratic space $V_{\mathcal{O}}$ of dimension $d$ over $\mathcal{O}$, I mean ...
2 votes
0 answers
80 views

Inequality involving minors of an orthogonal matrix

Fix $n \geq 3$ and take any orthonormal vectors $x,y,z \in \mathbb{R}^n$. Let also $A \in M_n(\mathbb{R})$ be a symmetric matrix with positive entries ($A_{ij} = A_{ji} > 0$). Is the following ...
0 votes
0 answers
97 views

Can a Tangent Space always be expressed with “more structure” than just a vector space (e.g. a choice of basis for Stiefel manifold)

I'm currently trying to read about the Stiefel manifold, or set of all $p$ orthonormal $n$-dimensional vectors embedded in $\mathbb{R}^{n\times p}$. $$\mathcal{V}_p(\mathbb{R}^n) = \{U \in \mathbb{R}^{...
1 vote
1 answer
138 views

Orthogonal vectors translation using standard vectors

When $n=2m$, let us consider the following vectors $\mathbf{v}_1,\ldots, \mathbf{v}_n$ in $\mathbb{R}^n$ $$\mathbf{v}_q=(v_{1q},\ldots,v_{n,q})$$ $$v_{p,q}=\sin\Big(\frac{pq}{n+1}\pi\Big)$$ It is ...
1 vote
1 answer
214 views

Conditions of P for existence of orthogonal matrix Q and permutation matrix U satisfying QP = PU

Question: Let $P\in \mathbb{R}^{d\times n}$ be a $d$-rank real matrix and $PP^T = c I_d$ with a certain constant $c > 0$. Under what additional conditions of $P$ does there exist an orthogonal ...
14 votes
4 answers
2k views

Measuring the "distance" of a matrix from a diagonal matrix

Let $A$ be a $N \times N$ symmetric positive semi-definite matrix with $N \geq 2$. Let $D$ be a diagonal matrix of dimension $N$. I would like to measure how much $A$ "is far" from $D$, i.e. ...
8 votes
2 answers
519 views

Orthogonal basis of ${\bf Sym}_n(\mathbb R)$, made of orthogonal matrices

My question is motivated by this one, but within real matrices instead of complex ones. ${\bf Sym}_n(\mathbb R)$ is a vector space of dimension $N=\frac{n(n+1)}2$. Equipped with the scalar product $\...
2 votes
1 answer
98 views

One question about nega-cyclic Hadamard matrices

Let $n$ be a multiple of $4$, is there any $n \times n$ negacyclic Hadamard matrix? If yes - how to construct it? If no - why? Here an $n \times n$ nega-cyclic matrix is a square matrix of the form: \...
8 votes
2 answers
440 views

Show $\langle \log(R), \log(R^{-1}S) \rangle \geq \langle \log(R), \log(S) - \log(R) \rangle $ for all $R,S \in \mathrm{SO}(3)$

$\DeclareMathOperator\SO{SO}$I have a similar question to one I asked a few days ago. Lately, I've been researching Lie groups equipped with bi-invariant Riemannian metrics. One common object is $\SO(...
1 vote
1 answer
112 views

Orthonormal matrices with columns that switch signs

Consider an orthonormal matrix $W\in\mathbb{R}^{2n\times 2n}$ that satisfies the "abs property" $$|w_i|^T |w_{i+n}|=1$$ for all $i \in \{1,2,\ldots,n\}$, where $w_i \in \mathbb{R}^{2n}$ is ...
1 vote
0 answers
237 views

Construct a permutation matrix from some eigenvectors and eigenvalues

Given $n$ orthonormal vectors $v_1, \dots, v_n \in \mathbb R^d$, where $d > n$, we can show that there are many orthogonal matrices $X$ of size $d$ such that $v_1, \dots, v_n$ are eigenvectors of $...
8 votes
3 answers
1k views

Conjecture on the existence of centrosymmetric Hadamard matrices

I work with centrosymmetric matrices and recently have started exploring the question of the existence of centrosymmetric Hadamard matrices. Definition: An $n \times m$ matrix $A = (a_{i,j})$ is ...
8 votes
2 answers
643 views

Is it true $\left\|\log(RS)\right\|≤\left\|\log(R)+\log(S)\right\|$ for all $R,S \in \mathrm{SO}(3)$, where $\|\cdot\|$ is the Frobenius norm?

$\DeclareMathOperator\SO{SO}$I asked this initially in math stack exchange, but thought to ask it here since it is more advanced and related to my research topic. I study optimization on Lie groups ...
2 votes
1 answer
207 views

A subgroup of $\mathrm{SL}_n(\mathbb{Z}/p\mathbb{Z})$

Let $p$ be an odd prime, and consider the group $$\{U\in \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}) : U^{t}U=I \bmod p \}\subseteq \operatorname{SL}_n(\mathbb{Z}/p\mathbb{Z}).$$ I wonder what is the ...
1 vote
3 answers
345 views

How to optimize for the best fit nonuniform-scale-rotation to a given 3×3 matrix?

Given a matrix $L\in \mathbb{R}^{3 \times 3}$, I'm looking for a method to find the closest (in a least squares sense) product of a non-uniform scaling matrix and a rotation matrix: $$ \min_{s\in\...
3 votes
1 answer
331 views

Variant of Wahba's problem

Wahba's problem is the following: $$\min_R \sum_{k=1}^K \|v_k - Rw_k\|^2$$ where $v_k$ and $w_k$ are arbitrary $3\times 1$ vectors, and $R$ is a rotation matrix (i.e., orthogonal with $\det(R)=1$). A ...
2 votes
2 answers
185 views

Orthonormal solution of overdetermined linear equations

I have a two matrices $A$ and $B$ in $\mathbb{R}^{m \times n }$ ($m \gg $ n) such that there exists an orthonormal matrix $X \in \mathbb{R}^{n \times n }$, such that: $$AX = B$$ Given that $X$ is ...
1 vote
1 answer
158 views

How many householder matrices do I need for constructing a given unitary matrix?

As we know we can construct unitary matrix as $H=H_1H_2\dots,H_k$, by stacking householder matrices $H_i\in \mathbb{R}^{d\times d}$. The number of householder matrices we use, i.e., $k$, determines ...
3 votes
0 answers
46 views

Evaluate $\int_\phi e^{tr(RM)} dR$ where $\phi$ is a set of all real orthonormal matrices of a certain size

I am trying to evaluate $\int_\phi e^{tr(RM)} dR$ where $\phi$ is a set of all real orthogonal matrices of a certain size. $M$ is an arbitrary real matrix (of a certain size). This is equivalent to $$\...
2 votes
0 answers
284 views

Proving that a product of reflections and an orthogonal matrix is in $\mathrm{SO}_*(V)$

Let $V=(V,b)$ be a finite-dimensional vector space equipped with $b$ a symmetric and positive definite bilinear form. And let $\{e_1,\dotsc,e_n\}$ be a orthonormal basis for the subspace $\ker((P_A)^t)...
5 votes
2 answers
495 views

Existence of parametrizations of rational orthogonal matrices

I suppose that there are formulas which parametrize all the orthogonal matrices with rational coefficients. Does anyone know anything about it? And what are some publications that discuss this? Thanks....
3 votes
2 answers
569 views

What do you call a scaled orthogonal map?

What do you call a linear map of the form $\alpha X$, where $\alpha\in\Bbb R$ and $X\in\mathrm O(V)$ is an orthogonal map ($V$ being some linear space with inner product)? Are there established names, ...
2 votes
0 answers
102 views

Decomposition of a 4D rotation into a particular sequence of simple rotations

I asked this question in math.stackexchange two days ago, but no one has answered yet. I suspect it is "hard enough" that it is appropriate to post it here as well. I am new to stackexchage, ...
4 votes
1 answer
334 views

Distribution of Submatrix of Orthogonal Matrix

Let $O$ be a matrix sampled from the Haar measure on $O(n)$. Let $X$ be the upperleft $k\times k$ submatrix of $O$. In a physics research project I am interested in the distribution of $X$, say $\rho(...
2 votes
1 answer
260 views

Non-Fourier complete orthogonal basis?

The Fourier Transform (FT) Is orthogonal: inner product of one basis, $e^{j\omega_0}$, with any other basis, $e^{j\omega_1}$, is zero Is invertible: info-preserving, has inverse function Is energy-...
12 votes
3 answers
558 views

$2n \times 2n$ matrices with entries in $\{1, 0, -1\}$ with exactly $n$ zeroes in each row and each column with orthogonal rows and orthogonal columns

I am interested in answering the following question: Question For a given $n$, does there exist a $2n \times 2n$ matrix with entries in $\{1, 0, -1\}$ having orthogonal rows and columns with exactly $...
7 votes
0 answers
224 views

Reference request: maximal determinant of matrices with pairwise orthogonal rows and entries in $\{1, 0, -1\}$

We know that "Hadamard maximal determinant problem" concerns the largest determinant of a matrix of oder $n$ with entries in $\{-1,1\}$ or $\{0, 1\}$. For $n=4k$, it is the Hadamard ...
3 votes
0 answers
185 views

Differentiable functions on $\mathbb{R}^n$ whose derivative is everywhere a scalar multiple of a special orthogonal matrix

The Cauchy–Riemann equations say that if $u : \mathbb{C} \rightarrow \mathbb{C}$ is holomorphic then, regarded as a linear transformation of $\mathbb{R}^2$, its derivative is either zero or, up to a ...
1 vote
1 answer
99 views

Orthogonal invariance of (weighted) Laplacian

It is well-known that if $O$ is an orthogonal map, then $\Delta u(Ox) = \Delta u$ where $\Delta$ is the Laplacian. Now, let $A$ be a constant invertible matrix, then we define the weighted Laplacian $$...
1 vote
0 answers
188 views

Is the group law for SO(2n, R) encoded in so(2n,R)?

Note that this is a partial duplicate of my math.stackexchange question here. In this post I am asking something slightly broader. Note that I am a mathematical physicist and not a representation ...
2 votes
1 answer
166 views

Subgroups of $\mathrm{SO}(A_0, \mathbb{F}_p)$

Let $n \geq 3$. Let $A_0$ denote the $n \times n$ symmetric matrix with $1$'s on the antidiagonal and $0$'s everywhere else. We can define the associated special orthogonal group $$ \mathrm{SO}(A_0, \...
2 votes
0 answers
194 views

Maximize the product of Hadamard matrix and a vector

Let $X$ be an $n \times n$ Hadamard matrix (i.e. entries are in $\{-1,1\}$ and rows are orthogonal). For my application, we can assume $n=2^k$. Given a vector $\bf{w} \in R^n$, I want to find the $X^*$...
7 votes
2 answers
374 views

Proving a lemma for a decomposition of orthogonal matrices

Setting Consider two independent orthogonal matrices, which are decomposed into 4 blocks: \begin{align} Q_{1} = \left[\begin{array}{cc} A_{1} & B_{1}\\ C_{1} & D_{1} \end{array}\right] , \,Q_{...
3 votes
0 answers
156 views

Matrix equation and spherical harmonics

I have a set of functions expanded in a finite number of spherical harmonics (up to degree $L$), $$ \eta_k^n(\theta,\phi) = \sum_{l=0}^L \sum_{m=-l}^l d_{kl}^{nm} Y_l^m(\theta,\phi) $$ Similar to the ...
6 votes
3 answers
3k views

functions with orthogonal Jacobian

I'm working on a model that would require to use vectorial functions of $\mathbb{R}^n \rightarrow \mathbb{R}^n$, such that $\forall x, y \in \mathbb{R}^n$, $\lVert \frac{df(x)}{dx}(y) \lVert_2 = \...
3 votes
1 answer
275 views

Is the Cayley distance on permutation (matrices) equivalent to the Riemannian metric on $O(n)$?

Denote by $d_C(\sigma,\mu)$ the minimal number of transpositions needed to go from a permutation $\sigma$ to a permutation $\mu$. E.g. if $d_C(\sigma,\mu)=0$, then $\sigma=\mu$, if $d_C(\sigma,\mu)=1$,...
3 votes
1 answer
321 views

The invertible matrices $S$ that satisfy $A=SDS^T$

Any real symmetric matrix $A$ can be written as $A=SDS^T$ for some diagonal matrix $D$ and invertible matrix $S$. Let's fix $D$ to be the (diagonal) inertia matrix of $A$, which has an entry $1, -1, 0$...
2 votes
1 answer
842 views

Matrix derivative w.r.t. a general inverse form: $(A^TA)^{-1/2}D(A^TA)^{-1/2}$

I want to find derivative of matrix $(A^TA)^{-1/2}D(A^TA)^{-1/2}$ w.r.t. $A_{ij}$ where D is a diagonal matrix. Alternatively, it is okay too to have $$\frac{\partial}{\partial A_{ij}} a^T(A^TA)^{-1/2}...