# Questions tagged [matrix-inverse]

For questions about inverses and pseudoinverses of matrices.

142
questions

3
votes

1
answer

153
views

### Deriving the "Explicit" formula for inverse of Hilbert/Cauchy matrices

My exact question is, how to derive the formula for $H^{-1}$, in which $H_{ij}=\frac{1}{i+j-1}$.
I am currently working my way through Hoffman&Kunze Linear Algebra. I noticed that a question on ...

0
votes

1
answer

75
views

### update rule for the inverse after a rank-1 update plus scaled identity

Is there an update rule for $$\left(\tilde{X}^T\tilde{X}+\alpha\cdot I\right)^{-1}$$ with $\tilde{X}=[X\;\; a]$ as a function of $A\triangleq (X^TX)^{-1}$, $X$ and $a$?
I know that when $\alpha=0$ we ...

4
votes

2
answers

193
views

### Results of invertibility of a matrix involving the Szego kernel

In the context of reproducing kernel Hilbert spaces, the Szego kernel is the function $k(z_i,z_j)=\frac{1}{1-z_j\overline{z_j}}$.
Given $2n$ points $\{z_1,\ldots,z_n\},\{w_1,\ldots,w_n\}\in\mathbb{D}\...

3
votes

0
answers

42
views

### Inverse of a banded bisymmetric matrix

I have a banded bisymmetric matrix, say
$ A = \begin{pmatrix}
a & d & f & 0 & 0 \\
d & b & e & g & 0 \\
f & e & c & e & f \\
0 & g & e & b &...

0
votes

0
answers

56
views

### When is a symmetric block Toeplitz matrix invertible?

Let
$$
Q =
\begin{bmatrix}
Q_0 & Q_1 & Q_2 & \cdots\\
Q_{-1} & Q_{0} & Q_1 & \cdots\\
Q_{-2} & Q_{-1} & Q_0 & \cdots\\
\vdots & \vdots & \vdots & \ddots
...

2
votes

1
answer

137
views

### Invertibility of message passing with invertible parametrization

Consider the message passing framework defined by, $$f(\boldsymbol{x}_i)= \boldsymbol{x}_i + \sum_{j \neq i} (\boldsymbol{x}_i -\boldsymbol{x}_j) g(\|\boldsymbol{x}_i -\boldsymbol{x}_j\|^2),$$ for $i=...

0
votes

1
answer

79
views

### Matrix quantization and effect on singular values

Let $A$ and $B$ be an $N\times n$ matrix with $n\le N$, and let $\sigma_1(X),\dots \sigma_n(X)$ denote the singular values of $X\in \{A,B\}$. Do we have upper and lower bounds for
$$
\|
\sigma_i(A)-\...

2
votes

0
answers

92
views

### Bound on the magnitude of the entries of the Laplacian pseudo-inverse

Let $L$ be the laplacian matrix of a connected graph $G$ with real positive weights and $N$ vertices, or that can be assumed to have binary weights for simplicity.My goal is to bound $\Vert L^+\Vert_{\...

0
votes

0
answers

34
views

### What is the impact of individual estimate on each other in matrix inversion?

I am looking to understand the impact of each estimate on each other in matrix inversion.
Lets say I have a vector $A = \left[a_1, a_2 \right]^T$ of size $2 \times 1$ and $a_1$ and $a_2$ are related ...

1
vote

1
answer

338
views

### Solvability of $A X B=C$ with $X=X^\mathrm{T}$

I am studying symmetric solutions to the complex matrix equation
\begin{equation}
A X B=C,
\end{equation}
where $A$, $B$, and $C$ are $m\times n$, $n \times k$, and $m \times k$ complex matrices, ...

2
votes

1
answer

143
views

### Continuity of Moore-Penrose generalized inversion

Any matrix $A\in\mathbb{C}^{m\times n}$ has a unique generalized inverse $A^{\dagger}\in\mathbb{C}^{n\times m}$ with the properties $$AA^{\dagger}A=A,\qquad A^{\dagger}AA^{\dagger}=A^{\dagger},\qquad (...

1
vote

1
answer

111
views

### A sine type Chebyshev system

A sequence of real functions $\{\phi_1,\cdots,\phi_n\}$ is called a Chebyshev system on an interval $I\subseteq\mathbb{R}$, if any real linear combination $\sum_{l=1}^n a_l\phi_l$ has at most $n-1$ ...

2
votes

0
answers

144
views

### What are the name and inverse of an interesting integer matrix?

It is practicable to compute the matrix inverses
\begin{align*}
\begin{pmatrix}
1 & 0 & 0 \\
1 & 1 & 1 \\
1 & 2 & 2^2 \\
\end{pmatrix}^{-1}
&=\begin{pmatrix}
1 & 0 &...

1
vote

0
answers

66
views

### Random matrix theory: accounting for mean

Assume a random matrix, denoted as $X$, which is an $n$ by $T$ matrix, $T\geq n$. While I understand the typical scenario where the random variables $X_{ij}$ are sampled from a $\mathcal{N}(0,\sigma_{...

1
vote

0
answers

114
views

### Implicit function theorem / Implicit selections when Jacobian not invertible

I saw the attached result in the book by Dontchev and Rockafellar.
It requires the Jacobian to be of full rank m. I suspect this condition can be further relaxed. Assume that we know that the columns ...

2
votes

0
answers

132
views

### Decompose a rational matrix as an integer matrix and an inverse of integer matrix

Suppose we have a non-singular rational matrix $Q$, consider the the $\mathbb{Z}$-span of the columns of $Q$ and $Q^{-1}$, denote it as $H = {\rm Span}_{\mathbb Z} \{ Q(\mathbb Z^{n}), Q^{-1}(\...

2
votes

1
answer

233
views

### Product of a vector by an inverse of Toeplitz matrix

It is well known that using fast Fourier transform it's possible to multiply a vector by a Toeplitz matrix $A \cdot v = w$ in $n\cdot\log(n)$ operations.
I read somewhere that also the product of a ...

3
votes

1
answer

304
views

### Inverting a matrix using the Matrix logarithm

This is probably going to lead nowhere, but maybe it be possible to use the matrix logarithm to invert matrices?
For positive definite matrices, we have that the logarithm exists and
$$
\log(A^{-1})= -...

1
vote

0
answers

128
views

### Infinite dimensional matrix solvability

In order to solve a boundary problem for a conducting hemisphere, the following matrix equation arises (derived from the boundary condition on the curved part of the surface) where we must solve for ...

0
votes

0
answers

156
views

### Given optimality of L1 norm, prove that absolute value of sum of a vector with proper sign is less than 1?

Problem:
Given a domain $\mathcal{D}\subset\mathbb{R}^{l}$, we can find $l$
points $\boldsymbol{v}_{i}\in\mathcal{D}$, $i=1,\cdots,l$. Each
point is a column vector with dimension $l\times1$. They ...

3
votes

1
answer

269
views

### Complexity of inverting and multiplying against a symmetric Toeplitz matrix with two repeated entries

I know that the computational complexity of inverting a general $n \times n$ matrix $A$ is $O(n^{2.373})$ and multiplying it against an $n \times m$ matrix is $O(n^2m)$. Moreover, I've seen that ...

4
votes

2
answers

438
views

### What is the inverse of a triangular matrix whose nonzero elements are binomial coefficients? What is the closed-form solution to a recursive relation?

Let
\begin{equation*}
\begin{split}
M_m
&=\begin{pmatrix}
-\binom{1}{0} & \binom{2}{0} &-\binom{3}{0} &\dotsm & (-1)^{m-1}\binom{m-1}{0} & (-1)^m\binom{m}{0}\\
0 & \binom{2}...

1
vote

0
answers

87
views

### Algorithm for efficiently calculating $(A+\sum_{i=1}^n B_i)^{-1}$ where $A^{-1}\in\mathbb S^n_+$ is known and $B_i$ are sparse matrices

Let $A\in\mathbb R^{n\times n}$ be a symmetric positive-definite matrix and $A^{-1}$ is already known. Now I want to compute the matrix $(A+\sum_{i=1}^n B_i)^{-1}$ where each $B_i$ is a sparse ...

2
votes

2
answers

168
views

### Orthonormal solution of overdetermined linear equations

I have a two matrices $A$ and $B$ in $\mathbb{R}^{m \times n }$ ($m \gg $ n) such that there exists an orthonormal matrix $X \in \mathbb{R}^{n \times n }$, such that:
$$AX = B$$
Given that $X$ is ...

2
votes

2
answers

261
views

### Full-rank matrix

I have a sparse square matrix and want to see if it is full rank (so that I can apply the implicit function theorem).
$$\left[\begin{array}{cccccccccc}
0 & 1 & 1 & 1 & 0 & 0 & ...

0
votes

1
answer

100
views

### Approximating the expectation of trace inverse of random Gaussian combination

Consider a random matrix $A \in \mathbb{R}^{m\times n}$ with i.i.d. entries, with mean zero and variance 1 and $m <n $. Has anyone studied this expectation in asymptotics $$E_{A}(\mathrm{Tr}( (A^T ...

2
votes

1
answer

220
views

### Trace inverse of random PSD matrix?

Consider a random matrix $A \in \mathbb{R}^{m\times n}$ with i.i.d. entries, with mean zero and variance 1 and $m <n $. I am interested in the expectation of $$E_{A}(\mathrm{Tr}( (A^T A + \lambda \...

-2
votes

1
answer

248
views

### Proving 2 matrices have the same trace [closed]

I found a problem in my textbook and I have tried solving it, but I had no succes. The problem is:
Let $A$ and $B$ be $n \times n$ matrices with complex number entries. Given that $AB−BA$ is ...

1
vote

1
answer

51
views

### Characterization of pseudo unit-matrices

I accidently found a class of rank-deficient square matrices that are their own Moore-Penrose pseudo inverse:
$$\boldsymbol{A}\in\mathbb{R}^{n\times n}: a_{(i,i)}=n-1,\, a_{\lbrace i,j\rbrace}=-1\...

2
votes

1
answer

253
views

### Fast inverse of asymmetric diagonally dominant matrix with diagonal 1 and non-positive off-diagonals

I am interested in ways to obtain (even approximately) the inverse of an asymmetric diagonally dominant matrix with diagonal 1 and non-positive off-diagonals.
Formally, let $A$ be a $n\times n$ matrix ...

1
vote

1
answer

250
views

### Condition on the probabilities for the $J\times J$ matrix $[ \Pr(X=j \mid Y=k) ]$ to be invertible

$\DeclareMathOperator\Pr{P}\newcommand\cPr[2]{\Pr(#1 \mid #2)}$I have a $J \times J$ matrix:
$$
M:= \begin{bmatrix}
\cPr{X=1}{Y=1} & \cPr{X=2}{Y = 1} & \cdots & \cPr{X=J}{Y = 1} \\
\cPr{X=...

0
votes

1
answer

137
views

### Does there exist a function $f(X)$ with the following gradient $\mathrm{Tr}[(I-X)^{-1}]\cdot g(X)$?

Let $f: \mathbb{R}^{n\times n} \to \mathbb{R}$ be a function that receives a square matrix and spits out a scalar. Does there exist a function $f$ such that the gradient $\nabla_Xf(X) = \mathrm{Tr}[(...

0
votes

1
answer

144
views

### Product of matrices equal identity

I need to solve the following equation for the matrix $P \in\mathbb{R}^{r\times d}:$
$$
((PAP^\top)^{-1} P S P^\top (PAP^\top)^{-1})^2 = I_r,
$$
where $S$ is a symmetric $d\times d$ matrix, $A$ is a ...

2
votes

2
answers

233
views

### When is $(I - X)^{-\top} \circ X = 0$?

I am currently looking at the following expression $(I - X)^{-\top} \circ X = 0$, where $\circ$ is the Hadamard product, $\top$ is the transpose, $I$ is the identity, and $X$ is non-negative and ...

2
votes

1
answer

137
views

### Existence of matrices with some invertibility properties

Prove that there exists five matrices $B_i \in \mathbb{F}_2^{5\times 10}$, $i\in \{1,2,3,4,5\}$, such that any two $B_i$'s form an invertible matrix in $\mathbb{F}_2^{10\times 10}$.
I am interested ...

3
votes

1
answer

401
views

### Minimum upper bound for sum of the entries of the inverse covariance matrix

Let $x \in \mathbb{R}^n$ and $k$ is RBF kernel
$$k(x, x') := \exp \left(-\frac{\|x-x'\|^2}{2\sigma^2}\right)$$
and let $\mathbf{K}$ be the following $n \times n$ covariance matrix
$$\mathbf{K} = \...

1
vote

1
answer

150
views

### If $\Vert A-B\Vert_{op}\leq \varepsilon$ then $A^{-1}$ and $B^{-1}$ are uniformly close

Let $A,B$ are two $p\times p$ positive definite matrices such that $0<\delta_0\leq \min\{\lambda_{\min}(A), \lambda_{\min}(B)\}\leq \max\{\lambda_{\max}(A), \lambda_{\max}(B)\}\leq \delta_1$. Also ...

4
votes

2
answers

668
views

### Do any two hermitian matrices A and B commute with the support of their commutator?

Let $A$ and $B$ be Hermitian matrices. Let $[A,B] = AB - BA$ be their commutator and let $[A,B]^+$ be the Moore-Penrose pseudoinverse of $[A,B]$.
Is it then true that $A$ and $B$ both commute with the ...

2
votes

1
answer

420
views

### Mistake in Karl Pearson's 1900 paper introducing the chi-squared distribution

Background
I'm reading Karl Pearson's 1900 paper titled:
On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be ...

2
votes

1
answer

790
views

### Matrix derivative w.r.t. a general inverse form: $(A^TA)^{-1/2}D(A^TA)^{-1/2}$

I want to find derivative of matrix $(A^TA)^{-1/2}D(A^TA)^{-1/2}$ w.r.t. $A_{ij}$ where D is a diagonal matrix. Alternatively, it is okay too to have
$$\frac{\partial}{\partial A_{ij}} a^T(A^TA)^{-1/2}...

0
votes

2
answers

102
views

### Computation to differentiate a determinant [closed]

Consider a positive Hermitian $N \times N$ matrix $A$ with complex valued coefficients. We list its eigenvalues in increasing order and with their multiplicities, $\mu_{1} \leq \mu_{2} \leq \cdots \...

2
votes

1
answer

342
views

### Ratios of Gaussian integrals with a positive semidefinite matrix

Cross-post from MSE
https://math.stackexchange.com/questions/4118128/ratios-of-gaussian-integrals-with-a-positive-semidefinite-matrix
Generally speaking, I’m wondering what the usual identities for ...

5
votes

2
answers

932
views

### Sufficient conditions for invertibility of a block tridiagonal matrix

Let $M_n \in \mathbb{R}^{N \times N}$ be a block-tridiagonal matrix:
$$M_n = \begin{bmatrix} B_1 & C_1 & 0 & 0 & \cdots & 0 \\ A_1 & B_2 & C_2 & 0 & \cdots & 0 \...

2
votes

1
answer

183
views

### Closed form for the inverse of a special transition matrix

Let $b\in\mathbf{R}^n$ be fixed, and let $A\in\mathcal{M}_{n\times n}(\mathbf{R})$ be given but otherwise arbitrary. Let $a_1,\ldots,a_n$ denote the coefficients of the characteristic polynomial of $A$...

1
vote

1
answer

172
views

### Expected pseudo-inverse of isotropic random matrix

Suppose I have a random $m \times m$ matrix $R \sim \mu$ that is possibly singular. Is it true that
$ E[R] \propto I$ implies that there exists a scalar $r_{\mu, m}$ such that $E[R^+] = r_{\mu, m}I$, ...

4
votes

1
answer

666
views

### Condition number for matrix of eigenvectors of a diagonalizable matrix

Let $A$ be a diagonalizable matrix, i.e., $A=SDS^{−1}$. For any matrix $A$, condition number is defined as $\kappa(A)=\|A\| \|A\|^{-1}$.
For $A$ being a diagonalizable matrix, define $G_A=\{{S: S^{-1} ...

2
votes

1
answer

743
views

### Matrix inversion inequality

Suppose $A, B, C\in\mathbb{R}^{n\times n}$ are all symmetric positive definite matrices, and they satisfy the inequality $A \succeq B + C$. Assume also that all of the three matrices are bounded, i.e.,...

2
votes

1
answer

734
views

### Complexity of pseudoinverse of a low-rank matrix

I have a large matrix $\mathbf{A}\in \mathbb{C}^{m\times n}$ with very low rank $r$, I find that the general complexity of finding its pseudoinverse is $\mathcal{O}(\max(m,n)^3)$, this is too high. ...

32
votes

1
answer

5k
views

### Inverting lower triangular matrix in time $n^2$

I have a lower $n\times n$ triangular matrix called $A$ and I want to get $A^{-1}$ solved in $O(n^2)$. How can I do it?
I tried using a method called "forward substitution", but the ...

9
votes

3
answers

1k
views

### How to calculate inverse of sum of two Kronecker products with specific form efficiently?

I have a matrix with specific form of $A\otimes I + B\otimes J$ where $A$ and $B$ are general dense matrices, $n\times n$. $I$ is an $m\times m$ identity matrix. $J$ is a $m \times m$ dense matrix ...