All Questions
Tagged with matrices matrix-inverse
83 questions
128
votes
13
answers
27k
views
Should the formula for the inverse of a 2x2 matrix be obvious?
As every MO user knows, and can easily prove, the inverse of the matrix $\begin{pmatrix} a & b \\\ c & d \end{pmatrix}$ is $\dfrac{1}{ad - bc} \begin{pmatrix} d & -b \\ -c & a \end{...
- 7,337
32
votes
1
answer
5k
views
Inverting lower triangular matrix in time $n^2$
I have a lower $n\times n$ triangular matrix called $A$ and I want to get $A^{-1}$ solved in $O(n^2)$. How can I do it?
I tried using a method called "forward substitution", but the ...
- 303
26
votes
6
answers
14k
views
Deriving inverse of Hilbert matrix
The Hilbert matrix is the square matrix given by
$$H_{ij}=\frac{1}{i+j-1}$$
Wikipedia states that its inverse is given by
$$(H^{-1})_{ij} = (-1)^{i+j}(i+j-1) {{n+i-1}\choose{n-j}}{{n+j-1}\choose{n-...
- 1,254
19
votes
4
answers
7k
views
Sherman-Morrison type formula for Moore-Penrose pseudoinverse
Given an $n\times n$ invertible matrix $\mathbf A$ and two column vectors $\mathbf u$, $\mathbf v\in\mathbb R^n$, suppose that $1 + {\mathbf v}^T {\mathbf A}^{-1}\mathbf u \neq 0$.
Then the Sherman-...
17
votes
1
answer
4k
views
Geometric interpretations of matrix inverses
$A$ is an invertible $n \times n$ matrix. Interpret each row of $A$ as a point in $\mathbb{R}^n$; then these $n$ points define a unique hyperplane in $\mathbb{R}^n$ that passes through each point (...
- 693
15
votes
3
answers
6k
views
Questions on Toeplitz matrices: invertibility, determinant, positive-definiteness
These questions are probably very basic but I'll dare to ask them anyway since I didn't have much luck in Math Stack Exchange.
Let $A$ be an $n \times n$ Hermitian Toeplitz matrix:
$$A = \begin{...
- 3,626
11
votes
2
answers
2k
views
Inverse of a small submatrix
Let $A$ be a large matrix (say, $1000 \times 1000$), and let $\mathcal I = \{2,3,5\}$ be a set of row/column indices. Let $(A^{-1})_{\cal I \times I}$ denote the submatrix of $A^{-1}$ that consists of ...
- 241
11
votes
2
answers
9k
views
How to calculate the inverse of the sum of an identity and a Kronecker product efficiently?
I have a matrix $K$ which is the sum of a identity and a Kronecker product of two symmetric matrices as following and I want to calculate the inverse of it $K^{-1}$.
\begin{eqnarray}
K=\mathbf{I}_{mn}+...
- 607
11
votes
0
answers
313
views
Jaffard's theorem - finite matrices
For infinite matrices, Jaffard's theorem states that if $(A(k,l))_{k,l\in \mathbb{Z}}$ is invertible and satisfies
$$
A(k,l) \leq C (1+\left|k-l\right|)^{-r},
$$
for some $C>0$,
then
$$
A^{-1}(k,...
- 393
10
votes
3
answers
830
views
Find the inverse of a matrix that is very similar to the Hilbert matrix
The standard Hilbert matrix $H$ is given by
$$H_{ij}=\frac{1}{i+j-1},$$
and it has an inverse given for example in this MO question.
Now I have encountered a matrix $M$ of similar form, namely,
$$...
- 153
10
votes
3
answers
2k
views
Partial inverse of a matrix - or does it have its own name?
In my calculations I need to use something which is "between" a matrix and its inverse. That is, I invert only some dimensions. I am interested if it has an established name.
That is, a matrix (here ...
- 1,612
9
votes
2
answers
894
views
Inverse of special upper triangular matrix
Consider the following $n \times n$ upper triangular matrix with a particularly nice structure:
\begin{equation}\mathbf{P} = \begin{pmatrix}
1 & \beta & \alpha+\beta & \dots & (n-3)\...
- 230
9
votes
1
answer
605
views
Inverse of a matrix with binomial entries
This is closely related to this question: Eigenvalues of a matrix with binomial entries.
We consider the matrix:
$$M_{ij} = 4^{-j}\binom{2j}{i}$$
where it is understood that the binomial ...
- 884
9
votes
3
answers
2k
views
How to calculate inverse of sum of two Kronecker products with specific form efficiently?
I have a matrix with specific form of $A\otimes I + B\otimes J$ where $A$ and $B$ are general dense matrices, $n\times n$. $I$ is an $m\times m$ identity matrix. $J$ is a $m \times m$ dense matrix ...
- 91
8
votes
2
answers
12k
views
Relation between eigenvalues of $A$ and $A^TA$?
For an $n\times n$ diagonizable matrix $A$, is there a relation between the eigenvalues of $A$ and the eigenvalues of $A^TA$?
I ask this because I am looking into the relation between $A$ and $A+cI$, ...
- 181
8
votes
1
answer
361
views
Invertible matrix with group ring coefficient
Before asking the question I do need
some notations.
$G$ a (torsion-free) group, $\mathbb{Z}^{´}=\mathbb{Z}[\frac{1}{2}]$
$R:= \mathbb{Z}[G]$, $R^{´}=\mathbb{Z}^{´}[G]$ group rings.
$Mat_{n}(R)$ the ...
- 223
8
votes
0
answers
5k
views
Partitioned inverse 3x3 block matrix
We know that matrices can be inverted blockwise by using the following analytic inversion formula:
\begin{equation}
\begin{bmatrix} \mathbf{A} & \mathbf{C^T} \\ \mathbf{C} & \mathbf{D} \end{...
- 81
7
votes
1
answer
488
views
Invertibility of a matrix defined using inner product
Let $n,m \geq 1$. We fix $n$ distinct vectors $x_1, ... , x_n \in \mathbb{R}^m$. We define $A \in \mathbb{R}^{n\times n}$ as
\begin{equation}
A_{ij} = x_i^T \left(n x_j - \sum_{1 \leq k \leq n} x_k \...
- 2,306
7
votes
1
answer
3k
views
What are known properties of matrices where off-diagonal elements are 1?
Consider a matrix where the diagonal entries are anything but the off-diagonal entries are all one. I was able to find a formula for the determinant of this matrix, but what are other known properties?...
- 277
7
votes
1
answer
856
views
Trace of inverse of random positive-definite matrix in high dimension?
Consider a random matrix $A \in \mathbb{R}^{n\times n}$ with i.i.d. entries, with symmetric law and finite variance. I am curious about the behavior of $$\mathrm{Tr}( (A^T A + \lambda \mathrm{Id})^{-1}...
- 2,306
7
votes
1
answer
2k
views
Determinant and Inverse of a Toeplitz matrix
Let $T(n,k)$ be a $n \times n$ symmetric Toeplitz matrix, where all the entries of first $k$ super-diagonal (and sub-diagonal), last $k-1$ super-diagonal (and sub-diagonal) are ones, and rest of the ...
- 640
5
votes
2
answers
312
views
minimum-maximum entries matrix
Let $M(n)$ be an $n\times n$ matrix in the variables $x_1,\dots,x_n$ with entries
$$M_{i,j}(n)=\frac{x_{\max(i,j)}}{x_{\min(i,j)}}, \qquad 1\leq i,j\leq n.$$
I'm interested in the following:
...
- 43.2k
5
votes
2
answers
730
views
Do any two hermitian matrices A and B commute with the support of their commutator?
Let $A$ and $B$ be Hermitian matrices. Let $[A,B] = AB - BA$ be their commutator and let $[A,B]^+$ be the Moore-Penrose pseudoinverse of $[A,B]$.
Is it then true that $A$ and $B$ both commute with the ...
- 1,947
5
votes
1
answer
375
views
Are inverse eigenvalue problems (IEPs) hopeless and not a fruitful area of research?
I've been studying IEPs, in particular, the Nonnegative Inverse Eigenvalue Problem, some basic theoretical framework, the many open questions that IEPs have, and now sort of realize the computational ...
- 1
5
votes
1
answer
438
views
Inverse of a Cauchy-like matrix
Consider $n\times n$ symmetric Cauchy-like matrix $M$ with elements $(M_{ij})_{i,j=1}^{n}$ given by
$$M_{ij} = \frac{1}{(n-i)!(n-j)!(2n-i-j+1)} = \displaystyle\int_{0}^{1}\frac{x^{n-i}}{(n-i)!} \frac{...
- 1,538
5
votes
1
answer
368
views
$(AB)^+\approx B^+A^+$ for $B$ "fat" enough?
Let $A\in\mathbb{R}^{r\times m}$ be a matrix of full row rank, and let $\cdot^+$ denote the Moore-Penrose inverse.
Consider a sequence of matrices $\{B_n\}_{n>1}$, $B_n\in\mathbb{R}^{m\times n}$, ...
- 2,712
5
votes
2
answers
973
views
Sufficient conditions for invertibility of a block tridiagonal matrix
Let $M_n \in \mathbb{R}^{N \times N}$ be a block-tridiagonal matrix:
$$M_n = \begin{bmatrix} B_1 & C_1 & 0 & 0 & \cdots & 0 \\ A_1 & B_2 & C_2 & 0 & \cdots & 0 \...
- 397
5
votes
1
answer
199
views
Find the inverse of a more general matrix that is similar to the Hilbert matrix
In the last MO question , the following matrix is given:
$$M_{ij}=\left[\frac{1+(-1)^{i+j}}{i+j-1}\right]$$
and its inverse has been discussed.
Now the problem is further extended to a more general ...
- 153
4
votes
2
answers
203
views
Results of invertibility of a matrix involving the Szego kernel
In the context of reproducing kernel Hilbert spaces, the Szego kernel is the function $k(z_i,z_j)=\frac{1}{1-z_j\overline{z_j}}$.
Given $2n$ points $\{z_1,\ldots,z_n\},\{w_1,\ldots,w_n\}\in\mathbb{D}\...
- 167
4
votes
1
answer
4k
views
Numerical trace of inverse matrix from Cholesky
This question was somewhat answered here: Fast trace of inverse of a square matrix. However, I feel like there was no complete answer wrt the Cholesky case.
I have the matrix $\Sigma=LL^T$. Is there ...
- 171
4
votes
1
answer
3k
views
Approximating the expectation of a matrix inverse
Let
$$R := A \Lambda^{-1} A^H + \frac{1}{\gamma} I_n$$
where $A$ is a given $n \times m$ matrix (where $m \gg n$),
$$\Lambda := \mbox{diag} \big( \lambda_1, \lambda_2, \dots, \lambda_m \big)$$
...
- 67
3
votes
1
answer
342
views
Inverting a matrix using the Matrix logarithm
This is probably going to lead nowhere, but maybe it be possible to use the matrix logarithm to invert matrices?
For positive definite matrices, we have that the logarithm exists and
$$
\log(A^{-1})= -...
- 385
3
votes
2
answers
3k
views
Inverse of particular lower triangular matrix
I have an $n \times n$ lower triangular matrix $A$ where
$$A_{i,j} = {\bf x}_i{\bf x}_j^H,\quad i>j$$
$$A_{ii}=1, \quad 1 \leq i \leq n,$$
and ${\bf x}_i$ is a $1 \times k$ (row) vector, where $...
- 31
3
votes
1
answer
332
views
Complexity of inverting and multiplying against a symmetric Toeplitz matrix with two repeated entries
I know that the computational complexity of inverting a general $n \times n$ matrix $A$ is $O(n^{2.373})$ and multiplying it against an $n \times m$ matrix is $O(n^2m)$. Moreover, I've seen that ...
- 91
3
votes
2
answers
375
views
Inequality for 0-1 matrices
Given an $n \times n$-matrix $A$ with entries only $0$ or $1$ and determinant equal to $\pm 1$. Define the magnitude $M_A$ of $A$ as the sum of all entries of the inverse of $A$.
Question 0: Do we ...
- 26.5k
3
votes
1
answer
2k
views
Transforming a non-invertible matrix into an invertible matrix
Given a non-invertible, diagonalizable matrix $A$, I wish to transform it into another matrix $B$ that satisfies:
$B$ is invertible
all non-zero eigenvalues of $A$, are also eigenvalues of $B$
all of ...
- 265
3
votes
1
answer
1k
views
Inverse of a larger matrix where the inverse of the submatrix is known
Let $A, A^{-1} \in \mathbb{R}^{n \times n}$ be known matrices. Suppose we have an invertible matrix $B \in \mathbb{R}^{(n+1) \times (n+1)}$ of the following form:
$$B = \begin{bmatrix}
A & ...
3
votes
1
answer
454
views
Difference of pseudoinverse bound under assumptions
This seems like a standard problem, but unable to find a solution online.
Suppose we have two singular PSD matrices A and B with the following assumptions:
$ 0 < x \leq ||A|| \leq y$
$ 0 < ||...
- 33
3
votes
1
answer
428
views
Minimum upper bound for sum of the entries of the inverse covariance matrix
Let $x \in \mathbb{R}^n$ and $k$ is RBF kernel
$$k(x, x') := \exp \left(-\frac{\|x-x'\|^2}{2\sigma^2}\right)$$
and let $\mathbf{K}$ be the following $n \times n$ covariance matrix
$$\mathbf{K} = \...
3
votes
0
answers
75
views
Solutions to a special confluent Vandermonde system
Consider the polynomial $P(X) =\prod_{i=1}^k (X-x_i)^s$ and let $M$ be the corresponding confluent Vandermonde matrix. Concretely, here is what I mean by that. Define
$$
M^{(0)} = \begin{pmatrix}
1 &...
- 613
3
votes
0
answers
231
views
Singularity of symmetric block matrix with singular diagonal blocks
One can show that the following statement holds:
Given symmetric matrix $A \in \Re^{n \times n}$ and tall matrix $B \in \Re^{n \times p}$ with full column rank,
$$\begin{bmatrix}A & B \\ B^T &...
- 73
2
votes
3
answers
550
views
Inverse of matrix $D + ADA^T$
Let $D$ be an arbitrary diagonal matrix and let $A$ be an orthogonal matrix ($A'A = AA' = I$). How to compute the following matrix inverse efficiently?
$$(D + ADA^T)^{-1}$$
Hints or references are ...
- 89
2
votes
2
answers
4k
views
Find inverse and determinant of a symmetric matrix - for a maximum-likelihood estimation
Evaluate the determinant $\det \Omega $ and find the inverse matrix $\Omega^{-1}$ of:
$$\Omega = \begin{bmatrix} \beta_1^2(1+\theta_1^2) & \beta_1 \beta_2 & ... & \beta_1 \beta_{k-1} &...
- 123
2
votes
2
answers
272
views
Full-rank matrix
I have a sparse square matrix and want to see if it is full rank (so that I can apply the implicit function theorem).
$$\left[\begin{array}{cccccccccc}
0 & 1 & 1 & 1 & 0 & 0 & ...
- 188
2
votes
2
answers
185
views
Orthonormal solution of overdetermined linear equations
I have a two matrices $A$ and $B$ in $\mathbb{R}^{m \times n }$ ($m \gg $ n) such that there exists an orthonormal matrix $X \in \mathbb{R}^{n \times n }$, such that:
$$AX = B$$
Given that $X$ is ...
- 123
2
votes
1
answer
137
views
Existence of matrices with some invertibility properties
Prove that there exists five matrices $B_i \in \mathbb{F}_2^{5\times 10}$, $i\in \{1,2,3,4,5\}$, such that any two $B_i$'s form an invertible matrix in $\mathbb{F}_2^{10\times 10}$.
I am interested ...
user83947
2
votes
1
answer
438
views
Mistake in Karl Pearson's 1900 paper introducing the chi-squared distribution
Background
I'm reading Karl Pearson's 1900 paper titled:
On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be ...
- 41
2
votes
2
answers
1k
views
When is the following block matrix invertible?
Let
$$A = \begin{bmatrix}
x_{11} A_{11} & x_{12} A_{12} & x_{13} A_{13} & \cdots & x_{1d} A_{1d}\\
x_{21} A_{21} & x_{22} A_{22} & x_{23} A_{23} & \cdots & x_{2d} ...
- 187
2
votes
1
answer
3k
views
Inverse of an AR(1) or Laplacian (?) or Kac-Murdock-Szegö matrix
My current problem involves having an exact (symbolic) inverse of a scaled AR(1) matrix for $n$-dimension. (I don't know what this matrix would be called in general; I'm sure it is used often.) This ...
- 291
2
votes
2
answers
4k
views
Moore-Penrose pseudo inverse
I have an $n\times p$ matrix $Z$ with $p>n$
I have $A$, a diagonal matrix with positive entries
I would like to know if there is a known relation (as a function of $A$) between
the Moore-Penrose ...
- 21