**2**

votes

**1**answer

88 views

### The convergence of Matrix factorization

I'm trying to prove the convergence of Matrix factorization.
The problem is described below.
$|X-WH|^2 + |H|_2^2 +|W|_2^2$.
My optimization steps are using Alternating least squares which update H ...

**2**

votes

**2**answers

243 views

### Gaussian expectation of an exponentiated outer product

Given a normal random column vector $\mathbf{x} \sim N(\mu, \Sigma)$, I need the expectation,
$$ E\left[ \exp(\mathbf{xx}^\top)\right]$$
where $\exp(\cdot)$ is element-wise exponential function (not ...

**0**

votes

**1**answer

82 views

### Dimension of a similarity class

Let $K$ be an algebraically closed field with characteristic $0$. I consider the Jordan decomposition of a NILPOTENT matrix: $A=diag(J_{r_1},\cdots,J_{r_s})\in M_n(K)$ where $J_k$ is the nilpotent ...

**2**

votes

**2**answers

137 views

### Asymptotic property of a quadratic form

suppose $x=\Delta$, $y=M \Phi \Delta$, where $\Delta\in N\times 1$, $M^T=M \in N \times N$ and $\Phi^T=\Phi \in N \times N$. Define $Z=xy^T+yx^T$. It is known from my previous question that $Z$ has ...

**2**

votes

**0**answers

326 views

### On increasing the penalty term in convex optimization with regularization

Given the two strictly convex (unique solution) optimization problems as:
$$Problem\:1:\min_{X} f(X)+\|X\|_{F}^2 \hspace{2cm}Problem \:2:\min_{X}f(X)+n\|X\|_2^2$$
where $X\in\mathbf{S}_{++}^{n}$ ...

**2**

votes

**1**answer

480 views

### An inequality involving traces and matrix inversions

The following question kept me wondering for some time:
Given the symmetric matrices $A,B,C\in\mathbb{R}^{n×n}$ where $A$ and $C$ are positive definite (hence invertible), and $B$ is positive ...

**4**

votes

**3**answers

128 views

### Norm of the upper triangular part of symmetric matrix

Let $D\in \mathbb{R}^{n\times n}$ denote a lower triangular matrix. With $\|\cdot\|$ denoting the spectral matrix norm, is there an estimate like
$$
\|D\| \leq C\|D+D^T\|,
$$
where $C>0$ is ...

**2**

votes

**1**answer

152 views

### Alike looking matrices imply convergence of eigenvalues?

This is a question about convergence of eigenvalues which essentially came up in studying the spectrum of St.-Liouville operators.
We want to look at matrices that agree in most of their entries and ...

**3**

votes

**1**answer

101 views

### On the solution of a generalized Lyapunov equation

We shall reconsider the following equation
$$X=F_{1}XF_{1}^{T}+...+F_{p}XF_{p}^{T}+C$$
where $p$ is a positive integer and $C$ is a known symmetric positive semidefinite matrix.
I met with this ...

**3**

votes

**1**answer

191 views

### largest eigenvalue of a symmetric matrix

I have a matrix of the form:
$X=\Delta \Delta^T (\Phi+\Phi^T) P + P (\Phi+\Phi^T) \Delta \Delta^T $,
where $\Delta$ is $N\times 1$ real, $P=P^T$. I know that such matrix is rank two, but after doing ...

**5**

votes

**1**answer

473 views

### Die hard nilpotent spaces

Let $V\subset\mathbb{C}^{n\times n}$ be a linear space consisting of $n\times n$ complex matrices. Say that $V$ is nilpotent if every matrix $v\in V$ is nilpotent; denote by $V^k$ the subspace spanned ...

**10**

votes

**1**answer

224 views

### Factor a sum of products of cofactors

Let $M$ be any $n\times n$ matrix.
We define the usual cofactors: $C_{i,j}$ is $(-1)^{i+j}$ times the determinant of the submatrix obtained by deleting row $i$ and column $j$ of $M$.
We can write ...

**5**

votes

**1**answer

147 views

### Origins of the Jacobi matrix

I have several questions concerning history of Jacobi matrices.
Does anybody know why the Jacobi matrix (=symmetric tridiagonal matrix) is named by Carl Gustav Jacob Jacobi? What was his contribution ...

**2**

votes

**0**answers

57 views

### Reducing $\ell_1$ norm of non-full-rank matrices

I have two matrices ${\bf{X}}_{p\times r}$ and ${\bf{Y}}_{r\times q}$ with $r<\min(p,q)$. Matrix ${\bf Y}$ does not have full row rank (i.e., rank$({\bf Y})<r$). Can I build two new matrices ...

**9**

votes

**1**answer

365 views

### Why does this antisymmetric product factor out a determinant?

Consider a generic $n \times n$ matrix $M$.
Define the $(n-1) \times n$ matrix $M_q$ to be $M$ with the $q$th row omitted, and assume that $M_q$ possesses a right inverse, $R_q$:
$$R_q = M_q^T (M_q ...

**5**

votes

**3**answers

178 views

### Norm of triangular truncation operator on rank deficient matrices

Let $T_{n\times n}$ be a triangular truncation matrix, i.e.
$$T_{i,j}=\begin{cases}1 & i\ge j\\ 0 & i<j \end{cases}$$
It is known that for arbitrary $A_{n\times n}$
$$\|T\circ ...

**0**

votes

**1**answer

138 views

### How do eigenvalues change if we duplicate a row and column of a symmetric matrix

Let ${\bf A}$ be a size $n \times n$ symmetric positive semidefinite matrix with the first column being ${\bf a}_1$. If we define a new matrix,
\begin{align}
{\bf B} = \left[\begin{array}{cc} a_{11} ...

**0**

votes

**0**answers

199 views

### Proximal operator of modified L1 matrix norm

In literature proximal operator $prox_{\lambda f} : R^n \rightarrow R^n$ of $f$ is defined as:
$prox_{\lambda f}(V) = argmin(X) (f(X) + (1/2 \lambda)||X-V||^2_2)$
Consider now $g(X) = ...

**1**

vote

**1**answer

178 views

### Are there some algorithms to solve the diagonal matrix $X$ to the following matrix equation?

Suppose $X$ is an unknown $m \times m$ diagonal matrix. Given a scalar $0<c<1$, and a matrix $A$ of $m \times m$ size whose entries $0<A_{i,j}<1$. Are there some algorithms to find the ...

**3**

votes

**1**answer

259 views

### Number of Matrices with bounded determinant

Here's my question:
Let $k,B,C$ be positive integers such that $B<C$. Can you give an upper bound for the number of $k\times k$ integer matrices having entries bounded in modulus by $B$ having ...

**0**

votes

**2**answers

159 views

### Uniqueness of solution of a nonconvex optimization problem

What conditions need to be hold for a nonconvex optimization problem to have a unique solution?
Specifically, I have the following minimization problem that I'd like to know whether it has a unique ...

**4**

votes

**3**answers

223 views

### Is this function well studied?

Let $A_1,\dots,A_L$ be $N\times N$ hermitian matrices. Define the simplex
\begin{align}
\mathcal{S}=\left\{[x_1,\dots,x_L]\mid x_i\geq 0,~\sum_{i=1}^{L}x_i=1 \right\}
\end{align}
and consider the ...

**2**

votes

**0**answers

45 views

### Invexity of the $L_2$ norm

I have the following function:
$ f({\bf A,b}) = \| {\bf y - XAb} \|_2^2$
where ${\bf y}_{n \times 1}$ and ${\bf X}_{n \times p}$ are fixed, and ${\bf A}_{p \times r}$ and ${\bf b}_{r,1}$ are the ...

**0**

votes

**0**answers

53 views

### Solution of a nonlinear system of two equations

Given the matrix $A_{M,N}$ with $N\gt M$, the vector $y$, I have to find the vectors $x$ and $u$, satisfying the following equations:
$$D(x)x=A^Tu$$
$$y=Ax$$
where: $$D(x) = \left| \begin{array}{ccc}
...

**0**

votes

**2**answers

205 views

### Convexity of the Frobenius norm of the product of two matrices

I have the following function for two matrices ${\bf A}$ and ${\bf B}$:
$f({\bf A}, {\bf B}) = \| {\bf Y - XAB} \|_F^2 = trace\{({\bf Y - XAB)}^T({\bf Y - XAB)}\}$
where matrices ${\bf X}_{n \times ...

**2**

votes

**2**answers

268 views

### Solving a matrix equation $X=c \cdot AXA' +I$ with a diagonal corrections

I am now struggling to solve the matrix $X \in R^{n \times n}$ in the following equation:
$X=c \cdot AXA' - diag(c \cdot AXA')+ I$,
where
(1) $A \in R^{n \times n}$ is a given matrix whose element ...

**2**

votes

**1**answer

111 views

### Comparison of the smallest eigenvalues of two tridiagonal matrices

Let $n\geq2$ be an integer and $E_{ii}$ for an integer $2\leq i\leq n$ be the $n\times n$-matrix with its $ii$-entry equal to 1 and remaining entries equal zero. Furthermore, let ...

**0**

votes

**1**answer

89 views

### Solution of infinite dimension linear system

Suppose that ${a_n}$ and $b_n$ is decreasing sequence such that $a_0=A$, $lim_{n->\infty}a_n=0$ and $b_0=B$, $lim_{n->\infty}b_n=0$.
For fix n,
we can construct n dimension linear equation ...

**10**

votes

**1**answer

300 views

### LU factorization for $I+A$ (A skew-symmetric)

The matrix $M=I+A\in \mathbb{R}^{n\times n}$, where $I$ is the identity and $A=-A^T$ is skew-symmetric satisfies
$$
Mx\cdot x = \|x\|^2 \quad\text{for all }x\in\mathbb{R}^n.
$$
Therefore, $M=LU$ has ...

**1**

vote

**0**answers

28 views

### the 3th and 4th order statistics of Circularly Symmetric Complex Normal random vector?

Assume that ${\bf{z}} \in {\mathbb{C}}^{n \times 1}$ is a CSCG random vector denoted with $\mathcal{C} ~ (\bf{\mu} _0,\bf \Sigma _0)$ where $\mu _0$ and $\bf \Sigma _0$ are mean and contrivance ...

**1**

vote

**1**answer

305 views

### Generalising the cyclic property of the trace of a matrix

Are their other functions of a complex square matrix, not trivially related to trace, which also posses the cyclic property?
Furthermore, do all such functions $f(A)$ depend only on the spectrum of ...

**16**

votes

**1**answer

319 views

### A possible extension of a determinant inequality

It is well known that if $A, B$ are positive semidefinite matrices, then $$\det (A+B)\ge \det A+\det B.$$
I am considering a possible extension of this result. Let $\mathbb{M}_m(\mathbb{M}_n)$ ...

**1**

vote

**1**answer

354 views

### Under what conditions there is a one-to-one mapping between a product of matrices and the sequence of matrices leading to the product? [closed]

I have a set of matrices $A_1,\ldots,A_n$. Let $\mathcal{A} = \{A_i\}$.
What are some simple conditions under which for any sequence of indices between $1$ and $n$, $a_1,\ldots,a_m$, the product
...

**0**

votes

**1**answer

169 views

### Positive Semidefinite matrix [closed]

Let $A$ be an $n\times n$ symmetrix matrix, if $\forall i$,
$a_{ii}\geq |a_{ij}|,\forall j$
satisfies, can we say that $A$ is a positive semidefinite matrix? I tried to find a counter example, but ...

**0**

votes

**0**answers

115 views

### Reduction from permanent to $(0,1)$-permanent and implication of $P \ne NP$

Valiant
shows reduction from counting the solutions of CNF formula $F$,$\#SAT(F)$
to computing permanent where $ Perm(A)= 4^{t(F)}\cdot \#SAT(F)$
for certain efficiently computable $t(F)$ and matrix ...

**4**

votes

**1**answer

66 views

### An extension of the Golden Thompson inequality

For three symmetric positive-semidefinite matrices $A,B,C$ I am trying to figure out if the following inequality holds, at least in some cases:
$$tr(Ae^{B+C})≤tr(Ae^Be^C)$$
Note that if $A=I$ then ...

**8**

votes

**1**answer

215 views

### On an inequality among determinants

For Hermitian matrices $X, Y$, I write $X\ge Y\ge 0$ to mean $X-Y$ and $Y$ are positive semidefinite.
In Lemma 2.5 of [Linear Algebra Appl. 452 (2014) 1-6] I proved that if $X + Y\ge W + Z$,
$X\ge ...

**3**

votes

**1**answer

161 views

### Switching representatives of right coset in a paper on fundamental domain of tree of GL(2)

I have a question concerning the following paper: "The fundamental domain of the tree of GL(2) over the function field of an elliptic curve" by Shuzo Takahashi. (1993, Duke Math. J., Vol. 72, No. 1). ...

**0**

votes

**0**answers

60 views

### Prime Hadamard Matrices

Assume that $n$ is a sufficiently large number. Is there a Hadamaed matrix $H_{4n \times 4n}=(h_{ij})$ with the last row and the last cloumn $J$ (thet is, for every $k$, $h_{k,4n}=1$ and $h_{4n, ...

**3**

votes

**1**answer

97 views

### Space of matrices B for which there is a solution to Bx=c for a given c

Let $F$ be a field, $k$ and $m$ natural numbers with $k \leq m$, and $c \in F^m$.
Is there some name for the set $\mathcal{B}_c = \{ B \in F^{m \times k}\, | \,\, \exists x \in F^k $s.t. $ Bx = c\}$ ...

**3**

votes

**0**answers

72 views

### the annihilator of cokernel in a particular case

Let $A\in Mat(m,n;R)$ for $m\le n$ and $R$ a local ring. Consider the $mn\times(m^2+n^2)$ matrix $A\otimes 1_{nn}\oplus 1_{mm}\otimes A^T$, here $1_{mm}$, $1_{nn}$ are identity matrices. I'd like to ...

**2**

votes

**1**answer

363 views

### Diagonalization of 4th order tensors

I have been wondering about the following problem...
Let $n$ be a positive integer and denote by $M_n^s$ the space of symmetric $n\times n$ real matrices. Now, we look at the space $\mathcal ...

**5**

votes

**0**answers

563 views

### A stronger Cauchy-Schwarz inequality for traces of compression matrices

Assume that $A$ and $B$ are contractions, so
$I-AA^T$ and $I-BB^T$ are positive-definite matrices. Let
$C=(I-AB^T)^{-1}(I-AA^{T})(I-BA^{T})^{-1}$, and show that:
...

**0**

votes

**1**answer

83 views

### Reference request for: inverse of a non-singular M-matrix has all elements non-negative?

Does anyone know the best (earliest?) reference please for the proof that the inverse of a non-singular M-matrix has all elements non-negative?

**0**

votes

**0**answers

36 views

### Nonlinear matrix equation (transpose) [duplicate]

Let $H$, $M$ and $N$ be 10 by 10 matrices over the integers. If $M$ and $N$ are known, how do you solve for $H$ from the following equation?
$M = H N H^T$
where $H^T$ is the transpose of H.

**2**

votes

**1**answer

88 views

### Approximation with a rank-$1$ matrix

Given a matrix $A$ (generally speaking, complex and non-square), I want to find an identically-sized matrix $D$ with ${\rm rk} D\le 1$ to minimize the induced operator norm $\|A-D\|_2$. From the ...

**6**

votes

**7**answers

677 views

### Source for roots of matrix polynomials?

A
matrix polynomial
is a polynomial whose variables are square $n \times n$ matrices,
let's say with entries in $\mathbb{C}$, and with coefficients in $\mathbb{C}$.
I am seeking a source of results on ...

**3**

votes

**0**answers

138 views

### Method to Generate Random Mutually Orthogonal Unitary Matrices

The title says it all, I'd like to know if such a method exists to generate random mutually orthogonal unitary matrices. If so, any supplementary references would be very much obliged. Thanks again!

**8**

votes

**1**answer

146 views

### A variant of Cholesky decomposition involving binary matrices

Studying a problem that is not directly related to linear algebra I came across the following problem.
Let $B$ be $n \times n$ symmetric matrix whose entries are non-negative integers. I would like ...

**2**

votes

**0**answers

218 views

### Cavalieri's principle and inversion of the Vandermonde matrix

There are many examples on the Web of the use of Cavalieri's principle in determining areas and volumes of 2-D and 3-D geometrical figures. The Wikipedia link uses the principle as both a proof and ...