Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 29887

Questions about the properties of vector spaces and linear transformations, including linear systems in general.

0 votes
1 answer
846 views

Prove that the following two optimization problems are equivalent

I am trying to solve the following optimization problem for the vector $ y $, where $ A_i $ are some given matrix (maybe low rank) and $ x_i $ are unconstrained $$ \min_{y, x_i} \sum_{i=1}^J || y - A_ …
Pushpendre's user avatar
2 votes

Orthogonal Procrustes problem with Absolute Values

Let $A, B \in \mathbb{R}^{n \times m}$ be positive matrices. Consider the problem, $ \underset{A, B}{\arg\min} || A + B - T ||_F $ subject to $A > 0, B > 0$, and $(A - B) = O$ is orthogonal and $A_{ …
Pushpendre's user avatar
2 votes
Accepted

Orthogonal Procrustes problem with Absolute Values

Here are alternate encodings based on Sebastian's comments on my previous answer. Comment: If you want to constrain the solutions found to a particular sign pattern matrix then an additional $mn$ li …
Pushpendre's user avatar
1 vote

Proof for a rank-one decomposition theorem of positive (semi) definite matrices

$$X_1 = RR' - x_1x_1'$$ U is unitary therefore, $$X_1 = RUIU'R' - \frac{1}{r}RUhh'U'R'$$ Let $M = RU$ then $X = MM'$ So the question becomes whether $MM' - M\frac{hh'}{r}M'$ is psd or not ? so we go t …
Pushpendre's user avatar
3 votes
Accepted

Relation between the QR decomposition of matrix A and the QR of the augmented version of A

First consider the simple case, if $Q_1 = I$, then you want to find $Q_2$ and $R_2$ such that $Q_2 R_2 = \begin{bmatrix} R_1 \\ I \end{bmatrix}$. Split the columns of $Q_2^T$ into left and right halve …
Pushpendre's user avatar
2 votes

Relationship between the eigenvalues of a matrix and its symmetric or antisymmetric part

Assume that $N$ is a real valued matrix. Let $x$ be an eigenvector corresponding to $\lambda_s$, i.e. $N_sx = \lambda_sx$. Note that $N_ax$ is always orthogonal to $x$. Therefore $||Nx||^2 = {\lambda_ …
Pushpendre's user avatar
0 votes
1 answer
1k views

Efficient way to find SVD of sum of projection matrices?

Lets say that we have n matrices of data $X_i : i \in [1, n]$. All $X_i$ have the same number of rows. Their associated projection matrices are $P_i = X_i(X_i^T X_i)^{-1}X_i^T$ Also say that we have …
Pushpendre's user avatar
0 votes

Minimize distance between centroids of subsets of points

This is more of a comment but are you sure that this is a well-motivated problem ? Also this question is probaly not a good fit for MO (maybe stats.stack or math.stack?). What I mean is that usually …
Pushpendre's user avatar
8 votes
2 answers
420 views

Existence and characterization of transitive matrices?

We call a matrix $M \in \mathbb{R}^{d \times d}$ transitive if it satisfies the following: For any three vectors $u, v, w$ in $\mathbb{R}^d$. If $u^T M v > 0$ and $v^T M w > 0$ then $u^TMw > 0$. …
Pushpendre's user avatar
11 votes

Efficient rank-two updates of an eigenvalue decomposition (or more generally SVD)

Just wanted to note that if one knows that the rank two update is of the form $uv^t + vu^t$ and one knows $v$ and $u$ then it is easy to find $x,y$ such that $uv^t + vu^t = xx^t - yy^t$. $x,y = \sqrt …
Pushpendre's user avatar
3 votes
Accepted

Minimize Frobenius norm

Here's one approach to solve this problem. Since $U$ is a thin matrix with orthogonal columns each of which has unit norm it spans a $d$ dimensional subspace within the $n$ dimensional ambient subspa …
Pushpendre's user avatar
1 vote

Solution of infinite dimension linear system

p.s. - This is really a comment but I don't have enough rep. It seems, you want to bound $$ X_n = A_n^{-1} B_n $$. Let's say we simplify, that $A_n$ and $B_n$ are independent, and then start by assu …
Pushpendre's user avatar
0 votes
Accepted

Perturbing a normal matrix

$\epsilon = 0 \implies \exists v: v $ is eigenvector of N and $v$ is orthogonal to $e_1 \implies Mv = Nv \implies v $ is an eigenvector of $M$ with same eigenvalue. So if $\epsilon = 0$ then $\delta$ …
Pushpendre's user avatar
1 vote

Row-based iterative algorithms for computing the kernel of a matrix

Assume your matrix is real valued. If we do $QR$ factorization of a matrix $A$, then $Q$ doesn't tell you anything about the kernel. It tells you about the range space of $A$. In fact the right-most …
Pushpendre's user avatar
7 votes

Linearly constrained eigenvalue problem

Your problem has been answered at https://scicomp.stackexchange.com/questions/14096/sparse-smallest-eigenvalue-problem-on-a-linear-subspace :) Or you can read Golub's original paper Some modified mat …
Pushpendre's user avatar