Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 1898

Optimization with convex constraints and convex objectives; notions related to convex optimization such as sub-gradients, normal cones, separating hyperplanes

1 vote

Is there any efficient solution of the matrix equation AXB + (AXB)' + cX = D

As @loupblanc states in his answer, there is ample literature on solving equations of the form $AXB+CXD=E$ in $O(p^3)$. Unfortunately, as far as I know, none of these methods extend to cases where the …
Federico Poloni's user avatar
3 votes
Accepted

Tighest Gap $\|x\|_1/\|x\|_2$ between $\ell^1$ and $\ell^2$ norms

(EDIT: changing this to at least solve the stated problem...) We first look for the optimal vector for fixed $\|\lambda\|_1=M$. Hence the problem is: maximize $\|\lambda\|_2^2$ s.t. $\|\lambda\|_1=M$ …
Federico Poloni's user avatar
4 votes

What is the most accurate and efficient method of finding an inverse of a hessian matrix?

This would probably get better answers on [scicomp.se]. Anyway: If you value accuracy over efficiency, using a QR factorization gives a backward stable algorithm, i.e., it guarantees that your soluti …
Federico Poloni's user avatar
1 vote
Accepted

Possible analytical way to solve or approximate a specific optimization problem's solution

$ACB$ ranges over all the matrices with rank smaller or equal to the rank of $C$, so this is equivalent to a problem with $C=I$ (and possibly with a smaller $k$). That said, it is not clear to me how …
Federico Poloni's user avatar
2 votes

LASSO problem but with a maximization instead of minimization

That problem does not have a maximum. Unless $A$ or $k$ are zero, you can take $\alpha = Me_j$, where $e_j$ is a vector of the canonical basis, and then the objective function diverges when $M \to \in …
Federico Poloni's user avatar
0 votes

Minimize Frobenius norm

Up to an orthogonal change of basis you may assume $U = \begin{bmatrix}I_d\\0\end{bmatrix}$. In this basis, the problem becomes $$ \min_{X_{11} \succeq 0} \left\|\begin{bmatrix}X_{11} & X_{12}\\ X_{12 …
Federico Poloni's user avatar
10 votes

Is the pseudoinverse the same as least squares with regularization?

Yes, they are connected. The first problem is a special case of the second when $\lambda=0$, if the first problem has a unique solution (i.e., $\ker A = 0$), or if the second is also formulated as a …
Federico Poloni's user avatar
3 votes
Accepted

Matrix reconstruction puzzle

[EDIT: as OP confirm that they need the Frobenius norm, this should be a complete solution for that case] Since that norm is orthogonally invariant, $$ \|A - A'\| = \|P^T(A-A')\| = \|P^TA - DP^TA\| = …
Federico Poloni's user avatar
3 votes

The set of matrices with same spectral radius

Since you ask about positive entries, the Perron-Frobenius theorem limits possibilities. A possible characterization is the following: $$ A_1 = \{DMD^{-1} \colon \text{$D$ diagonal with positive $D_{i …
Federico Poloni's user avatar
1 vote
Accepted

Efficient algorithm for solving a convex quadratic program

Using an SVD $A=USV^T$, and setting $y=U^Tx$, $c=U^Tb$, you can reduce the problem to a diagonal one $$\min_{y\in\mathbb{R}^n} c^Ty + \frac12 y^T S^2 y = \min_{y\in\mathbb{R}^n} \sum_{i=1}^n c_i y_i + …
Federico Poloni's user avatar
1 vote
Accepted

Matrix norm minimization and matrix inner product

The comments to this question of mine show that, in general, the operator-norm and Frobenius-norm minima are distinct for this problem. Let me summarize the argument here. Let $M=diag(\alpha,\beta,\ga …
Federico Poloni's user avatar
1 vote
Accepted

Inequality for matrix with rows summing to 1

If I am not missing something, this seems a direct application of Titu's lemma $$ \sum_{k=1}^K \frac{x_k^2}{y_k} \geq \frac{\left(\sum_{k=1}^K x_k \right)^2}{\sum_{k=1}^K y_k}, \quad x_k \geq 0, y_k > …
Federico Poloni's user avatar
1 vote

Optimization algorithms for Kronecker approximation of high-dimensional covariance matrices

Answering to the edit: I still have no idea how $S$ is defined in terms of $G$. But that's fine, it can just be a $D^2\times D^2$ matrix for now. Not all matrices can be written as $S = U \otimes V$. …
Federico Poloni's user avatar
3 votes

Optimization algorithms for Kronecker approximation of high-dimensional covariance matrices

A Kronecker product is essentially a rank-1 matrix, once you change indices: if $A_{ijkl} = U_{ik}V_{jl}$ (where all indices vary from $0$ to $n-1$, to keep the notation simpler), then the matrix defi …
Federico Poloni's user avatar