Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 8430

Optimization with convex constraints and convex objectives; notions related to convex optimization such as sub-gradients, normal cones, separating hyperplanes

2 votes
Accepted

Fast projection onto a subspace

As noted in the comments, this problem is not really a research level problem. Afaik, versions of it were originally solved in the 50s. Here is an entire survey that discusses efficient algorithms (i …
Suvrit's user avatar
  • 28.6k
4 votes
Accepted

Iterative matrix inversion with $L^\infty$ norm

One approach is to solve the optimization problem: \begin{equation*} \min_x\quad \|Ax-y\|_\infty. \end{equation*} This is a nonsmooth optimization problem, but is amenable to a variety of scalable opt …
Suvrit's user avatar
  • 28.6k
3 votes

Maximizing a pseudoconcave function in a box

Your problem is a special case of a Fractional Linear Program, so as such following the recipe provided on Wikipedia you should be able to solve it by using a reformulation to an equivalent linear pro …
Suvrit's user avatar
  • 28.6k
7 votes
Accepted

L-infinity-norm regularized proximity problem

This is indeed a classic problem. Recall the more general problem of computing the prox operator of an lsc convex function $f$, i.e., \begin{equation*} \text{prox}_f(y) := \operatorname{argmin}\quad \ …
Suvrit's user avatar
  • 28.6k
4 votes
Accepted

Fixed point iteration on symmetric biconvex function

The paper cited in my answer here provides a detailed proof of the two-block case of alternating minimization (block coordinate descent). In particular, as mentioned in my comment, the convergence fol …
Community's user avatar
  • 1
2 votes
Accepted

Analysis of first-order methods for constrained convex optimization with approximate oracles

Building on Nesterov's work, in his Ph.D thesis, Peter Richtarik considers first-order methods with relative error of approximation guarantees. I haven't looked in too closely, but I am sure that a la …
Suvrit's user avatar
  • 28.6k
7 votes
Accepted

Maximizing Frobenius Norm of Commutator (an opposite Procrustes problem)

Unless I'm mistaken, the following argument provides a solution. Since the Frobenius norm is orthogonally invariant we can assume without loss of generality that $S$ is diagonal. I'll write $Q$ inste …
Suvrit's user avatar
  • 28.6k
7 votes

Convex Sets and Nearest Neighbors

A nonempty set $S$ in a normed linear space $X$ is called a Chebyshev set if for each $u \in X$ there is exactly one nearest point in $S$ to $u$ (i.e., for a Chebyshev set, nearest points always exist …
Suvrit's user avatar
  • 28.6k
1 vote

Is the prox-residual monotone?

Although not monotone at the operator level (as suggested by C. Mooney's proof), the monotonicity of prox-residual norms is known (probably you are already aware of it). Let $P_\eta^g$ denote the pr …
Suvrit's user avatar
  • 28.6k
5 votes

Is group theory useful in any way to optimization?

To some extent. Here's some relevant material where group theoretic objects show up in optimization (though a lot of it is convex algebraic geometry). Orbitopes Group majorization and a host of maj …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Distance between two sets

You are trying to solve what is known as a best approximation problem. von Neumann's alternating projections does not work here (as might have been perhaps suggested above) You can use Dykstra's pr …
Suvrit's user avatar
  • 28.6k
3 votes
Accepted

Block Covariance Matrix - Positive Definite? (Quadratic Optimization)

If $C$ is positive semidefinite, then so is $\begin{bmatrix} C & C\\ C & C\end{bmatrix}$ for the simple reason that it is nothing but the Kronecker product of $\begin{bmatrix} 1 & 1\\ 1 & 1\end{bmatri …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Circumscribed ellipsoid of minimum Hilbert-Schmidt norm

One reference that I could locate is the following Minimum norm ellipsoids as a measure in high-cycle fatigue criteria by Nestor Zouain, presented at a conference in 2005 (see $\S5$ of that pdf). Howe …
Suvrit's user avatar
  • 28.6k
0 votes

Question on convex optimization and dual norms

A somewhat more general theorem is available (though not entirely suitable for consumption by a beginner, but maybe it's ok). See Theorem 15.4 in Convex Analysis, by R. T. Rockafellar. Thm.15.4 (R …
Suvrit's user avatar
  • 28.6k
2 votes

optimize spectral radius

Maybe this is overkill, but I would recommend that you read the masterful paper: Optimizing the spectral radius, by Yurii Nesterov and Vladimir Protasov, 2012. Unless I'm mistaken, your problem is a …
Suvrit's user avatar
  • 28.6k

15 30 50 per page