Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 9652

Nonlinear objectives, nonlinear constraints, non-convex objective, non-convex feasible region.

6 votes

Nearest matrix orthogonally similar to a given matrix

Not a full answer, but some pointers on how to get a numerical method: If $\|\cdot\|_2$ denotes the spectral norm, then, by unitary invariance, your problem is equal to $$ \min_{T\in O(n)}\|AT-TB\|_2. …
Dirk's user avatar
  • 12.7k
5 votes

Can this optimization problem be transformed into or approximated by a SOCP?

First, you should restrict $x$ to be positive or use $|x|^\beta$ instead. Then I think that the answer is no: For $\beta\neq 1/2$ you can argue as follows: The special case of diagonal $\Omega = \ …
Dirk's user avatar
  • 12.7k
4 votes

Sparse approximation of the inverse of a sparse matrix

$\newcommand{\Ag}{\mathcal{A}_\gamma}$ Not a full answer, put probably a fruitful pointer: In the discretization of infinite dimensional problems one faces (bi-)infinite matrices. There, the Jaffard …
Dirk's user avatar
  • 12.7k
4 votes

Reference request: importance of Lipschitz continuity

Here is my two cents: In (unconstrained continuous) optimization you want to find minima of functions and in the differentiable case these have vanishing gradient. (In the convex case, vanishing gradi …
Dirk's user avatar
  • 12.7k
3 votes
Accepted

Better alternative to solve quadratic programming for large matrices

Your problem is also convex. Hence, a whole bunch of methods for convex optimization are available. Since projecting onto the constraints is not too difficult (project each row of $A$ onto the simplex …
Dirk's user avatar
  • 12.7k
3 votes
Accepted

Adding constraints as penalty with $\| \cdot \|_0$ norm

The claim in the paper is false. Since the problem is not convex, the claim does not follow from general results. However, there are some results in this direction in quite general cases: If $x^*$ i …
Dirk's user avatar
  • 12.7k
2 votes
Accepted

Rate of convergence for cyclic gradient descent

Methods of these type sometimes go under the name "Kaczmarz method". Kaczmarz method is a method for solving $Ax=b$ by iteratively (e.g. cyclic") projection onto the solutions of the equations given b …
Dirk's user avatar
  • 12.7k
2 votes

Optimization with weaker oracle than projection

I would guess that the method is going to converge (weakly), even with constant stepsizes. Off the top of my head I don't know a precise reference. The method is close in spirit to the "hybrid project …
Dirk's user avatar
  • 12.7k
2 votes
Accepted

Calculating derivatives of arbitrary-order at an operator's root

Although this question sounds quite innocent, a systematic treatment of higher order derivatives of implicit functions is quite involved. On a second thought, this is no surprise if you think about ho …
Dirk's user avatar
  • 12.7k
2 votes
Accepted

Argmax of a function of $n$ variables under linear constraint

Here is an approach via Langange multipliers: The Lagrangian of the constrained problem is $$L(x,\lambda) = x_1\cdots x_n + x_2\cdots x_n + x_n - \lambda(\sum_{i=1}^n x_i - n-C).$$ The solution is a c …
Dirk's user avatar
  • 12.7k
1 vote
Accepted

Question about optimizing a given function by optimizing an approximation

In general, small perturbations of the objective may change the set of local maxima drastically. Just think of a flat local maximum and adding a small wiggling (so also uniform approximation does not …
Dirk's user avatar
  • 12.7k
1 vote
Accepted

Gradient-descent "type" Methods for non-convex and non-smooth functions

Several splitting methods fit the bill: Often the non-convexity and the non-smoothness come from different parts of the objective and one can split the objective like $ f(x)=g(x) +h(x)$ with a convex …
Dirk's user avatar
  • 12.7k
1 vote

Block coordinate descent convergence rate

The Wikipedia page has a counterexample: A continuous convex function for which coordinate descent fails to converge but getting stuck in a non-optimal point. Here are the level lines of this functi …
Dirk's user avatar
  • 12.7k
1 vote

Is there a general guideline for minimizing $\sup_{y\in H}F(\;\cdot\;,y)$?

The problem you are dealing with is of the form $$ \inf_{x\in H}\sup_{y\in H} F(x,y). $$ If $F$ is convex in $x$ and concave in $y$, this is a saddle point problem and you can find a lot of informatio …
Dirk's user avatar
  • 12.7k
1 vote
Accepted

Quasiconvexity property of quasinorms

No, quasinorms are in general not quasiconvex. (Well, this is true if quasiconve means that the levelsets of the function are convex; other defintions of quasiconvexity may exist…) By positive homoge …
Dirk's user avatar
  • 12.7k

15 30 50 per page