Search Results
Search type | Search syntax |
---|---|
Tags | [tag] |
Exact | "words here" |
Author |
user:1234 user:me (yours) |
Score |
score:3 (3+) score:0 (none) |
Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
Views | views:250 |
Code | code:"if (foo != bar)" |
Sections |
title:apples body:"apples oranges" |
URL | url:"*.example.com" |
Saves | in:saves |
Status |
closed:yes duplicate:no migrated:no wiki:no |
Types |
is:question is:answer |
Exclude |
-[tag] -apples |
For more details on advanced search visit our help page |
Nonlinear objectives, nonlinear constraints, non-convex objective, non-convex feasible region.
6
votes
Nearest matrix orthogonally similar to a given matrix
Not a full answer, but some pointers on how to get a numerical method: If $\|\cdot\|_2$ denotes the spectral norm, then, by unitary invariance, your problem is equal to
$$
\min_{T\in O(n)}\|AT-TB\|_2. …
5
votes
Can this optimization problem be transformed into or approximated by a SOCP?
First, you should restrict $x$ to be positive or use $|x|^\beta$ instead.
Then I think that the answer is no:
For $\beta\neq 1/2$ you can argue as follows:
The special case of diagonal $\Omega = \ …
4
votes
Sparse approximation of the inverse of a sparse matrix
$\newcommand{\Ag}{\mathcal{A}_\gamma}$
Not a full answer, put probably a fruitful pointer:
In the discretization of infinite dimensional problems one faces (bi-)infinite matrices. There, the Jaffard …
4
votes
Reference request: importance of Lipschitz continuity
Here is my two cents: In (unconstrained continuous) optimization you want to find minima of functions and in the differentiable case these have vanishing gradient. (In the convex case, vanishing gradi …
3
votes
Accepted
Better alternative to solve quadratic programming for large matrices
Your problem is also convex. Hence, a whole bunch of methods for convex optimization are available. Since projecting onto the constraints is not too difficult (project each row of $A$ onto the simplex …
3
votes
Accepted
Adding constraints as penalty with $\| \cdot \|_0$ norm
The claim in the paper is false.
Since the problem is not convex, the claim does not follow from general results. However, there are some results in this direction in quite general cases:
If $x^*$ i …
2
votes
Accepted
Rate of convergence for cyclic gradient descent
Methods of these type sometimes go under the name "Kaczmarz method". Kaczmarz method is a method for solving $Ax=b$ by iteratively (e.g. cyclic") projection onto the solutions of the equations given b …
2
votes
Optimization with weaker oracle than projection
I would guess that the method is going to converge (weakly), even with constant stepsizes. Off the top of my head I don't know a precise reference. The method is close in spirit to the "hybrid project …
2
votes
Accepted
Calculating derivatives of arbitrary-order at an operator's root
Although this question sounds quite innocent, a systematic treatment of higher order derivatives of implicit functions is quite involved. On a second thought, this is no surprise if you think about ho …
2
votes
Accepted
Argmax of a function of $n$ variables under linear constraint
Here is an approach via Langange multipliers: The Lagrangian of the constrained problem is
$$L(x,\lambda) = x_1\cdots x_n + x_2\cdots x_n + x_n - \lambda(\sum_{i=1}^n x_i - n-C).$$
The solution is a c …
1
vote
Accepted
Question about optimizing a given function by optimizing an approximation
In general, small perturbations of the objective may change the set of local maxima drastically. Just think of a flat local maximum and adding a small wiggling (so also uniform approximation does not …
1
vote
Accepted
Gradient-descent "type" Methods for non-convex and non-smooth functions
Several splitting methods fit the bill: Often the non-convexity and the non-smoothness come from different parts of the objective and one can split the objective like $ f(x)=g(x) +h(x)$ with a convex …
1
vote
Block coordinate descent convergence rate
The Wikipedia page has a counterexample: A continuous convex function for which coordinate descent fails to converge but getting stuck in a non-optimal point.
Here are the level lines of this functi …
1
vote
Is there a general guideline for minimizing $\sup_{y\in H}F(\;\cdot\;,y)$?
The problem you are dealing with is of the form
$$
\inf_{x\in H}\sup_{y\in H} F(x,y).
$$
If $F$ is convex in $x$ and concave in $y$, this is a saddle point problem and you can find a lot of informatio …
1
vote
Accepted
Quasiconvexity property of quasinorms
No, quasinorms are in general not quasiconvex. (Well, this is true if quasiconve means that the levelsets of the function are convex; other defintions of quasiconvexity may exist…)
By positive homoge …