Some questions about Invexity - MathOverflow most recent 30 from http://mathoverflow.net 2013-05-21T11:44:20Z http://mathoverflow.net/feeds/question/43754 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/43754/some-questions-about-invexity Some questions about Invexity Shineway 2010-10-27T03:39:33Z 2012-03-12T10:47:05Z <p>Recently, I am looking into a non-convex optimization problem whose points satisfying KKT conditions can be obtained. Then the problem becomes how to decide whether the KKT conditions are sufficient for the global optimality of the solution. It is said on Wikipedia(<a href="http://en.wikipedia.org/wiki/Karush%25E2%2580%2593Kuhn%25E2%2580%2593Tucker_conditions#Sufficient_conditions" rel="nofollow">link text</a>) that for "invex function" the KKT is sufficient for optimality. By doing some searching, I was led to a concept called "invexity" and the book "Invexity and Optimization" ( <a href="http://www.springerlink.com/content/978-3-540-78561-3#section=155972&amp;page=1" rel="nofollow">http://www.springerlink.com/content/978-3-540-78561-3#section=155972&amp;page=1</a>).</p> <p>But, why this "invexity" research, which was first proposed in 1980's, is only confined in a small group of people. And the book is cited for only 4 times.</p> <p>In my current understanding, invexity is a generalization of convexity, and has some very good properties as in convexity, which should be very attractive and should have drawn lots of people's attention.</p> <p>Is it because this concept is not interesting, not useful? Or it is being studied under other names?</p> http://mathoverflow.net/questions/43754/some-questions-about-invexity/43764#43764 Answer by Mike Spivey for Some questions about Invexity Mike Spivey 2010-10-27T05:37:27Z 2010-10-27T05:37:27Z <p>There are a lot of generalizations or variations of convexity, such as quasi-convexity, pseudo-convexity, semilocal convexity, semilocal quasi-convexity, semilocal pseudo-convexity, strict versions of these, strong versions of these, etc. There is a reason for the existence of each term, in that each makes the hypotheses of some theorem tighter or has some other benefit (such as invexity making the KKT conditions not just necessary but sufficient). I agree with you that invexity ought to be better known, but it may have gotten lost in all the other generalizations/variations out there.</p> http://mathoverflow.net/questions/43754/some-questions-about-invexity/80694#80694 Answer by Czenek for Some questions about Invexity Czenek 2011-11-11T16:22:32Z 2011-11-11T16:22:32Z <p>Worth to read "A critical view on invexity" by Constantin Zalinescu www.math.uaic.ro/~zalinesc/papers3.php?file=invexity.pdf</p> http://mathoverflow.net/questions/43754/some-questions-about-invexity/90976#90976 Answer by Dirk for Some questions about Invexity Dirk 2012-03-12T10:47:05Z 2012-03-12T10:47:05Z <p>I second Czenek's recommendation. Moreover, it could be helpful to know this cute little characterization of invexity (due to Craven and Grower, see also <a href="http://dx.doi.org/10.1017/S0334270000005142" rel="nofollow">here</a>):</p> <p><strong>Theorem:</strong> A differentiable function $f$ is invex if and only if every stationary point is a global minimum.</p> <p><strong>Proof:</strong> Let $f$ be invex and $u$ stationary. Then $\nabla f(u) = 0$ and hence $f(x)-f(u)\geq 0$ for all $x$. Conversely, let every stationary point be globally optimal. Then $$\eta(x,u) = \begin{cases}0 &amp; \text{if}\ \nabla f(u) = 0\\ \frac{f(x)-f(u)}{\|\nabla f(u)\|^2}\nabla f(u) &amp; \text{else}\end{cases}$$ shows that $f$ is invex.</p> <p>Hence, invexity is just another way to say the every stationary point is globally optimal. Since the latter property is fulfilled by quite "arbitrary" functions, one may conclude that invexity does not impose too many structure. </p>