Welcome to MathOverflow

Question

0

Hello,

I have the following function form as one of my constraints :

f(x) = MIN(0, x)

Because of the MIN, it is non-differentiable.

As I would like to use an optimizer that uses derivative based methods, I need my objective function and constraints to be differentiable.

How could I convert (or approximate) this function into a differentiable one?

Here is an example of data and the function chart, even if it is trivial.

edited May 6 2011 at 19:08

asked May 6 2011 at 18:15

ibiza
13●2

	Your question is somewhat vague. Are you defining the function $f(x)$ to be $\min(0,x)$, or is $f(x)$ a function that is already defined and you want to impose the constraint that $f(x)=\min(0,x)$? If you're defining $f(x)$ to be $\min(0,x)$, then how else does $f(x)$ appear in your problem? Does it appear in other constraints? Does it appear in the objective function? – Brian Borchers May 6 2011 at 18:41
	The anti-derivative of a suitable bump function does what you want. – Ryan Budney May 6 2011 at 19:22

Pait · Accepted Answer · 2012-01-31 13:48:42Z UTC

You can try

$f(\xi) = \frac{\xi}{2}+\frac{\ln 2}{2k} + \frac{\ln(\cosh(k \xi)}{2k},$

whose derivative is

$f'(\xi) = \frac{1}{2} [\tanh(k \xi) + 1].$

This function approaches the maximum as $k\rightarrow \infty$ (change as needed for the minimum). Will this help solve your problem? Perhaps, if the lack of smoothness is not its essential feature - a question related to the domain of application, not strictly a mathematical issue.

littleO · Answer 2 · 2011-07-31 08:08:48Z UTC

0

What if you add to your objective function the indicator function of $(-\infty,0]$, and then solved your problem with the proximal gradient method or FISTA ?

answered Jul 31 2011 at 8:08

littleO
21●1●1

Converting (or approximating) a non-differentiable function to a differentiable function

Remember to vote up questions/answers you find interesting or helpful (requires 15 reputation points)

2 Answers

You can accept an answer to one of your own questions by clicking the check mark next to it. This awards 15 reputation points to the person who answered and 2 reputation points to you.