most recent 30 from http://mathoverflow.net 2013-06-19T09:07:07Z http://mathoverflow.net/feeds/question/118829 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/118829/difference-between-generalized-gradient-and-subgradient unknown (google) 2013-01-13T17:13:53Z 2013-01-13T22:19:42Z

<p>Hi, I am wondering what the difference between 'generalized gradient' and 'subgradient' of a (potentially non-differentiable) convex function 'f' is. </p> <p>The generalized gradient I am interested in is meant in the sense of the paper http://www.is.tuebingen.mpg.de/fileadmin/user_upload/files/publications/ICML2010-Kim_6519[0].pdf (see page 3, footnote 2).</p> <p>many thx for any help.</p>

http://mathoverflow.net/questions/118829/difference-between-generalized-gradient-and-subgradient/118850#118850 arsmath 2013-01-13T22:19:42Z 2013-01-13T22:19:42Z

<p>Generalized gradients generalize subdifferentials. Subdifferentials are defined globally, and rely on the simple geometry of convex functions. If in a neighborhood a linear subspace only touches the graph of a convex function without crossing it, then you know for a fact it won't cross the graph later. So the intuition between the subdifferential is that you take each linear subspace of that is strictly below the convex function, and slide it up until it touches it. The subdifferential tells you the relation between the slopes of linear subspaces, and the points on the graph where the linear subspace will touch without crossing.</p> <p>For a general non-convex function, a linear subspace that touches the graph at one point can cross it again at another point. So you need a definition that works locally, only in a small neighborhood of the point. The definition of generalized gradient gives you that. It's reasonably easy to find information online about it. For example, the page on <a href="http://www.encyclopediaofmath.org/index.php/Clarke_generalized_derivative" rel="nofollow">Clarke generalized derivative</a> at Encyclopedia of Mathematics gives a quick introduction. Clarke's book, <i>Optimization and nonsmooth analysis</i>, is nice. A more recent book reference is Rockafeller and Wets, <i>Variational analysis</i>, which thoroughly covers this and related topics.</p> <p>I quickly looked over the paper you link to, and I don't see why they need generalized gradients instead of just subdifferentials, though I didn't look too closely.</p>