7
$\begingroup$

Let $f\in C^2(\Bbb R^m), f\geq 0$, Hessian matrix of $f$ is upper bounded by some constant $C$. Do we have $|\nabla f|\leq \alpha \sqrt{f}$ for some $\alpha$, even if the Hessian matrix is degenerate?

$\endgroup$
1
  • 1
    $\begingroup$ Sorry, it should be f\geq 0 $\endgroup$
    – zhangwei
    Commented Jul 18, 2021 at 11:54

1 Answer 1

9
$\begingroup$

$\newcommand\R{\mathbb R}$Let $\R:=R$. Suppose that $|f''(x)(h,h)|\le C|h|^2$ for all $x$ and $h$ in $\R^m$ -- this is how we interpret the condition "Hessian matrix of $f$ is upper bounded by some constant $C$". Of course, here $f''(x)$ is the bilinear form that is the second derivative of $f$ at $x$, so that $f''(x)(h,k)=h^\top H(x)k$ for all $x,h,k$ in $\R^m$, where $H(x)$ is the Hessian matrix of $f$ at $x$.

Consider first the case $m=1$. Take any $x\in\R$ and any real $h>0$. Then $$0\le f(x+h)\le f(x)+f'(x)h+Ch^2/2,$$ whence $$f'(x)\ge-\frac{f(x)}h-\frac C2\,h=-K\sqrt{f(x)}$$ if $h=\sqrt{2f(x)/C}$, where $K:=\sqrt{2C}$. Similarly (or by the left-right symmetry), $f'(x)\le K\sqrt{f(x)}$, and hence $$|f'(x)|\le K\sqrt{f(x)} \label{1}\tag{1}$$ for all $x\in\R$.

Now take any natural $m$. Considering the restrictions of $f$ to all straight lines in $\R^m$, we see that \eqref{1} holds for all $x\in\R^m$, where now $|f'(x)|$ denotes the norm of the linear form $f'(x)$ that is the derivative of $f$ at $x$, so that $f'(x)(h)=h^\top\,\nabla f(x)$ for all $h\in\R^n$ and hence $|f'(x)|=|\nabla f(x)|$.

Thus, the desired conclusion holds, in general.

$\endgroup$
6
  • $\begingroup$ Thanks a lot! That's so cool! $\endgroup$
    – zhangwei
    Commented Jul 19, 2021 at 3:50
  • $\begingroup$ @ZhangWei : I am glad you liked this answer. Are you then satisfied with it? $\endgroup$ Commented Jul 19, 2021 at 12:34
  • $\begingroup$ Of course. This is wonderful. $\endgroup$
    – zhangwei
    Commented Jul 21, 2021 at 1:02
  • $\begingroup$ @ZhangWei : As a new contributor, you may be unfamiliar with these guidelines -- so, just in case: mathoverflow.net/help/someone-answers and mathoverflow.net/help/accepted-answer $\endgroup$ Commented Jul 21, 2021 at 2:25
  • $\begingroup$ We may also say: since $ f(x)+f'(x)h+Ch^2/2\ge0$ for all $h\in\mathbb R$, as a polynomial in $h$ it has a non-positive discriminant, that is $f'(x)^2\le2Cf(x) $. $\endgroup$ Commented Sep 8, 2021 at 7:59

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .