Skip to main content
3 of 8
added 33 characters in body
Iosif Pinelis
  • 127.7k
  • 8
  • 107
  • 229

$\newcommand\R{\mathbb R}$Let $\R:=R$. Suppose that $|f''(x)(h,h)|\le C|h|^2$ for all $x$ and $h$ in $\R^m$ -- this is how we interpret the condition "Hessian matrix of $f$ is upper bounded by some constant $C$". Of course, here $f''(x)$ is the bilinear form that is the second derivative of $f$ at $x$.

Consider first the case $m=1$. Take any $x\in\R$ and any real $h>0$. Then $$0\le f(x+h)\le f(x)+f'(x)h+Ch^2/2,$$ whence $$f'(x)\ge-\frac{f(x)}h-\frac C2\,h\ge-K\sqrt{f(x)},$$ where $K:=\sqrt{2C}$. Similarly, $f'(x)\le K\sqrt{f(x)}$, and hence $$|f'(x)|\le K\sqrt{f(x)} \tag{1}$$ for all $x\in\R$.

Now take any natural $m$. Considering the restrictions of $f$ to all straight lines in $\R^m$, we see that (1) holds, where now $|f'(x)|$ denotes the norm of the linear form $f'(x)$ that is the derivative of $f$ at $x$, so that $|f'(x)|=|\nabla f(x)|$.

Thus, the desired conclusion holds, in general.

Iosif Pinelis
  • 127.7k
  • 8
  • 107
  • 229