Skip to main content
`\eqref`, `\lVert\rVert`
Source Link
LSpice
  • 12.9k
  • 4
  • 45
  • 69

Strong convexity inequality w.r.t. infinity norm $\|\cdot\|_$\lVert\cdot\rVert_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation}\begin{equation} \label{prop} \tag{P}\qquad \alpha \lVert x-x^*\rVert_{\infty} \leq \lVert\nabla f(x)\rVert_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer is no, what would be a sufficient condition to verify property (P)\eqref{prop}?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$$f=x\mapsto \frac{1}{2}\lVert x\rVert_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$$\lVert x\rVert_{\infty} \triangleq \max_{1 \leq i \leq n}\lvert x_i\rvert$.

Strong convexity inequality w.r.t infinity norm $\|\cdot\|_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer is no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.

Strong convexity inequality w.r.t. infinity norm $\lVert\cdot\rVert_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \tag{P}\qquad \alpha \lVert x-x^*\rVert_{\infty} \leq \lVert\nabla f(x)\rVert_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer is no, what would be a sufficient condition to verify property \eqref{prop}?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\lVert x\rVert_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\lVert x\rVert_{\infty} \triangleq \max_{1 \leq i \leq n}\lvert x_i\rvert$.
edited body
Source Link

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer ifis no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer if no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer is no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.
changed tag, formatting
Source Link
YCor
  • 63.9k
  • 5
  • 187
  • 286

Strong convexity inequality w.r.t infinity norm $||\cdot||_$\|\cdot\|_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} (P): \qquad \alpha ||x-x^*||_{\infty} \leq ||\nabla f(x)||_{\infty}, \end{equation}\begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer if no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}||x||_{2}^2$$f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Thanks in advance,

EDIT:

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $||x||_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$$\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.

Strong convexity inequality w.r.t infinity norm $||\cdot||_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} (P): \qquad \alpha ||x-x^*||_{\infty} \leq ||\nabla f(x)||_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer if no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}||x||_{2}^2$ for every $n$.

Thanks in advance,

EDIT:

Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $||x||_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.

Strong convexity inequality w.r.t infinity norm $\|\cdot\|_{\infty}$

Consider a twice differentiable 1-strongly convex function $f:\mathbb{R}^n \to \mathbb{R}$.

Is it true that there exists $\alpha>0$ independent of $n$ such that, for all $x \in \mathbb{R}^n$: \begin{equation} \label{prop} \text{(P)}: \qquad \alpha \|x-x^*\|_{\infty} \leq \|\nabla f(x)\|_{\infty}, \end{equation} where $x^*$ is the unique global minimizer of $f$.

If the answer if no, what would be a sufficient condition to verify property (P)?

The reason why I am asking the question is that, using the equivalence of norms, it is simple to show that (P) holds with $\alpha = \frac{1}{\sqrt{n}}$. But I think it is possible to do better, but cannot prove it. For example, it holds with $\alpha = 1$ for $n=1$, and for $f=x\mapsto \frac{1}{2}\|x\|_{2}^2$ for every $n$.

Edit. Reminder:

  • As $f$ is twice differentiable, it is 1-strongly convex iff $\nabla^2 f \succcurlyeq I_{n \times n}$.
  • $\|x\|_{\infty} \triangleq \max_{1 \leq i \leq n}|x_i|$.
Source Link
Loading