Skip to main content
typo fix: x_i == z_i
Source Link
dohmatob
  • 6.9k
  • 1
  • 18
  • 76

Let $x=(z_1,\ldots,z_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $\Delta_f(z,p):=f(\sum_{i}z_i p_i) - \sum_i f(p_iz_i)$, thus providing a kind of reversed Jensen's inequality.

Indeed, it was shown that

If $f$ is concave, $a:=\min_i z_i$ and $b := \max_i z_i$, then $$ \Delta_f(z,p) \le \max_{p,q \ge 0,\;p+q=1} pf(b)+qf(a) - f(pb+qa). $$

I could probably use this with $f=\log$ to bound $\Delta_{\log} (z,p)$.

Let $x=(z_1,\ldots,z_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $\Delta_f(z,p):=f(\sum_{i}z_i p_i) - \sum_i f(p_iz_i)$, thus providing a kind of reversed Jensen's inequality.

Indeed, it was shown that

If $f$ is concave, $a:=\min_i z_i$ and $b := \max_i z_i$, then $$ \Delta_f(z,p) \le \max_{p,q \ge 0,\;p+q=1} pf(b)+qf(a) - f(pb+qa). $$

Let $x=(z_1,\ldots,z_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $\Delta_f(z,p):=f(\sum_{i}z_i p_i) - \sum_i f(p_iz_i)$, thus providing a kind of reversed Jensen's inequality.

Indeed, it was shown that

If $f$ is concave, $a:=\min_i z_i$ and $b := \max_i z_i$, then $$ \Delta_f(z,p) \le \max_{p,q \ge 0,\;p+q=1} pf(b)+qf(a) - f(pb+qa). $$

I could probably use this with $f=\log$ to bound $\Delta_{\log} (z,p)$.

typo fix: x_i == z_i
Source Link
dohmatob
  • 6.9k
  • 1
  • 18
  • 76

Let $x=(x_1,\ldots,x_n)$$x=(z_1,\ldots,z_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $f(\sum_{i}x_i p_i) - \sum_i f(p_ix_i)$$\Delta_f(z,p):=f(\sum_{i}z_i p_i) - \sum_i f(p_iz_i)$, thus providing a kind of reversed Jensen's inequality.

Indeed, it was shown that

If $f$ is concave, $a:=\min_i z_i$ and $b := \max_i z_i$, then $$ \Delta_f(z,p) \le \max_{p,q \ge 0,\;p+q=1} pf(b)+qf(a) - f(pb+qa). $$

Let $x=(x_1,\ldots,x_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $f(\sum_{i}x_i p_i) - \sum_i f(p_ix_i)$, thus providing a kind of reversed Jensen's inequality.

Let $x=(z_1,\ldots,z_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $\Delta_f(z,p):=f(\sum_{i}z_i p_i) - \sum_i f(p_iz_i)$, thus providing a kind of reversed Jensen's inequality.

Indeed, it was shown that

If $f$ is concave, $a:=\min_i z_i$ and $b := \max_i z_i$, then $$ \Delta_f(z,p) \le \max_{p,q \ge 0,\;p+q=1} pf(b)+qf(a) - f(pb+qa). $$

Source Link
dohmatob
  • 6.9k
  • 1
  • 18
  • 76

Good UPPER bounds for $\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i$ where $(p_i)_i$ is a probability vector

Let $x=(x_1,\ldots,x_n)$ be real vector and $(p_1,\ldots,p_n)$ be a probability vector.

Question

$\log(\sum_{i=1}^n p_ie^{z_i})-\sum_{i=1}^np_iz_i \le ???$

Observation

This paper allows us to upper-bound things like $f(\sum_{i}x_i p_i) - \sum_i f(p_ix_i)$, thus providing a kind of reversed Jensen's inequality.