Skip to main content
Made $p$ discrete.
Source Link
Mark Wildon
  • 11.2k
  • 3
  • 47
  • 73

If $p(x)$ is a discrete probabilistic density function with finite support, one could construct another discrete probabilistic density function proportional to $p(x)[1-p(x)]$ with a corresponding partition function (toto make the new function integratesum to 1)$1$. It(Rule out the degenerate case where $p(x_0) = 1$ for a unique $x_0$.)

It seems that the new constructed p.d.f has a bigger or equal entropy than $p(x)$?. How to prove that? Suggestions are welcomed for any references or direct solution.

If $p(x)$ is a probabilistic density function with finite support, one could construct another probabilistic density function proportional to $p(x)[1-p(x)]$ with a corresponding partition function (to make the new function integrate to 1). It seems that the new constructed p.d.f has a bigger or equal entropy than $p(x)$? How to prove that? Suggestions are welcomed for any references or direct solution.

If $p(x)$ is a discrete probabilistic density function, one could construct another discrete probabilistic density function proportional to $p(x)[1-p(x)]$ with a corresponding partition function to make the new function sum to $1$. (Rule out the degenerate case where $p(x_0) = 1$ for a unique $x_0$.)

It seems that the new constructed p.d.f has a bigger or equal entropy than $p(x)$. How to prove that? Suggestions are welcomed for any references or direct solution.

Put in LaTeX, corrected spelling mistake, removed thank.
Source Link
Mark Wildon
  • 11.2k
  • 3
  • 47
  • 73

shannon Shannon entropy of p$p(x)(1-p(x))$ is no less than entropy of p$p(x)$

if p(x)If $p(x)$ is a probabilistic density function onwith finite support, one could construct another probablisticprobabilistic density function proportional to p(x)[1-p(x)]$p(x)[1-p(x)]$ with a corresponding partition function (to make the new funcitonfunction integrate to 1). It seems that the new constructed p.d.f has a bigger or equal entropy than p(x)$p(x)$? How to prove that? Suggestions Suggestions are welcomed for any references or direct solution. Thanks.

shannon entropy of p(x)(1-p(x)) is no less than entropy of p(x)

if p(x) is a probabilistic density function on finite support, one could construct another probablistic density function proportional to p(x)[1-p(x)] with a corresponding partition function (to make the new funciton integrate to 1). It seems that the new constructed p.d.f has a bigger or equal entropy than p(x)? How to prove that? Suggestions are welcomed for any references or direct solution. Thanks.

Shannon entropy of $p(x)(1-p(x))$ is no less than entropy of $p(x)$

If $p(x)$ is a probabilistic density function with finite support, one could construct another probabilistic density function proportional to $p(x)[1-p(x)]$ with a corresponding partition function (to make the new function integrate to 1). It seems that the new constructed p.d.f has a bigger or equal entropy than $p(x)$? How to prove that? Suggestions are welcomed for any references or direct solution.

edited tags
Link
YCor
  • 63.9k
  • 5
  • 187
  • 286
Source Link
sunxd
  • 191
  • 4
Loading