Timeline for analog of principle of inclusion-exclusion
Current License: CC BY-SA 4.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| S Jan 16, 2019 at 0:01 | history | suggested | Hans | CC BY-SA 4.0 |
Use the LaTeX script.
|
| Jan 15, 2019 at 22:29 | review | Suggested edits | |||
| S Jan 16, 2019 at 0:01 | |||||
| Jan 15, 2019 at 19:47 | comment | added | Will Orrick | @Hans It's been a while since I thought about this, but, yes, $P$ does represent the probability. The distinction is that I am speaking of the information content of an event rather than of a random variable. Perhaps it would have been clearer if I had stuck with the term "pointwise mutual information", which I used in my comment to Kenny Easwaran's answer, instead of dropping the adjective "pointwise", but many books do the same. The information content of a single event is sometimes referred to as "self information". | |
| Jan 15, 2019 at 8:22 | comment | added | Hans | The notation is confusing and looks wrong. For example, you say $I(E) = −\log P(E)$. What is $P$ the probability? The conventional definition of entropy $I(X)=-\sum_{x\in X(\Omega)} P(x)\ln P(x)$ for a random variable $X$. How does your definition reconcile with the conventional one? | |
| Oct 29, 2009 at 0:49 | history | edited | Will Orrick | CC BY-SA 2.5 |
Cover and Thomas reference
|
| Oct 24, 2009 at 15:28 | history | answered | Will Orrick | CC BY-SA 2.5 |