Timeline for Is there some generalization of the "Maximum Coverage Problem" for information in random variables?
Current License: CC BY-SA 3.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| May 19, 2011 at 0:59 | comment | added | MRule | Is it known whether entropy is a modular set function ? It seems like it is ? Since mutual information $MI=I(X;Y)$ and joint entropy $H(X,Y)$ obey the following relationship : $I(X;Y)+H(X,Y)=H(X)+H(Y)$ And, this would mean that all intuition about what happens when you take the union, intersection, and complement, with sets, should generalize to information for mutual information, joint entropy, and conditional entropy, respectively ? | |
| May 17, 2011 at 14:02 | comment | added | MRule | Thanks, I really appreciate your help. This answer is clear and exactly addresses the question. | |
| May 17, 2011 at 13:55 | vote | accept | MRule | ||
| May 17, 2011 at 11:53 | history | answered | Bobby Kleinberg | CC BY-SA 3.0 |