most recent 30 from http://mathoverflow.net 2013-06-19T09:46:08Z http://mathoverflow.net/feeds/question/69218 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy Mahdi Majidi-Zolbanin 2011-06-30T21:51:53Z 2012-07-19T15:53:44Z

<p>What are the axioms that a good notion of entropy must satisfy? Please note that I am <em>not</em> asking for the definitions of various types of entropy such as <em>topological entropy</em> or <em>measure-theoretic entropy</em> or etc. My question is, if $X$ is a 'space', in a broad sense (topological, measure, algebraic, etc.) and $\varphi:X\rightarrow X$ is a self-map, and if we want to define a good notion of entropy to measure the complexity of $\varphi$, what axioms should this notion satisfy? </p> <p>EDIT: Perhaps a more reasonable question: For a system given by iterating a function, what should a good notion of entropy measure (with no or minimum reference to the type of space)?</p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/69221#69221 Anthony Leverrier 2011-06-30T22:31:28Z 2011-06-30T22:31:28Z

<p>In addition to the wikipedia page, you can take a look at this fairly recent paper "A Characterization of Entropy in Terms of Information Loss" by John C. Baez, Tobias Fritz, Tom Leinster <a href="http://arxiv.org/abs/1106.1791" rel="nofollow">http://arxiv.org/abs/1106.1791</a></p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/69231#69231 Vaughn Climenhaga 2011-07-01T05:17:29Z 2011-07-01T05:26:50Z

<p>This isn't a full axiomatisation, partly because it's a little vague, and partly because I only am really familiar with the notion of entropy in two contexts: topological space and measure space. Nevertheless, there's a commonality to the procedure in both those cases.</p> <ol> <li>Start with a space $X$ and a map $f\colon X\to X$.</li> <li>Coarse-grain your space to a certain scale, so that orbit segments that are very close together are not distinguishable.</li> <li>Count how many mutually distinguishable orbit segments of length $n$ it takes to be "significant"; call this number $a_n$.</li> <li>Find the growth rate $\lim_{n\to\infty} \frac 1n \log a_n$; this is the entropy at the particular coarse scale you chose.</li> <li>Let the coarse scale become finer and finer and take a limit to get the entropy.</li> </ol> <p>Depending on how you make that procedure precise, you get various notions. For example, if $X$ is a topological space, "certain scale" means "code by an open cover", and "significant" means "covers X", then you get topological entropy. On the other hand, if $X$ is a measure space, "certain scale" means "code by a partition", and "significant" means "covers a set of uniformly positive measure", then you get measure-theoretic entropy.</p> <p>I'd be interested in knowing if there are other notions of entropy for other sorts of spaces that have analogous definitions. Or for that matter, if there are other notions that <em>don't</em> have analogous definitions.</p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/69270#69270 Aaron Bergman 2011-07-01T15:41:29Z 2011-07-01T15:41:29Z

<p>From a more physical perspective, there's the work of Lieb and Yngvason:</p> <p><a href="http://arxiv.org/abs/math-ph/0204007" rel="nofollow">http://arxiv.org/abs/math-ph/0204007</a></p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/102648#102648 Algernon 2012-07-19T11:48:43Z 2012-07-19T12:50:34Z

<p>The topological and measure-theoretic entropies of $(X,\varphi)$ formalize <em>average entropy per iteration</em> of partial observations ($\equiv$ the coarse-graining that Vaughn mentions above). (I am not familiar with other notions of entropy for dynamical systems.) In either case, one first needs an elementary notion of entropy for the class of allowed observations that is independent of $\varphi$.</p> <p>Chris Hillman has some (sadly) unpublished <a href="http://goo.gl/3HR33" rel="nofollow">notes</a> in which he gives an elegant axiomatization of entropy that encompasses many more examples such as the Hausdorff dimension or what he calls the Galois entropy.</p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/102664#102664 Simone Virili 2012-07-19T13:31:25Z 2012-07-19T13:31:25Z

<p>I want just to mention a framework in which we (Dikran Dikranjan, Anna Giordano Bruno and me) are going to redefine many notions of entropy.</p> <p>The idea of prof. Dikranjan was to define the category of normed semigroups. Indeed, a normed semigroup is just a semigroup $S$ with a norm $$v:S\to \mathbb R_{\geq 0}$$ such that $v(xy)\leq v(x)+v(y)$. The morphisms in the category are just semigroup homomorphisms such that the norm of the image is $\leq$ than the norm of the original point. </p> <p>In this category one can define a notion of entropy of an endomorphism $\phi:(S,v)\to (S,v)$. In fact one takes $$h(\phi)=\sup \left( \lim_{n\to\infty}\frac{v(x\phi(x)\dots\phi^{n-1}(x))}{n}: x\in S\right ) .$$ It is interesting to notice that already at this level, the above entropy function satisfies some good properties. Furthermore, it turns out that many of the usual notions of entropy (topological, algebraic, mesure-theoretic entropy, ...) for endomorphisms or automorphisms can be defined using a suitable functor from the category in which they are defined to the category of normed semigroups (the semigroup can be the set of subset with intersection (or sum in groups), the set of open covers with intersection, ... the norm can be $\log$ of the cardinality, measure, minimal cardinality of a subcover ...).</p> <p>Let me conclude remarking that if you are looking for lists of axioms for entropy functions you should look to the following papers:</p> <p>L. N. Stojanov, Uniqueness of topological entropy for endomorphisms on compact groups, Boll. Un. Mat. Ital. B 7 (1987) no. 3, 829–847. (axiomatic char. of topological entropy on compact groups)</p> <p>D. Dikranjan and A. Giordano Bruno, Entropy on abelian groups, preprint; arXiv:1007.0533. (axiomatic char. of algebraic entropy on discrete groups)</p> <p>L. Salce, P. Vamos, S. Virili, Length functions, multiplicities and algebraic entropy, Forum Math. (2011) (axiomatic char. of a notion of algebraic entropy on modules)</p> <p>The above characterizations are discussed in the following survey,</p> <p>D. Dikranjan, M. Sanchis, S. Virili, New and old facts about entropy in uniform spaces and topological groups, Topology appl. (2012) 1916-1942</p>

http://mathoverflow.net/questions/69218/if-you-were-to-axiomatize-the-notion-of-entropy/102678#102678 o a 2012-07-19T15:53:44Z 2012-07-19T15:53:44Z

<p><a href="http://www.ihes.fr/~gromov/PDF/structre-serch-entropy-july5-2012.pdf" rel="nofollow">This paper</a> of Gromov seems to aim to answer exactly your question: to provide a category theoretic axiomatization of entropy that is as general as possible. He defines entropy as a functor from the category of things you actually observe, to the category of sets. His formalism probably applies to your case if you define your 'state detectors' P (on page 2) in an appropriate manner...</p>