# Questions tagged [it.information-theory]

Theoretical and experimental aspects of information theory and coding theory. This tag covers but is not limited to following branches: information theory, information geometry, optimal transportation theory, coding theory.

**-1**

**0**answers

### Maximum mutual information of random unitary transformation

**5**

**1**answer

### Kullback–Leibler chains

**2**

**1**answer

### Mutual Information after Applying Random Unitary Matrix

**-1**

**0**answers

### Table of common relative entropies?

**0**

**0**answers

### Channel capacity for sequences of length n

**1**

**1**answer

### paper only available in Russian (Kozachenko Leonenko entropy estimator)

**0**

**0**answers

### intuition about Gaussian processes over a finite space

**8**

**2**answers

### Maximum of the weighted binomial sum $2^{-r}\sum_{i=0}^r\binom{m}{i}$

**1**

**0**answers

### Maximum mutual information of a matrix representation

**1**

**1**answer

### KL-divergence and sub-$\sigma$-algebras

**1**

**1**answer

### Almost-parallel corners of the hypercube in high dimensions

**1**

**1**answer

### Simple non-asymptotic upper-bound for packing number of a hamming cube

**5**

**1**answer

### reverse KL-divergence: Bregman or not?

**5**

**0**answers

### Computing the zeta transform of a Boolean function: Space-time tradeoff

**0**

**0**answers

### A basic property of maximal correlation

**1**

**0**answers

### Normalizing constants preserve metric entropy

**14**

**2**answers

### information-theoretic derivation of the prime number theorem

**2**

**1**answer

### Monotonicity of Dirichlet form of Markov chain

**0**

**1**answer

### Parameterization of exponential family

**1**

**1**answer

### Do enough permutations of an initial set eventually probably cover most permutations?

**5**

**2**answers

### Comparison of Information and Wasserstein Topologies

**0**

**1**answer

### Integrability of $\int \log(f(x)) f(x) dx$ for a probability density function $f$

**2**

**0**answers

### The uniform “probability” on $\mathbf{N}$: What occurs beyond logarithmic density?

**6**

**1**answer

### Probability of a deviation when Jensen’s inequality is almost tight

**1**

**0**answers

### A variant of Huffman code

**0**

**1**answer

### Lower bound for reduced variance after conditioning

**1**

**1**answer

### error correcting huffman code [closed]

**0**

**1**answer

### Encoding numbers with relationship into one and back

**3**

**1**answer

### Information monotonicity of divergence => function of $f$-divergence

**5**

**3**answers

### Is there a quantum analog of Kolmogorov Complexity?

**8**

**1**answer

### The entropy of a partition of unity

**2**

**0**answers

### Linear independence of Vandermonde matrix in systematic Reed-Solomon code

**2**

**0**answers

### Finding k elements with count queries

**0**

**1**answer

### Entropy of a refinement of a partition

**5**

**2**answers

### Shannon entropy and doubly stochastic matrices

**10**

**0**answers

### Measuring the randomness of texts

**2**

**0**answers

### An inequality of KL Divergence for two different distributions passing through a same channel

**6**

**1**answer

### Smallest $\mathrm{D}(Q\|P)$ given fixed marginals $\mathrm{D}(Q_X\|P_X)$ and $\mathrm{D}(Q_Y\|P_Y)$

**1**

**1**answer

### How much reduction in expected variance can we get from a single bit?

**1**

**1**answer

### Trace entropies

**4**

**1**answer

### Information density of proofs?

**1**

**0**answers

### A new notion of probability coupling

**2**

**1**answer

### Conditional entropy - solve example

**2**

**1**answer

### Strong Data Processing Inequality for capped channels

**2**

**1**answer

### Information theory for uncountably infinite-dimensional continuous random variable

**0**

**0**answers

### Is there a difference between using nats and bits to express entropy?

**4**

**1**answer

### Books to develop a deep understanding of Algorithmic Information Theory?

**8**

**3**answers

### Identifying a subset with as few tests as possible

**4**

**1**answer

### $\varepsilon$-net of a $d$-dimensional unit ball formed by power set of $V = \{+1, 0 -1\}^d$

**5**

**0**answers