Channel capacity of a coin flip - MathOverflow most recent 30 from http://mathoverflow.net 2013-05-26T08:49:14Z http://mathoverflow.net/feeds/question/105540 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/105540/channel-capacity-of-a-coin-flip Channel capacity of a coin flip Andrea 2012-08-26T15:22:49Z 2012-08-26T17:32:05Z <p>I'm having some issue in understanding the channel capacity.</p> <p>\$C=max_{p(x)}I(X, Y)\$</p> <p>In particular the practical side. For example (an exercise), if I toss a fair coin and I transmit the result in a binary channel. What's the channel capacity?</p> <p>I'm trying to imagine the channel graph. I believe is something like this.</p> <p>H --1--> H</p> <p>T --1--> T</p> <p>A noiseless channel like this has \$C=log|X|\$ so \$C=log2=1bit\$. Why? I could represent it like this:</p> <p>x --0.5--> H</p> <p>x --0.5--> T</p> <p>And the channel capacity becomes \$C=log1=0\$ because \$|X|=1\$.</p> <p>Please someone help I'm quite confused.</p> http://mathoverflow.net/questions/105540/channel-capacity-of-a-coin-flip/105556#105556 Answer by Sune Jakobsen for Channel capacity of a coin flip Sune Jakobsen 2012-08-26T17:32:05Z 2012-08-26T17:32:05Z <p>If you channel is that you can decide if the cion shows head or tail and the pass the coin to your friend with that side up, then the channel has capacity of one bit. This corresponds to your first computation. </p> <p>If you channel is that you throw the coin to you friend on such a way that it is head with 50% probability and tail with 50% probability, then you cannot send any information over the channel. This corresponds to your second computation.</p>