Skip to main content
deleted 13 characters in body
Source Link
mw19930312
  • 263
  • 1
  • 6

I'm exploring the possibility to apply information theory on an uncountably infinite-dimensional scenario. I found the concept of `generalized entropy'generalized entropy for continuous random variables defined on finite-dimensional Euclidean space. I wonder whether there are similar concepts for uncountably infinite-dimensional cases. For instance, if I have a distribution on $C([0, 1])$, which is the space of continuous function on $[0, 1]$, then how can I quantify the entropy of this distribution?

I'm exploring the possibility to apply information theory on an uncountably infinite-dimensional scenario. I found the concept of `generalized entropy' for continuous random variables defined on finite-dimensional Euclidean space. I wonder whether there are similar concepts for uncountably infinite-dimensional cases. For instance, if I have a distribution on $C([0, 1])$, which is the space of continuous function on $[0, 1]$, then how can I quantify the entropy of this distribution?

I'm exploring the possibility to apply information theory on an uncountably infinite-dimensional scenario. I found the concept of generalized entropy for continuous random variables defined on finite-dimensional Euclidean space. I wonder whether there are similar concepts for uncountably infinite-dimensional cases. For instance, if I have a distribution on $C([0, 1])$, which is the space of continuous function on $[0, 1]$, then how can I quantify the entropy of this distribution?

Source Link
mw19930312
  • 263
  • 1
  • 6

Information theory for uncountably infinite-dimensional continuous random variable

I'm exploring the possibility to apply information theory on an uncountably infinite-dimensional scenario. I found the concept of `generalized entropy' for continuous random variables defined on finite-dimensional Euclidean space. I wonder whether there are similar concepts for uncountably infinite-dimensional cases. For instance, if I have a distribution on $C([0, 1])$, which is the space of continuous function on $[0, 1]$, then how can I quantify the entropy of this distribution?