Kolmogorov Complexity and Information Theory -- With An Interpretation . . .
| Citations: | 6 - 1 self |
BibTeX
@MISC{Grünwald_kolmogorovcomplexity,
author = {Peter D. Grünwald and et al.},
title = {Kolmogorov Complexity and Information Theory -- With An Interpretation . . . },
year = {}
}
Bookmark
 |
 |
 |
 |
 |
 |
OpenURL
Abstract
We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy, Kolmogorov complexity, Shannon mutual information and Kolmogorov (`algorithmic') mutual information. We explain how universal coding may be viewed as a middle ground between the two theories. We consider Shannon's rate distortion theory, which quantifies useful (in a certain sense) information. We use the communication of information as our guiding motif, and we explain how it relates to sequential question-answer sessions.
