Results 1 
1 of
1
A Formal Theory Of Information: I. Statics
, 1998
"... this paper, I study "entropy" as a quantity defined axiomatically by certain formal properties, independently of any particular mathematical context. In particular, unlike all previous attempts to axiomatize information theory which are known to me, the concept of probability will play no role in th ..."
Abstract

Cited by 1 (0 self)
 Add to MetaCart
this paper, I study "entropy" as a quantity defined axiomatically by certain formal properties, independently of any particular mathematical context. In particular, unlike all previous attempts to axiomatize information theory which are known to me, the concept of probability will play no role in the formal theory. I will define the notion of a joinset (essentially a lattice without the meet operation) and the notion of an entropy valuation on a joinset, which is a function assigning a nonnegative real number to every element of the joinset, subject to three simple axioms to be given below. I will explain how, given an entropy valuation, we immediately obtain conditional and interaction entropies defined on pairs of elements, and I will show that this suite of entropies has all the formal properties of Shannon's probabilistic entropy (see [3][16]). In particular, we have notions of