Results 1 - 10
of
10
The Dimensions of Individual Strings and Sequences
- INFORMATION AND COMPUTATION
, 2003
"... A constructive version of Hausdorff dimension is developed using constructive supergales, which are betting strategies that generalize the constructive supermartingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary ..."
Abstract
-
Cited by 77 (8 self)
- Add to MetaCart
A constructive version of Hausdorff dimension is developed using constructive supergales, which are betting strategies that generalize the constructive supermartingales used in the theory of individual random sequences. This constructive dimension is used to assign every individual (infinite, binary) sequence S a dimension, which is a real number dim(S) in the interval [0, 1]. Sequences that
Logical Depth and Physical Complexity
- THE UNIVERSAL TURING MACHINE: A HALF-CENTURY SURVEY
, 1988
"... Some mathematical and natural objects (a random sequence, a sequence of zeros, a perfect crystal, a gas) are intuitively trivial, while others (e.g. the human body, the digits of #) contain internal evidence of a nontrivial causal history. We formalize this ..."
Abstract
-
Cited by 39 (0 self)
- Add to MetaCart
Some mathematical and natural objects (a random sequence, a sequence of zeros, a perfect crystal, a gas) are intuitively trivial, while others (e.g. the human body, the digits of #) contain internal evidence of a nontrivial causal history. We formalize this
Hierarchies Of Generalized Kolmogorov Complexities And Nonenumerable Universal Measures Computable In The Limit
- INTERNATIONAL JOURNAL OF FOUNDATIONS OF COMPUTER SCIENCE
, 2000
"... The traditional theory of Kolmogorov complexity and algorithmic probability focuses on monotone Turing machines with one-way write-only output tape. This naturally leads to the universal enumerable Solomono-Levin measure. Here we introduce more general, nonenumerable but cumulatively enumerable m ..."
Abstract
-
Cited by 30 (13 self)
- Add to MetaCart
The traditional theory of Kolmogorov complexity and algorithmic probability focuses on monotone Turing machines with one-way write-only output tape. This naturally leads to the universal enumerable Solomono-Levin measure. Here we introduce more general, nonenumerable but cumulatively enumerable measures (CEMs) derived from Turing machines with lexicographically nondecreasing output and random input, and even more general approximable measures and distributions computable in the limit. We obtain a natural hierarchy of generalizations of algorithmic probability and Kolmogorov complexity, suggesting that the "true" information content of some (possibly in nite) bitstring x is the size of the shortest nonhalting program that converges to x and nothing but x on a Turing machine that can edit its previous outputs. Among other things we show that there are objects computable in the limit yet more random than Chaitin's "number of wisdom" Omega, that any approximable measure of x is small for any x lacking a short description, that there is no universal approximable distribution, that there is a universal CEM, and that any nonenumerable CEM of x is small for any x lacking a short enumerating program. We briey mention consequences for universes sampled from such priors.
Recursively Enumerable Reals and Chaitin Ω Numbers
"... A real is called recursively enumerable if it is the limit of a recursive, increasing, converging sequence of rationals. Following Solovay [23] and Chaitin [10] we say that an r.e. real dominates an r.e. real if from a good approximation of from below one can compute a good approximation of from b ..."
Abstract
-
Cited by 28 (3 self)
- Add to MetaCart
A real is called recursively enumerable if it is the limit of a recursive, increasing, converging sequence of rationals. Following Solovay [23] and Chaitin [10] we say that an r.e. real dominates an r.e. real if from a good approximation of from below one can compute a good approximation of from below. We shall study this relation and characterize it in terms of relations between r.e. sets. Solovay's [23]-like numbers are the maximal r.e. real numbers with respect to this order. They are random r.e. real numbers. The halting probability ofa universal self-delimiting Turing machine (Chaitin's Ω number, [9]) is also a random r.e. real. Solovay showed that any Chaitin Ω number is-like. In this paper we show that the converse implication is true as well: any Ω-like real in the unit interval is the halting probability of a universal self-delimiting Turing machine.
Scaled dimension and nonuniform complexity
- Journal of Computer and System Sciences
, 2004
"... Resource-bounded dimension is a complexity-theoretic extension of classical Hausdorff dimension introduced by Lutz (2000) in order to investigate the fractal structure of sets that have resource-bounded measure 0. For example, while it has long been known that the Boolean circuit-size complexity cla ..."
Abstract
-
Cited by 25 (11 self)
- Add to MetaCart
Resource-bounded dimension is a complexity-theoretic extension of classical Hausdorff dimension introduced by Lutz (2000) in order to investigate the fractal structure of sets that have resource-bounded measure 0. For example, while it has long been known that the Boolean circuit-size complexity class SIZE � α 2n n has measure 0 in ESPACE for all 0 ≤ α ≤ 1, we now know that SIZE � α 2n n has dimension α in ESPACE for all 0 ≤ α ≤ 1. The present paper furthers this program by developing a natural hierarchy of “rescaled” resource-bounded dimensions. For each integer i and each set X of decision problems, we define the ith-order dimension of X in suitable complexity classes. The 0th-order dimension is precisely the dimension of Hausdorff (1919) and Lutz (2000). Higher and lower orders are useful for various sets X. For example, we prove the following for 0 ≤ α ≤ 1 and any polynomial q(n) ≥ n2. 1. The class SIZE(2 αn) and the time- and space-bounded Kolmogorov complexity classes KT q (2 αn) and KS q (2 αn) have 1 st-order dimension α in ESPACE. 2. The classes SIZE(2nα), KT q (2nα), and KS q (2nα) have 2nd-order dimension α in ESPACE.
Inductive Inference Theory - A Unified Approach To Problems In Pattern Recognition And Artificial Intelligence
- Proceedings of the 4th International Conference on Artificial Intelligence , pp 274-- -280
, 1975
"... Recent results in induction theory are reviewed that demonstrate the general adequacy of the induction system of Solomono# and Willis. Several problems in pattern recognition and A.I. are investigated through these methods. The theory is used to obtain the a priori probabilities that are necessa ..."
Abstract
-
Cited by 9 (3 self)
- Add to MetaCart
Recent results in induction theory are reviewed that demonstrate the general adequacy of the induction system of Solomono# and Willis. Several problems in pattern recognition and A.I. are investigated through these methods. The theory is used to obtain the a priori probabilities that are necessary in the application of stochastic languages to pattern recognition.
Why Computational Complexity Requires Stricter Martingales
"... The word "martingale " has related, but different, meanings in probability theory and theoretical computer science. In computational complexity and algorithmic information theory, a martingale is typically a function d on strings such that E(d(wb)|w) = d(w) for all strings w, where the c ..."
Abstract
-
Cited by 5 (0 self)
- Add to MetaCart
The word "martingale " has related, but different, meanings in probability theory and theoretical computer science. In computational complexity and algorithmic information theory, a martingale is typically a function d on strings such that E(d(wb)|w) = d(w) for all strings w, where the conditional expectation is computed over all possible values of the next symbol b. In modern probability theory a martingale is typically a sequence,0,,1,,2,... of random variables such that E(,n+1|,0,...,,n) =,n for all n.
Sophistication Revisited
- Proceedings of the 30th International Colloquium on Automata, Languages and Programming
, 2001
"... The Kolmogorov structure function divides the smallest program producing a string in two parts: the useful information present in the string, called sophistication if based on total functions, and the remaining accidental information. We revisit the notion of sophistication due to Koppel, formal ..."
Abstract
-
Cited by 4 (3 self)
- Add to MetaCart
The Kolmogorov structure function divides the smallest program producing a string in two parts: the useful information present in the string, called sophistication if based on total functions, and the remaining accidental information. We revisit the notion of sophistication due to Koppel, formalize a connection between sophistication and a variation of computational depth (intuitively the useful or nonrandom information in a string), prove the existence of strings with maximum sophistication and show that they encode solutions of the halting problem, i.e., they are the deepest of all strings.
Effective Category and Measure in Abstract Complexity Theory (Extended Abstract)
, 1995
"... Complexity Theory---Extended Abstract #+ Cristian Calude # and Marius Zimand Abstract Strong variants of the Operator Speed-up Theorem, Operator Gap Theorem and Compression Theorem are obtained using an e#ective version of Baire Category Theorem. It is also shown that all complexity classes of re ..."
Abstract
- Add to MetaCart
Complexity Theory---Extended Abstract #+ Cristian Calude # and Marius Zimand Abstract Strong variants of the Operator Speed-up Theorem, Operator Gap Theorem and Compression Theorem are obtained using an e#ective version of Baire Category Theorem. It is also shown that all complexity classes of recursive predicates have e#ective measure zero in the space of recursive predicates and, on the other hand, the class of predicates with almost everywhere complexity above an arbitrary recursive threshold has recursive measure one in the class of recursive predicates. Keywords: Complexity measure, Operator Speed-up Theorem, Operator Gap Theorem, Compression Theorem, e#ective Baire classification, e#ective measure. 1 Introduction The abstract complexity theory initiated by Blum [2] (see also Bridges [5], Calude [8], Hartmanis and Hopcroft [17], Machtey and Young [23], Seiferas [34]) has revealed fundamental properties of complexity measures. The striking importance of this theory relies in i...
The Computational Complexity Column
, 1998
"... Introduction Investigation of the measure-theoretic structure of complexity classes began with the development of resource-bounded measure in 1991 [56]. Since that time, a growing body of research by more than forty scientists around the world has shown resource-bounded measure to be a powerful too ..."
Abstract
- Add to MetaCart
Introduction Investigation of the measure-theoretic structure of complexity classes began with the development of resource-bounded measure in 1991 [56]. Since that time, a growing body of research by more than forty scientists around the world has shown resource-bounded measure to be a powerful tool that sheds new light on many aspects of computational complexity. Recent survey papers by Lutz [60], Ambos-Spies and Mayordomo [3], and Buhrman and Torenvliet [22] describe many of the achievements of this line of inquiry. In this column, we give a more recent snapshot of resource-bounded measure, focusing not so much on what has been achieved to date as on what we hope will be achieved in the near future. Section 2 below gives a brief, nontechnical overview of resource-bounded measure in terms of its motivation and principal ideas. Sections 3, 4, and 5 describe twelve specific open problems in the area. We have used the following three criteria in choosing these problems. 1. Their

