Results 1 -
3 of
3
Information-theoretic Limitations of Formal Systems
- Journal of the ACM
, 1974
"... An attempt is made to apply information-theoretic computational complexity to metamathematics. The paper studies the number of bits of instructions that must be a given to a computer for it to perform finite and infinite tasks, and also the amount of time that it takes the computer to perform these ..."
Abstract
-
Cited by 43 (7 self)
- Add to MetaCart
An attempt is made to apply information-theoretic computational complexity to metamathematics. The paper studies the number of bits of instructions that must be a given to a computer for it to perform finite and infinite tasks, and also the amount of time that it takes the computer to perform these tasks. This is applied to measuring the difficulty of proving a given set of theorems, in terms of the number of bits of axioms that are assumed, and the size of the proofs needed to deduce the theorems from the axioms. 2 G. J. Chaitin Key Words and Phrases: complexity of sets, computational complexity, difficulty of theoremproving, entropy of sets, formal systems, Godel's incompleteness theorem, halting problem, information content of sets, information content of axioms, information theory, information time trade-offs, metamathematics, random strings, recursive functions, recursively enumerable sets, size of proofs, universal computers CR Categories: 5.21, 5.25, 5.27, 5.6 1. Introduct...
A New Approach to Formal Language Theory by Kolmogorov Complexity
- Preprint, SIAM J. Comput
, 1995
"... We present a new approach to formal language theory using Kolmogorov complexity. The main results presented here are an alternative for pumping lemma(s), a new characterization for regular languages, and a new method to separate deterministic context-free languages and nondeterministic context-free ..."
Abstract
-
Cited by 3 (0 self)
- Add to MetaCart
We present a new approach to formal language theory using Kolmogorov complexity. The main results presented here are an alternative for pumping lemma(s), a new characterization for regular languages, and a new method to separate deterministic context-free languages and nondeterministic context-free languages. The use of the new `incompressibility arguments' is illustrated by many examples. The approach is also successful at the high end of the Chomsky hierarchy since one can quantify nonrecursiveness in terms of Kolmogorov complexity. (This is a preliminary uncorrected version. The final version is the one published in SIAM J. Comput., 24:2(1995), 398-410.) 1 Introduction It is feasible to reconstruct parts of formal language theory using algorithmic information theory (Kolmogorov complexity). We provide theorems on how to use Kolmogorov complexity as a concrete and powerful tool. We do not just want A preliminary version of part of this work was presented at the 16th International...
Algorithmic Randomness as Foundation of Inductive Reasoning and Artificial Intelligence
, 2010
"... This article is a personal account of the past, present, and future of algorithmic randomness, emphasizing its role in inductive inference and artificial intelligence. It is written for a general audience interested in science and philosophy. Intuitively, randomness is a lack of order or predictabil ..."
Abstract
- Add to MetaCart
This article is a personal account of the past, present, and future of algorithmic randomness, emphasizing its role in inductive inference and artificial intelligence. It is written for a general audience interested in science and philosophy. Intuitively, randomness is a lack of order or predictability. If randomness is the opposite of determinism, then algorithmic randomness is the opposite of computability. Besides many other things, these concepts have been used to quantify Ockham’s razor, solve the induction problem, and define intelligence. Contents 1 Why were you initially drawn to the study of computation

