On Learning How to Learn Learning Strategies (1995)
| Citations: | 34 - 14 self |
BibTeX
@TECHREPORT{Schmidhuber95onlearning,
author = {Jürgen Schmidhuber},
title = {On Learning How to Learn Learning Strategies},
institution = {},
year = {1995}
}
OpenURL
Abstract
This paper introduces the "incremental self-improvement paradigm". Unlike previous methods, incremental self-improvement encourages a reinforcement learning system to improve the way it learns, and to improve the way it improves the way it learns ..., without significant theoretical limitations --- the system is able to "shift its inductive bias" in a universal way. Its major features are: (1) There is no explicit difference between "learning", "meta-learning", and other kinds of information processing. Using a Turing machine equivalent programming language, the system itself occasionally executes self-delimiting, initially highly random "self-modification programs" which modify the context-dependent probabilities of future action sequences (including future self-modification programs). (2) The system keeps only those probability modifications computed by "useful" selfmodification programs: those which bring about more payoff (reward, reinforcement) per time than all previous self-modi...







