## Dynamic System Evolution and Markov Chain Approximation (1998)

Venue: | Discrete Dynamics in NS, Gordon & Breach |

Citations: | 4 - 4 self |

### BibTeX

@INPROCEEDINGS{Melnik98dynamicsystem,

author = {Roderick V. Nicholas Melnik},

title = {Dynamic System Evolution and Markov Chain Approximation},

booktitle = {Discrete Dynamics in NS, Gordon & Breach},

year = {1998},

pages = {7--39}

}

### OpenURL

### Abstract

In this paper computational aspects of the mathematical modelling of dynamic system evolution have been considered as a problem in information theory. The construction of such models is treated as a decision making process with limited available information. The solution of the problem is associated with a computational model based on heuristics of a Markov Chain in a discrete space-time of events. A stable approximation of the chain has been derived and the limiting cases are discussed. An intrinsic interconnection of constructive, sequential, and evolutionary approaches in related optimization problems provides new challenges for future work. Key words: decision making with limited information, optimal control theory, hyperbolicity of dynamic rules, generalized dynamic systems, Markov Chain approximation. 1 Introduction Many mathematical problems in information theory and optimal control related to dynamic system studies can be formulated in the following generic form. A decision...