Abstract

Given a model of a physical process and a sequence of commands and observations received over time, the task of an autonomous controller is to determine the likely states of the process and the actions required to move the process to a desired configuration. We introduce a representation and algorithms for incrementally generating approximate belief states for a restricted but relevant class of partially observable Markov decision processes with very large state spaces. The algorithm incrementally generates, rather than revises, an approximate belief state at any point by abstracting and summarizing segments of the likely trajectories of the process. This enables applications to efficiently maintain a partial belief state when it remains consistent with observations and revisit past assumptions about the process’s evolution when the belief state is ruled out. The system presented has been implemented and results on examples from the domain of spacecraft control are presented.

Citations

228	Tractable inference for complex stochastic processes - Boyen, Koller - 1998
179	A model-based approach to reactive self-configuring systems - Williams, Nayak - 1996
167	Remote agent: To boldly go where no AI system has gone before - Muscettola, Nayak, et al. - 1998
154	Diagnosis with behavioral modes - Kleer, Williams - 1989
100	Rank-based systems: A simple approach to belief revision, belief update, and reasoning about evidence and actions - Goldszmidt, Pearl - 1992
40	Design of the Remote Agent Experiment for Spacecraft Autonomy - Bernard - 1998
23	Modeling belief in dynamic systems, part II: Revision and update - Friedman, Halpern - 1999
21	Fundamentals of model-based diagnosis of dynamic systems - Struss - 1997
17	Back to defaults: Characterizing and computing diagnoses as coherent assumption sets - Dressler, Struss - 1992