Abstract

Preference elicitation is a key problem facing the deployment of intelligent systems that make or recommend decisions on the behalf of users. Since not all aspects of a utility function have the same impact on object-level decision quality, determining which information to extract from a user is itself a sequential decision problem, balancing the amount of elicitation effort and time with decision quality.

Citations

3909	Neural networks for pattern recognition - Bishop - 1995
990	Decision with multiple objectives: preferences and value trade-offs - Keeney, Raiffa - 1976
331	Dynamic Programming: Deterministic and Stochastic Models - Bertsekas - 1987
235	The optimal control of partially observable Markov processes over a finite horizon - Smallwood, Sondik - 1973
114	Approximating optimal policies for partially observable stochastic domains - Parr, Russell - 1995
105	Value-function approximations for partially observable markov decision processes - Hauskrecht - 2000
87	Solving POMDPs by search in policy space - Hansen - 1998
84	Monte Carlo POMDPs - Thrun - 2000
82	Making rational decisions using adaptive utility elicitation - Chajewska, Parr
69	Algorithms for partially observable Markov decision processes. Doctoral dissertation - Cheng - 1988
67	UCP-Networks: A Directed Graphical Representation of Conditional Utilities - Boutilier, Bacchus, et al. - 2001
59	Memory approaches to reinforcement learning in non-Markovian domains - Lin, Mitchell - 1999
47	Utility elicitation as a classification problem - Chajewska, Getoor, et al. - 1998
1	On the foundations of expected expected utility. (manuscript - Boutilier - 2001
1	Simon French. Decision Theory - Columbia - 1988