Abstract

The optimal settings of retrieval parameters often depend on both the document collection and the query, and are usually found through empirical tuning. In this paper, we propose a family of two-stage language models for information retrieval that explicitly captures the different influences of the query and document collection on the optimal settings of retrieval parameters. As a special case, we present a two-stage smoothing method that allows us to estimate the smoothing parameters completely automatically. In the first stage, the document language model is smoothed using a Dirichlet prior with the collection language model as the reference model. In the second stage, the smoothed document language model is further interpolated with a query background language model. We propose a leave-one-out method for estimating the Dirichlet parameter of the first stage, and the use of document mixture models for estimating the interpolation parameter of the second stage. Evaluation on five different databases and four types of queries indicates that the twostage smoothing method with the proposed parameter estimation methods consistently gives retrieval performance that is close to— or better than—the best results achieved using a single smoothing method and exhaustive parameter search on the test data.

Citations

1216	Term-weighting approaches in automatic text retrieval - Salton, Buckley - 1988
684	A language modeling approach to information retrieval - Ponte, Croft - 1998
594	A vector space model for automatic indexing - Salton, Wong, et al. - 1975
510	Relevance weighting of search terms - Robertson, Jones - 1976
498	A study of smoothing methods for language models applied to information retrieval - Zhai, Lafferty
370	Okapi at trec-3 - Robertson, Walker, et al. - 1994
313	M.: Pivoted document length normalization - Singhal, Buckley, et al. - 1996
244	Relevance-based language models - Lavrenko, Croft - 2001
234	Document language models, query models, and risk minimization for information retrieval - Lafferty, Zhai - 2001
220	Information retrieval as statistical translation - Berger, Lafferty - 1999
158	A Hidden Markov Model Information Retrieval System - Miller, Leek, et al. - 1999
101	Twenty-One at TREC-7: Ad-hoc and Cross-language Track - Hiemstra, Kraaij - 1999
53	Model-based feedback in the kl-divergence retrieval model - Zhai, Lafferty
48	On the estimation of small probabilities by leaving-one-out - Ney, Essen, et al. - 1995
35	Improving two-stage ad-hoc retrieval for short queries - Kwok, Chan, et al. - 1998
7	editors (2001 - Voorhees, Harman
5	Probabilistic IR models based on query and document generation - Lafferty, Zhai - 2001