Abstract

Abstract: The exhaustivity of document descriptions and the specificity of index terms are usually regarded as independent. It is suggested that specificity should be interpreted statistically, as a function of term use rather than of term meaning. The effects on retrieval of variations in term specificity are examined, experiments with three test collections showing, in particular, that frequently-occurring terms are required for good overall performance. It is argued that terms should be weighted according to collection frequency, so that matches on less frequent, more specific, terms are of greater value than matches on frequent terms. Results for the test collections show that considerable improvements in performance are obtained with this very simple procedure. Exhaustivity and specificity We are familiar with the notions of exhaustivity and specificity: exhaustivity is a property of index descriptions, and specificity one of index terms. They are most clearly illustrated by a simple keyword or descriptor system. In this case the exhaustivity of a document description is the coverage of its various topics given by the terms assigned to it; and the specificity of an individual term is the level of detail at which a given concept is represented.

Citations

224	Automatic Information Organization and Retrieval - Salton - 1968
125	Factors determining the performance of indexing systems - Cleverdon, Mills, et al. - 1966
110	M.E.: Computer evaluation of indexing and text processing - Salton, Lesk - 1968
107	Automatic keyword classification for information retrieval - Jones - 1971
59	Information Retrieval Systems: Characteristics, Testing and Evaluation - Lancaster - 1968
5	Report of an Information - KEEN, DIGGER - 1972
2	Comparative evaluation of index languages - Aitchison, Hall, et al. - 1970
2	The effectiveness of automatically-generated weights and links - Artandi, Wolf - 1969
2	Interactive document storage and retrieval systems – design concepts - Borko - 1968
1	An Operational Interactive Retrieval System - Curtice, Jones - 1969