Abstract

Conventional wisdom holds that queries to information retrieval systems will yield more relevant results if they contain multiple topic-related terms and use Boolean and phrase operators to enhance interpretation. AlthoughstudieshaveshownthattheusersofWeb-based searchenginestypicallyentershort,term-basedqueries and rarely use search operators, little information exists concerning the effects of term and operator usage on the relevancy of search results. In this study, search engine users formulated queries on eight search topics. Each query was submitted to the user-specified search engine, and relevancy ratings for the retrieved pages were assigned. Expert-formulated queries were also submittedandprovidedabasisforcomparingrelevancy ratings across search engines. Data analysis based on our research model of the term and operator factors affecting relevancy was then conducted. The results showthatthedifferenceinthenumberoftermsbetween expert and nonexpert searches, the percentage of matching terms between those searches, and the erroneous use of nonsupported operators in nonexpert searchesexplainmostofthevariationintherelevancyof search results. These findings highlight the need for designing search engine interfaces that provide greater support in the areas of term selection and operator usage.

Citations