DMCA
The Impact of Summaries: What Makes a User Click?
| Citations: | 1 - 0 self |
BibTeX
@MISC{Nisa_theimpact,
author = {Khairun Nisa and Fachry Jaap Kamps and Junte Zhang},
title = {The Impact of Summaries: What Makes a User Click?},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Modern retrieval systems are in fact two-tier systems in which a user first views summaries of the results in a hit-list, and only when she decides to “click, ” the full result document is consulted. Standard information retrieval evaluation ignores the crucial summary step, and directly evaluates in terms of the relevance of the resulting document. In this paper, we investigate the impact of the result summaries on the user’s decision to click or not to click. Specifically, we want to find out both what information in the summary triggers a positive selection decision to view a result, and what information triggers a negative selection decision. We use a special document genre, archival finding aids, where results have a complex document structure and currently available systems experiment with structured summaries having both by an archivist) and query-biased snippets (showing the matching keywords in context). We conducted an experiment in which we asked test persons to explicitly mark the parts of summaries that trigger a selection decision, and asked them to explain further (i.e. why and how). The results from this user study indicate the importance of sufficient context in the summary. Selection decisions were primarily of the document. This may be a result of the completeness and coherence of the information in these elements, although also the length played a clear role. A whole paragraph (as in the abstract) triggered a decision more frequently than a short sentence (as in the title) or an incomplete sentence (as in the query-biased snippets). 1.
Keyphrases
user click selection decision query-biased snippet user decision complex document structure test person standard information retrieval evaluation clear role resulting document summary trigger result summary crucial summary step modern retrieval system whole paragraph short sentence full result document sufficient context incomplete sentence structured summary available system experiment matching keywords negative selection decision archival finding aid positive selection decision special document genre fact two-tier system user study
