A Comparative Study of the Effectiveness of Search Result Presentation on the Web

Joho, Hideo; Jose, Joemon M.

doi:10.1007/11735106_27

Cited by 25 publications

(20 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Enriched summaries were found to help capture a user's a ention. Including both textual and visual representations of a document when presenting results could have a positive e ect on relevance assessment and query reformulation [18]. Enriched summaries were also examined by Ali et al [2] in the context of navigational tasks.…”

Section: Serp Layouts and Presentationmentioning

confidence: 99%

A Study of Snippet Length and Informativeness

Maxwell

Azzopardi

Moshfeghi

2017

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

View full text Add to dashboard Cite

e design and presentation of a Search Engine Results Page (SERP) has been subject to much research. With many contemporary aspects of the SERP now under scrutiny, work still remains in investigating more traditional SERP components, such as the result summary. Prior studies have examined a variety of di erent aspects of result summaries, but in this paper we investigate the in uence of result summary length on search behaviour, performance and user experience. To this end, we designed and conducted a withinsubjects experiment using the TREC AQUAINT news collection with 53 participants. Using Kullback-Leibler distance as a measure of information gain, we examined result summaries of di erent lengths and selected four conditions where the change in information gain was the greatest: (i) title only; (ii) title plus one snippet; (iii) title plus two snippets; and (iv) title plus four snippets. Findings show that participants broadly preferred longer result summaries, as they were perceived to be more informative. However, their performance in terms of correctly identifying relevant documents was similar across all four conditions. Furthermore, while the participants felt that longer summaries were more informative, empirical observations suggest otherwise; while participants were more likely to click on relevant items given longer summaries, they also were more likely to click on non-relevant items. is shows that longer is not necessarily be er, though participants perceived that to be the case -and second, they reveal a positive relationship between the length and informativeness of summaries and their a ractiveness (i.e. clickthrough rates). ese ndings show that there are tensions between perception and performance when designing result summaries that need to be taken into account.

show abstract

Section: Serp Layouts and Presentationmentioning

confidence: 99%

A Study of Snippet Length and Informativeness

Maxwell

Azzopardi

Moshfeghi

2017

Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

View full text Add to dashboard Cite

show abstract

“…Faceted interfaces can help refine searches (Hearst, 2009), sharpen vague queries (White & Roth, 2009), speed searches (Yee et al, 2003), yield more relevant results (Chen & Dumais, 2000; Kules & Shneiderman 2008; Pratt, Hearst, & Fagan, 1999; Uddin & Janecek, 2007; Zhang & Marchionini, 2005), and increase satisfaction (Joho & Jose, 2006; Kules & Shneiderman, 2008; Uddin & Janecek, 2007; Zhang & Marchionini, 2005; Yee et al, 2003). Facets can be drawn from a number of types of metadata, including author name (personal or corporate), topical subject, genre, language, library or geographic locations, media type, format, and availability (Ballard & Blaine, 2011; Breeding, 2007; Yang & Hoffman, 2010).…”

Section: Literature Reviewmentioning

confidence: 99%

Influence of training and stage of search on gaze behavior in a library catalog faceted search interface

Kules

Capra

2011

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

This study examined how searchers interact with a web-based, faceted library catalog when conducting exploratory searches. It applied multiple methods, including eye tracking and stimulated recall interviews, to investigate important aspects of faceted search interface use, specifically: (a) searcher gaze behavior-what components of the interface searchers look at; (b) how gaze behavior differs when training is and is not provided; (c) how gaze behavior changes as searchers become familiar with the interface; and (d) how gaze behavior differs depending on the stage of the search process. The results confirm previous findings that facets account for approximately 10-30% of interface use. They show that providing a 60-second video demonstration increased searcher use of facets. However, searcher use of the facets did not evolve during the study session, which suggests that searchers may not, on their own, rapidly apply the faceted interfaces. The findings also suggest that searcher use of interface elements varied by the stage of their search during the session, with higher use of facets during decision-making stages. These findings will be of interest to librarians and interface designers who wish to maximize the value of faceted searching for patrons, as well as to researchers who study search behavior.

show abstract

“…Textual summary and thumbnail image contributed to a positive effect in user relevance assessment and query reformulation (H. Joho & Jose, 2006).…”

Section: On Results Item Representation Studies Reported Thatmentioning

confidence: 99%