This paper discusses the ways participants in a two-year ethnographic study judged relevance when engaged in searching and research tasks. Two experienced academics have been observed evaluating informative artefacts (documents, citations or other representations) encountered in the course of their own research projects. This study sought to explore the criteria and clues used to make decisions about the relevance of retrievable items. In presenting some of the findings from this longitudinal study, the paper demonstrates the value of this approach for enhancing our understanding of the evolving nature of human relevance judgments. The paper will describe how this interaction involves not only the notion of searcher-system communication, but a range of encounters that inform and influence that particular communication at the search interface. The paper suggests future collaboration between system specialists and human behaviour specialists to further our understanding of the socio-material systems in which people make judgments of relevance.
Keywordshuman relevance judgments, nature of relevance in contexts, taskbased information behaviour
CONCEPTUAL FRAMEWORKRelevance is a central but much debated concept in Information Science. After more than fifty years of discussion, there is still a lack of consensus about the meaning of the concept. As a result, a number of researchers over the years have observed that, despite its significance, it remains one of the least understood concepts of information retrieval [e.g. 3, 4, 5, 6].Considerable effort has gone into finding ways to relate searcher perspectives of relevance to those embodied in information systems. From a searcher's perspective, relevance assessment is a process by which she constantly shapes, defines and refines searching. This view of relevance is not contained in a system-