2021
DOI: 10.6017/ital.v40i2.12835
|View full text |Cite
|
Sign up to set email alerts
|

Framework for Measuring Relevancy in Discovery Environments

Abstract: Discovery environments are ubiquitous in academic libraries but studying their effectiveness and use in an academic environment has mostly centered around user satisfaction, experience, and task analysis. This study aims to create a quantitative, reproducible framework to test the relevancy of results and the overall success of Washington State University’s discovery environment (Primo by Ex Libris). Within this framework, the authors use bibliographic citations from student research papers submitted as part o… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
10
0

Year Published

2022
2022
2024
2024

Publication Types

Select...
3

Relationship

0
3

Authors

Journals

citations
Cited by 3 publications
(10 citation statements)
references
References 9 publications
0
10
0
Order By: Relevance
“…Also, given the problematic nature of the newspaper resource type in discovery systems, the researchers excluded this resource type in faceted searches. 46 In a refinement of previous work, the researchers altered the search types to be Open-Ended, Books Only, Articles Only, and Constrained (Open-Ended minus newspaper articles, reviews, etc. ).…”
Section: Search Resultsmentioning
confidence: 99%
See 2 more Smart Citations
“…Also, given the problematic nature of the newspaper resource type in discovery systems, the researchers excluded this resource type in faceted searches. 46 In a refinement of previous work, the researchers altered the search types to be Open-Ended, Books Only, Articles Only, and Constrained (Open-Ended minus newspaper articles, reviews, etc. ).…”
Section: Search Resultsmentioning
confidence: 99%
“…Building off previous work that indicated a natural-language-based query performs as well as or better than a machine-generated keyword search based on a supplied text corpus, the researchers used the original paper titles supplied by the student as a proxy for model Primo search queries. 45 Examples of paper titles as query include Water Is Life: Standing Rock and the Repercussions of the Native Experience (from fall 2020) and Transgressions of Historical Racist Immigration Policies Reborn (from spring 2021).…”
Section: Data Collectionmentioning
confidence: 99%
See 1 more Smart Citation
“…, 2016; Zhitomirsky-Geffet et al ., 2018). Studies evaluating the information retrieval of library discovery tools have often relied on user observation in laboratory settings, log analysis or comparison of search results to student citations in particular projects or courses (Behnert and Lewandowski, 2017; Galbreath et al ., 2021). None of these options were feasible for this study.…”
Section: Methodsmentioning
confidence: 99%
“…One common alternative to individual assessments of relevancy is to rely on the "wisdom of crowds" either through user studies or via click-through rates, which appears to improve the stability of relevancy judgments (Zhitomirsky-Geffet et al, 2016;Zhitomirsky-Geffet et al, 2018). Studies evaluating the information retrieval of library discovery tools have often relied on user observation in laboratory settings, log analysis or comparison of search results to student citations in particular projects or courses (Behnert and Lewandowski, 2017;Galbreath et al, 2021). None of these options were feasible for this study.…”
Section: Limitationsmentioning
confidence: 99%