Choosing Discovery: A Literature Review on the Selection and Evaluation of Discovery Layers

Moore, Kate; Greene, Courtney

doi:10.1080/19322909.2012.689602

Cited by 13 publications

(7 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although there are a few frameworks for evaluating library systems in general, they mainly focus on interfaces and user levels regarding digital libraries (Y. Zhang, 2010), or on the user demand regarding usability and the availability of certain features of discovery systems (Moore & Greene, 2012).…”

Section: Evaluation Of Library Information Systemsmentioning

confidence: 99%

A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Behnert

Lewandowski

2017

View full text Add to dashboard Cite

Purpose The purpose of this paper is to demonstrate how to apply traditional information retrieval (IR) evaluation methods based on standards from the Text REtrieval Conference and web search evaluation to all types of modern library information systems (LISs) including online public access catalogues, discovery systems, and digital libraries that provide web search features to gather information from heterogeneous sources. Design/methodology/approach The authors apply conventional procedures from IR evaluation to the LIS context considering the specific characteristics of modern library materials. Findings The authors introduce a framework consisting of five parts: search queries, search results, assessors, testing, and data analysis. The authors show how to deal with comparability problems resulting from diverse document types, e.g., electronic articles vs printed monographs and what issues need to be considered for retrieval tests in the library context. Practical implications The framework can be used as a guideline for conducting retrieval effectiveness studies in the library context. Originality/value Although a considerable amount of research has been done on IR evaluation, and standards for conducting retrieval effectiveness studies do exist, to the authors’ knowledge this is the first attempt to provide a systematic framework for evaluating the retrieval effectiveness of twenty-first-century LISs. The authors demonstrate which issues must be considered and what decisions must be made by researchers prior to a retrieval test.

show abstract

Section: Evaluation Of Library Information Systemsmentioning

confidence: 99%

A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Behnert

Lewandowski

2017

View full text Add to dashboard Cite

show abstract

“…At Grand Valley State University, Summon, while technically not the library catalog, was the only search box offered from the library's homepage and was advertised as "search summon for articles, books and more" (see Figure 2). The link "Find books & search the classic catalog" took the user to a page where Encore, then Summon, and then finally the "classic" III catalog was offered as a third and last choice for finding library materials [4] (see Figure 3). The other library offering Summon in our sample, the College of William and Mary, featured "Try Summon, our new search tool" as a prominent and central link on the library homepage and at one point in our analysis linked to "experimental" Summon from its Sirsi OPAC [5].…”

Section: Data Collectionmentioning

confidence: 99%

Next generation or current generation?

Yang

Hofmann

2011

Library Hi Tech

View full text Add to dashboard Cite

2010),"Evaluating and comparing discovery tools: how close are we towards next generation catalog?", Library Hi Tech, Vol. 28 Iss 4 pp. 690-709 http:// dx.If you would like to write for this, or any other Emerald publication, then please use our Emerald for Authors service information about how to choose which publication to write for and submission guidelines are available for all. Please visit www.emeraldinsight.com/authors for more information. About Emerald www.emeraldinsight.comEmerald is a global publisher linking research and practice to the benefit of society. The company manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as providing an extensive range of online products and additional customer resources and services.Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive preservation. AbstractPurpose -The study described in this paper aims to identify the progress made in the efforts to model current online public access catalogs (OPACs) after the next generation catalog (NGC) in academic libraries in the USA and Canada. Design/methodology/approach -A random sample of 260 colleges and universities was selected from Peterson's Guide to Four-Year Colleges 2009, an estimated 10 percent of the total population of 2,560 listed academic institutions. A checklist of 12 features of the NGC was used to evaluate the OPACs of the 260 libraries in the sample. The authors took as the OPAC that which the library linked to as its "catalog," even though some might be more properly considered "discovery tools" or "discovery layers." Some libraries used more than one OPAC interface simultaneously; in this case, each OPAC was analyzed separately. In the case of several institutions using the same consortial OPAC, only the first instance of the OPAC was analyzed. About 15 percent of the institutions (n ¼ 40) in the sample either did not have web sites or did not provide access to their online catalogs. In all, a total of 233 unique instances of OPACs were analyzed. Data were collected from September 2009 through July 2010. The findings can be extrapolated to the population at the 95 percent confidence level with a confidence interval of^3. Findings -While bits and pieces of the next generation catalog are steadily working themselves into the current catalog, academic libraries still have a long way to go. About 16 percent of the OPACs in the sample did not show any advanced features of the NGC. More than half of the libraries (61 percent) had only one to five advanced features in their OPACs. Many of those with six or more NGC features were discovery tools. Only 3 percent of the OPACs in the sample (n ¼ 8) demonstrated seven to ten out of the 12 functionalities of the NGC, and they were instances either of WorldCat Local or Summon. The weak areas were federated searching, relevance based on circulation statistics, and recommendations...

show abstract

“…This allows a user to search across practically every resource to which the library has access. 8 A few papers have discussed the failings of the traditional OPAC interface and the problems that discovery layers are intended to solve. Ballard and Blaine note that most OPAC interfaces are "often not intuitive and are inconsistent with well-established user interface conventions" and lack good relevancy rankings.…”

Section: Literature Reviewmentioning

confidence: 99%

Customizing an Open Source Discovery Layer at East Carolina University Libraries: The Cataloger’s Role in Developing a Replacement for a Traditional Online Catalog

Barber¹,

Holden²,

Mayo³

2016

LRTS

View full text Add to dashboard Cite

Open source discovery layers offer the ability to extensively customize every aspect of the search experience for a local user population. However, discovery layers have primarily been discussed in the professional literature in terms of the installation or configuration process. In this paper, three catalogers present a case study of an open source discovery layer implementation with a focus on the problems and solutions from the cataloging perspective. E ast Carolina University (ECU) is the third largest school in the North Carolina system, with almost 27,000 students.1 As of January 27, 2015, the university "employs nearly 2,050 full-time, part-time, and temporary faculty."2 These faculty and students are supported by more than 3,500 staff members. 3 In fall of 2014, 27,511 students were served by ECU Libraries, a system that consists of a main library (Joyner Library), Laupus Health Sciences Library (Laupus), and the music library. 4 These three very different libraries have a wide range of discovery challenges, from multiple classification schemes and subject vocabularies to differences in desired MARC fields in a brief record display to varying requirements for metadata granularity depending on the subject areas or collections. Such a wide array of needs requires a sophisticated and robust discovery tool that offers maximum potential for users to find and access the information they seek. ECU Libraries has been using the e-Library software from SirsiDynix's Symphony line of products for its OPAC since 2009. A 2013 internal assessment of e-Library identified problems that fell into three broad areas: poor relevancy ranking, an inflexible user interface, and cumbersome functionality.5 Because of the proprietary software's limitations, local customization and improvement of the relevancy of search results ranged from difficult to impossible to implement. Desired features, such as customized bibliographic displays for each library or highlighting search terms in record displays, could not be accommodated. The e-Library interface also failed to consistently index certain MARC elements; for example, the music library found that uniform titles in the 240 field were indexed differently from the same uniform titles found in the 700 field.To supplement the traditional OPAC, the libraries were tasked in 2009 with reviewing and recommending a discovery tool. 6 The decision was made to implement ProQuest's Summon product. While e-Library is used for traditional OPAC tasks such as title or call number browsing, placing holds, and tracking course

show abstract

Choosing Discovery: A Literature Review on the Selection and Evaluation of Discovery Layers

Cited by 13 publications

References 18 publications

A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments

Next generation or current generation?

Customizing an Open Source Discovery Layer at East Carolina University Libraries: The Cataloger’s Role in Developing a Replacement for a Traditional Online Catalog

Contact Info

Product

Resources

About