Selecting a web-scale discovery service is a large and important undertaking that involves a significant investment of time, staff, and resources. Finding the right match begins with a thorough and carefully planned evaluation process. To be successful, this process should be inclusive, goal-oriented, datadriven, user-centered, and transparent. The following article offers a step-by-step guide for developing a web-scale discovery evaluation plan rooted in these five key principles based on best practices synthesized from the literature as well as the author's own experiences coordinating the evaluation process at Rutgers University. The goal is to offer academic libraries that are considering acquiring a web-scale discovery service a blueprint for planning a structured and comprehensive evaluation process.
INTRODUCTIONAs the volume and variety of information resources continue to multiply, the library search environment has become increasingly fragmented. Instead of providing a unified, central point of access to its collections, the library offers an assortment of pathways to disparate silos of information. To the seasoned researcher familiar with these resources and experienced with a variety of search tools and strategies, this maze of options may be easy to navigate. But for the novice user who is less accustomed to these tools and even less attuned to the idiosyncrasies of each one's own unique interface, the sheer amount of choice can be overwhelming. Even if the user manages to find their way to the appropriate resource, figuring out how to use it effectively becomes yet another challenge. This is at least partly due to the fact that the expectations and behaviors of today's library users have been profoundly shaped by their experiences on the web. Popular sites like Google and Amazon offer simple, intuitive interfaces that search across a wide range of content to deliver immediate, relevant, and useful results. In comparison, library search interfaces often appear antiquated, confusing, and cumbersome. As a result, users are increasingly relying on information sources that they know to be of inferior quality, but are simply easier to find. As Luther and Kelly note, the biggest challenge academic libraries face in today's abundant but fragmented information landscape is "to offer an experience that has the simplicity of Google-which users expect-while searching the library's rich digital and print collectionswhich users need." 1 In an effort to better serve the needs of these users and improve access to library content, libraries have begun turning to new technologies capable of providing deep discovery of their vast scholarly collections from a single, easy--to--use interface. These technologies are known as web--scale discovery services.Joseph Deodato (jdeodato@rutgers.edu) is Digital User Services Librarian at Rutgers University, New Brunswick, New Jersey.EVALUATING WEB--SCALE DISCOVERY SERVICES: A STEP--BY--STEP GUIDE | DEODATO doi: 10.6017/ital.v34i2.5745
20To paraphrase Hoeppner, a web--sca...