Digital libraries (DLs) have been evaluated implicitly by analyzing the query behavior extracted from the log files (LFs), and explicitly by conducting user studies and usability tests. Unfortunately, such approaches do not fully assess the quality of the user experience (UX). Recently, UX is gaining momentum as a critical success factor across all sectors and became the ultimate criterion to guide user‐centered design. This is why we describe how the Mahlke's interaction UX framework can be adapted to the DL. We conducted a laboratory user study with 65 undergraduate students. Three data collection tools were considered: questionnaires, screen recording, and pick‐a‐mode scale. The findings of the study indicate that considering the UX when evaluating the DL provides useful insights of different aspects of the user interactions, perceptions and affective variables. The need to improve the DL system and simplify its interface still persists. Revisiting interfaces by implementing visualizing techniques is a possible solution.
Introduction. This paper discusses causes behind failed searches from the searchers’ perspective and examines associated emotions. Method. We conducted an online study with real users in their natural settings. Participants were asked to use a digital library and run one specific and one exploratory search task, using their own topics. They also answered pre- and post-questionnaires for both task types. Analysis. Three types of analysis were conducted: (i) one descriptive on answers in questionnaires, (ii) one textual on users’ failure reports to identify the causes and elicit associated emotions and (iii) one behavioural analysis of the interactions recorded in log files. Results. Users identified the lack of coverage and poor usability as main causes behind failed searches. We examined search behaviour along with declared perceptions of the causes behind failures and realised that the digital library functionalities were not fully used. Poor awareness of the digital library functionalities could be an unreported cause for search failures. In general, users had a positive attitude toward the digital library, expressing trust, joy, and anticipation. Anger and sadness were linked specifically to failed searches. Conclusions. There persists a need to improve the digital library systems and simplify their interfaces. The emotional effect is a significant factor that need to be considered in the user experience studies.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.