Background: Previous systematic reviews have indicated limited evidence and poor quality evaluations of clinical librarian (CL) services. Rigorous evaluations should demonstrate the value of CL services, but guidance is needed before this can be achieved. Objectives: To undertake a systematic review which examines models of CL services, quality, methods and perspectives of clinical librarian service evaluations. Methods: Systematic review methodology and synthesis of evidence, undertaken collaboratively by a group of 8 librarians to develop research and critical appraisal skills. Results: There are four clear models of clinical library service provision. Clinical librarians are effective in saving health professionals time, providing relevant, useful information and high quality services. Clinical librarians have a positive effect on clinical decision making by contributing to better informed decisions, diagnosis and choice of drug or therapy. The quality of CL studies is improving, but more work is needed on reducing bias and providing evidence of specific impacts on patient care. The Critical Incident Technique as part of a mixed method approach appears to offer a useful approach to demonstrating impact. Conclusions: This systematic review provides practical guidance regarding the evaluation of CL services. It also provides updated evidence regarding the effectiveness and impact of CL services. The approach used was successful in developing research and critical appraisal skills in a group of librarians.

Objective: To identify or develop a critical appraisal instrument (CAI) to aid in the selection of search filters for use in systematic review searching. The CAI is to be used by experienced searchers without specialized training in statistics or search filter design. Methods: Through extensive searching and consultation, one candidate instrument was identified. Through expert consultation and several rounds of testing, the instrument was extensively revised to become the Canadian Agency for Drugs and Technologies in Health (CADTH) CAI. Results: The CADTH CAI consists of ten questions and can be applied by experienced searchers with a moderate knowledge of search filter methodology. Conclusion:The CADTH CAI provides experienced searchers with a means of selecting the search filter that is most methodologically sound. Key Messages Implications for Practice• The CADTH CAI provides information specialists with the means of selecting search filters based on relative methodological quality.• The CADTH CAI provides search filter creators with a checklist of factors to consider in creating filters and in reporting on their filters for publication. Implications for Policy• With the CADTH CAI it is possible to make evidence-based decisions on filter selection, based on the methodological quality of the search filters.• Using the CADTH CAI to measure the quality of search filters used in systematic review searching introduces a new dimension to the evaluation of the overall quality of a systematic review.

Background: Although healthcare librarians are undertaking training in critical appraisal skills, what is not so clear is the impact of the training on the understanding and dissemination of these skills. Objectives: This study aims to examine the attitudes of healthcare librarians towards delivering critical appraisal training and their level of involvement. Methods: A questionnaire survey of 57 library services across 48 NHS Trust Library Services in northwest England followed up with 21 semi-structured interviews. Results: Seventy-three per cent of respondents felt that they ought to be involved in delivering critical appraisal training, however less than a third (29%) are actually involved. Librarians are involved in critical appraisal facilitation at various levels. Conclusions: Debate continues over the extent of librarian involvement in delivering critical appraisal training. As long as healthcare librarians recognise their own capabilities and identify the boundaries within which they feel comfortable then there is no reason why they should not be involved in delivering critical appraisal training.

Background: Many healthcare librarians are undertaking training in critical appraisal but a significant number are not cascading the training to their end-users. Objectives: To examine the barriers to healthcare librarian involvement in delivering critical appraisal training. Methods: A questionnaire survey of 57 library services across 48 NHS Trust Library Services in north west England followed up with 21 semi-structured interviews. Results: Two types of barriers were noted: extrinsic barriers (organisational, environmental, training, role expectations) and intrinsic barriers (knowledge, skills, attitude). Conclusions: These barriers are not mutually exclusive and by overcoming one of them it does not necessarily follow that healthcare librarians will engage in delivering critical appraisal skills training. The challenge lies in developing strategies to deal effectively with these barriers to encourage and support healthcare librarians in the delivery of critical appraisal training at a level at which they feel confident and able.