Objective: To identify or develop a critical appraisal instrument (CAI) to aid in the selection of search filters for use in systematic review searching. The CAI is to be used by experienced searchers without specialized training in statistics or search filter design. Methods: Through extensive searching and consultation, one candidate instrument was identified. Through expert consultation and several rounds of testing, the instrument was extensively revised to become the Canadian Agency for Drugs and Technologies in Health (CADTH) CAI. Results: The CADTH CAI consists of ten questions and can be applied by experienced searchers with a moderate knowledge of search filter methodology.
Conclusion:The CADTH CAI provides experienced searchers with a means of selecting the search filter that is most methodologically sound.
Key Messages
Implications for Practice• The CADTH CAI provides information specialists with the means of selecting search filters based on relative methodological quality.• The CADTH CAI provides search filter creators with a checklist of factors to consider in creating filters and in reporting on their filters for publication.
Implications for Policy• With the CADTH CAI it is possible to make evidence-based decisions on filter selection, based on the methodological quality of the search filters.• Using the CADTH CAI to measure the quality of search filters used in systematic review searching introduces a new dimension to the evaluation of the overall quality of a systematic review.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.