Expertise‐seeking research studies how people search for expertise and choose whom to contact in the context of a specific task. An important outcome are models that identify factors that influence expert finding. Expertise retrieval addresses the same problem, expert finding, but from a system‐centered perspective. The main focus has been on developing content‐based algorithms similar to document search. These algorithms identify matching experts primarily on the basis of the textual content of documents with which experts are associated. Other factors, such as the ones identified by expertise‐seeking models, are rarely taken into account. In this article, we extend content‐based expert‐finding approaches with contextual factors that have been found to influence human expert finding. We focus on a task of science communicators in a knowledge‐intensive environment, the task of finding similar experts, given an example expert. Our approach combines expertise‐seeking and retrieval research. First, we conduct a user study to identify contextual factors that may play a role in the studied task and environment. Then, we design expert retrieval models to capture these factors. We combine these with content‐based retrieval models and evaluate them in a retrieval experiment. Our main finding is that while content‐based features are the most important, human participants also take contextual factors into account, such as media experience and organizational structure. We develop two principled ways of modeling the identified factors and integrate them with content‐based retrieval models. Our experiments show that models combining content‐based and contextual factors can significantly outperform existing content‐based models.